panic: vm_page_unwire: wire count underflow for page 0xfffffe000e2c06d8, vmcore.680 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2023 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 14.0-CURRENT #1 main-n261876-f5a365e51feea-dirty: Thu Mar 30 16:22:59 CEST 2023 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 15.0.7 (https://github.com/llvm/llvm-project.git llvmorg-15.0.7-0-g8dfdcc7b7bf6) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.14-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33168019456 (31631 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 11 5 4 2 9 7 8 10 6 3 random: entropy device external interface kbd1 at kbdmux0 vtvga0: smbios0: at iomem 0xf05e0-0xf05fe smbios0: Version: 3.0, BCD Revision: 3.0 aesni0: acpi0: <> acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb416000-0xfb4167ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb412000-0xfb4123ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: EEPROM V1.63-0 eTrack 0x800009fa igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: EEPROM V1.63-0 eTrack 0x800009fa igb1: Using 1024 TX descriptors and 1024 RX descriptors igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb411000-0xfb4113ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb410000-0xfb4107ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 apei0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounter "TSC-low" frequency 1749998326 Hz quality 1000 Timecounters tick every 1.000 msec [nl_generic_kpi] genl_register_family: Registered family nlctrl id 16 [nl_generic_kpi] genl_register_cmds: Adding cmd GETFAMILY(3) to family nlctrl ugen2.1: at usbus2 Expensive callout(9) function: 0xffffffff804f6e00(0xfffffe0109fbc000) 0.009997254 s ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> ses0: ada0 in 'Slot 01', SATA Slot: scbus1 target 0 mlx5_core0: mem 0xf8000000-0xf9ffffff irq 32 at device 0.0 on pci3 mlx5: Mellanox Core driver 3.7.1 (November 2021)uhub0 on usbus2 uhub0: on usbus2 ugen1.1: at usbus1 ugen0.1: at usbus0 uhub1 on usbus1 uhub1: on usbus1 uhub2 on usbus0 uhub2: on usbus0 mlx5_core0: WARN: mlx5_vsc_set_space:127:(pid 0): Space 0x7 is not supported. mlx5_core0: WARN: 1) got signal 5 Process (pid 1) got signal 5 Process (pid 1) got signal 5 Process (pid 1) got signal 5 Process (pid 1) got signal 5 : : Process (pid 1) got signal 5 Process (pid 1) got signal 5 Process (pid 1) got signal 5 Process (pid 1) got signal 5 igb0: link state changed to UP debugnet_any_ifnet_update: Bad dn_init result from igb0 (ifp 0xfffff800050d4800), ignoring. Interface IP-Address Broadcast Setting hostuuid: 00000000-0000-0000-0000-002590c99976. Setting hostid: 0x90b83241. Starting file system checks: WARNING: / was not properly dismounted Mounting local filesystems:. Autoloading module: acpi_wmi Autoloading module: ichsmb Autoloading module: ioat acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device ioat0: mem 0x383ffff1c000-0x383ffff1ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0x383ffff18000-0x383ffff1bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0x383ffff14000-0x383ffff17fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0x383ffff10000-0x383ffff13fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0x383ffff0c000-0x383ffff0ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0x383ffff08000-0x383ffff0bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0x383ffff04000-0x383ffff07fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0x383ffff00000-0x383ffff03fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 ichsmb0: port 0x580-0x59f mem 0x383ffff21000-0x383ffff210ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 fsck2+ fsck -fy /tmp ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 586 files, 8020 used, 1257387 free (187 frags, 157150 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** + set +x Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.00-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. Setting up harvesting: PURE_RDRAND,[CALLOUT],[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . Setting hostname: mercat1.netperf.freebsd.org. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc10 /usr/local/lib/gcc8 /usr/local/lib/gcc9 /usr/local/lib/perl5/5.32/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat lo0: link state changed to UP Autoloading module: mlx5 Autoloading module: mlx5 Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce0. mce0: flags=8822 metric 0 mtu 1500 options RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,HWRXTSTMP,MEXTPG,TXTLS4,TXTLS6,VXLAN_HWCSUM,VXLAN_HWTSO,RXTLS6 ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce1. mce1: flags=8822 metric 0 mtu 1500 options RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,HWRXTSTMP,MEXTPG,TXTLS4,TXTLS6,VXLAN_HWCSUM,VXLAN_HWTSO,RXTLS6 ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid Autoloading module: usbhid Autoloading module: wmt uhid0 on uhub2 uhid0: on usbus0 Autoloading module: ums ums0 on uhub5 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192.168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Clearing /tmp (X related). Recovering vi editor sessions:. Updating motd:. Updating /var/run/os-release done. Starting syslogd. No core dumps found. Setting date via ntp. 30 Mar 20:41:56 ntpdate[3550]: step time server 192.168.5.1 offset +0.163705 sec Starting watchdogd. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Mounting late filesystems:. Starting inetd. Starting cron. Performing sanity check on sshd configuration. Starting sshd. Thu Mar 30 20:41 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: Mar 30 20:42:04 mercat1 su[3690]: pho to root on /dev/pts/0 Mar 30 20:44:38 mercat1 su[4077]: pho to root on /dev/pts/1 20230330 20:44:55 all (1/1): unionfs9.sh 20230330 20:50:00 all (1/1): unionfs9.sh 20230330 20:55:02 all (1/1): unionfs9.sh 20230330 21:00:05 all (1/1): unionfs9.sh 20230330 21:05:08 all (1/1): unionfs9.sh 20230330 21:10:11 all (1/1): unionfs9.sh 20230330 21:15:12 all (1/1): unionfs9.sh Mar 30 21:16:10 mercat1 kernel: pid 80580 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20230330 21:20:15 all (1/1): unionfs9.sh 20230330 21:25:19 all (1/1): unionfs9.sh 20230330 21:30:23 all (1/1): unionfs9.sh 20230330 21:35:27 all (1/1): unionfs9.sh 20230330 21:40:30 all (1/1): unionfs9.sh 20230330 21:45:38 all.sh done, elapsed 0 day(s), 01:00.43 20230330 21:45:41 all (1/15): unionfs.sh lock order reversal: 1st 0xfffffe0141a08520 unionfs (unionfs, lockmgr) @ /usr/src/sys/fs/unionfs/union_subr.c:458 2nd 0xfffffe01445cce80 ufs (ufs, lockmgr) @ kern/vfs_subr.c:3294 lock order ufs -> unionfs established at: #0 0xffffffff80c63f7b at witness_checkorder+0x2fb #1 0xffffffff80bbf705 at lockmgr_lock_flags+0x185 #2 0xffffffff82756c90 at unionfs_lock+0x490 #3 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #4 0xffffffff80d00264 at _vn_lock+0x54 #5 0xffffffff80ce80f0 at vflush+0xd0 #6 0xffffffff82753353 at unionfs_unmount+0x53 #7 0xffffffff80cdc8d9 at dounmount+0x7e9 #8 0xffffffff80cdc087 at kern_unmount+0x2e7 #9 0xffffffff810ee587 at amd64_syscall+0x157 #10 0xffffffff810c1d2b at fast_syscall_common+0xf8 lock order unionfs -> ufs attempted at: #0 0xffffffff80c64833 at witness_checkorder+0xbb3 #1 0xffffffff80bbf705 at lockmgr_lock_flags+0x185 #2 0xffffffff80f5c95d at ffs_lock+0x9d #3 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #4 0xffffffff80d00264 at _vn_lock+0x54 #5 0xffffffff80ce748a at vput_final+0x16a #6 0xffffffff82750b31 at unionfs_noderem+0x2f1 #7 0xffffffff827567ed at unionfs_reclaim+0xd #8 0xffffffff811c281f at VOP_RECLAIM_APV+0x5f #9 0xffffffff80ce8ee3 at vgonel+0x463 #10 0xffffffff80ce973c at vrecycle+0x5c #11 0xffffffff827567dc at unionfs_inactive+0x1c #12 0xffffffff811c2510 at VOP_INACTIVE_APV+0x60 #13 0xffffffff80ce7f3a at vinactivef+0xda #14 0xffffffff80ce75c7 at vput_final+0x2a7 #15 0xffffffff80d0061e at vn_close1+0x13e #16 0xffffffff80cfeafd at vn_closefile+0x3d #17 0xffffffff80b8d84b at _fdrop+0x1b 20230330 21:47:57 all (2/15): unionfs10.sh 20230330 21:48:00 all (3/15): unionfs11.sh 20230330 21:48:02 all (4/15): unionfs12.sh 20230330 21:48:04 all (5/15): unionfs13.sh 20230330 21:48:28 all (6/15): unionfs14.sh 20230330 21:53:36 all (7/15): unionfs15.sh 20230330 21:53:41 all (8/15): unionfs2.sh stress2: freework leak: 102/111. stress2: newblk leak: 57360/57367. 20230330 22:05:03 all (9/15): unionfs3.sh 20230330 22:05:05 all (10/15): unionfs4.sh 20230330 22:07:14 all (11/15): unionfs5.sh fsync: giving up on dirty (error = 35) 0xfffffe016cfc0000: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 283 seqc users 0 rdev 0xfffff80021172400 hold count flags () flags () v_object 0xfffff80550bb1d68 ref 0 pages 2235 cleanbuf 267 dirtybuf 14 lock type mntfs: EXCL by thread 0xfffffe015b3fe1e0 (pid 16607, mkdir, tid 100577) with exclusive waiters pending #0 0xffffffff80bc028e at lockmgr_xlock_hard+0x4be #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f34d2d at softdep_flushworklist+0x5d #4 0xffffffff80f5a0b7 at ffs_sync+0x3b7 #5 0xffffffff80f71bce at ufs_sync_nlink+0xae #6 0xffffffff80f6fe00 at ufs_mkdir+0x40 #7 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #8 0xffffffff82755cda at unionfs_mkdir+0xca #9 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #10 0xffffffff80cfc23d at kern_mkdirat+0x20d #11 0xffffffff810ee587 at amd64_syscall+0x157 #12 0xffffffff810c1d2b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe016cfc0000: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 283 seqc users 0 rdev 0xfffff80021172400 hold count flags () flags () v_object 0xfffff80550bb1d68 ref 0 pages 2235 cleanbuf 270 dirtybuf 11 lock type mntfs: EXCL by thread 0xfffffe015b3fe1e0 (pid 16607, mkdir, tid 100577) with exclusive waiters pending #0 0xffffffff80bbf75f at lockmgr_lock_flags+0x1df #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f59fa0 at ffs_sync+0x2a0 #4 0xffffffff80f71bce at ufs_sync_nlink+0xae #5 0xffffffff80f6fe00 at ufs_mkdir+0x40 #6 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #7 0xffffffff82755cda at unionfs_mkdir+0xca #8 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #9 0xffffffff80cfc23d at kern_mkdirat+0x20d #10 0xffffffff810ee587 at amd64_syscall+0x157 #11 0xffffffff810c1d2b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe016cfc0000: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 283 seqc users 0 rdev 0xfffff80021172400 hold count flags () flags () v_object 0xfffff80550bb1d68 ref 0 pages 2235 cleanbuf 267 dirtybuf 14 lock type mntfs: EXCL by thread 0xfffffe0145a8d1e0 (pid 16605, mkdir, tid 100563) with exclusive waiters pending #0 0xffffffff80bbf75f at lockmgr_lock_flags+0x1df #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f34d2d at softdep_flushworklist+0x5d #4 0xffffffff80f5a0b7 at ffs_sync+0x3b7 #5 0xffffffff80f71bce at ufs_sync_nlink+0xae #6 0xffffffff80f6fe00 at ufs_mkdir+0x40 #7 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #8 0xffffffff82755cda at unionfs_mkdir+0xca #9 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #10 0xffffffff80cfc23d at kern_mkdirat+0x20d #11 0xffffffff810ee587 at amd64_syscall+0x157 #12 0xffffffff810c1d2b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe016cfc0000: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 283 seqc users 0 rdev 0xfffff80021172400 hold count flags () flags () v_object 0xfffff80550bb1d68 ref 0 pages 2235 cleanbuf 270 dirtybuf 11 lock type mntfs: EXCL by thread 0xfffffe0157dbcc80 (pid 16604, mkdir, tid 100534) with exclusive waiters pending #0 0xffffffff80bc028e at lockmgr_xlock_hard+0x4be #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f34d2d at softdep_flushworklist+0x5d #4 0xffffffff80f5a0b7 at ffs_sync+0x3b7 #5 0xffffffff80f71bce at ufs_sync_nlink+0xae #6 0xffffffff80f6fe00 at ufs_mkdir+0x40 #7 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #8 0xffffffff82755cda at unionfs_mkdir+0xca #9 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #10 0xffffffff80cfc23d at kern_mkdirat+0x20d #11 0xffffffff810ee587 at amd64_syscall+0x157 #12 0xffffffff810c1d2b at fast_syscall_common+0xf8 20230330 22:09:16 all (12/15): unionfs6.sh 20230330 22:15:30 all (13/15): unionfs7.sh 20230330 22:22:01 all (14/15): unionfs8.sh lock order reversal: 1st 0xfffffe016e2ec070 isofs (isofs, lockmgr) @ /usr/src/sys/fs/unionfs/union_vnops.c:2000 2nd 0xfffffe016e2ed0d8 ufs (ufs, lockmgr) @ /usr/src/sys/fs/unionfs/union_vnops.c:2031 3rd 0xfffffe015ed46070 isofs (isofs, lockmgr) @ fs/cd9660/cd9660_vfsops.c:691 lock order isofs -> ufs established at: #0 0xffffffff80c63f7b at witness_checkorder+0x2fb #1 0xffffffff80bbf705 at lockmgr_lock_flags+0x185 #2 0xffffffff80f5c95d at ffs_lock+0x9d #3 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #4 0xffffffff82756bd3 at unionfs_lock+0x3d3 #5 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #6 0xffffffff80d00264 at _vn_lock+0x54 #7 0xffffffff82753453 at unionfs_root+0x43 #8 0xffffffff80cdf447 at vfs_domount_first+0x2d7 #9 0xffffffff80cdb8d2 at vfs_domount+0x312 #10 0xffffffff80cd9ed7 at vfs_donmount+0x967 #11 0xffffffff80cd9539 at sys_nmount+0x69 #12 0xffffffff810ee587 at amd64_syscall+0x157 #13 0xffffffff810c1d2b at fast_syscall_common+0xf8 lock order ufs -> isofs attempted at: #0 0xffffffff80c64833 at witness_checkorder+0xbb3 #1 0xffffffff80bbfe6a at lockmgr_xlock_hard+0x9a #2 0xffffffff80bc071b at __lockmgr_args+0x1fb #3 0xffffffff80b6ac42 at cd9660_vget_internal+0x192 #4 0xffffffff80b68868 at cd9660_lookup+0x958 #5 0xffffffff811bf0d1 at VOP_CACHEDLOOKUP_APV+0x61 #6 0xffffffff80cc61f5 at vfs_cache_lookup+0xa5 #7 0xffffffff811beef1 at VOP_LOOKUP_APV+0x61 #8 0xffffffff82753b0e at unionfs_lookup+0x41e #9 0xffffffff811bf0d1 at VOP_CACHEDLOOKUP_APV+0x61 #10 0xffffffff80cc61f5 at vfs_cache_lookup+0xa5 #11 0xffffffff811beef1 at VOP_LOOKUP_APV+0x61 #12 0xffffffff80cd7559 at vfs_lookup+0x499 #13 0xffffffff80cd6840 at namei+0x340 #14 0xffffffff80cf863f at kern_statat+0x12f #15 0xffffffff80cf8d8f at sys_fstatat+0x2f #16 0xffffffff810ee587 at amd64_syscall+0x157 #17 0xffffffff810c1d2b at fast_syscall_common+0xf8 lock order reversal: 1st 0xfffffe016a7030d8 unionfs (unionfs, lockmgr) @ /usr/src/sys/fs/unionfs/union_subr.c:458 2nd 0xfffffe015ed46070 isofs (isofs, lockmgr) @ kern/vfs_subr.c:3294 lock order unionfs -> isofs attempted at: #0 0xffffffff80c64833 at witness_checkorder+0xbb3 #1 0xffffffff80bbf705 at lockmgr_lock_flags+0x185 #2 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #3 0xffffffff80d00264 at _vn_lock+0x54 #4 0xffffffff80ce748a at vput_final+0x16a #5 0xffffffff82750b24 at unionfs_noderem+0x2e4 #6 0xffffffff827567ed at unionfs_reclaim+0xd #7 0xffffffff811c281f at VOP_RECLAIM_APV+0x5f #8 0xffffffff80ce8ee3 at vgonel+0x463 #9 0xffffffff80ce973c at vrecycle+0x5c #10 0xffffffff827567dc at unionfs_inactive+0x1c #11 0xffffffff811c2510 at VOP_INACTIVE_APV+0x60 #12 0xffffffff80ce7f3a at vinactivef+0xda #13 0xffffffff80ce75c7 at vput_final+0x2a7 #14 0xffffffff80cf86fa at kern_statat+0x1ea #15 0xffffffff80cf8d8f at sys_fstatat+0x2f #16 0xffffffff810ee587 at amd64_syscall+0x157 #17 0xffffffff810c1d2b at fast_syscall_common+0xf8 20230330 22:28:54 all (15/15): unionfs9.sh Mar 30 22:30:03 mercat1 kernel: pid 84626 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20230330 22:33:57 all (1/15): unionfs.sh 20230330 22:36:06 all (2/15): unionfs10.sh 20230330 22:36:08 all (3/15): unionfs11.sh 20230330 22:36:11 all (4/15): unionfs12.sh 20230330 22:36:13 all (5/15): unionfs13.sh 20230330 22:36:37 all (6/15): unionfs14.sh 20230330 22:41:39 all (7/15): unionfs15.sh 20230330 22:41:45 all (8/15): unionfs2.sh stress2: freework leak: 422/431. stress2: newblk leak: 49487/49494. 20230330 22:52:51 all (9/15): unionfs3.sh 20230330 22:52:56 all (10/15): unionfs4.sh Mar 30 22:53:14 mercat1 kernel: pid 64038 (rw), uid 0 inumber 140698 on /mnt10: filesystem full 20230330 22:55:05 all (11/15): unionfs5.sh 20230330 22:57:16 all (12/15): unionfs6.sh Mar 30 23:00:42 mercat1 kernel: pid 81635 (rw), uid 2007 inumber 331679 on /mnt10: filesystem full 20230330 23:03:34 all (13/15): unionfs7.sh Mar 30 23:10:17 mercat1 kernel: pid 10536 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20230330 23:10:31 all (14/15): unionfs8.sh Mar 30 23:13:41 mercat1 kernel: pid 14563 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20230330 23:17:27 all (15/15): unionfs9.sh 20230330 23:22:31 all (1/15): unionfs.sh 20230330 23:24:35 all (2/15): unionfs10.sh 20230330 23:24:37 all (3/15): unionfs11.sh 20230330 23:24:39 all (4/15): unionfs12.sh 20230330 23:24:41 all (5/15): unionfs13.sh 20230330 23:25:05 all (6/15): unionfs14.sh 20230330 23:30:09 all (7/15): unionfs15.sh 20230330 23:30:15 all (8/15): unionfs2.sh stress2: freework leak: 726/735. stress2: newblk leak: 66164/66171. 20230330 23:41:47 all (9/15): unionfs3.sh 20230330 23:41:49 all (10/15): unionfs4.sh 20230330 23:43:59 all (11/15): unionfs5.sh 20230330 23:46:13 all (12/15): unionfs6.sh Mar 30 23:52:08 mercat1 kernel: pid 50989 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20230330 23:52:45 all (13/15): unionfs7.sh Mar 30 23:55:36 mercat1 kernel: pid 55449 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20230330 23:59:10 all (14/15): unionfs8.sh 20230331 00:05:26 all (15/15): unionfs9.sh 20230331 00:10:30 all (1/15): unionfs.sh 20230331 00:12:33 all (2/15): unionfs10.sh 20230331 00:12:36 all (3/15): unionfs11.sh 20230331 00:12:38 all (4/15): unionfs12.sh 20230331 00:12:40 all (5/15): unionfs13.sh 20230331 00:13:04 all (6/15): unionfs14.sh 20230331 00:18:07 all (7/15): unionfs15.sh 20230331 00:18:13 all (8/15): unionfs2.sh stress2: freework leak: 4992/5001. stress2: newblk leak: 21342/21349. 20230331 00:29:10 all (9/15): unionfs3.sh 20230331 00:29:13 all (10/15): unionfs4.sh 20230331 00:31:22 all (11/15): unionfs5.sh 20230331 00:33:54 all (12/15): unionfs6.sh Mar 31 00:39:30 mercat1 kernel: pid 26722 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20230331 00:40:31 all (13/15): unionfs7.sh 20230331 00:46:50 all (14/15): unionfs8.sh fsync: giving up on dirty (error = 35) 0xfffffe01677104b0: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 1681 seqc users 0 rdev 0xfffff801b9156000 hold count flags () flags () v_object 0xfffff804ba6e0840 ref 0 pages 13435 cleanbuf 1678 dirtybuf 1 lock type mntfs: EXCL by thread 0xfffffe015086be40 (pid 45472, mkdir, tid 100609) with exclusive waiters pending #0 0xffffffff80bbf75f at lockmgr_lock_flags+0x1df #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f34d2d at softdep_flushworklist+0x5d #4 0xffffffff80f5a0b7 at ffs_sync+0x3b7 #5 0xffffffff80f71bce at ufs_sync_nlink+0xae #6 0xffffffff80f6fe00 at ufs_mkdir+0x40 #7 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #8 0xffffffff82755cda at unionfs_mkdir+0xca #9 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #10 0xffffffff80cfc23d at kern_mkdirat+0x20d #11 0xffffffff810ee587 at amd64_syscall+0x157 #12 0xffffffff810c1d2b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe01677104b0: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 1681 seqc users 0 rdev 0xfffff801b9156000 hold count flags () flags () v_object 0xfffff804ba6e0840 ref 0 pages 13435 cleanbuf 1678 dirtybuf 1 lock type mntfs: EXCL by thread 0xfffffe015086be40 (pid 45472, mkdir, tid 100609) with exclusive waiters pending #0 0xffffffff80bbf75f at lockmgr_lock_flags+0x1df #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f59fa0 at ffs_sync+0x2a0 #4 0xffffffff80f71bce at ufs_sync_nlink+0xae #5 0xffffffff80f6fe00 at ufs_mkdir+0x40 #6 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #7 0xffffffff82755cda at unionfs_mkdir+0xca #8 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #9 0xffffffff80cfc23d at kern_mkdirat+0x20d #10 0xffffffff810ee587 at amd64_syscall+0x157 #11 0xffffffff810c1d2b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe01677104b0: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 1681 seqc users 0 rdev 0xfffff801b9156000 hold count flags () flags () v_object 0xfffff804ba6e0840 ref 0 pages 13435 cleanbuf 1678 dirtybuf 1 lock type mntfs: EXCL by thread 0xfffffe015b3ff020 (pid 45487, dirnprename, tid 100574) with exclusive waiters pending #0 0xffffffff80bc028e at lockmgr_xlock_hard+0x4be #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f34d2d at softdep_flushworklist+0x5d #4 0xffffffff80f5a0b7 at ffs_sync+0x3b7 #5 0xffffffff80f71c36 at ufs_sync_nlink1+0x26 #6 0xffffffff80f6f782 at ufs_rename+0xe62 #7 0xffffffff811c1a0c at VOP_RENAME_APV+0x3c #8 0xffffffff827558a0 at unionfs_rename+0x340 #9 0xffffffff811c1a0c at VOP_RENAME_APV+0x3c #10 0xffffffff80cfbc36 at kern_renameat+0x416 #11 0xffffffff810ee587 at amd64_syscall+0x157 #12 0xffffffff810c1d2b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe01677104b0: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 1681 seqc users 0 rdev 0xfffff801b9156000 hold count flags () flags () v_object 0xfffff804ba6e0840 ref 0 pages 13435 cleanbuf 1678 dirtybuf 1 lock type mntfs: EXCL by thread 0xfffffe015b3ff020 (pid 45487, dirnprename, tid 100574) with exclusive waiters pending #0 0xffffffff80bbf75f at lockmgr_lock_flags+0x1df #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f59fa0 at ffs_sync+0x2a0 #4 0xffffffff80f71c36 at ufs_sync_nlink1+0x26 #5 0xffffffff80f6f782 at ufs_rename+0xe62 #6 0xffffffff811c1a0c at VOP_RENAME_APV+0x3c #7 0xffffffff827558a0 at unionfs_rename+0x340 #8 0xffffffff811c1a0c at VOP_RENAME_APV+0x3c #9 0xffffffff80cfbc36 at kern_renameat+0x416 #10 0xffffffff810ee587 at amd64_syscall+0x157 #11 0xffffffff810c1d2b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe01677104b0: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 1681 seqc users 0 rdev 0xfffff801b9156000 hold count flags () flags () v_object 0xfffff804ba6e0840 ref 0 pages 13435 cleanbuf 1678 dirtybuf 1 lock type mntfs: EXCL by thread 0xfffffe016fd80000 (pid 45500, dirnprename, tid 100900) #0 0xffffffff80bc028e at lockmgr_xlock_hard+0x4be #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f34d2d at softdep_flushworklist+0x5d #4 0xffffffff80f5a0b7 at ffs_sync+0x3b7 #5 0xffffffff80f71c36 at ufs_sync_nlink1+0x26 #6 0xffffffff80f6f782 at ufs_rename+0xe62 #7 0xffffffff811c1a0c at VOP_RENAME_APV+0x3c #8 0xffffffff827558a0 at unionfs_rename+0x340 #9 0xffffffff811c1a0c at VOP_RENAME_APV+0x3c #10 0xffffffff80cfbc36 at kern_renameat+0x416 #11 0xffffffff810ee587 at amd64_syscall+0x157 #12 0xffffffff810c1d2b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe01677104b0: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 1681 seqc users 0 rdev 0xfffff801b9156000 hold count flags () flags () v_object 0xfffff804ba6e0840 ref 0 pages 13435 cleanbuf 1678 dirtybuf 1 lock type mntfs: EXCL by thread 0xfffffe016fd80000 (pid 45500, dirnprename, tid 100900) #0 0xffffffff80bbf75f at lockmgr_lock_flags+0x1df #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f59fa0 at ffs_sync+0x2a0 #4 0xffffffff80f71c36 at ufs_sync_nlink1+0x26 #5 0xffffffff80f6f782 at ufs_rename+0xe62 #6 0xffffffff811c1a0c at VOP_RENAME_APV+0x3c #7 0xffffffff827558a0 at unionfs_rename+0x340 #8 0xffffffff811c1a0c at VOP_RENAME_APV+0x3c #9 0xffffffff80cfbc36 at kern_renameat+0x416 #10 0xffffffff810ee587 at amd64_syscall+0x157 #11 0xffffffff810c1d2b at fast_syscall_common+0xf8 20230331 00:53:17 all (15/15): unionfs9.sh 20230331 00:58:20 all (1/15): unionfs.sh 20230331 01:00:22 all (2/15): unionfs10.sh 20230331 01:00:25 all (3/15): unionfs11.sh 20230331 01:00:27 all (4/15): unionfs12.sh 20230331 01:00:29 all (5/15): unionfs13.sh 20230331 01:00:53 all (6/15): unionfs14.sh 20230331 01:05:56 all (7/15): unionfs15.sh 20230331 01:06:01 all (8/15): unionfs2.sh stress2: freework leak: 163/172. stress2: newblk leak: 90117/90123. 20230331 01:17:21 all (9/15): unionfs3.sh 20230331 01:17:22 all (10/15): unionfs4.sh Mar 31 01:17:31 mercat1 kernel: pid 35147 (rw), uid 0 inumber 68521 on /mnt10: filesystem full Mar 31 01:18:20 mercat1 kernel: pid 35138 (rw), uid 0 inumber 51141 on /mnt10: filesystem full Mar 31 01:18:40 mercat1 kernel: pid 35153 (rw), uid 0 inumber 132100 on /mnt10: filesystem full 20230331 01:19:29 all (11/15): unionfs5.sh 20230331 01:22:01 all (12/15): unionfs6.sh Mar 31 01:27:05 mercat1 kernel: pid 82667 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Mar 31 01:28:14 mercat1 kernel: pid 82639 (rw), uid 2007 inumber 339461 on /mnt10: filesystem full 20230331 01:28:26 all (13/15): unionfs7.sh fsync: giving up on dirty (error = 35) 0xfffffe014a4382c0: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 2254 seqc users 0 rdev 0xfffff80003ca6800 hold count flags () flags () v_object 0xfffff80178925420 ref 0 pages 28827 cleanbuf 2251 dirtybuf 1 lock type mntfs: EXCL by thread 0xfffffe0173ee0900 (pid 84141, mkdir, tid 100787) with exclusive waiters pending #0 0xffffffff80bbf75f at lockmgr_lock_flags+0x1df #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f34d2d at softdep_flushworklist+0x5d #4 0xffffffff80f5a0b7 at ffs_sync+0x3b7 #5 0xffffffff80f71bce at ufs_sync_nlink+0xae #6 0xffffffff80f6fe00 at ufs_mkdir+0x40 #7 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #8 0xffffffff82755cda at unionfs_mkdir+0xca #9 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #10 0xffffffff80cfc23d at kern_mkdirat+0x20d #11 0xffffffff810ee587 at amd64_syscall+0x157 #12 0xffffffff810c1d2b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe014a4382c0: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 2254 seqc users 0 rdev 0xfffff80003ca6800 hold count flags () flags () v_object 0xfffff80178925420 ref 0 pages 28827 cleanbuf 2251 dirtybuf 1 lock type mntfs: EXCL by thread 0xfffffe0173ee0900 (pid 84141, mkdir, tid 100787) with exclusive waiters pending #0 0xffffffff80bbf75f at lockmgr_lock_flags+0x1df #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f59fa0 at ffs_sync+0x2a0 #4 0xffffffff80f71bce at ufs_sync_nlink+0xae #5 0xffffffff80f6fe00 at ufs_mkdir+0x40 #6 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #7 0xffffffff82755cda at unionfs_mkdir+0xca #8 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #9 0xffffffff80cfc23d at kern_mkdirat+0x20d #10 0xffffffff810ee587 at amd64_syscall+0x157 #11 0xffffffff810c1d2b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe014a4382c0: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 2254 seqc users 0 rdev 0xfffff80003ca6800 hold count flags () flags () v_object 0xfffff80178925420 ref 0 pages 28827 cleanbuf 2251 dirtybuf 1 lock type mntfs: EXCL by thread 0xfffffe0142b591e0 (pid 84167, dirnprename, tid 100795) with exclusive waiters pending #0 0xffffffff80bc028e at lockmgr_xlock_hard+0x4be #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f34d2d at softdep_flushworklist+0x5d #4 0xffffffff80f5a0b7 at ffs_sync+0x3b7 #5 0xffffffff80f71c36 at ufs_sync_nlink1+0x26 #6 0xffffffff80f6f782 at ufs_rename+0xe62 #7 0xffffffff811c1a0c at VOP_RENAME_APV+0x3c #8 0xffffffff827558a0 at unionfs_rename+0x340 #9 0xffffffff811c1a0c at VOP_RENAME_APV+0x3c #10 0xffffffff80cfbc36 at kern_renameat+0x416 #11 0xffffffff810ee587 at amd64_syscall+0x157 #12 0xffffffff810c1d2b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe014a4382c0: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 2254 seqc users 0 rdev 0xfffff80003ca6800 hold count flags () flags () v_object 0xfffff80178925420 ref 0 pages 28827 cleanbuf 2251 dirtybuf 1 lock type mntfs: EXCL by thread 0xfffffe0142b591e0 (pid 84167, dirnprename, tid 100795) with exclusive waiters pending #0 0xffffffff80bbf75f at lockmgr_lock_flags+0x1df #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f59fa0 at ffs_sync+0x2a0 #4 0xffffffff80f71c36 at ufs_sync_nlink1+0x26 #5 0xffffffff80f6f782 at ufs_rename+0xe62 #6 0xffffffff811c1a0c at VOP_RENAME_APV+0x3c #7 0xffffffff827558a0 at unionfs_rename+0x340 #8 0xffffffff811c1a0c at VOP_RENAME_APV+0x3c #9 0xffffffff80cfbc36 at kern_renameat+0x416 #10 0xffffffff810ee587 at amd64_syscall+0x157 #11 0xffffffff810c1d2b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe014a4382c0: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 2254 seqc users 0 rdev 0xfffff80003ca6800 hold count flags () flags () v_object 0xfffff80178925420 ref 0 pages 28827 cleanbuf 2251 dirtybuf 1 lock type mntfs: EXCL by thread 0xfffffe010e3da1e0 (pid 84170, dirnprename, tid 100560) #0 0xffffffff80bc028e at lockmgr_xlock_hard+0x4be #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f34d2d at softdep_flushworklist+0x5d #4 0xffffffff80f5a0b7 at ffs_sync+0x3b7 #5 0xffffffff80f71c36 at ufs_sync_nlink1+0x26 #6 0xffffffff80f6f782 at ufs_rename+0xe62 #7 0xffffffff811c1a0c at VOP_RENAME_APV+0x3c #8 0xffffffff827558a0 at unionfs_rename+0x340 #9 0xffffffff811c1a0c at VOP_RENAME_APV+0x3c #10 0xffffffff80cfbc36 at kern_renameat+0x416 #11 0xffffffff810ee587 at amd64_syscall+0x157 #12 0xffffffff810c1d2b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe014a4382c0: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 2254 seqc users 0 rdev 0xfffff80003ca6800 hold count flags () flags () v_object 0xfffff80178925420 ref 0 pages 28827 cleanbuf 2251 dirtybuf 1 lock type mntfs: EXCL by thread 0xfffffe010e3da1e0 (pid 84170, dirnprename, tid 100560) #0 0xffffffff80bbf75f at lockmgr_lock_flags+0x1df #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f59fa0 at ffs_sync+0x2a0 #4 0xffffffff80f71c36 at ufs_sync_nlink1+0x26 #5 0xffffffff80f6f782 at ufs_rename+0xe62 #6 0xffffffff811c1a0c at VOP_RENAME_APV+0x3c #7 0xffffffff827558a0 at unionfs_rename+0x340 #8 0xffffffff811c1a0c at VOP_RENAME_APV+0x3c #9 0xffffffff80cfbc36 at kern_renameat+0x416 #10 0xffffffff810ee587 at amd64_syscall+0x157 #11 0xffffffff810c1d2b at fast_syscall_common+0xf8 20230331 01:35:14 all (14/15): unionfs8.sh Mar 31 01:36:20 mercat1 kernel: pid 6375 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Mar 31 01:38:02 mercat1 kernel: pid 8147 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20230331 01:41:40 all (15/15): unionfs9.sh 20230331 01:46:44 all (1/15): unionfs.sh 20230331 01:48:49 all (2/15): unionfs10.sh 20230331 01:48:51 all (3/15): unionfs11.sh 20230331 01:48:53 all (4/15): unionfs12.sh 20230331 01:48:56 all (5/15): unionfs13.sh 20230331 01:49:19 all (6/15): unionfs14.sh 20230331 01:54:22 all (7/15): unionfs15.sh 20230331 01:54:28 all (8/15): unionfs2.sh stress2: freework leak: 147/156. stress2: newblk leak: 81946/81952. 20230331 02:06:28 all (9/15): unionfs3.sh 20230331 02:06:30 all (10/15): unionfs4.sh Mar 31 02:07:36 mercat1 kernel: pid 52241 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page Mar 31 02:08:03 mercat1 kernel: pid 52249 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20230331 02:08:39 all (11/15): unionfs5.sh 20230331 02:11:46 all (12/15): unionfs6.sh 20230331 02:18:26 all (13/15): unionfs7.sh 20230331 02:25:02 all (14/15): unionfs8.sh 20230331 02:31:44 all (15/15): unionfs9.sh 20230331 02:36:47 all (1/15): unionfs.sh 20230331 02:38:55 all (2/15): unionfs10.sh 20230331 02:38:57 all (3/15): unionfs11.sh 20230331 02:38:59 all (4/15): unionfs12.sh 20230331 02:39:01 all (5/15): unionfs13.sh 20230331 02:39:25 all (6/15): unionfs14.sh 20230331 02:44:28 all (7/15): unionfs15.sh 20230331 02:44:34 all (8/15): unionfs2.sh stress2: freework leak: 114/123. stress2: newblk leak: 41004/41011. 20230331 02:56:05 all.sh done, elapsed 0 day(s), 05:10.24 20230331 02:56:09 all (1/358): advlock.sh 20230331 02:57:11 all (2/358): audit2.sh Mar 31 02:59:22 mercat1 kernel: pid 86012 (rw), uid 2007 inumber 83715 on /mnt: filesystem full Mar 31 02:59:55 mercat1 kernel: pid 86016 (rw), uid 2007 inumber 4627 on /mnt: filesystem full Mar 31 02:59:57 mercat1 kernel: pid 86048 (link), uid 2007 inumber 65877 on /mnt: filesystem full Mar 31 03:00:00 mercat1 kernel: pid 85997 (rw), uid 2007 inumber 101647 on /mnt: filesystem full Mar 31 03:00:10 mercat1 kernel: pid 86045 (rw), uid 2007 inumber 119201 on /mnt: filesystem full 20230331 03:03:25 all (3/358): badcode.sh Mar 31 03:08:29 mercat1 kernel: pid 99611 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Mar 31 03:10:36 mercat1 kernel: pid 88194 (find), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20230331 03:14:14 all (4/358): badcode2.sh Mar 31 03:22:16 mercat1 kernel: pid 28003 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20230331 03:25:41 all (5/358): badcode3.sh 20230331 03:30:49 all (6/358): bench.sh 20230331 03:31:37 all (7/358): beneath2.sh 20230331 03:31:40 all (8/358): beneath3.sh 20230331 03:31:42 all (9/358): bio.sh 20230331 03:36:55 all (10/358): buildkernel.sh 20230331 03:59:11 all (11/358): buildworld.sh 20230331 03:59:13 all (12/358): buildworld3.sh lock order reversal: 1st 0xfffff802e36e2ea0 FFS (FFS Lock, sleep mutex) @ ufs/ufs/ufs_quota.c:752 2nd 0xfffffe0143faf040 struct mount mtx (struct mount mtx, sleep mutex) @ ufs/ufs/ufs_quota.c:758 lock order struct mount mtx -> FFS Lock established at: #0 0xffffffff80c63f7b at witness_checkorder+0x2fb #1 0xffffffff80bcc8c4 at __mtx_lock_flags+0x94 #2 0xffffffff80f352c4 at softdep_flushfiles+0x394 #3 0xffffffff80f5978c at ffs_unmount+0xac #4 0xffffffff80cdc8d9 at dounmount+0x7e9 #5 0xffffffff80cdc087 at kern_unmount+0x2e7 #6 0xffffffff810ee587 at amd64_syscall+0x157 #7 0xffffffff810c1d2b at fast_syscall_common+0xf8 lock order FFS Lock -> struct mount mtx attempted at: #0 0xffffffff80c64833 at witness_checkorder+0xbb3 #1 0xffffffff80bcc8c4 at __mtx_lock_flags+0x94 #2 0xffffffff80f6b4ad at quotaoff_inchange+0xbd #3 0xffffffff80f6ca92 at ufs_quotactl+0xe2 #4 0xffffffff80cf3b0d at sys_quotactl+0x16d #5 0xffffffff810ee587 at amd64_syscall+0x157 #6 0xffffffff810c1d2b at fast_syscall_common+0xf8 20230331 04:19:18 all (13/358): buildworld4.sh 20230331 04:29:23 all (14/358): burnin.sh 20230331 04:49:57 all (15/358): chroot.sh 20230331 04:50:02 all (16/358): cmp.sh Mar 31 04:51:34 mercat1 kernel: pid 54286 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page Mar 31 04:52:05 mercat1 kernel: pid 54285 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page Mar 31 04:53:50 mercat1 kernel: pid 54272 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page Mar 31 04:55:18 mercat1 kernel: pid 58450 (cmp), uid 2007 inumber 131323 on /mnt: out of inodes Mar 31 04:55:18 mercat1 kernel: pid 58456 (cmp), uid 2007 inumber 2 on /mnt: out of inodes 20230331 04:55:25 all (17/358): core2.sh 20230331 04:55:34 all (18/358): core3.sh Mar 31 04:55:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:37 mercat1 syslogd: last message repeated 17 times Mar 31 04:55:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:37 mercat1 syslogd: last message repeated 125 times Mar 31 04:55:38 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:38 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:38 mercat1 syslogd: last message repeated 65 times Mar 31 04:55:38 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:38 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:38 mercat1 syslogd: last message repeated 54 times Mar 31 04:55:38 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:38 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:38 mercat1 syslogd: last message repeated 12 times Mar 31 04:55:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:39 mercat1 syslogd: last message repeated 171 times Mar 31 04:55:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:40 mercat1 syslogd: last message repeated 124 times Mar 31 04:55:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:40 mercat1 syslogd: last message repeated 61 times Mar 31 04:55:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:41 mercat1 syslogd: last message repeated 60 times Mar 31 04:55:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:41 mercat1 syslogd: last message repeated 62 times Mar 31 04:55:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:42 mercat1 syslogd: last message repeated 21 times Mar 31 04:55:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:42 mercat1 syslogd: last message repeated 39 times Mar 31 04:55:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:42 mercat1 syslogd: last message repeated 61 times Mar 31 04:55:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:42 mercat1 syslogd: last message repeated 62 times Mar 31 04:55:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:42 mercat1 syslogd: last message repeated 61 times Mar 31 04:55:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:43 mercat1 syslogd: last message repeated 60 times Mar 31 04:55:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:43 mercat1 syslogd: last message repeated 62 times Mar 31 04:55:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:43 mercat1 syslogd: last message repeated 62 times Mar 31 04:55:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:44 mercat1 syslogd: last message repeated 65 times Mar 31 04:55:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:44 mercat1 syslogd: last message repeated 57 times Mar 31 04:55:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:44 mercat1 syslogd: last message repeated 62 times Mar 31 04:55:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:44 mercat1 syslogd: last message repeated 63 times Mar 31 04:55:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:45 mercat1 syslogd: last message repeated 61 times Mar 31 04:55:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:45 mercat1 syslogd: last message repeated 12 times Mar 31 04:55:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:45 mercat1 syslogd: last message repeated 48 times Mar 31 04:55:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:45 mercat1 syslogd: last message repeated 61 times Mar 31 04:55:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:45 mercat1 syslogd: last message repeated 60 times Mar 31 04:55:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:45 mercat1 syslogd: last message repeated 62 times Mar 31 04:55:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:46 mercat1 syslogd: last message repeated 76 times Mar 31 04:55:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:46 mercat1 syslogd: last message repeated 47 times Mar 31 04:55:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:46 mercat1 syslogd: last message repeated 62 times Mar 31 04:55:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:46 mercat1 syslogd: last message repeated 124 times Mar 31 04:55:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:46 mercat1 syslogd: last message repeated 60 times Mar 31 04:55:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:47 mercat1 syslogd: last message repeated 60 times Mar 31 04:55:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:47 mercat1 syslogd: last message repeated 60 times Mar 31 04:55:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:48 mercat1 syslogd: last message repeated 123 times Mar 31 04:55:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:48 mercat1 syslogd: last message repeated 62 times Mar 31 04:55:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:48 mercat1 syslogd: last message repeated 62 times Mar 31 04:55:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:48 mercat1 syslogd: last message repeated 64 times Mar 31 04:55:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:49 mercat1 syslogd: last message repeated 57 times Mar 31 04:55:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:49 mercat1 syslogd: last message repeated 31 times Mar 31 04:55:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:49 mercat1 syslogd: last message repeated 90 times Mar 31 04:55:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:50 mercat1 syslogd: last message repeated 62 times Mar 31 04:55:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:50 mercat1 syslogd: last message repeated 61 times Mar 31 04:55:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:51 mercat1 syslogd: last message repeated 21 times Mar 31 04:55:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:51 mercat1 syslogd: last message repeated 38 times Mar 31 04:55:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:51 mercat1 syslogd: last message repeated 88 times Mar 31 04:55:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:52 mercat1 syslogd: last message repeated 98 times Mar 31 04:55:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:52 mercat1 syslogd: last message repeated 59 times Mar 31 04:55:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:52 mercat1 syslogd: last message repeated 126 times Mar 31 04:55:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:53 mercat1 syslogd: last message repeated 62 times Mar 31 04:55:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:53 mercat1 syslogd: last message repeated 60 times Mar 31 04:55:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:54 mercat1 syslogd: last message repeated 62 times Mar 31 04:55:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:54 mercat1 syslogd: last message repeated 61 times Mar 31 04:55:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:54 mercat1 syslogd: last message repeated 63 times Mar 31 04:55:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:54 mercat1 syslogd: last message repeated 59 times Mar 31 04:55:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:54 mercat1 syslogd: last message repeated 61 times Mar 31 04:55:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:55 mercat1 syslogd: last message repeated 60 times Mar 31 04:55:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:55 mercat1 syslogd: last message repeated 36 times Mar 31 04:55:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:56 mercat1 syslogd: last message repeated 27 times Mar 31 04:55:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:56 mercat1 syslogd: last message repeated 122 times Mar 31 04:55:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:56 mercat1 syslogd: last message repeated 12 times Mar 31 04:55:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:58 mercat1 syslogd: last message repeated 242 times Mar 31 04:55:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:58 mercat1 syslogd: last message repeated 116 times Mar 31 04:55:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:58 mercat1 syslogd: last message repeated 5 times Mar 31 04:55:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:58 mercat1 syslogd: last message repeated 53 times Mar 31 04:55:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:58 mercat1 syslogd: last message repeated 60 times Mar 31 04:55:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:59 mercat1 syslogd: last message repeated 38 times Mar 31 04:55:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:59 mercat1 syslogd: last message repeated 22 times Mar 31 04:55:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:55:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:55:59 mercat1 syslogd: last message repeated 124 times Mar 31 04:56:00 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:00 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:00 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:00 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:00 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:00 mercat1 syslogd: last message repeated 64 times Mar 31 04:56:00 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:00 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:00 mercat1 syslogd: last message repeated 127 times Mar 31 04:56:01 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:01 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:02 mercat1 syslogd: last message repeated 308 times Mar 31 04:56:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:03 mercat1 syslogd: last message repeated 122 times Mar 31 04:56:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:03 mercat1 syslogd: last message repeated 68 times Mar 31 04:56:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:04 mercat1 syslogd: last message repeated 116 times Mar 31 04:56:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:04 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:04 mercat1 syslogd: last message repeated 122 times Mar 31 04:56:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:05 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:05 mercat1 syslogd: last message repeated 13 times Mar 31 04:56:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:05 mercat1 syslogd: last message repeated 47 times Mar 31 04:56:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:06 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:06 mercat1 syslogd: last message repeated 141 times Mar 31 04:56:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:06 mercat1 syslogd: last message repeated 42 times Mar 31 04:56:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:06 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:07 mercat1 syslogd: last message repeated 123 times Mar 31 04:56:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:09 mercat1 syslogd: last message repeated 60 times Mar 31 04:56:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:09 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:09 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:09 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:10 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:10 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:10 mercat1 syslogd: last message repeated 67 times Mar 31 04:56:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:11 mercat1 syslogd: last message repeated 53 times Mar 31 04:56:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:11 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:11 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:11 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:12 mercat1 syslogd: last message repeated 253 times Mar 31 04:56:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:12 mercat1 syslogd: last message repeated 57 times Mar 31 04:56:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:12 mercat1 syslogd: last message repeated 9 times Mar 31 04:56:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:12 mercat1 syslogd: last message repeated 50 times Mar 31 04:56:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:13 mercat1 syslogd: last message repeated 133 times Mar 31 04:56:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:13 mercat1 syslogd: last message repeated 116 times Mar 31 04:56:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:14 mercat1 syslogd: last message repeated 125 times Mar 31 04:56:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:14 mercat1 syslogd: last message repeated 122 times Mar 31 04:56:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:15 mercat1 syslogd: last message repeated 65 times Mar 31 04:56:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:15 mercat1 syslogd: last message repeated 56 times Mar 31 04:56:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:15 mercat1 syslogd: last message repeated 128 times Mar 31 04:56:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:16 mercat1 syslogd: last message repeated 56 times Mar 31 04:56:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:16 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:17 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:19 mercat1 syslogd: last message repeated 313 times Mar 31 04:56:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:19 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:19 mercat1 syslogd: last message repeated 126 times Mar 31 04:56:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:20 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:20 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:21 mercat1 syslogd: last message repeated 123 times Mar 31 04:56:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:21 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:21 mercat1 syslogd: last message repeated 73 times Mar 31 04:56:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:22 mercat1 syslogd: last message repeated 50 times Mar 31 04:56:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:22 mercat1 syslogd: last message repeated 37 times Mar 31 04:56:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:22 mercat1 syslogd: last message repeated 22 times Mar 31 04:56:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:22 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:22 mercat1 syslogd: last message repeated 124 times Mar 31 04:56:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:22 mercat1 syslogd: last message repeated 38 times Mar 31 04:56:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:22 mercat1 syslogd: last message repeated 21 times Mar 31 04:56:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:22 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:23 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:23 mercat1 syslogd: last message repeated 123 times Mar 31 04:56:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:23 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:23 mercat1 syslogd: last message repeated 65 times Mar 31 04:56:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:24 mercat1 syslogd: last message repeated 187 times Mar 31 04:56:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:25 mercat1 syslogd: last message repeated 118 times Mar 31 04:56:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:25 mercat1 syslogd: last message repeated 38 times Mar 31 04:56:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:25 mercat1 syslogd: last message repeated 22 times Mar 31 04:56:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:26 mercat1 syslogd: last message repeated 7 times Mar 31 04:56:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:26 mercat1 syslogd: last message repeated 52 times Mar 31 04:56:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:26 mercat1 syslogd: last message repeated 126 times Mar 31 04:56:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:26 mercat1 syslogd: last message repeated 65 times Mar 31 04:56:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:26 mercat1 syslogd: last message repeated 118 times Mar 31 04:56:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:26 mercat1 syslogd: last message repeated 63 times Mar 31 04:56:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:28 mercat1 syslogd: last message repeated 192 times Mar 31 04:56:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:28 mercat1 syslogd: last message repeated 54 times Mar 31 04:56:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:28 mercat1 syslogd: last message repeated 64 times Mar 31 04:56:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:28 mercat1 syslogd: last message repeated 58 times Mar 31 04:56:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:28 mercat1 syslogd: last message repeated 8 times Mar 31 04:56:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:29 mercat1 syslogd: last message repeated 50 times Mar 31 04:56:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:29 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:29 mercat1 syslogd: last message repeated 24 times Mar 31 04:56:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:30 mercat1 syslogd: last message repeated 160 times Mar 31 04:56:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:30 mercat1 syslogd: last message repeated 66 times Mar 31 04:56:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:31 mercat1 syslogd: last message repeated 56 times Mar 31 04:56:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:31 mercat1 syslogd: last message repeated 12 times Mar 31 04:56:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:32 mercat1 syslogd: last message repeated 176 times Mar 31 04:56:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:32 mercat1 syslogd: last message repeated 11 times Mar 31 04:56:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:32 mercat1 syslogd: last message repeated 49 times Mar 31 04:56:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:32 mercat1 syslogd: last message repeated 186 times Mar 31 04:56:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:32 mercat1 syslogd: last message repeated 29 times Mar 31 04:56:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:32 mercat1 syslogd: last message repeated 31 times Mar 31 04:56:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:33 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:34 mercat1 syslogd: last message repeated 43 times Mar 31 04:56:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:34 mercat1 syslogd: last message repeated 17 times Mar 31 04:56:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:34 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:34 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:34 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:34 mercat1 syslogd: last message repeated 11 times Mar 31 04:56:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:34 mercat1 syslogd: last message repeated 47 times Mar 31 04:56:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:34 mercat1 syslogd: last message repeated 60 times Mar 31 04:56:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:35 mercat1 syslogd: last message repeated 63 times Mar 31 04:56:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:35 mercat1 syslogd: last message repeated 65 times Mar 31 04:56:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:35 mercat1 syslogd: last message repeated 120 times Mar 31 04:56:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:35 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:35 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:36 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:36 mercat1 syslogd: last message repeated 75 times Mar 31 04:56:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:36 mercat1 syslogd: last message repeated 48 times Mar 31 04:56:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:36 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:36 mercat1 syslogd: last message repeated 6 times Mar 31 04:56:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:36 mercat1 syslogd: last message repeated 54 times Mar 31 04:56:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:37 mercat1 syslogd: last message repeated 125 times Mar 31 04:56:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:37 mercat1 syslogd: last message repeated 184 times Mar 31 04:56:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:37 mercat1 syslogd: last message repeated 26 times Mar 31 04:56:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:37 mercat1 syslogd: last message repeated 33 times Mar 31 04:56:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:38 mercat1 syslogd: last message repeated 60 times Mar 31 04:56:38 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:38 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:38 mercat1 syslogd: last message repeated 124 times Mar 31 04:56:38 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:38 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:38 mercat1 syslogd: last message repeated 125 times Mar 31 04:56:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:39 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:39 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:40 mercat1 syslogd: last message repeated 38 times Mar 31 04:56:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:40 mercat1 syslogd: last message repeated 21 times Mar 31 04:56:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:40 mercat1 syslogd: last message repeated 9 times Mar 31 04:56:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:40 mercat1 syslogd: last message repeated 112 times Mar 31 04:56:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:40 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:40 mercat1 syslogd: last message repeated 13 times Mar 31 04:56:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:41 mercat1 syslogd: last message repeated 110 times Mar 31 04:56:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:42 mercat1 syslogd: last message repeated 131 times Mar 31 04:56:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:42 mercat1 syslogd: last message repeated 116 times Mar 31 04:56:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:43 mercat1 syslogd: last message repeated 124 times Mar 31 04:56:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:43 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:43 mercat1 syslogd: last message repeated 64 times Mar 31 04:56:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:43 mercat1 syslogd: last message repeated 58 times Mar 31 04:56:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:43 mercat1 syslogd: last message repeated 63 times Mar 31 04:56:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:44 mercat1 syslogd: last message repeated 66 times Mar 31 04:56:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:44 mercat1 syslogd: last message repeated 71 times Mar 31 04:56:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:44 mercat1 syslogd: last message repeated 46 times Mar 31 04:56:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:45 mercat1 syslogd: last message repeated 91 times Mar 31 04:56:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:45 mercat1 syslogd: last message repeated 94 times Mar 31 04:56:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:46 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:46 mercat1 syslogd: last message repeated 125 times Mar 31 04:56:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:46 mercat1 syslogd: last message repeated 63 times Mar 31 04:56:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:47 mercat1 syslogd: last message repeated 59 times Mar 31 04:56:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:47 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:48 mercat1 syslogd: last message repeated 41 times Mar 31 04:56:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:48 mercat1 syslogd: last message repeated 19 times Mar 31 04:56:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:48 mercat1 syslogd: last message repeated 60 times Mar 31 04:56:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:49 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:49 mercat1 syslogd: last message repeated 67 times Mar 31 04:56:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:49 mercat1 syslogd: last message repeated 56 times Mar 31 04:56:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:49 mercat1 syslogd: last message repeated 60 times Mar 31 04:56:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:49 mercat1 syslogd: last message repeated 123 times Mar 31 04:56:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:50 mercat1 syslogd: last message repeated 27 times Mar 31 04:56:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:50 mercat1 syslogd: last message repeated 168 times Mar 31 04:56:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:50 mercat1 syslogd: last message repeated 54 times Mar 31 04:56:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:51 mercat1 syslogd: last message repeated 123 times Mar 31 04:56:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:51 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:51 mercat1 syslogd: last message repeated 60 times Mar 31 04:56:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:52 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:52 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:52 mercat1 syslogd: last message repeated 76 times Mar 31 04:56:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:53 mercat1 syslogd: last message repeated 47 times Mar 31 04:56:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:53 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:53 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:53 mercat1 syslogd: last message repeated 61 times Mar 31 04:56:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:54 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:54 mercat1 syslogd: last message repeated 124 times Mar 31 04:56:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:54 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:54 mercat1 syslogd: last message repeated 9 times Mar 31 04:56:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:54 mercat1 syslogd: last message repeated 50 times Mar 31 04:56:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:54 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:55 mercat1 syslogd: last message repeated 254 times Mar 31 04:56:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:56 mercat1 syslogd: last message repeated 125 times Mar 31 04:56:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:56 mercat1 syslogd: last message repeated 64 times Mar 31 04:56:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:56 mercat1 syslogd: last message repeated 57 times Mar 31 04:56:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:57 mercat1 syslogd: last message repeated 188 times Mar 31 04:56:57 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:57 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:58 mercat1 syslogd: last message repeated 63 times Mar 31 04:56:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:58 mercat1 syslogd: last message repeated 59 times Mar 31 04:56:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:58 mercat1 syslogd: last message repeated 7 times Mar 31 04:56:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:58 mercat1 syslogd: last message repeated 51 times Mar 31 04:56:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:58 mercat1 syslogd: last message repeated 62 times Mar 31 04:56:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:56:59 mercat1 syslogd: last message repeated 11 times Mar 31 04:56:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:56:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:00 mercat1 syslogd: last message repeated 298 times Mar 31 04:57:00 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:00 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:00 mercat1 syslogd: last message repeated 28 times Mar 31 04:57:00 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:00 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:00 mercat1 syslogd: last message repeated 41 times Mar 31 04:57:01 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:01 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:01 mercat1 syslogd: last message repeated 52 times Mar 31 04:57:01 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:01 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:01 mercat1 syslogd: last message repeated 35 times Mar 31 04:57:01 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:01 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:01 mercat1 syslogd: last message repeated 29 times Mar 31 04:57:01 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:01 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:02 mercat1 syslogd: last message repeated 186 times Mar 31 04:57:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:02 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:03 mercat1 syslogd: last message repeated 61 times Mar 31 04:57:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:03 mercat1 syslogd: last message repeated 3 times Mar 31 04:57:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:04 mercat1 syslogd: last message repeated 56 times Mar 31 04:57:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:04 mercat1 syslogd: last message repeated 61 times Mar 31 04:57:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:04 mercat1 syslogd: last message repeated 60 times Mar 31 04:57:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:04 mercat1 syslogd: last message repeated 3 times Mar 31 04:57:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:04 mercat1 syslogd: last message repeated 57 times Mar 31 04:57:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:04 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:04 mercat1 syslogd: last message repeated 61 times Mar 31 04:57:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:05 mercat1 syslogd: last message repeated 126 times Mar 31 04:57:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:05 mercat1 syslogd: last message repeated 58 times Mar 31 04:57:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:05 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:05 mercat1 syslogd: last message repeated 126 times Mar 31 04:57:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:06 mercat1 syslogd: last message repeated 68 times Mar 31 04:57:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:06 mercat1 syslogd: last message repeated 52 times Mar 31 04:57:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:06 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:06 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:06 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:06 mercat1 syslogd: last message repeated 61 times Mar 31 04:57:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:07 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:07 mercat1 syslogd: last message repeated 65 times Mar 31 04:57:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:07 mercat1 syslogd: last message repeated 65 times Mar 31 04:57:08 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:08 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:08 mercat1 syslogd: last message repeated 117 times Mar 31 04:57:08 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:08 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:08 mercat1 syslogd: last message repeated 123 times Mar 31 04:57:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:09 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:09 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:09 mercat1 syslogd: last message repeated 59 times Mar 31 04:57:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:10 mercat1 syslogd: last message repeated 21 times Mar 31 04:57:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:10 mercat1 syslogd: last message repeated 39 times Mar 31 04:57:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:10 mercat1 syslogd: last message repeated 124 times Mar 31 04:57:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:10 mercat1 syslogd: last message repeated 63 times Mar 31 04:57:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:11 mercat1 syslogd: last message repeated 61 times Mar 31 04:57:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:11 mercat1 syslogd: last message repeated 7 times Mar 31 04:57:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:13 mercat1 syslogd: last message repeated 241 times Mar 31 04:57:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:13 mercat1 syslogd: last message repeated 64 times Mar 31 04:57:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:13 mercat1 syslogd: last message repeated 58 times Mar 31 04:57:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:13 mercat1 syslogd: last message repeated 60 times Mar 31 04:57:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:14 mercat1 syslogd: last message repeated 61 times Mar 31 04:57:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:14 mercat1 syslogd: last message repeated 123 times Mar 31 04:57:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:14 mercat1 syslogd: last message repeated 61 times Mar 31 04:57:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:15 mercat1 syslogd: last message repeated 125 times Mar 31 04:57:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:15 mercat1 syslogd: last message repeated 85 times Mar 31 04:57:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:16 mercat1 syslogd: last message repeated 35 times Mar 31 04:57:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:16 mercat1 syslogd: last message repeated 61 times Mar 31 04:57:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:16 mercat1 syslogd: last message repeated 61 times Mar 31 04:57:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:16 mercat1 syslogd: last message repeated 63 times Mar 31 04:57:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:17 mercat1 syslogd: last message repeated 65 times Mar 31 04:57:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:17 mercat1 syslogd: last message repeated 66 times Mar 31 04:57:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:17 mercat1 syslogd: last message repeated 53 times Mar 31 04:57:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:17 mercat1 syslogd: last message repeated 63 times Mar 31 04:57:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:18 mercat1 syslogd: last message repeated 123 times Mar 31 04:57:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:18 mercat1 syslogd: last message repeated 9 times Mar 31 04:57:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:18 mercat1 syslogd: last message repeated 49 times Mar 31 04:57:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:19 mercat1 syslogd: last message repeated 60 times Mar 31 04:57:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:19 mercat1 syslogd: last message repeated 128 times Mar 31 04:57:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:21 mercat1 syslogd: last message repeated 197 times Mar 31 04:57:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:21 mercat1 syslogd: last message repeated 51 times Mar 31 04:57:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:21 mercat1 syslogd: last message repeated 61 times Mar 31 04:57:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:21 mercat1 syslogd: last message repeated 63 times Mar 31 04:57:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:22 mercat1 syslogd: last message repeated 66 times Mar 31 04:57:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:22 mercat1 syslogd: last message repeated 56 times Mar 31 04:57:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:22 mercat1 syslogd: last message repeated 10 times Mar 31 04:57:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:22 mercat1 syslogd: last message repeated 48 times Mar 31 04:57:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:22 mercat1 syslogd: last message repeated 125 times Mar 31 04:57:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:23 mercat1 syslogd: last message repeated 63 times Mar 31 04:57:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:23 mercat1 syslogd: last message repeated 68 times Mar 31 04:57:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:23 mercat1 syslogd: last message repeated 116 times Mar 31 04:57:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:24 mercat1 syslogd: last message repeated 132 times Mar 31 04:57:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:24 mercat1 syslogd: last message repeated 55 times Mar 31 04:57:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:24 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:25 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:25 mercat1 syslogd: last message repeated 60 times Mar 31 04:57:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:25 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:26 mercat1 syslogd: last message repeated 60 times Mar 31 04:57:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:26 mercat1 syslogd: last message repeated 11 times Mar 31 04:57:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:26 mercat1 syslogd: last message repeated 49 times Mar 31 04:57:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:26 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:26 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:27 mercat1 syslogd: last message repeated 14 times Mar 31 04:57:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:27 mercat1 syslogd: last message repeated 110 times Mar 31 04:57:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:27 mercat1 syslogd: last message repeated 76 times Mar 31 04:57:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:28 mercat1 syslogd: last message repeated 110 times Mar 31 04:57:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:28 mercat1 syslogd: last message repeated 61 times Mar 31 04:57:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:28 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:29 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:29 mercat1 syslogd: last message repeated 61 times Mar 31 04:57:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:30 mercat1 syslogd: last message repeated 135 times Mar 31 04:57:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:30 mercat1 syslogd: last message repeated 113 times Mar 31 04:57:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:31 mercat1 syslogd: last message repeated 124 times Mar 31 04:57:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:31 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:31 mercat1 syslogd: last message repeated 61 times Mar 31 04:57:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:31 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:32 mercat1 syslogd: last message repeated 129 times Mar 31 04:57:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:32 mercat1 syslogd: last message repeated 66 times Mar 31 04:57:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:32 mercat1 syslogd: last message repeated 51 times Mar 31 04:57:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:33 mercat1 syslogd: last message repeated 63 times Mar 31 04:57:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:33 mercat1 syslogd: last message repeated 58 times Mar 31 04:57:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:33 mercat1 syslogd: last message repeated 123 times Mar 31 04:57:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:34 mercat1 syslogd: last message repeated 123 times Mar 31 04:57:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:34 mercat1 syslogd: last message repeated 185 times Mar 31 04:57:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:35 mercat1 syslogd: last message repeated 186 times Mar 31 04:57:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:35 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:35 mercat1 syslogd: last message repeated 60 times Mar 31 04:57:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:35 mercat1 syslogd: last message repeated 64 times Mar 31 04:57:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:36 mercat1 syslogd: last message repeated 251 times Mar 31 04:57:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:36 mercat1 syslogd: last message repeated 55 times Mar 31 04:57:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:36 mercat1 syslogd: last message repeated 124 times Mar 31 04:57:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:37 mercat1 syslogd: last message repeated 125 times Mar 31 04:57:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:37 mercat1 syslogd: last message repeated 125 times Mar 31 04:57:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:37 mercat1 syslogd: last message repeated 61 times Mar 31 04:57:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:38 mercat1 syslogd: last message repeated 87 times Mar 31 04:57:38 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:38 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:38 mercat1 syslogd: last message repeated 37 times Mar 31 04:57:38 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:38 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:38 mercat1 syslogd: last message repeated 126 times Mar 31 04:57:38 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:38 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:39 mercat1 syslogd: last message repeated 61 times Mar 31 04:57:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:39 mercat1 syslogd: last message repeated 62 times Mar 31 04:57:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:39 mercat1 syslogd: last message repeated 61 times Mar 31 04:57:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:40 mercat1 syslogd: last message repeated 43 times Mar 31 04:57:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:40 mercat1 syslogd: last message repeated 15 times Mar 31 04:57:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:40 mercat1 syslogd: last message repeated 61 times Mar 31 04:57:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:40 mercat1 syslogd: last message repeated 59 times Mar 31 04:57:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:40 mercat1 syslogd: last message repeated 63 times Mar 31 04:57:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:57:41 mercat1 syslogd: last message repeated 121 times Mar 31 04:57:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:57:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:02 mercat1 syslogd: last message repeated 124 times Mar 31 04:58:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:02 mercat1 syslogd: last message repeated 39 times Mar 31 04:58:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:02 mercat1 syslogd: last message repeated 19 times Mar 31 04:58:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:02 mercat1 syslogd: last message repeated 124 times Mar 31 04:58:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:02 mercat1 syslogd: last message repeated 62 times Mar 31 04:58:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:02 mercat1 syslogd: last message repeated 60 times Mar 31 04:58:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:02 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:02 mercat1 syslogd: last message repeated 64 times Mar 31 04:58:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:03 mercat1 syslogd: last message repeated 63 times Mar 31 04:58:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:03 mercat1 syslogd: last message repeated 122 times Mar 31 04:58:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:03 mercat1 syslogd: last message repeated 126 times Mar 31 04:58:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:03 mercat1 syslogd: last message repeated 123 times Mar 31 04:58:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:04 mercat1 syslogd: last message repeated 62 times Mar 31 04:58:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:04 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:05 mercat1 syslogd: last message repeated 63 times Mar 31 04:58:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:06 mercat1 syslogd: last message repeated 63 times Mar 31 04:58:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:06 mercat1 syslogd: last message repeated 57 times Mar 31 04:58:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:06 mercat1 syslogd: last message repeated 10 times Mar 31 04:58:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:07 mercat1 syslogd: last message repeated 50 times Mar 31 04:58:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:07 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:07 mercat1 syslogd: last message repeated 38 times Mar 31 04:58:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:07 mercat1 syslogd: last message repeated 83 times Mar 31 04:58:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:08 mercat1 syslogd: last message repeated 123 times Mar 31 04:58:08 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:08 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:09 mercat1 syslogd: last message repeated 33 times Mar 31 04:58:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:09 mercat1 syslogd: last message repeated 25 times Mar 31 04:58:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:09 mercat1 syslogd: last message repeated 44 times Mar 31 04:58:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:09 mercat1 syslogd: last message repeated 14 times Mar 31 04:58:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:09 mercat1 syslogd: last message repeated 63 times Mar 31 04:58:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:09 mercat1 syslogd: last message repeated 59 times Mar 31 04:58:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:09 mercat1 syslogd: last message repeated 60 times Mar 31 04:58:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:10 mercat1 syslogd: last message repeated 62 times Mar 31 04:58:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:10 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:11 mercat1 syslogd: last message repeated 60 times Mar 31 04:58:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:11 mercat1 syslogd: last message repeated 126 times Mar 31 04:58:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:11 mercat1 syslogd: last message repeated 62 times Mar 31 04:58:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:12 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:12 mercat1 syslogd: last message repeated 60 times Mar 31 04:58:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:12 mercat1 syslogd: last message repeated 5 times Mar 31 04:58:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:12 mercat1 syslogd: last message repeated 55 times Mar 31 04:58:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:13 mercat1 syslogd: last message repeated 14 times Mar 31 04:58:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:13 mercat1 syslogd: last message repeated 46 times Mar 31 04:58:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:13 mercat1 syslogd: last message repeated 60 times Mar 31 04:58:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:13 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:14 mercat1 syslogd: last message repeated 42 times Mar 31 04:58:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:15 mercat1 syslogd: last message repeated 150 times Mar 31 04:58:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:15 mercat1 syslogd: last message repeated 52 times Mar 31 04:58:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:15 mercat1 syslogd: last message repeated 63 times Mar 31 04:58:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:15 mercat1 syslogd: last message repeated 58 times Mar 31 04:58:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:15 mercat1 syslogd: last message repeated 124 times Mar 31 04:58:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:15 mercat1 syslogd: last message repeated 64 times Mar 31 04:58:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:16 mercat1 syslogd: last message repeated 66 times Mar 31 04:58:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:16 mercat1 syslogd: last message repeated 55 times Mar 31 04:58:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:16 mercat1 syslogd: last message repeated 66 times Mar 31 04:58:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:16 mercat1 syslogd: last message repeated 56 times Mar 31 04:58:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:17 mercat1 syslogd: last message repeated 60 times Mar 31 04:58:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:17 mercat1 syslogd: last message repeated 67 times Mar 31 04:58:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:18 mercat1 syslogd: last message repeated 147 times Mar 31 04:58:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:18 mercat1 syslogd: last message repeated 97 times Mar 31 04:58:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:18 mercat1 syslogd: last message repeated 3 times Mar 31 04:58:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:18 mercat1 syslogd: last message repeated 56 times Mar 31 04:58:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:19 mercat1 syslogd: last message repeated 13 times Mar 31 04:58:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:19 mercat1 syslogd: last message repeated 47 times Mar 31 04:58:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:19 mercat1 syslogd: last message repeated 123 times Mar 31 04:58:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:19 mercat1 syslogd: last message repeated 62 times Mar 31 04:58:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:19 mercat1 syslogd: last message repeated 60 times Mar 31 04:58:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:19 mercat1 syslogd: last message repeated 63 times Mar 31 04:58:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:20 mercat1 syslogd: last message repeated 59 times Mar 31 04:58:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:20 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:20 mercat1 syslogd: last message repeated 124 times Mar 31 04:58:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:20 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:21 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:21 mercat1 syslogd: last message repeated 124 times Mar 31 04:58:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:22 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:22 mercat1 syslogd: last message repeated 125 times Mar 31 04:58:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:23 mercat1 syslogd: last message repeated 133 times Mar 31 04:58:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:24 mercat1 syslogd: last message repeated 53 times Mar 31 04:58:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:24 mercat1 syslogd: last message repeated 62 times Mar 31 04:58:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:24 mercat1 syslogd: last message repeated 62 times Mar 31 04:58:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:24 mercat1 syslogd: last message repeated 70 times Mar 31 04:58:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:25 mercat1 syslogd: last message repeated 52 times Mar 31 04:58:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:26 mercat1 syslogd: last message repeated 253 times Mar 31 04:58:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:27 mercat1 syslogd: last message repeated 312 times Mar 31 04:58:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:28 mercat1 syslogd: last message repeated 124 times Mar 31 04:58:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:29 mercat1 syslogd: last message repeated 126 times Mar 31 04:58:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:30 mercat1 syslogd: last message repeated 194 times Mar 31 04:58:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:30 mercat1 syslogd: last message repeated 55 times Mar 31 04:58:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:30 mercat1 syslogd: last message repeated 60 times Mar 31 04:58:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:30 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:31 mercat1 syslogd: last message repeated 187 times Mar 31 04:58:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:31 mercat1 syslogd: last message repeated 13 times Mar 31 04:58:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:31 mercat1 syslogd: last message repeated 46 times Mar 31 04:58:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:32 mercat1 syslogd: last message repeated 60 times Mar 31 04:58:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:33 mercat1 syslogd: last message repeated 254 times Mar 31 04:58:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:33 mercat1 syslogd: last message repeated 185 times Mar 31 04:58:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:34 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:34 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:35 mercat1 syslogd: last message repeated 123 times Mar 31 04:58:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:35 mercat1 syslogd: last message repeated 62 times Mar 31 04:58:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:35 mercat1 syslogd: last message repeated 63 times Mar 31 04:58:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:36 mercat1 syslogd: last message repeated 58 times Mar 31 04:58:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:36 mercat1 syslogd: last message repeated 8 times Mar 31 04:58:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:36 mercat1 syslogd: last message repeated 52 times Mar 31 04:58:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:37 mercat1 syslogd: last message repeated 186 times Mar 31 04:58:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:37 mercat1 syslogd: last message repeated 60 times Mar 31 04:58:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:38 mercat1 syslogd: last message repeated 251 times Mar 31 04:58:38 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:38 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:39 mercat1 syslogd: last message repeated 23 times Mar 31 04:58:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:39 mercat1 syslogd: last message repeated 36 times Mar 31 04:58:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:39 mercat1 syslogd: last message repeated 64 times Mar 31 04:58:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:39 mercat1 syslogd: last message repeated 121 times Mar 31 04:58:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:40 mercat1 syslogd: last message repeated 64 times Mar 31 04:58:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:40 mercat1 syslogd: last message repeated 58 times Mar 31 04:58:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:40 mercat1 syslogd: last message repeated 62 times Mar 31 04:58:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:41 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:41 mercat1 syslogd: last message repeated 123 times Mar 31 04:58:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:41 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:43 mercat1 syslogd: last message repeated 139 times Mar 31 04:58:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:43 mercat1 syslogd: last message repeated 111 times Mar 31 04:58:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:43 mercat1 syslogd: last message repeated 42 times Mar 31 04:58:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:43 mercat1 syslogd: last message repeated 16 times Mar 31 04:58:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:44 mercat1 syslogd: last message repeated 66 times Mar 31 04:58:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:44 mercat1 syslogd: last message repeated 57 times Mar 31 04:58:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:44 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:44 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:45 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:46 mercat1 syslogd: last message repeated 62 times Mar 31 04:58:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:46 mercat1 syslogd: last message repeated 124 times Mar 31 04:58:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:46 mercat1 syslogd: last message repeated 9 times Mar 31 04:58:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:47 mercat1 syslogd: last message repeated 49 times Mar 31 04:58:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:47 mercat1 syslogd: last message repeated 62 times Mar 31 04:58:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:47 mercat1 syslogd: last message repeated 60 times Mar 31 04:58:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:47 mercat1 syslogd: last message repeated 61 times Mar 31 04:58:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:58:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:58:47 mercat1 syslogd: last message repeated 125 times Mar 31 04:59:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:11 mercat1 syslogd: last message repeated 61 times Mar 31 04:59:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:11 mercat1 syslogd: last message repeated 16 times Mar 31 04:59:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:11 mercat1 syslogd: last message repeated 44 times Mar 31 04:59:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:11 mercat1 syslogd: last message repeated 60 times Mar 31 04:59:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:11 mercat1 syslogd: last message repeated 15 times Mar 31 04:59:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:12 mercat1 syslogd: last message repeated 109 times Mar 31 04:59:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:12 mercat1 syslogd: last message repeated 15 times Mar 31 04:59:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:12 mercat1 syslogd: last message repeated 45 times Mar 31 04:59:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:12 mercat1 syslogd: last message repeated 149 times Mar 31 04:59:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:12 mercat1 syslogd: last message repeated 100 times Mar 31 04:59:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:13 mercat1 syslogd: last message repeated 65 times Mar 31 04:59:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:13 mercat1 syslogd: last message repeated 124 times Mar 31 04:59:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:14 mercat1 syslogd: last message repeated 56 times Mar 31 04:59:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:14 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:14 mercat1 syslogd: last message repeated 60 times Mar 31 04:59:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:14 mercat1 syslogd: last message repeated 61 times Mar 31 04:59:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:14 mercat1 syslogd: last message repeated 61 times Mar 31 04:59:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:14 mercat1 syslogd: last message repeated 39 times Mar 31 04:59:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:14 mercat1 syslogd: last message repeated 20 times Mar 31 04:59:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:15 mercat1 syslogd: last message repeated 64 times Mar 31 04:59:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:15 mercat1 syslogd: last message repeated 97 times Mar 31 04:59:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:16 mercat1 syslogd: last message repeated 146 times Mar 31 04:59:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:16 mercat1 syslogd: last message repeated 45 times Mar 31 04:59:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:16 mercat1 syslogd: last message repeated 76 times Mar 31 04:59:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:16 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:17 mercat1 syslogd: last message repeated 61 times Mar 31 04:59:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:17 mercat1 syslogd: last message repeated 32 times Mar 31 04:59:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:17 mercat1 syslogd: last message repeated 92 times Mar 31 04:59:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:18 mercat1 syslogd: last message repeated 124 times Mar 31 04:59:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:18 mercat1 syslogd: last message repeated 8 times Mar 31 04:59:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:19 mercat1 syslogd: last message repeated 51 times Mar 31 04:59:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:19 mercat1 syslogd: last message repeated 61 times Mar 31 04:59:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:19 mercat1 syslogd: last message repeated 124 times Mar 31 04:59:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:20 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:20 mercat1 syslogd: last message repeated 59 times Mar 31 04:59:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:20 mercat1 syslogd: last message repeated 50 times Mar 31 04:59:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:20 mercat1 syslogd: last message repeated 8 times Mar 31 04:59:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:20 mercat1 syslogd: last message repeated 61 times Mar 31 04:59:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:21 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:22 mercat1 syslogd: last message repeated 124 times Mar 31 04:59:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:22 mercat1 syslogd: last message repeated 61 times Mar 31 04:59:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:22 mercat1 syslogd: last message repeated 66 times Mar 31 04:59:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:22 mercat1 syslogd: last message repeated 55 times Mar 31 04:59:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:23 mercat1 syslogd: last message repeated 252 times Mar 31 04:59:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:24 mercat1 syslogd: last message repeated 68 times Mar 31 04:59:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:24 mercat1 syslogd: last message repeated 115 times Mar 31 04:59:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:25 mercat1 syslogd: last message repeated 250 times Mar 31 04:59:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:25 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:26 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:26 mercat1 syslogd: last message repeated 65 times Mar 31 04:59:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:27 mercat1 syslogd: last message repeated 81 times Mar 31 04:59:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:27 mercat1 syslogd: last message repeated 37 times Mar 31 04:59:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:27 mercat1 syslogd: last message repeated 188 times Mar 31 04:59:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:27 mercat1 syslogd: last message repeated 64 times Mar 31 04:59:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:29 mercat1 syslogd: last message repeated 184 times Mar 31 04:59:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:29 mercat1 syslogd: last message repeated 10 times Mar 31 04:59:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:29 mercat1 syslogd: last message repeated 50 times Mar 31 04:59:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:29 mercat1 syslogd: last message repeated 38 times Mar 31 04:59:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:29 mercat1 syslogd: last message repeated 22 times Mar 31 04:59:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:30 mercat1 syslogd: last message repeated 61 times Mar 31 04:59:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:30 mercat1 syslogd: last message repeated 61 times Mar 31 04:59:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:31 mercat1 syslogd: last message repeated 33 times Mar 31 04:59:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:31 mercat1 syslogd: last message repeated 26 times Mar 31 04:59:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:31 mercat1 syslogd: last message repeated 44 times Mar 31 04:59:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:31 mercat1 syslogd: last message repeated 13 times Mar 31 04:59:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:31 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:31 mercat1 syslogd: last message repeated 124 times Mar 31 04:59:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:32 mercat1 syslogd: last message repeated 71 times Mar 31 04:59:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:33 mercat1 syslogd: last message repeated 185 times Mar 31 04:59:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:33 mercat1 syslogd: last message repeated 58 times Mar 31 04:59:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:33 mercat1 syslogd: last message repeated 82 times Mar 31 04:59:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:33 mercat1 syslogd: last message repeated 104 times Mar 31 04:59:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:34 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:35 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:35 mercat1 syslogd: last message repeated 67 times Mar 31 04:59:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:35 mercat1 syslogd: last message repeated 55 times Mar 31 04:59:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:35 mercat1 syslogd: last message repeated 10 times Mar 31 04:59:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:35 mercat1 syslogd: last message repeated 50 times Mar 31 04:59:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:35 mercat1 syslogd: last message repeated 63 times Mar 31 04:59:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:36 mercat1 syslogd: last message repeated 59 times Mar 31 04:59:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:36 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:36 mercat1 syslogd: last message repeated 78 times Mar 31 04:59:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:36 mercat1 syslogd: last message repeated 46 times Mar 31 04:59:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:37 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:38 mercat1 syslogd: last message repeated 43 times Mar 31 04:59:38 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:38 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:38 mercat1 syslogd: last message repeated 17 times Mar 31 04:59:38 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:38 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:38 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:39 mercat1 syslogd: last message repeated 61 times Mar 31 04:59:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:39 mercat1 syslogd: last message repeated 3 times Mar 31 04:59:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:39 mercat1 syslogd: last message repeated 55 times Mar 31 04:59:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:39 mercat1 syslogd: last message repeated 12 times Mar 31 04:59:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:40 mercat1 syslogd: last message repeated 115 times Mar 31 04:59:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:40 mercat1 syslogd: last message repeated 56 times Mar 31 04:59:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:40 mercat1 syslogd: last message repeated 60 times Mar 31 04:59:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:40 mercat1 syslogd: last message repeated 44 times Mar 31 04:59:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:40 mercat1 syslogd: last message repeated 14 times Mar 31 04:59:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:40 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:41 mercat1 syslogd: last message repeated 64 times Mar 31 04:59:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:41 mercat1 syslogd: last message repeated 59 times Mar 31 04:59:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:42 mercat1 syslogd: last message repeated 188 times Mar 31 04:59:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:42 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:42 mercat1 syslogd: last message repeated 122 times Mar 31 04:59:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:43 mercat1 syslogd: last message repeated 128 times Mar 31 04:59:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:43 mercat1 syslogd: last message repeated 59 times Mar 31 04:59:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:43 mercat1 syslogd: last message repeated 6 times Mar 31 04:59:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:44 mercat1 syslogd: last message repeated 117 times Mar 31 04:59:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:44 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:44 mercat1 syslogd: last message repeated 61 times Mar 31 04:59:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:44 mercat1 syslogd: last message repeated 64 times Mar 31 04:59:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:44 mercat1 syslogd: last message repeated 61 times Mar 31 04:59:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:45 mercat1 syslogd: last message repeated 64 times Mar 31 04:59:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:45 mercat1 syslogd: last message repeated 57 times Mar 31 04:59:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:46 mercat1 syslogd: last message repeated 61 times Mar 31 04:59:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:46 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:47 mercat1 syslogd: last message repeated 123 times Mar 31 04:59:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:47 mercat1 syslogd: last message repeated 75 times Mar 31 04:59:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:47 mercat1 syslogd: last message repeated 47 times Mar 31 04:59:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:47 mercat1 syslogd: last message repeated 63 times Mar 31 04:59:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:48 mercat1 syslogd: last message repeated 58 times Mar 31 04:59:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:48 mercat1 syslogd: last message repeated 60 times Mar 31 04:59:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:49 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:49 mercat1 syslogd: last message repeated 122 times Mar 31 04:59:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:49 mercat1 syslogd: last message repeated 124 times Mar 31 04:59:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:50 mercat1 syslogd: last message repeated 46 times Mar 31 04:59:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:50 mercat1 syslogd: last message repeated 13 times Mar 31 04:59:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:51 mercat1 syslogd: last message repeated 126 times Mar 31 04:59:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:51 mercat1 syslogd: last message repeated 60 times Mar 31 04:59:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:51 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:51 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:52 mercat1 syslogd: last message repeated 123 times Mar 31 04:59:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:52 mercat1 syslogd: last message repeated 124 times Mar 31 04:59:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:52 mercat1 syslogd: last message repeated 126 times Mar 31 04:59:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:53 mercat1 syslogd: last message repeated 57 times Mar 31 04:59:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:53 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:53 mercat1 syslogd: last message repeated 63 times Mar 31 04:59:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:54 mercat1 syslogd: last message repeated 60 times Mar 31 04:59:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:54 mercat1 syslogd: last message repeated 122 times Mar 31 04:59:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:54 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:54 mercat1 syslogd: last message repeated 129 times Mar 31 04:59:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:55 mercat1 syslogd: last message repeated 66 times Mar 31 04:59:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:55 mercat1 syslogd: last message repeated 55 times Mar 31 04:59:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:55 mercat1 syslogd: last message repeated 61 times Mar 31 04:59:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:56 mercat1 syslogd: last message repeated 133 times Mar 31 04:59:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:56 mercat1 syslogd: last message repeated 52 times Mar 31 04:59:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:56 mercat1 syslogd: last message repeated 65 times Mar 31 04:59:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:57 mercat1 syslogd: last message repeated 122 times Mar 31 04:59:57 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:57 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:57 mercat1 syslogd: last message repeated 65 times Mar 31 04:59:57 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:57 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:57 mercat1 syslogd: last message repeated 58 times Mar 31 04:59:57 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:57 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:57 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:58 mercat1 syslogd: last message repeated 62 times Mar 31 04:59:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:58 mercat1 syslogd: last message repeated 60 times Mar 31 04:59:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:58 mercat1 syslogd: last message repeated 3 times Mar 31 04:59:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:58 mercat1 syslogd: last message repeated 57 times Mar 31 04:59:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:58 mercat1 syslogd: last message repeated 9 times Mar 31 04:59:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:59 mercat1 syslogd: last message repeated 115 times Mar 31 04:59:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 04:59:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 04:59:59 mercat1 syslogd: last message repeated 61 times Mar 31 05:00:00 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:00 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:00 mercat1 syslogd: last message repeated 66 times Mar 31 05:00:00 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:00 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:00 mercat1 syslogd: last message repeated 54 times Mar 31 05:00:01 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:01 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:01 mercat1 syslogd: last message repeated 61 times Mar 31 05:00:01 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:01 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:01 mercat1 syslogd: last message repeated 63 times Mar 31 05:00:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:24 mercat1 syslogd: last message repeated 85 times Mar 31 05:00:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:24 mercat1 syslogd: last message repeated 38 times Mar 31 05:00:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:24 mercat1 syslogd: last message repeated 70 times Mar 31 05:00:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:24 mercat1 syslogd: last message repeated 51 times Mar 31 05:00:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:24 mercat1 syslogd: last message repeated 66 times Mar 31 05:00:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:24 mercat1 syslogd: last message repeated 118 times Mar 31 05:00:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:25 mercat1 syslogd: last message repeated 62 times Mar 31 05:00:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:26 mercat1 syslogd: last message repeated 125 times Mar 31 05:00:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:27 mercat1 syslogd: last message repeated 105 times Mar 31 05:00:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:27 mercat1 syslogd: last message repeated 82 times Mar 31 05:00:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:27 mercat1 syslogd: last message repeated 2 times Mar 31 05:00:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:27 mercat1 syslogd: last message repeated 58 times Mar 31 05:00:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:28 mercat1 syslogd: last message repeated 189 times Mar 31 05:00:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:28 mercat1 syslogd: last message repeated 125 times Mar 31 05:00:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:29 mercat1 syslogd: last message repeated 61 times Mar 31 05:00:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:29 mercat1 syslogd: last message repeated 61 times Mar 31 05:00:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:29 mercat1 syslogd: last message repeated 123 times Mar 31 05:00:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:30 mercat1 syslogd: last message repeated 42 times Mar 31 05:00:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:30 mercat1 syslogd: last message repeated 16 times Mar 31 05:00:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:30 mercat1 syslogd: last message repeated 61 times Mar 31 05:00:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:31 mercat1 syslogd: last message repeated 37 times Mar 31 05:00:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:31 mercat1 syslogd: last message repeated 29 times Mar 31 05:00:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:31 mercat1 syslogd: last message repeated 55 times Mar 31 05:00:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:32 mercat1 syslogd: last message repeated 60 times Mar 31 05:00:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:32 mercat1 syslogd: last message repeated 60 times Mar 31 05:00:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:32 mercat1 syslogd: last message repeated 185 times Mar 31 05:00:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:32 mercat1 syslogd: last message repeated 9 times Mar 31 05:00:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:33 mercat1 syslogd: last message repeated 50 times Mar 31 05:00:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:33 mercat1 syslogd: last message repeated 61 times Mar 31 05:00:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:34 mercat1 syslogd: last message repeated 197 times Mar 31 05:00:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:35 mercat1 syslogd: last message repeated 52 times Mar 31 05:00:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:35 mercat1 syslogd: last message repeated 60 times Mar 31 05:00:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:35 mercat1 syslogd: last message repeated 64 times Mar 31 05:00:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:36 mercat1 syslogd: last message repeated 133 times Mar 31 05:00:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:36 mercat1 syslogd: last message repeated 73 times Mar 31 05:00:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:36 mercat1 syslogd: last message repeated 40 times Mar 31 05:00:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:37 mercat1 syslogd: last message repeated 64 times Mar 31 05:00:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:38 mercat1 syslogd: last message repeated 192 times Mar 31 05:00:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:39 mercat1 syslogd: last message repeated 55 times Mar 31 05:00:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:39 mercat1 syslogd: last message repeated 61 times Mar 31 05:00:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:39 mercat1 syslogd: last message repeated 62 times Mar 31 05:00:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:40 mercat1 syslogd: last message repeated 124 times Mar 31 05:00:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:40 mercat1 syslogd: last message repeated 67 times Mar 31 05:00:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:40 mercat1 syslogd: last message repeated 55 times Mar 31 05:00:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:40 mercat1 syslogd: last message repeated 7 times Mar 31 05:00:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:41 mercat1 syslogd: last message repeated 53 times Mar 31 05:00:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:41 mercat1 syslogd: last message repeated 62 times Mar 31 05:00:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:41 mercat1 syslogd: last message repeated 60 times Mar 31 05:00:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:41 mercat1 syslogd: last message repeated 30 times Mar 31 05:00:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:41 mercat1 syslogd: last message repeated 30 times Mar 31 05:00:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:41 mercat1 syslogd: last message repeated 18 times Mar 31 05:00:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:41 mercat1 syslogd: last message repeated 41 times Mar 31 05:00:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:42 mercat1 syslogd: last message repeated 61 times Mar 31 05:00:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:42 mercat1 syslogd: last message repeated 65 times Mar 31 05:00:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:42 mercat1 syslogd: last message repeated 59 times Mar 31 05:00:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:42 mercat1 syslogd: last message repeated 62 times Mar 31 05:00:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:42 mercat1 syslogd: last message repeated 62 times Mar 31 05:00:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:43 mercat1 syslogd: last message repeated 61 times Mar 31 05:00:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:43 mercat1 syslogd: last message repeated 61 times Mar 31 05:00:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:43 mercat1 syslogd: last message repeated 66 times Mar 31 05:00:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:44 mercat1 syslogd: last message repeated 54 times Mar 31 05:00:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:44 mercat1 syslogd: last message repeated 13 times Mar 31 05:00:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:44 mercat1 syslogd: last message repeated 46 times Mar 31 05:00:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:44 mercat1 syslogd: last message repeated 61 times Mar 31 05:00:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:45 mercat1 syslogd: last message repeated 122 times Mar 31 05:00:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:45 mercat1 syslogd: last message repeated 20 times Mar 31 05:00:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:45 mercat1 syslogd: last message repeated 38 times Mar 31 05:00:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:45 mercat1 syslogd: last message repeated 61 times Mar 31 05:00:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:46 mercat1 syslogd: last message repeated 62 times Mar 31 05:00:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:46 mercat1 syslogd: last message repeated 61 times Mar 31 05:00:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:46 mercat1 syslogd: last message repeated 65 times Mar 31 05:00:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:47 mercat1 syslogd: last message repeated 58 times Mar 31 05:00:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:47 mercat1 syslogd: last message repeated 60 times Mar 31 05:00:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:47 mercat1 syslogd: last message repeated 39 times Mar 31 05:00:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:47 mercat1 syslogd: last message repeated 21 times Mar 31 05:00:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:48 mercat1 syslogd: last message repeated 62 times Mar 31 05:00:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:48 mercat1 syslogd: last message repeated 63 times Mar 31 05:00:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:49 mercat1 syslogd: last message repeated 59 times Mar 31 05:00:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:49 mercat1 syslogd: last message repeated 7 times Mar 31 05:00:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:49 mercat1 syslogd: last message repeated 116 times Mar 31 05:00:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:49 mercat1 syslogd: last message repeated 19 times Mar 31 05:00:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:50 mercat1 syslogd: last message repeated 167 times Mar 31 05:00:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:50 mercat1 syslogd: last message repeated 60 times Mar 31 05:00:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:50 mercat1 syslogd: last message repeated 8 times Mar 31 05:00:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:51 mercat1 syslogd: last message repeated 51 times Mar 31 05:00:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:51 mercat1 syslogd: last message repeated 123 times Mar 31 05:00:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:51 mercat1 syslogd: last message repeated 61 times Mar 31 05:00:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:51 mercat1 syslogd: last message repeated 62 times Mar 31 05:00:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:51 mercat1 syslogd: last message repeated 64 times Mar 31 05:00:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:51 mercat1 syslogd: last message repeated 56 times Mar 31 05:00:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:52 mercat1 syslogd: last message repeated 60 times Mar 31 05:00:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:52 mercat1 syslogd: last message repeated 62 times Mar 31 05:00:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:52 mercat1 syslogd: last message repeated 66 times Mar 31 05:00:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:52 mercat1 syslogd: last message repeated 58 times Mar 31 05:00:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:52 mercat1 syslogd: last message repeated 60 times Mar 31 05:00:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:53 mercat1 syslogd: last message repeated 29 times Mar 31 05:00:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:53 mercat1 syslogd: last message repeated 31 times Mar 31 05:00:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:53 mercat1 syslogd: last message repeated 61 times Mar 31 05:00:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:54 mercat1 syslogd: last message repeated 124 times Mar 31 05:00:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:54 mercat1 syslogd: last message repeated 252 times Mar 31 05:00:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:55 mercat1 syslogd: last message repeated 126 times Mar 31 05:00:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:55 mercat1 syslogd: last message repeated 63 times Mar 31 05:00:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:56 mercat1 syslogd: last message repeated 65 times Mar 31 05:00:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:56 mercat1 syslogd: last message repeated 56 times Mar 31 05:00:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:56 mercat1 syslogd: last message repeated 8 times Mar 31 05:00:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:56 mercat1 syslogd: last message repeated 114 times Mar 31 05:00:57 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:57 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:57 mercat1 syslogd: last message repeated 62 times Mar 31 05:00:57 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:57 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:57 mercat1 syslogd: last message repeated 62 times Mar 31 05:00:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:58 mercat1 syslogd: last message repeated 63 times Mar 31 05:00:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:58 mercat1 syslogd: last message repeated 63 times Mar 31 05:00:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:59 mercat1 syslogd: last message repeated 57 times Mar 31 05:00:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:59 mercat1 syslogd: last message repeated 60 times Mar 31 05:00:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:59 mercat1 syslogd: last message repeated 124 times Mar 31 05:00:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:00:59 mercat1 syslogd: last message repeated 61 times Mar 31 05:00:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:00:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:00 mercat1 syslogd: last message repeated 132 times Mar 31 05:01:00 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:00 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:00 mercat1 syslogd: last message repeated 54 times Mar 31 05:01:00 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:00 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:01 mercat1 syslogd: last message repeated 34 times Mar 31 05:01:01 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:01 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:01 mercat1 syslogd: last message repeated 89 times Mar 31 05:01:01 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:01 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:02 mercat1 syslogd: last message repeated 138 times Mar 31 05:01:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:02 mercat1 syslogd: last message repeated 110 times Mar 31 05:01:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:03 mercat1 syslogd: last message repeated 65 times Mar 31 05:01:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:03 mercat1 syslogd: last message repeated 58 times Mar 31 05:01:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:03 mercat1 syslogd: last message repeated 194 times Mar 31 05:01:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:04 mercat1 syslogd: last message repeated 180 times Mar 31 05:01:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:04 mercat1 syslogd: last message repeated 8 times Mar 31 05:01:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:05 mercat1 syslogd: last message repeated 52 times Mar 31 05:01:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:05 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:05 mercat1 syslogd: last message repeated 126 times Mar 31 05:01:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:05 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:05 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:06 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:06 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:06 mercat1 syslogd: last message repeated 60 times Mar 31 05:01:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:06 mercat1 syslogd: last message repeated 60 times Mar 31 05:01:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:06 mercat1 syslogd: last message repeated 10 times Mar 31 05:01:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:07 mercat1 syslogd: last message repeated 48 times Mar 31 05:01:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:07 mercat1 syslogd: last message repeated 60 times Mar 31 05:01:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:08 mercat1 syslogd: last message repeated 15 times Mar 31 05:01:08 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:08 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:08 mercat1 syslogd: last message repeated 45 times Mar 31 05:01:08 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:08 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:09 mercat1 syslogd: last message repeated 188 times Mar 31 05:01:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:09 mercat1 syslogd: last message repeated 5 times Mar 31 05:01:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:09 mercat1 syslogd: last message repeated 53 times Mar 31 05:01:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:10 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:10 mercat1 syslogd: last message repeated 60 times Mar 31 05:01:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:10 mercat1 syslogd: last message repeated 63 times Mar 31 05:01:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:11 mercat1 syslogd: last message repeated 65 times Mar 31 05:01:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:11 mercat1 syslogd: last message repeated 55 times Mar 31 05:01:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:11 mercat1 syslogd: last message repeated 10 times Mar 31 05:01:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:11 mercat1 syslogd: last message repeated 50 times Mar 31 05:01:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:12 mercat1 syslogd: last message repeated 60 times Mar 31 05:01:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:12 mercat1 syslogd: last message repeated 63 times Mar 31 05:01:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:13 mercat1 syslogd: last message repeated 59 times Mar 31 05:01:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:13 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:14 mercat1 syslogd: last message repeated 41 times Mar 31 05:01:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:14 mercat1 syslogd: last message repeated 35 times Mar 31 05:01:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:15 mercat1 syslogd: last message repeated 176 times Mar 31 05:01:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:15 mercat1 syslogd: last message repeated 57 times Mar 31 05:01:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:15 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:16 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:16 mercat1 syslogd: last message repeated 28 times Mar 31 05:01:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:17 mercat1 syslogd: last message repeated 45 times Mar 31 05:01:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:17 mercat1 syslogd: last message repeated 47 times Mar 31 05:01:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:17 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:17 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:17 mercat1 syslogd: last message repeated 7 times Mar 31 05:01:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:18 mercat1 syslogd: last message repeated 120 times Mar 31 05:01:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:18 mercat1 syslogd: last message repeated 56 times Mar 31 05:01:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:19 mercat1 syslogd: last message repeated 124 times Mar 31 05:01:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:19 mercat1 syslogd: last message repeated 100 times Mar 31 05:01:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:19 mercat1 syslogd: last message repeated 23 times Mar 31 05:01:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:20 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:21 mercat1 syslogd: last message repeated 376 times Mar 31 05:01:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:21 mercat1 syslogd: last message repeated 125 times Mar 31 05:01:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:21 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:22 mercat1 syslogd: last message repeated 124 times Mar 31 05:01:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:22 mercat1 syslogd: last message repeated 60 times Mar 31 05:01:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:22 mercat1 syslogd: last message repeated 60 times Mar 31 05:01:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:23 mercat1 syslogd: last message repeated 60 times Mar 31 05:01:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:23 mercat1 syslogd: last message repeated 24 times Mar 31 05:01:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:24 mercat1 syslogd: last message repeated 104 times Mar 31 05:01:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:24 mercat1 syslogd: last message repeated 54 times Mar 31 05:01:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:24 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:25 mercat1 syslogd: last message repeated 39 times Mar 31 05:01:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:25 mercat1 syslogd: last message repeated 19 times Mar 31 05:01:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:25 mercat1 syslogd: last message repeated 60 times Mar 31 05:01:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:25 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:26 mercat1 syslogd: last message repeated 60 times Mar 31 05:01:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:26 mercat1 syslogd: last message repeated 129 times Mar 31 05:01:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:26 mercat1 syslogd: last message repeated 58 times Mar 31 05:01:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:27 mercat1 syslogd: last message repeated 65 times Mar 31 05:01:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:27 mercat1 syslogd: last message repeated 67 times Mar 31 05:01:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:28 mercat1 syslogd: last message repeated 53 times Mar 31 05:01:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:28 mercat1 syslogd: last message repeated 13 times Mar 31 05:01:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:28 mercat1 syslogd: last message repeated 47 times Mar 31 05:01:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:28 mercat1 syslogd: last message repeated 29 times Mar 31 05:01:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:28 mercat1 syslogd: last message repeated 31 times Mar 31 05:01:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:29 mercat1 syslogd: last message repeated 132 times Mar 31 05:01:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:29 mercat1 syslogd: last message repeated 53 times Mar 31 05:01:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:29 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:30 mercat1 syslogd: last message repeated 66 times Mar 31 05:01:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:30 mercat1 syslogd: last message repeated 56 times Mar 31 05:01:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:30 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:30 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:30 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:31 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:32 mercat1 syslogd: last message repeated 128 times Mar 31 05:01:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:32 mercat1 syslogd: last message repeated 57 times Mar 31 05:01:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:32 mercat1 syslogd: last message repeated 125 times Mar 31 05:01:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:32 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:33 mercat1 syslogd: last message repeated 59 times Mar 31 05:01:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:33 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:33 mercat1 syslogd: last message repeated 60 times Mar 31 05:01:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:33 mercat1 syslogd: last message repeated 63 times Mar 31 05:01:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:34 mercat1 syslogd: last message repeated 67 times Mar 31 05:01:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:34 mercat1 syslogd: last message repeated 118 times Mar 31 05:01:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:34 mercat1 syslogd: last message repeated 63 times Mar 31 05:01:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:35 mercat1 syslogd: last message repeated 60 times Mar 31 05:01:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:35 mercat1 syslogd: last message repeated 77 times Mar 31 05:01:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:35 mercat1 syslogd: last message repeated 46 times Mar 31 05:01:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:35 mercat1 syslogd: last message repeated 60 times Mar 31 05:01:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:35 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:35 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:35 mercat1 syslogd: last message repeated 60 times Mar 31 05:01:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:35 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:36 mercat1 syslogd: last message repeated 189 times Mar 31 05:01:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:36 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:37 mercat1 syslogd: last message repeated 71 times Mar 31 05:01:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:37 mercat1 syslogd: last message repeated 51 times Mar 31 05:01:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:38 mercat1 syslogd: last message repeated 125 times Mar 31 05:01:38 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:38 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:38 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:38 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:38 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:38 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:38 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:38 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:39 mercat1 syslogd: last message repeated 76 times Mar 31 05:01:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:39 mercat1 syslogd: last message repeated 47 times Mar 31 05:01:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:39 mercat1 syslogd: last message repeated 125 times Mar 31 05:01:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:39 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:39 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:40 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:40 mercat1 syslogd: last message repeated 34 times Mar 31 05:01:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:40 mercat1 syslogd: last message repeated 26 times Mar 31 05:01:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:41 mercat1 syslogd: last message repeated 65 times Mar 31 05:01:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:41 mercat1 syslogd: last message repeated 59 times Mar 31 05:01:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:41 mercat1 syslogd: last message repeated 8 times Mar 31 05:01:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:41 mercat1 syslogd: last message repeated 51 times Mar 31 05:01:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:41 mercat1 syslogd: last message repeated 123 times Mar 31 05:01:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:42 mercat1 syslogd: last message repeated 67 times Mar 31 05:01:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:43 mercat1 syslogd: last message repeated 183 times Mar 31 05:01:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:44 mercat1 syslogd: last message repeated 189 times Mar 31 05:01:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:44 mercat1 syslogd: last message repeated 64 times Mar 31 05:01:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:44 mercat1 syslogd: last message repeated 121 times Mar 31 05:01:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:44 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:45 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:45 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:46 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:46 mercat1 syslogd: last message repeated 43 times Mar 31 05:01:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:46 mercat1 syslogd: last message repeated 82 times Mar 31 05:01:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:46 mercat1 syslogd: last message repeated 58 times Mar 31 05:01:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:46 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:46 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:46 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:47 mercat1 syslogd: last message repeated 126 times Mar 31 05:01:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:47 mercat1 syslogd: last message repeated 68 times Mar 31 05:01:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:47 mercat1 syslogd: last message repeated 53 times Mar 31 05:01:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:47 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:47 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:48 mercat1 syslogd: last message repeated 66 times Mar 31 05:01:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:48 mercat1 syslogd: last message repeated 57 times Mar 31 05:01:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:48 mercat1 syslogd: last message repeated 10 times Mar 31 05:01:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:49 mercat1 syslogd: last message repeated 113 times Mar 31 05:01:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:49 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:50 mercat1 syslogd: last message repeated 128 times Mar 31 05:01:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:50 mercat1 syslogd: last message repeated 59 times Mar 31 05:01:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:50 mercat1 syslogd: last message repeated 7 times Mar 31 05:01:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:50 mercat1 syslogd: last message repeated 52 times Mar 31 05:01:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:51 mercat1 syslogd: last message repeated 68 times Mar 31 05:01:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:51 mercat1 syslogd: last message repeated 66 times Mar 31 05:01:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:51 mercat1 syslogd: last message repeated 52 times Mar 31 05:01:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:51 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:52 mercat1 syslogd: last message repeated 129 times Mar 31 05:01:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:52 mercat1 syslogd: last message repeated 55 times Mar 31 05:01:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:52 mercat1 syslogd: last message repeated 64 times Mar 31 05:01:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:53 mercat1 syslogd: last message repeated 56 times Mar 31 05:01:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:53 mercat1 syslogd: last message repeated 9 times Mar 31 05:01:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:53 mercat1 syslogd: last message repeated 51 times Mar 31 05:01:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:53 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:54 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:54 mercat1 syslogd: last message repeated 45 times Mar 31 05:01:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:54 mercat1 syslogd: last message repeated 13 times Mar 31 05:01:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:54 mercat1 syslogd: last message repeated 65 times Mar 31 05:01:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:55 mercat1 syslogd: last message repeated 57 times Mar 31 05:01:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:55 mercat1 syslogd: last message repeated 63 times Mar 31 05:01:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:56 mercat1 syslogd: last message repeated 125 times Mar 31 05:01:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:57 mercat1 syslogd: last message repeated 191 times Mar 31 05:01:57 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:57 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:57 mercat1 syslogd: last message repeated 58 times Mar 31 05:01:57 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:57 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:58 mercat1 syslogd: last message repeated 143 times Mar 31 05:01:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:58 mercat1 syslogd: last message repeated 42 times Mar 31 05:01:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:58 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:58 mercat1 syslogd: last message repeated 65 times Mar 31 05:01:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:58 mercat1 syslogd: last message repeated 57 times Mar 31 05:01:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:58 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:58 mercat1 syslogd: last message repeated 60 times Mar 31 05:01:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:59 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:59 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:59 mercat1 syslogd: last message repeated 62 times Mar 31 05:01:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:59 mercat1 syslogd: last message repeated 124 times Mar 31 05:01:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:01:59 mercat1 syslogd: last message repeated 61 times Mar 31 05:01:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:01:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:01 mercat1 syslogd: last message repeated 185 times Mar 31 05:02:01 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:01 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:01 mercat1 syslogd: last message repeated 124 times Mar 31 05:02:01 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:01 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:01 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:02 mercat1 syslogd: last message repeated 59 times Mar 31 05:02:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:02 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:02 mercat1 syslogd: last message repeated 187 times Mar 31 05:02:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:03 mercat1 syslogd: last message repeated 60 times Mar 31 05:02:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:03 mercat1 syslogd: last message repeated 3 times Mar 31 05:02:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:03 mercat1 syslogd: last message repeated 57 times Mar 31 05:02:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:03 mercat1 syslogd: last message repeated 8 times Mar 31 05:02:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:04 mercat1 syslogd: last message repeated 50 times Mar 31 05:02:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:04 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:04 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:05 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:05 mercat1 syslogd: last message repeated 64 times Mar 31 05:02:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:05 mercat1 syslogd: last message repeated 120 times Mar 31 05:02:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:06 mercat1 syslogd: last message repeated 30 times Mar 31 05:02:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:06 mercat1 syslogd: last message repeated 30 times Mar 31 05:02:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:07 mercat1 syslogd: last message repeated 124 times Mar 31 05:02:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:07 mercat1 syslogd: last message repeated 64 times Mar 31 05:02:08 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:08 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:08 mercat1 syslogd: last message repeated 121 times Mar 31 05:02:08 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:08 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:08 mercat1 syslogd: last message repeated 10 times Mar 31 05:02:08 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:08 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:09 mercat1 syslogd: last message repeated 175 times Mar 31 05:02:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:09 mercat1 syslogd: last message repeated 124 times Mar 31 05:02:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:09 mercat1 syslogd: last message repeated 67 times Mar 31 05:02:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:10 mercat1 syslogd: last message repeated 55 times Mar 31 05:02:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:10 mercat1 syslogd: last message repeated 130 times Mar 31 05:02:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:10 mercat1 syslogd: last message repeated 56 times Mar 31 05:02:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:10 mercat1 syslogd: last message repeated 10 times Mar 31 05:02:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:10 mercat1 syslogd: last message repeated 50 times Mar 31 05:02:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:12 mercat1 syslogd: last message repeated 84 times Mar 31 05:02:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:12 mercat1 syslogd: last message repeated 38 times Mar 31 05:02:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:12 mercat1 syslogd: last message repeated 129 times Mar 31 05:02:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:12 mercat1 syslogd: last message repeated 56 times Mar 31 05:02:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:12 mercat1 syslogd: last message repeated 60 times Mar 31 05:02:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:12 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:13 mercat1 syslogd: last message repeated 10 times Mar 31 05:02:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:13 mercat1 syslogd: last message repeated 49 times Mar 31 05:02:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:13 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:13 mercat1 syslogd: last message repeated 63 times Mar 31 05:02:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:13 mercat1 syslogd: last message repeated 57 times Mar 31 05:02:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:14 mercat1 syslogd: last message repeated 26 times Mar 31 05:02:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:14 mercat1 syslogd: last message repeated 32 times Mar 31 05:02:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:14 mercat1 syslogd: last message repeated 60 times Mar 31 05:02:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:14 mercat1 syslogd: last message repeated 60 times Mar 31 05:02:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:14 mercat1 syslogd: last message repeated 2 times Mar 31 05:02:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:15 mercat1 syslogd: last message repeated 56 times Mar 31 05:02:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:15 mercat1 syslogd: last message repeated 186 times Mar 31 05:02:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:16 mercat1 syslogd: last message repeated 69 times Mar 31 05:02:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:17 mercat1 syslogd: last message repeated 54 times Mar 31 05:02:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:17 mercat1 syslogd: last message repeated 13 times Mar 31 05:02:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:17 mercat1 syslogd: last message repeated 51 times Mar 31 05:02:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:17 mercat1 syslogd: last message repeated 67 times Mar 31 05:02:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:18 mercat1 syslogd: last message repeated 52 times Mar 31 05:02:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:18 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:18 mercat1 syslogd: last message repeated 186 times Mar 31 05:02:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:18 mercat1 syslogd: last message repeated 126 times Mar 31 05:02:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:19 mercat1 syslogd: last message repeated 58 times Mar 31 05:02:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:19 mercat1 syslogd: last message repeated 10 times Mar 31 05:02:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:19 mercat1 syslogd: last message repeated 112 times Mar 31 05:02:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:19 mercat1 syslogd: last message repeated 14 times Mar 31 05:02:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:19 mercat1 syslogd: last message repeated 46 times Mar 31 05:02:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:19 mercat1 syslogd: last message repeated 60 times Mar 31 05:02:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:20 mercat1 syslogd: last message repeated 185 times Mar 31 05:02:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:20 mercat1 syslogd: last message repeated 122 times Mar 31 05:02:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:21 mercat1 syslogd: last message repeated 41 times Mar 31 05:02:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:21 mercat1 syslogd: last message repeated 19 times Mar 31 05:02:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:21 mercat1 syslogd: last message repeated 19 times Mar 31 05:02:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:21 mercat1 syslogd: last message repeated 50 times Mar 31 05:02:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:22 mercat1 syslogd: last message repeated 241 times Mar 31 05:02:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:23 mercat1 syslogd: last message repeated 124 times Mar 31 05:02:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:23 mercat1 syslogd: last message repeated 64 times Mar 31 05:02:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:23 mercat1 syslogd: last message repeated 66 times Mar 31 05:02:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:23 mercat1 syslogd: last message repeated 55 times Mar 31 05:02:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:23 mercat1 syslogd: last message repeated 12 times Mar 31 05:02:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:24 mercat1 syslogd: last message repeated 48 times Mar 31 05:02:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:24 mercat1 syslogd: last message repeated 124 times Mar 31 05:02:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:24 mercat1 syslogd: last message repeated 253 times Mar 31 05:02:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:26 mercat1 syslogd: last message repeated 255 times Mar 31 05:02:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:26 mercat1 syslogd: last message repeated 111 times Mar 31 05:02:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:26 mercat1 syslogd: last message repeated 5 times Mar 31 05:02:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:26 mercat1 syslogd: last message repeated 54 times Mar 31 05:02:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:27 mercat1 syslogd: last message repeated 65 times Mar 31 05:02:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:27 mercat1 syslogd: last message repeated 58 times Mar 31 05:02:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:27 mercat1 syslogd: last message repeated 125 times Mar 31 05:02:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:28 mercat1 syslogd: last message repeated 65 times Mar 31 05:02:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:28 mercat1 syslogd: last message repeated 59 times Mar 31 05:02:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:28 mercat1 syslogd: last message repeated 5 times Mar 31 05:02:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:28 mercat1 syslogd: last message repeated 116 times Mar 31 05:02:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:29 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:29 mercat1 syslogd: last message repeated 126 times Mar 31 05:02:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:29 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:30 mercat1 syslogd: last message repeated 60 times Mar 31 05:02:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:30 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:30 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:30 mercat1 syslogd: last message repeated 29 times Mar 31 05:02:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:31 mercat1 syslogd: last message repeated 284 times Mar 31 05:02:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:31 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:32 mercat1 syslogd: last message repeated 124 times Mar 31 05:02:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:32 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:32 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:33 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:33 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:33 mercat1 syslogd: last message repeated 60 times Mar 31 05:02:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:33 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:33 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:34 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:34 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:34 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:34 mercat1 syslogd: last message repeated 9 times Mar 31 05:02:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:35 mercat1 syslogd: last message repeated 50 times Mar 31 05:02:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:35 mercat1 syslogd: last message repeated 40 times Mar 31 05:02:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:35 mercat1 syslogd: last message repeated 32 times Mar 31 05:02:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:36 mercat1 syslogd: last message repeated 50 times Mar 31 05:02:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:36 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:36 mercat1 syslogd: last message repeated 2 times Mar 31 05:02:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:36 mercat1 syslogd: last message repeated 56 times Mar 31 05:02:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:36 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:36 mercat1 syslogd: last message repeated 77 times Mar 31 05:02:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:36 mercat1 syslogd: last message repeated 46 times Mar 31 05:02:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:36 mercat1 syslogd: last message repeated 60 times Mar 31 05:02:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:37 mercat1 syslogd: last message repeated 124 times Mar 31 05:02:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:39 mercat1 syslogd: last message repeated 127 times Mar 31 05:02:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:39 mercat1 syslogd: last message repeated 57 times Mar 31 05:02:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:39 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:39 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:39 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:39 mercat1 syslogd: last message repeated 42 times Mar 31 05:02:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:39 mercat1 syslogd: last message repeated 16 times Mar 31 05:02:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:39 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:39 mercat1 syslogd: last message repeated 63 times Mar 31 05:02:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:40 mercat1 syslogd: last message repeated 60 times Mar 31 05:02:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:40 mercat1 syslogd: last message repeated 63 times Mar 31 05:02:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:40 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:40 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:41 mercat1 syslogd: last message repeated 125 times Mar 31 05:02:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:42 mercat1 syslogd: last message repeated 60 times Mar 31 05:02:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:42 mercat1 syslogd: last message repeated 35 times Mar 31 05:02:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:42 mercat1 syslogd: last message repeated 25 times Mar 31 05:02:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:42 mercat1 syslogd: last message repeated 125 times Mar 31 05:02:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:42 mercat1 syslogd: last message repeated 3 times Mar 31 05:02:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:44 mercat1 syslogd: last message repeated 82 times Mar 31 05:02:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:44 mercat1 syslogd: last message repeated 164 times Mar 31 05:02:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:44 mercat1 syslogd: last message repeated 125 times Mar 31 05:02:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:45 mercat1 syslogd: last message repeated 67 times Mar 31 05:02:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:45 mercat1 syslogd: last message repeated 54 times Mar 31 05:02:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:46 mercat1 syslogd: last message repeated 92 times Mar 31 05:02:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:46 mercat1 syslogd: last message repeated 30 times Mar 31 05:02:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:46 mercat1 syslogd: last message repeated 66 times Mar 31 05:02:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:47 mercat1 syslogd: last message repeated 56 times Mar 31 05:02:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:47 mercat1 syslogd: last message repeated 9 times Mar 31 05:02:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:47 mercat1 syslogd: last message repeated 112 times Mar 31 05:02:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:47 mercat1 syslogd: last message repeated 66 times Mar 31 05:02:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:47 mercat1 syslogd: last message repeated 55 times Mar 31 05:02:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:47 mercat1 syslogd: last message repeated 8 times Mar 31 05:02:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:48 mercat1 syslogd: last message repeated 51 times Mar 31 05:02:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:48 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:48 mercat1 syslogd: last message repeated 125 times Mar 31 05:02:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:49 mercat1 syslogd: last message repeated 126 times Mar 31 05:02:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:49 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:49 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:49 mercat1 syslogd: last message repeated 64 times Mar 31 05:02:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:50 mercat1 syslogd: last message repeated 65 times Mar 31 05:02:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:50 mercat1 syslogd: last message repeated 55 times Mar 31 05:02:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:50 mercat1 syslogd: last message repeated 60 times Mar 31 05:02:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:51 mercat1 syslogd: last message repeated 60 times Mar 31 05:02:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:51 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:51 mercat1 syslogd: last message repeated 11 times Mar 31 05:02:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:51 mercat1 syslogd: last message repeated 49 times Mar 31 05:02:51 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:51 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:52 mercat1 syslogd: last message repeated 30 times Mar 31 05:02:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:52 mercat1 syslogd: last message repeated 29 times Mar 31 05:02:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:52 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:53 mercat1 syslogd: last message repeated 188 times Mar 31 05:02:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:53 mercat1 syslogd: last message repeated 59 times Mar 31 05:02:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:54 mercat1 syslogd: last message repeated 60 times Mar 31 05:02:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:54 mercat1 syslogd: last message repeated 125 times Mar 31 05:02:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:54 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:54 mercat1 syslogd: last message repeated 60 times Mar 31 05:02:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:54 mercat1 syslogd: last message repeated 124 times Mar 31 05:02:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:55 mercat1 syslogd: last message repeated 66 times Mar 31 05:02:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:55 mercat1 syslogd: last message repeated 54 times Mar 31 05:02:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:55 mercat1 syslogd: last message repeated 62 times Mar 31 05:02:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:56 mercat1 syslogd: last message repeated 123 times Mar 31 05:02:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:56 mercat1 syslogd: last message repeated 60 times Mar 31 05:02:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:56 mercat1 syslogd: last message repeated 125 times Mar 31 05:02:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:56 mercat1 syslogd: last message repeated 59 times Mar 31 05:02:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:56 mercat1 syslogd: last message repeated 60 times Mar 31 05:02:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:57 mercat1 syslogd: last message repeated 37 times Mar 31 05:02:57 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:57 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:58 mercat1 syslogd: last message repeated 108 times Mar 31 05:02:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:58 mercat1 syslogd: last message repeated 40 times Mar 31 05:02:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:58 mercat1 syslogd: last message repeated 61 times Mar 31 05:02:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:58 mercat1 syslogd: last message repeated 60 times Mar 31 05:02:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:59 mercat1 syslogd: last message repeated 67 times Mar 31 05:02:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:02:59 mercat1 syslogd: last message repeated 54 times Mar 31 05:02:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:02:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:00 mercat1 syslogd: last message repeated 122 times Mar 31 05:03:00 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:00 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:00 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:00 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:00 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:00 mercat1 syslogd: last message repeated 60 times Mar 31 05:03:00 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:00 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:00 mercat1 syslogd: last message repeated 60 times Mar 31 05:03:00 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:00 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:00 mercat1 syslogd: last message repeated 60 times Mar 31 05:03:00 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:00 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:01 mercat1 syslogd: last message repeated 43 times Mar 31 05:03:01 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:01 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:01 mercat1 syslogd: last message repeated 32 times Mar 31 05:03:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:02 mercat1 syslogd: last message repeated 45 times Mar 31 05:03:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:03 mercat1 syslogd: last message repeated 185 times Mar 31 05:03:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:03 mercat1 syslogd: last message repeated 186 times Mar 31 05:03:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:04 mercat1 syslogd: last message repeated 65 times Mar 31 05:03:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:04 mercat1 syslogd: last message repeated 57 times Mar 31 05:03:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:04 mercat1 syslogd: last message repeated 8 times Mar 31 05:03:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:04 mercat1 syslogd: last message repeated 50 times Mar 31 05:03:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:04 mercat1 syslogd: last message repeated 60 times Mar 31 05:03:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:04 mercat1 syslogd: last message repeated 60 times Mar 31 05:03:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:05 mercat1 syslogd: last message repeated 24 times Mar 31 05:03:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:05 mercat1 syslogd: last message repeated 98 times Mar 31 05:03:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:06 mercat1 syslogd: last message repeated 61 times Mar 31 05:03:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:06 mercat1 syslogd: last message repeated 61 times Mar 31 05:03:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:07 mercat1 syslogd: last message repeated 28 times Mar 31 05:03:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:07 mercat1 syslogd: last message repeated 96 times Mar 31 05:03:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:07 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:08 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:08 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:08 mercat1 syslogd: last message repeated 250 times Mar 31 05:03:08 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:08 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:08 mercat1 syslogd: last message repeated 9 times Mar 31 05:03:08 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:08 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:08 mercat1 syslogd: last message repeated 51 times Mar 31 05:03:08 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:08 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:10 mercat1 syslogd: last message repeated 310 times Mar 31 05:03:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:10 mercat1 syslogd: last message repeated 18 times Mar 31 05:03:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:10 mercat1 syslogd: last message repeated 42 times Mar 31 05:03:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:11 mercat1 syslogd: last message repeated 314 times Mar 31 05:03:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:12 mercat1 syslogd: last message repeated 41 times Mar 31 05:03:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:12 mercat1 syslogd: last message repeated 19 times Mar 31 05:03:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:12 mercat1 syslogd: last message repeated 116 times Mar 31 05:03:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:13 mercat1 syslogd: last message repeated 69 times Mar 31 05:03:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:13 mercat1 syslogd: last message repeated 122 times Mar 31 05:03:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:14 mercat1 syslogd: last message repeated 7 times Mar 31 05:03:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:14 mercat1 syslogd: last message repeated 53 times Mar 31 05:03:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:14 mercat1 syslogd: last message repeated 66 times Mar 31 05:03:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:14 mercat1 syslogd: last message repeated 70 times Mar 31 05:03:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:14 mercat1 syslogd: last message repeated 44 times Mar 31 05:03:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:14 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:15 mercat1 syslogd: last message repeated 133 times Mar 31 05:03:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:16 mercat1 syslogd: last message repeated 117 times Mar 31 05:03:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:16 mercat1 syslogd: last message repeated 187 times Mar 31 05:03:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:17 mercat1 syslogd: last message repeated 45 times Mar 31 05:03:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:17 mercat1 syslogd: last message repeated 14 times Mar 31 05:03:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:17 mercat1 syslogd: last message repeated 39 times Mar 31 05:03:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:17 mercat1 syslogd: last message repeated 20 times Mar 31 05:03:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:17 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:18 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:18 mercat1 syslogd: last message repeated 69 times Mar 31 05:03:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:18 mercat1 syslogd: last message repeated 114 times Mar 31 05:03:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:19 mercat1 syslogd: last message repeated 131 times Mar 31 05:03:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:19 mercat1 syslogd: last message repeated 57 times Mar 31 05:03:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:19 mercat1 syslogd: last message repeated 61 times Mar 31 05:03:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:20 mercat1 syslogd: last message repeated 61 times Mar 31 05:03:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:20 mercat1 syslogd: last message repeated 65 times Mar 31 05:03:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:20 mercat1 syslogd: last message repeated 56 times Mar 31 05:03:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:20 mercat1 syslogd: last message repeated 130 times Mar 31 05:03:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:21 mercat1 syslogd: last message repeated 57 times Mar 31 05:03:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:21 mercat1 syslogd: last message repeated 63 times Mar 31 05:03:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:21 mercat1 syslogd: last message repeated 68 times Mar 31 05:03:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:21 mercat1 syslogd: last message repeated 52 times Mar 31 05:03:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:22 mercat1 syslogd: last message repeated 131 times Mar 31 05:03:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:23 mercat1 syslogd: last message repeated 118 times Mar 31 05:03:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:23 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:23 mercat1 syslogd: last message repeated 61 times Mar 31 05:03:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:24 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:24 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:24 mercat1 syslogd: last message repeated 123 times Mar 31 05:03:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:24 mercat1 syslogd: last message repeated 8 times Mar 31 05:03:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:25 mercat1 syslogd: last message repeated 114 times Mar 31 05:03:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:25 mercat1 syslogd: last message repeated 20 times Mar 31 05:03:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:26 mercat1 syslogd: last message repeated 165 times Mar 31 05:03:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:26 mercat1 syslogd: last message repeated 20 times Mar 31 05:03:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:26 mercat1 syslogd: last message repeated 39 times Mar 31 05:03:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:27 mercat1 syslogd: last message repeated 61 times Mar 31 05:03:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:27 mercat1 syslogd: last message repeated 61 times Mar 31 05:03:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:27 mercat1 syslogd: last message repeated 76 times Mar 31 05:03:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:27 mercat1 syslogd: last message repeated 46 times Mar 31 05:03:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:27 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:27 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:28 mercat1 syslogd: last message repeated 61 times Mar 31 05:03:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:28 mercat1 syslogd: last message repeated 50 times Mar 31 05:03:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:28 mercat1 syslogd: last message repeated 9 times Mar 31 05:03:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:29 mercat1 syslogd: last message repeated 157 times Mar 31 05:03:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:29 mercat1 syslogd: last message repeated 30 times Mar 31 05:03:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:29 mercat1 syslogd: last message repeated 21 times Mar 31 05:03:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:29 mercat1 syslogd: last message repeated 39 times Mar 31 05:03:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:30 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:30 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:31 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:31 mercat1 syslogd: last message repeated 61 times Mar 31 05:03:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:31 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:32 mercat1 syslogd: last message repeated 125 times Mar 31 05:03:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:32 mercat1 syslogd: last message repeated 60 times Mar 31 05:03:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:32 mercat1 syslogd: last message repeated 61 times Mar 31 05:03:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:32 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:32 mercat1 syslogd: last message repeated 61 times Mar 31 05:03:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:33 mercat1 syslogd: last message repeated 125 times Mar 31 05:03:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:33 mercat1 syslogd: last message repeated 129 times Mar 31 05:03:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:33 mercat1 syslogd: last message repeated 57 times Mar 31 05:03:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:34 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:34 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:34 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:35 mercat1 syslogd: last message repeated 197 times Mar 31 05:03:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:36 mercat1 syslogd: last message repeated 115 times Mar 31 05:03:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:36 mercat1 syslogd: last message repeated 125 times Mar 31 05:03:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:36 mercat1 syslogd: last message repeated 61 times Mar 31 05:03:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:37 mercat1 syslogd: last message repeated 43 times Mar 31 05:03:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:37 mercat1 syslogd: last message repeated 83 times Mar 31 05:03:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:37 mercat1 syslogd: last message repeated 58 times Mar 31 05:03:37 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:37 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:38 mercat1 syslogd: last message repeated 126 times Mar 31 05:03:38 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:38 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:38 mercat1 syslogd: last message repeated 123 times Mar 31 05:03:38 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:38 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:38 mercat1 syslogd: last message repeated 60 times Mar 31 05:03:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:39 mercat1 syslogd: last message repeated 123 times Mar 31 05:03:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:39 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:39 mercat1 syslogd: last message repeated 67 times Mar 31 05:03:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:39 mercat1 syslogd: last message repeated 54 times Mar 31 05:03:39 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:39 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:39 mercat1 syslogd: last message repeated 63 times Mar 31 05:03:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:40 mercat1 syslogd: last message repeated 65 times Mar 31 05:03:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:40 mercat1 syslogd: last message repeated 66 times Mar 31 05:03:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:40 mercat1 syslogd: last message repeated 116 times Mar 31 05:03:40 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:40 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:40 mercat1 syslogd: last message repeated 126 times Mar 31 05:03:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:41 mercat1 syslogd: last message repeated 67 times Mar 31 05:03:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:41 mercat1 syslogd: last message repeated 54 times Mar 31 05:03:41 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:41 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:41 mercat1 syslogd: last message repeated 128 times Mar 31 05:03:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:42 mercat1 syslogd: last message repeated 56 times Mar 31 05:03:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:42 mercat1 syslogd: last message repeated 13 times Mar 31 05:03:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:42 mercat1 syslogd: last message repeated 47 times Mar 31 05:03:42 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:42 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:43 mercat1 syslogd: last message repeated 187 times Mar 31 05:03:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:43 mercat1 syslogd: last message repeated 60 times Mar 31 05:03:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:43 mercat1 syslogd: last message repeated 29 times Mar 31 05:03:43 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:43 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:43 mercat1 syslogd: last message repeated 31 times Mar 31 05:03:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:44 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:44 mercat1 syslogd: last message repeated 61 times Mar 31 05:03:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:44 mercat1 syslogd: last message repeated 11 times Mar 31 05:03:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:44 mercat1 syslogd: last message repeated 48 times Mar 31 05:03:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:44 mercat1 syslogd: last message repeated 61 times Mar 31 05:03:44 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:44 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:45 mercat1 syslogd: last message repeated 68 times Mar 31 05:03:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:45 mercat1 syslogd: last message repeated 64 times Mar 31 05:03:45 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:45 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:45 mercat1 syslogd: last message repeated 52 times Mar 31 05:03:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:46 mercat1 syslogd: last message repeated 187 times Mar 31 05:03:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:46 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:46 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:46 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:47 mercat1 syslogd: last message repeated 80 times Mar 31 05:03:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:47 mercat1 syslogd: last message repeated 43 times Mar 31 05:03:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:47 mercat1 syslogd: last message repeated 61 times Mar 31 05:03:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:47 mercat1 syslogd: last message repeated 146 times Mar 31 05:03:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:47 mercat1 syslogd: last message repeated 38 times Mar 31 05:03:47 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:47 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:48 mercat1 syslogd: last message repeated 126 times Mar 31 05:03:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:48 mercat1 syslogd: last message repeated 3 times Mar 31 05:03:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:48 mercat1 syslogd: last message repeated 56 times Mar 31 05:03:48 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:48 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:48 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:49 mercat1 syslogd: last message repeated 123 times Mar 31 05:03:49 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:49 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:50 mercat1 syslogd: last message repeated 124 times Mar 31 05:03:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:50 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:50 mercat1 syslogd: last message repeated 61 times Mar 31 05:03:50 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:50 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:51 mercat1 syslogd: last message repeated 188 times Mar 31 05:03:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:52 mercat1 syslogd: last message repeated 66 times Mar 31 05:03:52 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:52 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:53 mercat1 syslogd: last message repeated 184 times Mar 31 05:03:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:53 mercat1 syslogd: last message repeated 58 times Mar 31 05:03:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:53 mercat1 syslogd: last message repeated 7 times Mar 31 05:03:53 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:54 mercat1 syslogd: last message repeated 178 times Mar 31 05:03:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:54 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:54 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:54 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:55 mercat1 syslogd: last message repeated 41 times Mar 31 05:03:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:55 mercat1 syslogd: last message repeated 143 times Mar 31 05:03:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:55 mercat1 syslogd: last message repeated 6 times Mar 31 05:03:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:55 mercat1 syslogd: last message repeated 54 times Mar 31 05:03:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:56 mercat1 syslogd: last message repeated 125 times Mar 31 05:03:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:56 mercat1 syslogd: last message repeated 57 times Mar 31 05:03:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:56 mercat1 syslogd: last message repeated 63 times Mar 31 05:03:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:57 mercat1 syslogd: last message repeated 86 times Mar 31 05:03:57 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:57 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:57 mercat1 syslogd: last message repeated 97 times Mar 31 05:03:57 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:57 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:57 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:57 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:57 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:58 mercat1 syslogd: last message repeated 124 times Mar 31 05:03:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:58 mercat1 syslogd: last message repeated 124 times Mar 31 05:03:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:58 mercat1 syslogd: last message repeated 124 times Mar 31 05:03:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:58 mercat1 syslogd: last message repeated 63 times Mar 31 05:03:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:59 mercat1 syslogd: last message repeated 66 times Mar 31 05:03:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:59 mercat1 syslogd: last message repeated 53 times Mar 31 05:03:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:59 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:59 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:03:59 mercat1 syslogd: last message repeated 62 times Mar 31 05:03:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:03:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:00 mercat1 syslogd: last message repeated 126 times Mar 31 05:04:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:22 mercat1 syslogd: last message repeated 124 times Mar 31 05:04:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:23 mercat1 syslogd: last message repeated 190 times Mar 31 05:04:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:23 mercat1 syslogd: last message repeated 59 times Mar 31 05:04:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:24 mercat1 syslogd: last message repeated 60 times Mar 31 05:04:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:24 mercat1 syslogd: last message repeated 12 times Mar 31 05:04:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:24 mercat1 syslogd: last message repeated 48 times Mar 31 05:04:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:24 mercat1 syslogd: last message repeated 125 times Mar 31 05:04:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:25 mercat1 syslogd: last message repeated 126 times Mar 31 05:04:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:25 mercat1 syslogd: last message repeated 61 times Mar 31 05:04:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:25 mercat1 syslogd: last message repeated 20 times Mar 31 05:04:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:26 mercat1 syslogd: last message repeated 102 times Mar 31 05:04:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:26 mercat1 syslogd: last message repeated 62 times Mar 31 05:04:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:26 mercat1 syslogd: last message repeated 61 times Mar 31 05:04:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:26 mercat1 syslogd: last message repeated 17 times Mar 31 05:04:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:27 mercat1 syslogd: last message repeated 43 times Mar 31 05:04:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:27 mercat1 syslogd: last message repeated 60 times Mar 31 05:04:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:27 mercat1 syslogd: last message repeated 131 times Mar 31 05:04:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:27 mercat1 syslogd: last message repeated 118 times Mar 31 05:04:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:28 mercat1 syslogd: last message repeated 60 times Mar 31 05:04:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:28 mercat1 syslogd: last message repeated 187 times Mar 31 05:04:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:28 mercat1 syslogd: last message repeated 7 times Mar 31 05:04:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:29 mercat1 syslogd: last message repeated 52 times Mar 31 05:04:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:29 mercat1 syslogd: last message repeated 59 times Mar 31 05:04:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:29 mercat1 syslogd: last message repeated 62 times Mar 31 05:04:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:29 mercat1 syslogd: last message repeated 64 times Mar 31 05:04:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:30 mercat1 syslogd: last message repeated 59 times Mar 31 05:04:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:30 mercat1 syslogd: last message repeated 7 times Mar 31 05:04:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:30 mercat1 syslogd: last message repeated 53 times Mar 31 05:04:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:30 mercat1 syslogd: last message repeated 124 times Mar 31 05:04:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:31 mercat1 syslogd: last message repeated 65 times Mar 31 05:04:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:31 mercat1 syslogd: last message repeated 67 times Mar 31 05:04:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:31 mercat1 syslogd: last message repeated 52 times Mar 31 05:04:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:32 mercat1 syslogd: last message repeated 129 times Mar 31 05:04:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:32 mercat1 syslogd: last message repeated 119 times Mar 31 05:04:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:33 mercat1 syslogd: last message repeated 189 times Mar 31 05:04:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:55 mercat1 syslogd: last message repeated 61 times Mar 31 05:04:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:55 mercat1 syslogd: last message repeated 111 times Mar 31 05:04:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:55 mercat1 syslogd: last message repeated 11 times Mar 31 05:04:55 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:55 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:56 mercat1 syslogd: last message repeated 33 times Mar 31 05:04:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:56 mercat1 syslogd: last message repeated 26 times Mar 31 05:04:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:56 mercat1 syslogd: last message repeated 61 times Mar 31 05:04:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:56 mercat1 syslogd: last message repeated 60 times Mar 31 05:04:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:56 mercat1 syslogd: last message repeated 14 times Mar 31 05:04:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:56 mercat1 syslogd: last message repeated 46 times Mar 31 05:04:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:56 mercat1 syslogd: last message repeated 61 times Mar 31 05:04:56 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:56 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:57 mercat1 syslogd: last message repeated 22 times Mar 31 05:04:57 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:57 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:57 mercat1 syslogd: last message repeated 38 times Mar 31 05:04:57 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:57 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:57 mercat1 syslogd: last message repeated 61 times Mar 31 05:04:57 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:57 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:58 mercat1 syslogd: last message repeated 125 times Mar 31 05:04:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:58 mercat1 syslogd: last message repeated 83 times Mar 31 05:04:58 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:58 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:59 mercat1 syslogd: last message repeated 166 times Mar 31 05:04:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:59 mercat1 syslogd: last message repeated 43 times Mar 31 05:04:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:59 mercat1 syslogd: last message repeated 17 times Mar 31 05:04:59 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:04:59 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:04:59 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:00 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:00 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:00 mercat1 syslogd: last message repeated 62 times Mar 31 05:05:00 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:00 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:00 mercat1 syslogd: last message repeated 60 times Mar 31 05:05:00 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:00 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:01 mercat1 syslogd: last message repeated 18 times Mar 31 05:05:01 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:01 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:01 mercat1 syslogd: last message repeated 42 times Mar 31 05:05:01 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:01 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:01 mercat1 syslogd: last message repeated 60 times Mar 31 05:05:01 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:01 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:01 mercat1 syslogd: last message repeated 62 times Mar 31 05:05:01 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:01 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:02 mercat1 syslogd: last message repeated 125 times Mar 31 05:05:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:02 mercat1 syslogd: last message repeated 60 times Mar 31 05:05:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:02 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:02 mercat1 syslogd: last message repeated 12 times Mar 31 05:05:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:02 mercat1 syslogd: last message repeated 111 times Mar 31 05:05:02 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:02 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:02 mercat1 syslogd: last message repeated 62 times Mar 31 05:05:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:03 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:03 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:03 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:03 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:03 mercat1 syslogd: last message repeated 60 times Mar 31 05:05:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:04 mercat1 syslogd: last message repeated 64 times Mar 31 05:05:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:04 mercat1 syslogd: last message repeated 60 times Mar 31 05:05:04 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:04 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:05 mercat1 syslogd: last message repeated 129 times Mar 31 05:05:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:05 mercat1 syslogd: last message repeated 56 times Mar 31 05:05:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:05 mercat1 syslogd: last message repeated 63 times Mar 31 05:05:05 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:05 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:06 mercat1 syslogd: last message repeated 63 times Mar 31 05:05:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:06 mercat1 syslogd: last message repeated 58 times Mar 31 05:05:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:06 mercat1 syslogd: last message repeated 9 times Mar 31 05:05:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:06 mercat1 syslogd: last message repeated 51 times Mar 31 05:05:06 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:06 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:07 mercat1 syslogd: last message repeated 122 times Mar 31 05:05:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:07 mercat1 syslogd: last message repeated 60 times Mar 31 05:05:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:07 mercat1 syslogd: last message repeated 78 times Mar 31 05:05:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:07 mercat1 syslogd: last message repeated 45 times Mar 31 05:05:07 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:07 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:07 mercat1 syslogd: last message repeated 63 times Mar 31 05:05:08 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:08 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:08 mercat1 syslogd: last message repeated 58 times Mar 31 05:05:08 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:08 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:08 mercat1 syslogd: last message repeated 132 times Mar 31 05:05:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:09 mercat1 syslogd: last message repeated 243 times Mar 31 05:05:09 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:09 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:10 mercat1 syslogd: last message repeated 62 times Mar 31 05:05:10 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:10 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:10 mercat1 syslogd: last message repeated 124 times Mar 31 05:05:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:11 mercat1 syslogd: last message repeated 3 times Mar 31 05:05:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:11 mercat1 syslogd: last message repeated 73 times Mar 31 05:05:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:11 mercat1 syslogd: last message repeated 44 times Mar 31 05:05:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:11 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:11 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:11 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:12 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:12 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:12 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:12 mercat1 syslogd: last message repeated 189 times Mar 31 05:05:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:13 mercat1 syslogd: last message repeated 62 times Mar 31 05:05:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:13 mercat1 syslogd: last message repeated 57 times Mar 31 05:05:13 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:13 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:13 mercat1 syslogd: last message repeated 6 times Mar 31 05:05:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:14 mercat1 syslogd: last message repeated 69 times Mar 31 05:05:14 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:14 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:14 mercat1 syslogd: last message repeated 113 times Mar 31 05:05:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:15 mercat1 syslogd: last message repeated 58 times Mar 31 05:05:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:15 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:15 mercat1 syslogd: last message repeated 18 times Mar 31 05:05:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:15 mercat1 syslogd: last message repeated 41 times Mar 31 05:05:15 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:15 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:15 mercat1 syslogd: last message repeated 67 times Mar 31 05:05:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:16 mercat1 syslogd: last message repeated 55 times Mar 31 05:05:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:16 mercat1 syslogd: last message repeated 62 times Mar 31 05:05:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:16 mercat1 syslogd: last message repeated 123 times Mar 31 05:05:16 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:16 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:16 mercat1 syslogd: last message repeated 62 times Mar 31 05:05:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:17 mercat1 syslogd: last message repeated 80 times Mar 31 05:05:17 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:17 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:17 mercat1 syslogd: last message repeated 42 times Mar 31 05:05:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:18 mercat1 syslogd: last message repeated 189 times Mar 31 05:05:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:18 mercat1 syslogd: last message repeated 59 times Mar 31 05:05:18 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:18 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:18 mercat1 syslogd: last message repeated 5 times Mar 31 05:05:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:19 mercat1 syslogd: last message repeated 67 times Mar 31 05:05:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:19 mercat1 syslogd: last message repeated 49 times Mar 31 05:05:19 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:19 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:19 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:20 mercat1 syslogd: last message repeated 247 times Mar 31 05:05:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:20 mercat1 syslogd: last message repeated 60 times Mar 31 05:05:20 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:20 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:21 mercat1 syslogd: last message repeated 25 times Mar 31 05:05:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:21 mercat1 syslogd: last message repeated 34 times Mar 31 05:05:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:21 mercat1 syslogd: last message repeated 6 times Mar 31 05:05:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:21 mercat1 syslogd: last message repeated 118 times Mar 31 05:05:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:21 mercat1 syslogd: last message repeated 59 times Mar 31 05:05:21 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:21 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:22 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:22 mercat1 syslogd: last message repeated 62 times Mar 31 05:05:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:22 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:22 mercat1 syslogd: last message repeated 60 times Mar 31 05:05:22 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:22 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:22 mercat1 syslogd: last message repeated 63 times Mar 31 05:05:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:23 mercat1 syslogd: last message repeated 57 times Mar 31 05:05:23 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:23 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:23 mercat1 syslogd: last message repeated 129 times Mar 31 05:05:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:24 mercat1 syslogd: last message repeated 59 times Mar 31 05:05:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:24 mercat1 syslogd: last message repeated 60 times Mar 31 05:05:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:24 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:24 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:24 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:25 mercat1 syslogd: last message repeated 47 times Mar 31 05:05:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:25 mercat1 syslogd: last message repeated 12 times Mar 31 05:05:25 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:25 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:26 mercat1 syslogd: last message repeated 123 times Mar 31 05:05:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:26 mercat1 syslogd: last message repeated 10 times Mar 31 05:05:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:26 mercat1 syslogd: last message repeated 112 times Mar 31 05:05:26 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:26 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:26 mercat1 syslogd: last message repeated 63 times Mar 31 05:05:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:27 mercat1 syslogd: last message repeated 122 times Mar 31 05:05:27 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:27 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:28 mercat1 syslogd: last message repeated 162 times Mar 31 05:05:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:28 mercat1 syslogd: last message repeated 22 times Mar 31 05:05:28 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:28 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:28 mercat1 syslogd: last message repeated 63 times Mar 31 05:05:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:29 mercat1 syslogd: last message repeated 67 times Mar 31 05:05:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:29 mercat1 syslogd: last message repeated 53 times Mar 31 05:05:29 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:29 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:29 mercat1 syslogd: last message repeated 62 times Mar 31 05:05:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:30 mercat1 syslogd: last message repeated 62 times Mar 31 05:05:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:30 mercat1 syslogd: last message repeated 2 times Mar 31 05:05:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:30 mercat1 syslogd: last message repeated 121 times Mar 31 05:05:30 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:30 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:31 mercat1 syslogd: last message repeated 124 times Mar 31 05:05:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:31 mercat1 syslogd: last message repeated 60 times Mar 31 05:05:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:31 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:31 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:31 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:31 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:31 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:32 mercat1 syslogd: last message repeated 33 times Mar 31 05:05:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:32 mercat1 syslogd: last message repeated 27 times Mar 31 05:05:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:32 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:32 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:32 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:33 mercat1 syslogd: last message repeated 62 times Mar 31 05:05:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:33 mercat1 syslogd: last message repeated 62 times Mar 31 05:05:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:33 mercat1 syslogd: last message repeated 9 times Mar 31 05:05:33 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:33 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:33 mercat1 syslogd: last message repeated 51 times Mar 31 05:05:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:34 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:34 mercat1 syslogd: last message repeated 50 times Mar 31 05:05:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:34 mercat1 syslogd: last message repeated 72 times Mar 31 05:05:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:34 mercat1 syslogd: last message repeated 62 times Mar 31 05:05:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:34 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:34 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:34 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:34 mercat1 syslogd: last message repeated 63 times Mar 31 05:05:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:35 mercat1 syslogd: last message repeated 61 times Mar 31 05:05:35 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:35 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:35 mercat1 syslogd: last message repeated 14 times Mar 31 05:05:36 mercat1 kernel: Failed to write core file for process core3 (error 9) Mar 31 05:05:36 mercat1 kernel: Failed to write core file for process core3 (error 5) Mar 31 05:05:36 mercat1 syslogd: last message repeated 46 times 20230331 05:15:37 all (19/358): core4.sh 20230331 05:16:00 all (20/358): core5.sh 20230331 06:26:42 *** Excessive run time: core5.sh, 70 min 20230331 06:26:43 all (21/358): creat.sh Mar 31 06:27:15 mercat1 kernel: pid 19129 (touch), uid 0 inumber 3328 on /mnt: out of inodes Mar 31 06:27:16 mercat1 kernel: pid 33064 (touch), uid 0 inumber 3329 on /mnt: out of inodes Mar 31 06:27:18 mercat1 kernel: pid 50011 (touch), uid 0 inumber 6658 on /mnt: out of inodes Mar 31 06:27:20 mercat1 kernel: pid 71030 (touch), uid 0 inumber 9985 on /mnt: out of inodes Mar 31 06:27:22 mercat1 kernel: pid 99948 (touch), uid 0 inumber 6658 on /mnt: out of inodes Mar 31 06:27:27 mercat1 kernel: pid 49792 (touch), uid 0 inumber 6657 on /mnt: out of inodes Mar 31 06:27:28 mercat1 kernel: pid 63388 (touch), uid 0 inumber 9985 on /mnt: out of inodes Mar 31 06:27:31 mercat1 kernel: pid 97381 (touch), uid 0 inumber 3329 on /mnt: out of inodes Mar 31 06:27:34 mercat1 kernel: pid 23148 (touch), uid 0 inumber 9984 on /mnt: out of inodes Mar 31 06:27:35 mercat1 kernel: pid 37583 (touch), uid 0 inumber 6657 on /mnt: out of inodes Mar 31 06:27:37 mercat1 kernel: pid 61182 (touch), uid 0 inumber 3329 on /mnt: out of inodes Mar 31 06:27:39 mercat1 kernel: pid 75932 (touch), uid 0 inumber 6658 on /mnt: out of inodes Mar 31 06:27:41 mercat1 kernel: pid 9429 (touch), uid 0 inumber 9985 on /mnt: out of inodes Mar 31 06:27:43 mercat1 kernel: pid 24569 (touch), uid 0 inumber 3328 on /mnt: out of inodes 20230331 06:27:45 all (22/358): creat2.sh 20230331 06:29:50 all (23/358): crossmp.sh stress2: freework leak: 191/197. 20230331 06:31:01 all (24/358): crossmp11.sh Mar 31 06:31:04 mercat1 kernel: pid 10133 (rw), uid 2007 inumber 7 on /mnt12: filesystem full Mar 31 06:31:05 mercat1 kernel: pid 10128 (rw), uid 2007 inumber 5 on /mnt11: filesystem full Mar 31 06:31:06 mercat1 kernel: pid 10118 (rw), uid 2007 inumber 74119 on /mnt10: filesystem full Mar 31 06:31:11 mercat1 kernel: pid 10186 (creat), uid 2007 inumber 49410 on /mnt13: out of inodes Mar 31 06:31:17 mercat1 kernel: pid 10142 (mkdir), uid 2007 inumber 98812 on /mnt13: out of inodes Mar 31 06:31:18 mercat1 kernel: pid 10205 (creat), uid 2007 inumber 4 on /mnt10: out of inodes Mar 31 06:31:19 mercat1 kernel: pid 10146 (mkdir), uid 2007 inumber 52392 on /mnt13: filesystem full Mar 31 06:31:23 mercat1 kernel: pid 10216 (creat), uid 2007 inumber 5 on /mnt10: out of inodes Mar 31 06:31:23 mercat1 kernel: pid 10152 (mkdir), uid 2007 inumber 18191 on /mnt13: filesystem full Mar 31 06:31:27 mercat1 kernel: pid 10125 (rw), uid 2007 inumber 74124 on /mnt11: filesystem full Mar 31 06:31:40 mercat1 kernel: pid 10211 (creat), uid 2007 inumber 74117 on /mnt10: out of inodes Mar 31 06:31:46 mercat1 kernel: pid 10157 (creat), uid 2007 inumber 74118 on /mnt11: out of inodes Mar 31 06:31:48 mercat1 kernel: pid 10216 (creat), uid 2007 inumber 5 on /mnt10: out of inodes Mar 31 06:31:52 mercat1 kernel: pid 10160 (creat), uid 2007 inumber 24709 on /mnt11: out of inodes Mar 31 06:31:53 mercat1 kernel: pid 10182 (creat), uid 2007 inumber 8 on /mnt13: out of inodes Mar 31 06:32:04 mercat1 kernel: pid 10154 (creat), uid 2007 inumber 24707 on /mnt11: out of inodes Mar 31 06:32:08 mercat1 kernel: pid 10175 (creat), uid 2007 inumber 49411 on /mnt13: out of inodes Mar 31 06:32:09 mercat1 kernel: pid 10205 (creat), uid 2007 inumber 4 on /mnt10: out of inodes Mar 31 06:32:11 mercat1 kernel: pid 10158 (creat), uid 2007 inumber 49410 on /mnt11: out of inodes Mar 31 06:32:12 mercat1 kernel: pid 10186 (creat), uid 2007 inumber 49410 on /mnt13: out of inodes Mar 31 06:32:26 mercat1 kernel: pid 10179 (creat), uid 2007 inumber 24713 on /mnt13: out of inodes Mar 31 06:32:33 mercat1 kernel: pid 10169 (creat), uid 2007 inumber 74116 on /mnt12: out of inodes Mar 31 06:32:39 mercat1 kernel: pid 10168 (creat), uid 2007 inumber 24709 on /mnt13: out of inodes Mar 31 06:32:48 mercat1 kernel: pid 10205 (creat), uid 2007 inumber 4 on /mnt10: out of inodes Mar 31 06:32:53 mercat1 kernel: pid 10182 (creat), uid 2007 inumber 8 on /mnt13: out of inodes Mar 31 06:32:56 mercat1 kernel: pid 10154 (creat), uid 2007 inumber 24707 on /mnt11: out of inodes Mar 31 06:33:02 mercat1 kernel: pid 10167 (creat), uid 2007 inumber 49410 on /mnt12: out of inodes Mar 31 06:33:04 mercat1 kernel: pid 21990 (rw), uid 2007 inumber 74119 on /mnt11: filesystem full Mar 31 06:33:05 mercat1 kernel: pid 22132 (rw), uid 2007 inumber 24707 on /mnt10: filesystem full Mar 31 06:33:05 mercat1 kernel: pid 22067 (rw), uid 2007 inumber 10 on /mnt13: filesystem full Mar 31 06:33:08 mercat1 kernel: pid 21952 (creat), uid 2007 inumber 74119 on /mnt12: filesystem full Mar 31 06:33:15 mercat1 kernel: pid 21952 (creat), uid 2007 inumber 74119 on /mnt12: out of inodes Mar 31 06:33:17 mercat1 kernel: pid 22006 (mkdir), uid 2007 inumber 98787 on /mnt11: out of inodes Mar 31 06:33:26 mercat1 kernel: pid 21958 (creat), uid 2007 inumber 49410 on /mnt12: out of inodes Mar 31 06:33:29 mercat1 kernel: pid 21995 (mkdir), uid 2007 inumber 74015 on /mnt11: out of inodes Mar 31 06:33:42 mercat1 kernel: pid 22153 (creat), uid 2007 inumber 24712 on /mnt10: out of inodes Mar 31 06:33:45 mercat1 kernel: pid 21964 (creat), uid 2007 inumber 49414 on /mnt12: out of inodes Mar 31 06:33:58 mercat1 kernel: pid 21948 (creat), uid 2007 inumber 49409 on /mnt12: out of inodes Mar 31 06:34:01 mercat1 kernel: pid 21946 (mkdir), uid 2007 inumber 24737 on /mnt12: out of inodes Mar 31 06:34:30 mercat1 kernel: pid 22009 (mkdir), uid 2007 inumber 24608 on /mnt11: out of inodes Mar 31 06:34:43 mercat1 kernel: pid 21955 (creat), uid 2007 inumber 24710 on /mnt12: out of inodes Mar 31 06:34:59 mercat1 syslogd: last message repeated 1 times Mar 31 06:35:05 mercat1 kernel: pid 34177 (rw), uid 2007 inumber 36 on /mnt11: filesystem full Mar 31 06:35:05 mercat1 kernel: pid 34151 (rw), uid 2007 inumber 11 on /mnt12: filesystem full Mar 31 06:35:05 mercat1 kernel: pid 34412 (rw), uid 2007 inumber 24708 on /mnt13: filesystem full Mar 31 06:35:05 mercat1 kernel: pid 34671 (rw), uid 2007 inumber 49412 on /mnt10: filesystem full Mar 31 06:35:07 mercat1 kernel: pid 34174 (rw), uid 2007 inumber 3096 on /mnt11: filesystem full Mar 31 06:35:11 mercat1 kernel: pid 34418 (mkdir), uid 2007 inumber 73824 on /mnt13: out of inodes Mar 31 06:35:12 mercat1 kernel: pid 34674 (mkdir), uid 2007 inumber 98815 on /mnt10: out of inodes Mar 31 06:35:19 mercat1 kernel: pid 34423 (mkdir), uid 2007 inumber 98760 on /mnt13: out of inodes Mar 31 06:35:20 mercat1 kernel: pid 34678 (mkdir), uid 2007 inumber 94358 on /mnt10: filesystem full Mar 31 06:35:22 mercat1 kernel: pid 34435 (creat), uid 2007 inumber 3 on /mnt13: out of inodes Mar 31 06:35:29 mercat1 kernel: pid 34194 (creat), uid 2007 inumber 30 on /mnt11: out of inodes Mar 31 06:35:34 mercat1 kernel: pid 34681 (mkdir), uid 2007 inumber 74103 on /mnt10: out of inodes Mar 31 06:35:36 mercat1 kernel: pid 34683 (mkdir), uid 2007 inumber 57206 on /mnt10: filesystem full Mar 31 06:35:38 mercat1 kernel: pid 34416 (mkdir), uid 2007 inumber 74077 on /mnt13: out of inodes Mar 31 06:35:39 mercat1 kernel: pid 34139 (creat), uid 2007 inumber 74120 on /mnt12: out of inodes Mar 31 06:35:42 mercat1 kernel: pid 34685 (mkdir), uid 2007 inumber 20952 on /mnt10: filesystem full Mar 31 06:35:45 mercat1 kernel: pid 34664 (rw), uid 2007 inumber 30761 on /mnt10: filesystem full Mar 31 06:35:53 mercat1 kernel: pid 34147 (creat), uid 2007 inumber 7 on /mnt12: out of inodes Mar 31 06:35:55 mercat1 kernel: pid 34440 (creat), uid 2007 inumber 74120 on /mnt13: out of inodes Mar 31 06:36:02 mercat1 kernel: pid 34136 (creat), uid 2007 inumber 74121 on /mnt12: out of inodes Mar 31 06:36:02 mercat1 kernel: pid 34443 (creat), uid 2007 inumber 24709 on /mnt13: out of inodes Mar 31 06:36:09 mercat1 kernel: pid 34136 (creat), uid 2007 inumber 74121 on /mnt12: out of inodes Mar 31 06:36:29 mercat1 kernel: pid 34673 (mkdir), uid 2007 inumber 24722 on /mnt10: out of inodes Mar 31 06:36:43 mercat1 kernel: pid 34186 (creat), uid 2007 inumber 31 on /mnt11: out of inodes 20230331 06:37:06 all (25/358): crossmp3.sh fsync: giving up on dirty (error = 35) 0xfffffe01862cf9c8: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 45 seqc users 0 rdev 0xfffff8003fb01800 hold count flags () flags () v_object 0xfffff801630b2420 ref 0 pages 2219 cleanbuf 38 dirtybuf 5 lock type mntfs: EXCL by thread 0xfffffe0174bbe000 (pid 49393, mkdir, tid 137893) #0 0xffffffff80bbf75f at lockmgr_lock_flags+0x1df #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f34d2d at softdep_flushworklist+0x5d #4 0xffffffff80f5a0b7 at ffs_sync+0x3b7 #5 0xffffffff80f71bce at ufs_sync_nlink+0xae #6 0xffffffff80f6fe00 at ufs_mkdir+0x40 #7 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #8 0xffffffff80cfc23d at kern_mkdirat+0x20d #9 0xffffffff810ee587 at amd64_syscall+0x157 #10 0xffffffff810c1d2b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe014e891e10: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 26 seqc users 0 rdev 0xfffff80718305000 hold count flags () flags () v_object 0xfffff801b23f0630 ref 0 pages 3107 cleanbuf 19 dirtybuf 5 lock type mntfs: EXCL by thread 0xfffffe01923b53a0 (pid 49564, mkdir, tid 138016) with exclusive waiters pending #0 0xffffffff80bbf75f at lockmgr_lock_flags+0x1df #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f34d2d at softdep_flushworklist+0x5d #4 0xffffffff80f5a0b7 at ffs_sync+0x3b7 #5 0xffffffff80f71bce at ufs_sync_nlink+0xae #6 0xffffffff80f6fe00 at ufs_mkdir+0x40 #7 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #8 0xffffffff80cfc23d at kern_mkdirat+0x20d #9 0xffffffff810ee587 at amd64_syscall+0x157 #10 0xffffffff810c1d2b at fast_syscall_common+0xf8 Mar 31 06:43:22 mercat1 kernel: pid 51172 (rw), uid 2007 inumber 9867 on /mnt10: filesystem full fsync: giving up on dirty (error = 35) 0xfffffe0173fc4258: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 9 seqc users 0 rdev 0xfffff80386c15000 hold count flags () flags () v_object 0xfffff805fb031210 ref 0 pages 210 cleanbuf 5 dirtybuf 2 lock type mntfs: EXCL by thread 0xfffffe01623e9020 (pid 50340, mkdir, tid 137935) with exclusive waiters pending #0 0xffffffff80bbf75f at lockmgr_lock_flags+0x1df #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f34d2d at softdep_flushworklist+0x5d #4 0xffffffff80f5a0b7 at ffs_sync+0x3b7 #5 0xffffffff80f71bce at ufs_sync_nlink+0xae #6 0xffffffff80f6fe00 at ufs_mkdir+0x40 #7 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #8 0xffffffff80cfc23d at kern_mkdirat+0x20d #9 0xffffffff810ee587 at amd64_syscall+0x157 #10 0xffffffff810c1d2b at fast_syscall_common+0xf8 Mar 31 06:43:35 mercat1 kernel: pid 51163 (mkdir), uid 2007 inumber 252255 on /mnt10: filesystem full Mar 31 06:43:47 mercat1 kernel: pid 51019 (rw), uid 2007 inumber 257254 on /mnt16: filesystem full Mar 31 06:44:01 mercat1 kernel: pid 51176 (rw), uid 2007 inumber 161697 on /mnt10: filesystem full Mar 31 06:44:09 mercat1 kernel: pid 51030 (rw), uid 2007 inumber 199744 on /mnt16: filesystem full Mar 31 06:44:12 mercat1 kernel: pid 51173 (rw), uid 2007 inumber 241175 on /mnt10: filesystem full 20230331 06:45:17 all (26/358): crossmp4.sh stress2: pts leak: 1/3 20230331 06:53:23 all (27/358): crossmp5.sh stress2: newblk leak: 331/335. 20230331 06:53:58 all (28/358): crossmp8.sh 20230331 06:58:06 all (29/358): crossmp9.sh 20230331 07:03:08 all (30/358): dangling.sh 20230331 07:13:42 all (31/358): datamove5.sh 20230331 07:13:51 all (32/358): devfd.sh 20230331 07:13:55 all (33/358): dfull.sh Mar 31 07:13:57 mercat1 kernel: pid 29244 (rw), uid 0 inumber 33029 on /mnt: filesystem full Mar 31 07:15:57 mercat1 kernel: pid 42741 (rw), uid 0 inumber 33026 on /mnt: filesystem full Mar 31 07:16:20 mercat1 kernel: pid 42761 (mkdir), uid 0 inumber 48893 on /mnt: out of inodes Mar 31 07:17:57 mercat1 kernel: pid 56210 (rw), uid 0 inumber 12 on /mnt: filesystem full Mar 31 07:18:12 mercat1 kernel: pid 56229 (creat), uid 0 inumber 23 on /mnt: out of inodes Mar 31 07:18:26 mercat1 kernel: pid 56235 (creat), uid 0 inumber 26 on /mnt: out of inodes Mar 31 07:18:42 mercat1 kernel: pid 56225 (creat), uid 0 inumber 21 on /mnt: out of inodes Mar 31 07:18:55 mercat1 kernel: pid 56206 (creat), uid 0 inumber 11 on /mnt: out of inodes Mar 31 07:18:59 mercat1 kernel: pid 62374 (rw), uid 0 inumber 57 on /mnt: filesystem full Mar 31 07:19:04 mercat1 kernel: pid 62388 (mkdir), uid 0 inumber 32962 on /mnt: out of inodes Mar 31 07:19:07 mercat1 kernel: pid 62394 (mkdir), uid 0 inumber 32982 on /mnt: out of inodes Mar 31 07:19:08 mercat1 kernel: pid 62396 (mkdir), uid 0 inumber 16437 on /mnt: out of inodes Mar 31 07:19:11 mercat1 kernel: pid 63638 (rw), uid 0 inumber 49540 on /mnt: filesystem full Mar 31 07:19:21 mercat1 kernel: pid 63658 (creat), uid 0 inumber 33050 on /mnt: out of inodes Mar 31 07:19:53 mercat1 kernel: pid 63646 (creat), uid 0 inumber 33030 on /mnt: out of inodes Mar 31 07:20:01 mercat1 kernel: pid 63637 (creat), uid 0 inumber 49542 on /mnt: out of inodes Mar 31 07:20:04 mercat1 kernel: pid 63649 (creat), uid 0 inumber 33034 on /mnt: out of inodes Mar 31 07:20:06 mercat1 kernel: pid 63643 (creat), uid 0 inumber 33025 on /mnt: out of inodes Mar 31 07:20:08 mercat1 kernel: pid 63652 (creat), uid 0 inumber 33038 on /mnt: out of inodes Mar 31 07:20:10 mercat1 kernel: pid 71024 (rw), uid 0 inumber 57045 on /mnt: filesystem full Mar 31 07:20:17 mercat1 kernel: pid 71035 (mkdir), uid 0 inumber 65984 on /mnt: out of inodes Mar 31 07:20:20 mercat1 kernel: pid 71036 (mkdir), uid 0 inumber 49529 on /mnt: out of inodes Mar 31 07:20:32 mercat1 kernel: pid 72277 (rw), uid 0 inumber 52048 on /mnt: filesystem full Mar 31 07:21:21 mercat1 kernel: pid 79344 (rw), uid 0 inumber 49609 on /mnt: filesystem full Mar 31 07:21:24 mercat1 kernel: pid 79342 (creat), uid 0 inumber 49608 on /mnt: out of inodes Mar 31 07:21:28 mercat1 kernel: pid 79341 (rw), uid 0 inumber 36900 on /mnt: filesystem full Mar 31 07:21:36 mercat1 kernel: pid 79364 (mkdir), uid 0 inumber 49685 on /mnt: out of inodes Mar 31 07:22:24 mercat1 kernel: pid 85776 (rw), uid 0 inumber 33168 on /mnt: filesystem full Mar 31 07:22:25 mercat1 kernel: pid 85772 (rw), uid 0 inumber 52908 on /mnt: filesystem full Mar 31 07:22:36 mercat1 kernel: pid 85802 (mkdir), uid 0 inumber 16211 on /mnt: out of inodes Mar 31 07:22:43 mercat1 kernel: pid 85785 (creat), uid 0 inumber 33174 on /mnt: out of inodes Mar 31 07:22:51 mercat1 kernel: pid 85793 (creat), uid 0 inumber 33180 on /mnt: out of inodes Mar 31 07:22:57 mercat1 kernel: pid 85807 (mkdir), uid 0 inumber 16361 on /mnt: out of inodes Mar 31 07:23:03 mercat1 kernel: pid 85797 (creat), uid 0 inumber 33182 on /mnt: out of inodes Mar 31 07:23:06 mercat1 kernel: pid 85803 (mkdir), uid 0 inumber 32109 on /mnt: out of inodes Mar 31 07:23:11 mercat1 kernel: pid 85799 (creat), uid 0 inumber 33183 on /mnt: out of inodes Mar 31 07:23:19 mercat1 kernel: pid 85790 (creat), uid 0 inumber 33179 on /mnt: out of inodes Mar 31 07:23:23 mercat1 kernel: pid 85791 (creat), uid 0 inumber 33178 on /mnt: out of inodes Mar 31 07:23:26 mercat1 kernel: pid 93171 (rw), uid 0 inumber 33061 on /mnt: filesystem full Mar 31 07:23:28 mercat1 kernel: pid 93160 (mkdir), uid 0 inumber 16449 on /mnt: out of inodes Mar 31 07:23:43 mercat1 kernel: pid 93156 (mkdir), uid 0 inumber 33115 on /mnt: out of inodes Mar 31 07:23:46 mercat1 kernel: pid 93155 (creat), uid 0 inumber 33069 on /mnt: out of inodes Mar 31 07:23:49 mercat1 kernel: pid 93152 (creat), uid 0 inumber 33028 on /mnt: out of inodes Mar 31 07:23:56 mercat1 syslogd: last message repeated 1 times Mar 31 07:24:28 mercat1 kernel: pid 99308 (creat), uid 0 inumber 49549 on /mnt: out of inodes Mar 31 07:24:31 mercat1 kernel: pid 99320 (creat), uid 0 inumber 40272 on /mnt: out of inodes Mar 31 07:24:41 mercat1 kernel: pid 99311 (mkdir), uid 0 inumber 49536 on /mnt: out of inodes Mar 31 07:24:44 mercat1 kernel: pid 99308 (creat), uid 0 inumber 49549 on /mnt: out of inodes Mar 31 07:24:50 mercat1 syslogd: last message repeated 2 times Mar 31 07:24:55 mercat1 kernel: pid 99320 (creat), uid 0 inumber 40272 on /mnt: out of inodes Mar 31 07:25:02 mercat1 kernel: pid 99308 (creat), uid 0 inumber 49549 on /mnt: out of inodes Mar 31 07:25:07 mercat1 syslogd: last message repeated 2 times Mar 31 07:25:10 mercat1 kernel: pid 99322 (creat), uid 0 inumber 40314 on /mnt: out of inodes Mar 31 07:25:13 mercat1 kernel: pid 99312 (creat), uid 0 inumber 40254 on /mnt: out of inodes Mar 31 07:25:16 mercat1 kernel: pid 99308 (creat), uid 0 inumber 49549 on /mnt: out of inodes Mar 31 07:25:26 mercat1 kernel: pid 6729 (rw), uid 0 inumber 49671 on /mnt: filesystem full Mar 31 07:25:40 mercat1 kernel: pid 6714 (creat), uid 0 inumber 49687 on /mnt: out of inodes Mar 31 07:26:25 mercat1 kernel: pid 12868 (rw), uid 0 inumber 49609 on /mnt: filesystem full Mar 31 07:26:26 mercat1 kernel: pid 12866 (rw), uid 0 inumber 52451 on /mnt: filesystem full Mar 31 07:26:38 mercat1 kernel: pid 12874 (mkdir), uid 0 inumber 32735 on /mnt: out of inodes Mar 31 07:26:42 mercat1 kernel: pid 12875 (creat), uid 0 inumber 49666 on /mnt: out of inodes Mar 31 07:26:47 mercat1 kernel: pid 12882 (mkdir), uid 0 inumber 32510 on /mnt: out of inodes Mar 31 07:26:56 mercat1 kernel: pid 12894 (creat), uid 0 inumber 49677 on /mnt: out of inodes Mar 31 07:27:01 mercat1 kernel: pid 12873 (creat), uid 0 inumber 49664 on /mnt: out of inodes Mar 31 07:27:06 mercat1 kernel: pid 12886 (mkdir), uid 0 inumber 36261 on /mnt: out of inodes Mar 31 07:27:19 mercat1 kernel: pid 12877 (creat), uid 0 inumber 49667 on /mnt: out of inodes Mar 31 07:27:27 mercat1 kernel: pid 20243 (rw), uid 0 inumber 49706 on /mnt: filesystem full Mar 31 07:27:29 mercat1 kernel: pid 20260 (mkdir), uid 0 inumber 46453 on /mnt: out of inodes Mar 31 07:27:45 mercat1 kernel: pid 20250 (creat), uid 0 inumber 49698 on /mnt: out of inodes Mar 31 07:27:50 mercat1 kernel: pid 20279 (mkdir), uid 0 inumber 47613 on /mnt: out of inodes Mar 31 07:28:05 mercat1 kernel: pid 20230 (creat), uid 0 inumber 49679 on /mnt: out of inodes Mar 31 07:28:10 mercat1 kernel: pid 20257 (mkdir), uid 0 inumber 32574 on /mnt: out of inodes Mar 31 07:28:16 mercat1 kernel: pid 20233 (creat), uid 0 inumber 49737 on /mnt: out of inodes Mar 31 07:28:26 mercat1 kernel: pid 20264 (creat), uid 0 inumber 49727 on /mnt: out of inodes Mar 31 07:28:30 mercat1 kernel: pid 26434 (rw), uid 0 inumber 49819 on /mnt: filesystem full Mar 31 07:28:35 mercat1 kernel: pid 26427 (creat), uid 0 inumber 49805 on /mnt: out of inodes Mar 31 07:28:37 mercat1 kernel: pid 26420 (creat), uid 0 inumber 49798 on /mnt: out of inodes Mar 31 07:28:40 mercat1 syslogd: last message repeated 2 times Mar 31 07:28:42 mercat1 kernel: pid 26424 (creat), uid 0 inumber 49801 on /mnt: out of inodes Mar 31 07:28:43 mercat1 kernel: pid 26420 (creat), uid 0 inumber 49798 on /mnt: out of inodes Mar 31 07:28:46 mercat1 kernel: pid 26426 (creat), uid 0 inumber 49804 on /mnt: out of inodes Mar 31 07:28:49 mercat1 kernel: pid 26422 (creat), uid 0 inumber 49820 on /mnt: out of inodes Mar 31 07:28:54 mercat1 kernel: pid 26427 (creat), uid 0 inumber 49805 on /mnt: out of inodes Mar 31 07:29:00 mercat1 kernel: pid 26429 (creat), uid 0 inumber 49808 on /mnt: out of inodes Mar 31 07:29:02 mercat1 kernel: pid 26420 (creat), uid 0 inumber 49798 on /mnt: out of inodes Mar 31 07:29:05 mercat1 kernel: pid 26424 (creat), uid 0 inumber 49801 on /mnt: out of inodes Mar 31 07:29:06 mercat1 syslogd: last message repeated 1 times Mar 31 07:29:09 mercat1 kernel: pid 26426 (creat), uid 0 inumber 49804 on /mnt: out of inodes Mar 31 07:29:11 mercat1 kernel: pid 26427 (creat), uid 0 inumber 49805 on /mnt: out of inodes Mar 31 07:29:14 mercat1 syslogd: last message repeated 1 times Mar 31 07:29:18 mercat1 kernel: pid 26424 (creat), uid 0 inumber 49801 on /mnt: out of inodes Mar 31 07:29:22 mercat1 kernel: pid 26429 (creat), uid 0 inumber 49808 on /mnt: out of inodes Mar 31 07:29:24 mercat1 kernel: pid 26427 (creat), uid 0 inumber 49805 on /mnt: out of inodes Mar 31 07:29:26 mercat1 kernel: pid 26420 (creat), uid 0 inumber 49798 on /mnt: out of inodes Mar 31 07:29:30 mercat1 kernel: pid 33777 (rw), uid 0 inumber 33025 on /mnt: filesystem full Mar 31 07:29:32 mercat1 kernel: pid 33784 (creat), uid 0 inumber 56002 on /mnt: out of inodes Mar 31 07:29:34 mercat1 kernel: pid 33781 (creat), uid 0 inumber 55999 on /mnt: out of inodes Mar 31 07:29:37 mercat1 kernel: pid 33788 (creat), uid 0 inumber 56006 on /mnt: out of inodes Mar 31 07:29:38 mercat1 kernel: pid 33786 (creat), uid 0 inumber 56004 on /mnt: out of inodes Mar 31 07:29:41 mercat1 kernel: pid 33787 (creat), uid 0 inumber 56005 on /mnt: out of inodes Mar 31 07:29:44 mercat1 kernel: pid 33779 (creat), uid 0 inumber 55998 on /mnt: out of inodes Mar 31 07:29:46 mercat1 kernel: pid 33780 (creat), uid 0 inumber 33027 on /mnt: out of inodes Mar 31 07:29:53 mercat1 syslogd: last message repeated 1 times Mar 31 07:29:55 mercat1 kernel: pid 33788 (creat), uid 0 inumber 56006 on /mnt: out of inodes Mar 31 07:29:58 mercat1 kernel: pid 33781 (creat), uid 0 inumber 55999 on /mnt: out of inodes Mar 31 07:30:00 mercat1 kernel: pid 33779 (creat), uid 0 inumber 55998 on /mnt: out of inodes Mar 31 07:30:03 mercat1 kernel: pid 33780 (creat), uid 0 inumber 33027 on /mnt: out of inodes Mar 31 07:30:05 mercat1 kernel: pid 33784 (creat), uid 0 inumber 56002 on /mnt: out of inodes Mar 31 07:30:09 mercat1 syslogd: last message repeated 1 times Mar 31 07:30:11 mercat1 kernel: pid 33781 (creat), uid 0 inumber 55999 on /mnt: out of inodes Mar 31 07:30:13 mercat1 kernel: pid 33785 (creat), uid 0 inumber 56003 on /mnt: out of inodes Mar 31 07:30:15 mercat1 kernel: pid 33788 (creat), uid 0 inumber 56006 on /mnt: out of inodes Mar 31 07:30:17 mercat1 kernel: pid 33786 (creat), uid 0 inumber 56004 on /mnt: out of inodes Mar 31 07:30:19 mercat1 kernel: pid 33784 (creat), uid 0 inumber 56002 on /mnt: out of inodes Mar 31 07:30:21 mercat1 kernel: pid 33785 (creat), uid 0 inumber 56003 on /mnt: out of inodes Mar 31 07:30:23 mercat1 kernel: pid 33788 (creat), uid 0 inumber 56006 on /mnt: out of inodes Mar 31 07:30:25 mercat1 kernel: pid 33783 (creat), uid 0 inumber 56001 on /mnt: out of inodes Mar 31 07:30:30 mercat1 kernel: pid 41118 (rw), uid 0 inumber 33031 on /mnt: filesystem full Mar 31 07:30:33 mercat1 kernel: pid 41140 (rw), uid 0 inumber 39428 on /mnt: filesystem full Mar 31 07:31:04 mercat1 kernel: pid 41125 (creat), uid 0 inumber 33111 on /mnt: out of inodes Mar 31 07:31:10 mercat1 kernel: pid 41128 (creat), uid 0 inumber 33132 on /mnt: out of inodes Mar 31 07:31:11 mercat1 kernel: pid 41119 (creat), uid 0 inumber 33098 on /mnt: out of inodes Mar 31 07:31:14 mercat1 kernel: pid 41128 (creat), uid 0 inumber 33132 on /mnt: out of inodes Mar 31 07:31:28 mercat1 kernel: pid 41125 (creat), uid 0 inumber 33111 on /mnt: out of inodes Mar 31 07:31:30 mercat1 kernel: pid 47266 (rw), uid 0 inumber 33158 on /mnt: filesystem full Mar 31 07:31:35 mercat1 kernel: pid 47276 (mkdir), uid 0 inumber 15118 on /mnt: out of inodes Mar 31 07:32:31 mercat1 kernel: pid 54553 (rw), uid 0 inumber 69 on /mnt: filesystem full Mar 31 07:32:37 mercat1 kernel: pid 54526 (creat), uid 0 inumber 28 on /mnt: out of inodes Mar 31 07:33:20 mercat1 kernel: pid 54532 (creat), uid 0 inumber 43 on /mnt: out of inodes Mar 31 07:33:24 mercat1 kernel: pid 54537 (mkdir), uid 0 inumber 49276 on /mnt: out of inodes Mar 31 07:33:29 mercat1 kernel: pid 60804 (rw), uid 0 inumber 57885 on /mnt: filesystem full Mar 31 07:33:33 mercat1 kernel: pid 60805 (creat), uid 0 inumber 57858 on /mnt: out of inodes Mar 31 07:34:15 mercat1 kernel: pid 60811 (creat), uid 0 inumber 57864 on /mnt: out of inodes Mar 31 07:34:18 mercat1 kernel: pid 60818 (creat), uid 0 inumber 57877 on /mnt: out of inodes Mar 31 07:34:23 mercat1 kernel: pid 60822 (creat), uid 0 inumber 57871 on /mnt: out of inodes Mar 31 07:34:25 mercat1 kernel: pid 60818 (creat), uid 0 inumber 57877 on /mnt: out of inodes Mar 31 07:34:27 mercat1 kernel: pid 60822 (creat), uid 0 inumber 57871 on /mnt: out of inodes 20230331 07:34:29 all (34/358): dtrace.sh 20230331 07:40:50 all (35/358): dumpfs.sh stress2: newblk leak: 306/312. 20230331 07:40:52 all (36/358): elf.sh Mar 31 07:41:04 mercat1 elf[92675]: stack overflow detected; terminated Mar 31 07:41:10 mercat1 elf[97323]: stack overflow detected; terminated Mar 31 07:41:25 mercat1 elf[6054]: stack overflow detected; terminated Mar 31 07:41:44 mercat1 elf[18291]: stack overflow detected; terminated Mar 31 07:41:46 mercat1 elf[19236]: stack overflow detected; terminated Mar 31 07:42:08 mercat1 elf[28868]: stack overflow detected; terminated Mar 31 07:42:09 mercat1 elf[29462]: stack overflow detected; terminated Mar 31 07:42:17 mercat1 elf[33692]: stack overflow detected; terminated Mar 31 07:42:27 mercat1 elf[39970]: stack overflow detected; terminated Mar 31 07:42:38 mercat1 elf[47029]: stack overflow detected; terminated Mar 31 07:43:00 mercat1 elf[61164]: stack overflow detected; terminated Mar 31 07:43:02 mercat1 elf[62236]: stack overflow detected; terminated Mar 31 07:43:09 mercat1 elf[65978]: stack overflow detected; terminated Mar 31 07:43:19 mercat1 elf[70084]: stack overflow detected; terminated Mar 31 07:43:21 mercat1 elf[71087]: stack overflow detected; terminated Mar 31 07:43:32 mercat1 elf[77053]: stack overflow detected; terminated Mar 31 07:43:34 mercat1 elf[78115]: stack overflow detected; terminated Mar 31 07:43:49 mercat1 elf[88074]: stack overflow detected; terminated Mar 31 07:43:52 mercat1 elf[89674]: stack overflow detected; terminated 20230331 07:43:53 all (37/358): execpath.sh 20230331 07:43:55 all (38/358): execve2.sh 20230331 07:45:57 all (39/358): exlock.sh 20230331 07:46:44 all (40/358): extattr.sh 20230331 07:46:47 all (41/358): extattr2.sh Mar 31 07:53:54 mercat1 kernel: pid 79890 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20230331 07:57:29 all (42/358): extattr3.sh 20230331 07:57:33 all (43/358): extattr_set_fd.sh 20230331 07:57:38 all (44/358): extattrctl.sh lock order reversal: 1st 0xfffff80123cfcc40 ufs_extattr_sx (ufs_extattr_sx, sx) @ ufs/ufs/ufs_extattr.c:119 2nd 0xfffffe0155e1b520 ufs (ufs, lockmgr) @ kern/vfs_subr.c:3294 lock order ufs -> ufs_extattr_sx established at: #0 0xffffffff80c63f7b at witness_checkorder+0x2fb #1 0xffffffff80bfd443 at _sx_xlock+0x63 #2 0xffffffff80f656a2 at ufs_extattr_vnode_inactive+0x42 #3 0xffffffff80f65fb5 at ufs_inactive+0x215 #4 0xffffffff811c2510 at VOP_INACTIVE_APV+0x60 #5 0xffffffff80ce7f3a at vinactivef+0xda #6 0xffffffff80ce75c7 at vput_final+0x2a7 #7 0xffffffff80cfc651 at kern_frmdirat+0x2f1 #8 0xffffffff810ee587 at amd64_syscall+0x157 #9 0xffffffff810c1d2b at fast_syscall_common+0xf8 lock order ufs_extattr_sx -> ufs attempted at: #0 0xffffffff80c64833 at witness_checkorder+0xbb3 #1 0xffffffff80bbf705 at lockmgr_lock_flags+0x185 #2 0xffffffff80f5c95d at ffs_lock+0x9d #3 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #4 0xffffffff80d00264 at _vn_lock+0x54 #5 0xffffffff80ce748a at vput_final+0x16a #6 0xffffffff80f6426b at ufs_extattr_autostart+0xab #7 0xffffffff80f5b040 at ffs_mountfs+0xbc0 #8 0xffffffff80f58de0 at ffs_mount+0x460 #9 0xffffffff80cdf3ca at vfs_domount_first+0x25a #10 0xffffffff80cdb8d2 at vfs_domount+0x312 #11 0xffffffff80cd9ed7 at vfs_donmount+0x967 #12 0xffffffff80cd9539 at sys_nmount+0x69 #13 0xffffffff810ee587 at amd64_syscall+0x157 #14 0xffffffff810c1d2b at fast_syscall_common+0xf8 20230331 07:57:40 all (45/358): fcntl2.sh 20230331 08:00:42 all (46/358): ffs_blkfree.sh stress2: newblk leak: 32764/32768. 20230331 08:00:52 all (47/358): ffs_sync.sh 20230331 08:03:56 all (48/358): ffs_syncvnode.sh Mar 31 08:08:22 mercat1 kernel: pid 54440 (rw), uid 2007 inumber 65685 on /mnt: filesystem full Mar 31 08:12:30 mercat1 kernel: pid 81335 (mkdir), uid 2007 inumber 80343 on /mnt: filesystem full Mar 31 08:12:36 mercat1 kernel: pid 81310 (rw), uid 2007 inumber 122150 on /mnt: filesystem full Mar 31 08:14:07 mercat1 kernel: pid 81326 (creat), uid 2007 inumber 5 on /mnt: out of inodes Mar 31 08:14:44 mercat1 kernel: pid 94519 (rw), uid 2007 inumber 44 on /mnt: filesystem full Mar 31 08:15:58 mercat1 kernel: pid 94497 (creat), uid 2007 inumber 131458 on /mnt: out of inodes Mar 31 08:17:07 mercat1 kernel: pid 8086 (rw), uid 2007 inumber 212694 on /mnt: filesystem full Mar 31 08:17:16 mercat1 kernel: pid 8071 (creat), uid 2007 inumber 197003 on /mnt: out of inodes Mar 31 08:17:52 mercat1 kernel: pid 8068 (creat), uid 2007 inumber 197001 on /mnt: out of inodes Mar 31 08:18:09 mercat1 kernel: pid 8071 (creat), uid 2007 inumber 197003 on /mnt: out of inodes Mar 31 08:18:16 mercat1 syslogd: last message repeated 1 times Mar 31 08:18:49 mercat1 kernel: pid 21587 (rw), uid 2007 inumber 103236 on /mnt: filesystem full Mar 31 08:20:50 mercat1 kernel: pid 35128 (rw), uid 2007 inumber 224413 on /mnt: filesystem full 20230331 08:24:27 all (49/358): ffs_syncvnode2.sh Mar 31 08:24:31 mercat1 kernel: pid 63495 (rw), uid 2007 inumber 131339 on /mnt: filesystem full Mar 31 08:27:15 mercat1 kernel: pid 75784 (rw), uid 2007 inumber 198367 on /mnt: filesystem full Mar 31 08:27:50 mercat1 kernel: pid 75786 (rw), uid 2007 inumber 46313 on /mnt: filesystem full Mar 31 08:32:41 mercat1 kernel: pid 16337 (rw), uid 2007 inumber 131329 on /mnt: filesystem full Mar 31 08:32:54 mercat1 kernel: pid 16352 (rw), uid 2007 inumber 211664 on /mnt: filesystem full Mar 31 08:34:41 mercat1 kernel: pid 29857 (rw), uid 2007 inumber 199379 on /mnt: filesystem full Mar 31 08:34:45 mercat1 kernel: pid 29859 (rw), uid 2007 inumber 284 on /mnt: filesystem full fsync: giving up on dirty (error = 35) 0xfffffe014f1a49c8: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 44 seqc users 0 rdev 0xfffff80531d6f000 hold count flags () flags () v_object 0xfffff806c2e54b58 ref 0 pages 24551 cleanbuf 13 dirtybuf 29 lock type mntfs: EXCL by thread 0xfffffe0173f28720 (pid 29871, mkdir, tid 101067) with exclusive waiters pending #0 0xffffffff80bbf75f at lockmgr_lock_flags+0x1df #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f34d2d at softdep_flushworklist+0x5d #4 0xffffffff80f5a0b7 at ffs_sync+0x3b7 #5 0xffffffff80f71bce at ufs_sync_nlink+0xae #6 0xffffffff80f6fe00 at ufs_mkdir+0x40 #7 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #8 0xffffffff80cfc23d at kern_mkdirat+0x20d #9 0xffffffff810ee587 at amd64_syscall+0x157 #10 0xffffffff810c1d2b at fast_syscall_common+0xf8 Mar 31 08:39:24 mercat1 kernel: pid 58080 (rw), uid 2007 inumber 253054 on /mnt: filesystem full Mar 31 08:40:47 mercat1 kernel: pid 71591 (creat), uid 2007 inumber 74139 on /mnt: filesystem full Mar 31 08:40:53 mercat1 kernel: pid 71592 (creat), uid 2007 inumber 74140 on /mnt: out of inodes Mar 31 08:42:38 mercat1 kernel: pid 71591 (creat), uid 2007 inumber 74139 on /mnt: out of inodes fsync: giving up on dirty (error = 35) 0xfffffe014f1a49c8: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 107 seqc users 0 rdev 0xfffff80531d6f000 hold count flags () flags () v_object 0xfffff806c2e54b58 ref 0 pages 41751 cleanbuf 93 dirtybuf 12 lock type mntfs: EXCL by thread 0xfffffe01522cec80 (pid 85061, mkdir, tid 122408) with exclusive waiters pending #0 0xffffffff80bbf75f at lockmgr_lock_flags+0x1df #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f34d2d at softdep_flushworklist+0x5d #4 0xffffffff80f5a0b7 at ffs_sync+0x3b7 #5 0xffffffff80f71bce at ufs_sync_nlink+0xae #6 0xffffffff80f6fe00 at ufs_mkdir+0x40 #7 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #8 0xffffffff80cfc23d at kern_mkdirat+0x20d #9 0xffffffff810ee587 at amd64_syscall+0x157 #10 0xffffffff810c1d2b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe014f1a49c8: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 23 seqc users 0 rdev 0xfffff80531d6f000 hold count flags () flags () v_object 0xfffff806c2e54b58 ref 0 pages 41783 cleanbuf 6 dirtybuf 17 lock type mntfs: EXCL by thread 0xfffffe0173efa740 (pid 85070, mkdir, tid 100863) with exclusive waiters pending #0 0xffffffff80bc028e at lockmgr_xlock_hard+0x4be #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f34d2d at softdep_flushworklist+0x5d #4 0xffffffff80f5a0b7 at ffs_sync+0x3b7 #5 0xffffffff80f71bce at ufs_sync_nlink+0xae #6 0xffffffff80f6fe00 at ufs_mkdir+0x40 #7 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #8 0xffffffff80cfc23d at kern_mkdirat+0x20d #9 0xffffffff810ee587 at amd64_syscall+0x157 #10 0xffffffff810c1d2b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe014f1a49c8: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 26 seqc users 0 rdev 0xfffff80531d6f000 hold count flags () flags () v_object 0xfffff806c2e54b58 ref 0 pages 41791 cleanbuf 8 dirtybuf 16 lock type mntfs: EXCL by thread 0xfffffe0158ea1560 (pid 85072, mkdir, tid 100695) with exclusive waiters pending #0 0xffffffff80bc028e at lockmgr_xlock_hard+0x4be #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f34d2d at softdep_flushworklist+0x5d #4 0xffffffff80f5a0b7 at ffs_sync+0x3b7 #5 0xffffffff80f71bce at ufs_sync_nlink+0xae #6 0xffffffff80f6fe00 at ufs_mkdir+0x40 #7 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #8 0xffffffff80cfc23d at kern_mkdirat+0x20d #9 0xffffffff810ee587 at amd64_syscall+0x157 #10 0xffffffff810c1d2b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe014f1a49c8: type VCHR state VSTATE_CONSTRUCTED usecount 1, writecount 0, refcount 28 seqc users 0 rdev 0xfffff80531d6f000 hold count flags () flags () v_object 0xfffff806c2e54b58 ref 0 pages 41791 cleanbuf 15 dirtybuf 11 lock type mntfs: EXCL by thread 0xfffffe016fd84740 (pid 85068, mkdir, tid 122321) with exclusive waiters pending #0 0xffffffff80bc028e at lockmgr_xlock_hard+0x4be #1 0xffffffff811c29ac at VOP_LOCK1_APV+0x3c #2 0xffffffff80d00264 at _vn_lock+0x54 #3 0xffffffff80f34d2d at softdep_flushworklist+0x5d #4 0xffffffff80f5a0b7 at ffs_sync+0x3b7 #5 0xffffffff80f71bce at ufs_sync_nlink+0xae #6 0xffffffff80f6fe00 at ufs_mkdir+0x40 #7 0xffffffff811c1b9d at VOP_MKDIR_APV+0x6d #8 0xffffffff80cfc23d at kern_mkdirat+0x20d #9 0xffffffff810ee587 at amd64_syscall+0x157 #10 0xffffffff810c1d2b at fast_syscall_common+0xf8 20230331 08:44:43 all (50/358): fifo.sh 20230331 08:44:45 all (51/358): fifo2.sh 20230331 08:46:48 all (52/358): fifo3.sh 20230331 08:47:19 all (53/358): flock.sh 20230331 08:48:20 all (54/358): flock_open_close.sh 20230331 08:50:54 all (55/358): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20230331 08:53:03 all (56/358): force10.sh UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt UFS: forcibly unmounting /dev/md10 from /mnt 20230331 08:58:14 all (57/358): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20230331 08:59:58 all (58/358): force12.sh 20230331 09:00:00 all (59/358): force2.sh UFS: forcibly unmounting /dev/md10 from /mnt 20230331 09:01:25 all (60/358): force3.sh g_vfs_done(): md10 converting all errors to ENXIO g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error = 6 supressing further ENXIO UFS: forcibly unmounting /dev/md10 from /mnt 20230331 09:01:44 all (61/358): force5.sh UFS: forcibly unmounting /dev/md10 from /mnt 20230331 09:02:52 all (62/358): force6.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 32764/32768. 20230331 09:03:02 all (63/358): force8.sh UFS: forcibly unmounting /dev/md10 from /mnt 20230331 09:03:41 all (64/358): force9.sh Mar 31 09:06:12 mercat1 su[46652]: pho to root on /dev/pts/2 UFS: forcibly unmounting /dev/md10 from /mnt softdep_check_suspend: freeing orphaned indirdep 0xfffff8011d0ff500 stress2: GEOM leak: 17/91 20230331 09:06:55 all (65/358): fork2.sh witness_lock_list_get: witness exhausted 20230331 09:08:00 all (66/358): forkbomb.sh maxproc limit exceeded by uid 2007 (pid 67319); see tuning(7) and login.conf(5) 20230331 09:17:51 all (67/358): fragments.sh Mar 31 09:17:56 mercat1 kernel: pid 99063 (fragments), uid 2007 inumber 115011 on /mnt: filesystem full Mar 31 09:17:57 mercat1 kernel: pid 99063 (fragments), uid 2007 inumber 115107 on /mnt: filesystem full Mar 31 09:17:58 mercat1 kernel: pid 99063 (fragments), uid 2007 inumber 115203 on /mnt: filesystem full Mar 31 09:17:59 mercat1 kernel: pid 99073 (fragments), uid 2007 inumber 14108 on /mnt: filesystem full Mar 31 09:18:00 mercat1 kernel: pid 99072 (fragments), uid 2007 inumber 14240 on /mnt: filesystem full Mar 31 09:18:01 mercat1 kernel: pid 99073 (fragments), uid 2007 inumber 14139 on /mnt: filesystem full Mar 31 09:18:02 mercat1 kernel: pid 99068 (fragments), uid 2007 inumber 14126 on /mnt: filesystem full Mar 31 09:18:03 mercat1 kernel: pid 99074 (fragments), uid 2007 inumber 14142 on /mnt: filesystem full Mar 31 09:18:04 mercat1 kernel: pid 99075 (fragments), uid 2007 inumber 14078 on /mnt: filesystem full Mar 31 09:18:05 mercat1 kernel: pid 99075 (fragments), uid 2007 inumber 14077 on /mnt: filesystem full Mar 31 09:18:06 mercat1 kernel: pid 316 (fragments), uid 2007 inumber 14118 on /mnt: filesystem full Mar 31 09:18:07 mercat1 kernel: pid 315 (fragments), uid 2007 inumber 14125 on /mnt: filesystem full Mar 31 09:18:08 mercat1 kernel: pid 320 (fragments), uid 2007 inumber 14135 on /mnt: filesystem full Mar 31 09:18:09 mercat1 kernel: pid 316 (fragments), uid 2007 inumber 14087 on /mnt: filesystem full Mar 31 09:18:10 mercat1 kernel: pid 319 (fragments), uid 2007 inumber 14089 on /mnt: filesystem full Mar 31 09:18:11 mercat1 kernel: pid 319 (fragments), uid 2007 inumber 14103 on /mnt: filesystem full Mar 31 09:18:12 mercat1 kernel: pid 331 (fragments), uid 2007 inumber 14227 on /mnt: filesystem full Mar 31 09:18:13 mercat1 kernel: pid 332 (fragments), uid 2007 inumber 14157 on /mnt: filesystem full Mar 31 09:18:14 mercat1 kernel: pid 333 (fragments), uid 2007 inumber 14104 on /mnt: filesystem full Mar 31 09:18:15 mercat1 kernel: pid 329 (fragments), uid 2007 inumber 14112 on /mnt: filesystem full Mar 31 09:18:16 mercat1 kernel: pid 328 (fragments), uid 2007 inumber 14091 on /mnt: filesystem full Mar 31 09:18:17 mercat1 kernel: pid 332 (fragments), uid 2007 inumber 14121 on /mnt: filesystem full Mar 31 09:18:18 mercat1 kernel: pid 332 (fragments), uid 2007 inumber 14133 on /mnt: filesystem full Mar 31 09:18:19 mercat1 kernel: pid 1564 (fragments), uid 2007 inumber 14126 on /mnt: filesystem full Mar 31 09:18:20 mercat1 kernel: pid 1565 (fragments), uid 2007 inumber 14103 on /mnt: filesystem full Mar 31 09:18:21 mercat1 kernel: pid 1560 (fragments), uid 2007 inumber 14080 on /mnt: filesystem full Mar 31 09:18:22 mercat1 kernel: pid 1567 (fragments), uid 2007 inumber 14174 on /mnt: filesystem full Mar 31 09:18:23 mercat1 kernel: pid 1567 (fragments), uid 2007 inumber 14184 on /mnt: filesystem full Mar 31 09:18:24 mercat1 kernel: pid 1565 (fragments), uid 2007 inumber 14081 on /mnt: filesystem full Mar 31 09:18:25 mercat1 kernel: pid 2786 (fragments), uid 2007 inumber 14089 on /mnt: filesystem full Mar 31 09:18:26 mercat1 kernel: pid 2793 (fragments), uid 2007 inumber 14098 on /mnt: filesystem full Mar 31 09:18:27 mercat1 kernel: pid 2787 (fragments), uid 2007 inumber 14183 on /mnt: filesystem full Mar 31 09:18:28 mercat1 kernel: pid 2790 (fragments), uid 2007 inumber 14112 on /mnt: filesystem full Mar 31 09:18:29 mercat1 kernel: pid 2790 (fragments), uid 2007 inumber 14131 on /mnt: filesystem full Mar 31 09:18:30 mercat1 kernel: pid 2800 (fragments), uid 2007 inumber 14190 on /mnt: filesystem full Mar 31 09:18:31 mercat1 kernel: pid 2799 (fragments), uid 2007 inumber 14310 on /mnt: filesystem full Mar 31 09:18:32 mercat1 kernel: pid 2801 (fragments), uid 2007 inumber 14113 on /mnt: filesystem full Mar 31 09:18:33 mercat1 kernel: pid 2798 (fragments), uid 2007 inumber 14077 on /mnt: filesystem full Mar 31 09:18:34 mercat1 kernel: pid 3886 (fragments), uid 2007 inumber 14081 on /mnt: filesystem full Mar 31 09:18:35 mercat1 kernel: pid 3895 (fragments), uid 2007 inumber 14096 on /mnt: filesystem full Mar 31 09:18:36 mercat1 kernel: pid 3893 (fragments), uid 2007 inumber 14244 on /mnt: filesystem full Mar 31 09:18:37 mercat1 kernel: pid 3894 (fragments), uid 2007 inumber 14116 on /mnt: filesystem full Mar 31 09:18:38 mercat1 kernel: pid 3892 (fragments), uid 2007 inumber 14193 on /mnt: filesystem full Mar 31 09:18:39 mercat1 kernel: pid 3892 (fragments), uid 2007 inumber 14135 on /mnt: filesystem full Mar 31 09:18:40 mercat1 kernel: pid 3889 (fragments), uid 2007 inumber 14171 on /mnt: filesystem full Mar 31 09:18:41 mercat1 kernel: pid 4063 (fragments), uid 2007 inumber 14152 on /mnt: filesystem full Mar 31 09:18:42 mercat1 kernel: pid 4068 (fragments), uid 2007 inumber 14252 on /mnt: filesystem full Mar 31 09:18:43 mercat1 kernel: pid 4071 (fragments), uid 2007 inumber 14131 on /mnt: filesystem full Mar 31 09:18:44 mercat1 kernel: pid 4072 (fragments), uid 2007 inumber 14194 on /mnt: filesystem full Mar 31 09:18:45 mercat1 kernel: pid 4072 (fragments), uid 2007 inumber 14077 on /mnt: filesystem full Mar 31 09:18:46 mercat1 kernel: pid 4068 (fragments), uid 2007 inumber 14126 on /mnt: filesystem full Mar 31 09:18:47 mercat1 kernel: pid 4068 (fragments), uid 2007 inumber 14080 on /mnt: filesystem full Mar 31 09:18:48 mercat1 kernel: pid 5304 (fragments), uid 2007 inumber 14107 on /mnt: filesystem full Mar 31 09:18:49 mercat1 kernel: pid 5305 (fragments), uid 2007 inumber 14263 on /mnt: filesystem full Mar 31 09:18:50 mercat1 kernel: pid 5304 (fragments), uid 2007 inumber 14083 on /mnt: filesystem full Mar 31 09:18:51 mercat1 kernel: pid 5308 (fragments), uid 2007 inumber 14169 on /mnt: filesystem full Mar 31 09:18:52 mercat1 kernel: pid 5310 (fragments), uid 2007 inumber 14334 on /mnt: filesystem full Mar 31 09:18:53 mercat1 kernel: pid 5320 (fragments), uid 2007 inumber 14135 on /mnt: filesystem full Mar 31 09:18:54 mercat1 kernel: pid 5324 (fragments), uid 2007 inumber 14313 on /mnt: filesystem full Mar 31 09:18:55 mercat1 kernel: pid 5324 (fragments), uid 2007 inumber 14187 on /mnt: filesystem full Mar 31 09:18:56 mercat1 kernel: pid 5322 (fragments), uid 2007 inumber 14081 on /mnt: filesystem full Mar 31 09:18:57 mercat1 kernel: pid 5317 (fragments), uid 2007 inumber 14231 on /mnt: filesystem full Mar 31 09:18:58 mercat1 kernel: pid 5318 (fragments), uid 2007 inumber 14093 on /mnt: filesystem full Mar 31 09:18:59 mercat1 kernel: pid 6549 (fragments), uid 2007 inumber 14135 on /mnt: filesystem full Mar 31 09:19:00 mercat1 kernel: pid 6544 (fragments), uid 2007 inumber 14304 on /mnt: filesystem full Mar 31 09:19:01 mercat1 kernel: pid 6543 (fragments), uid 2007 inumber 14093 on /mnt: filesystem full Mar 31 09:19:02 mercat1 kernel: pid 6549 (fragments), uid 2007 inumber 14156 on /mnt: filesystem full Mar 31 09:19:03 mercat1 kernel: pid 6550 (fragments), uid 2007 inumber 14084 on /mnt: filesystem full Mar 31 09:19:04 mercat1 kernel: pid 6550 (fragments), uid 2007 inumber 14122 on /mnt: filesystem full Mar 31 09:19:05 mercat1 kernel: pid 6561 (fragments), uid 2007 inumber 14129 on /mnt: filesystem full Mar 31 09:19:06 mercat1 kernel: pid 6562 (fragments), uid 2007 inumber 14077 on /mnt: filesystem full Mar 31 09:19:07 mercat1 kernel: pid 6562 (fragments), uid 2007 inumber 14093 on /mnt: filesystem full Mar 31 09:19:08 mercat1 kernel: pid 6556 (fragments), uid 2007 inumber 14085 on /mnt: filesystem full Mar 31 09:19:09 mercat1 kernel: pid 6555 (fragments), uid 2007 inumber 14078 on /mnt: filesystem full Mar 31 09:19:10 mercat1 kernel: pid 6560 (fragments), uid 2007 inumber 14136 on /mnt: filesystem full Mar 31 09:19:11 mercat1 kernel: pid 6560 (fragments), uid 2007 inumber 14091 on /mnt: filesystem full Mar 31 09:19:12 mercat1 kernel: pid 7788 (fragments), uid 2007 inumber 14188 on /mnt: filesystem full Mar 31 09:19:13 mercat1 kernel: pid 7790 (fragments), uid 2007 inumber 14134 on /mnt: filesystem full Mar 31 09:19:14 mercat1 kernel: pid 7792 (fragments), uid 2007 inumber 14351 on /mnt: filesystem full Mar 31 09:19:15 mercat1 kernel: pid 7787 (fragments), uid 2007 inumber 14078 on /mnt: filesystem full Mar 31 09:19:16 mercat1 kernel: pid 7787 (fragments), uid 2007 inumber 14123 on /mnt: filesystem full Mar 31 09:19:17 mercat1 kernel: pid 7785 (fragments), uid 2007 inumber 14142 on /mnt: filesystem full Mar 31 09:19:18 mercat1 kernel: pid 9016 (fragments), uid 2007 inumber 14127 on /mnt: filesystem full Mar 31 09:19:19 mercat1 kernel: pid 9016 (fragments), uid 2007 inumber 14251 on /mnt: filesystem full Mar 31 09:19:20 mercat1 kernel: pid 9012 (fragments), uid 2007 inumber 14176 on /mnt: filesystem full Mar 31 09:19:21 mercat1 kernel: pid 9013 (fragments), uid 2007 inumber 14081 on /mnt: filesystem full Mar 31 09:19:22 mercat1 kernel: pid 9013 (fragments), uid 2007 inumber 14093 on /mnt: filesystem full Mar 31 09:19:23 mercat1 kernel: pid 9027 (fragments), uid 2007 inumber 14181 on /mnt: filesystem full Mar 31 09:19:24 mercat1 kernel: pid 9025 (fragments), uid 2007 inumber 14184 on /mnt: filesystem full Mar 31 09:19:25 mercat1 kernel: pid 9028 (fragments), uid 2007 inumber 14200 on /mnt: filesystem full Mar 31 09:19:26 mercat1 kernel: pid 9030 (fragments), uid 2007 inumber 14115 on /mnt: filesystem full Mar 31 09:19:27 mercat1 kernel: pid 9024 (fragments), uid 2007 inumber 14107 on /mnt: filesystem full Mar 31 09:19:28 mercat1 kernel: pid 9024 (fragments), uid 2007 inumber 14097 on /mnt: filesystem full Mar 31 09:19:29 mercat1 kernel: pid 10255 (fragments), uid 2007 inumber 14245 on /mnt: filesystem full Mar 31 09:19:30 mercat1 kernel: pid 10250 (fragments), uid 2007 inumber 14111 on /mnt: filesystem full Mar 31 09:19:31 mercat1 kernel: pid 10249 (fragments), uid 2007 inumber 14111 on /mnt: filesystem full Mar 31 09:19:32 mercat1 kernel: pid 10256 (fragments), uid 2007 inumber 14077 on /mnt: filesystem full Mar 31 09:19:33 mercat1 kernel: pid 10251 (fragments), uid 2007 inumber 14145 on /mnt: filesystem full Mar 31 09:19:35 mercat1 kernel: pid 10254 (fragments), uid 2007 inumber 14197 on /mnt: filesystem full Mar 31 09:19:35 mercat1 kernel: pid 10256 (fragments), uid 2007 inumber 14148 on /mnt: filesystem full Mar 31 09:19:36 mercat1 kernel: pid 10262 (fragments), uid 2007 inumber 14179 on /mnt: filesystem full Mar 31 09:19:37 mercat1 kernel: pid 10266 (fragments), uid 2007 inumber 14218 on /mnt: filesystem full Mar 31 09:19:38 mercat1 kernel: pid 10266 (fragments), uid 2007 inumber 14232 on /mnt: filesystem full Mar 31 09:19:40 mercat1 kernel: pid 10264 (fragments), uid 2007 inumber 14180 on /mnt: filesystem full Mar 31 09:19:41 mercat1 kernel: pid 10264 (fragments), uid 2007 inumber 14082 on /mnt: filesystem full Mar 31 09:19:42 mercat1 kernel: pid 11487 (fragments), uid 2007 inumber 14109 on /mnt: filesystem full Mar 31 09:19:42 mercat1 kernel: pid 11493 (fragments), uid 2007 inumber 14281 on /mnt: filesystem full Mar 31 09:19:43 mercat1 kernel: pid 11489 (fragments), uid 2007 inumber 14208 on /mnt: filesystem full Mar 31 09:19:44 mercat1 kernel: pid 11492 (fragments), uid 2007 inumber 14174 on /mnt: filesystem full Mar 31 09:19:45 mercat1 kernel: pid 11493 (fragments), uid 2007 inumber 14117 on /mnt: filesystem full Mar 31 09:19:47 mercat1 kernel: pid 11487 (fragments), uid 2007 inumber 14202 on /mnt: filesystem full Mar 31 09:19:48 mercat1 kernel: pid 11506 (fragments), uid 2007 inumber 14115 on /mnt: filesystem full Mar 31 09:19:49 mercat1 kernel: pid 11509 (fragments), uid 2007 inumber 14250 on /mnt: filesystem full Mar 31 09:19:49 mercat1 kernel: pid 11510 (fragments), uid 2007 inumber 14084 on /mnt: filesystem full Mar 31 09:19:50 mercat1 kernel: pid 11503 (fragments), uid 2007 inumber 14223 on /mnt: filesystem full Mar 31 09:19:52 mercat1 kernel: pid 11508 (fragments), uid 2007 inumber 14081 on /mnt: filesystem full Mar 31 09:19:53 mercat1 kernel: pid 11506 (fragments), uid 2007 inumber 14101 on /mnt: filesystem full Mar 31 09:19:54 mercat1 kernel: pid 11505 (fragments), uid 2007 inumber 14084 on /mnt: filesystem full Mar 31 09:19:55 mercat1 kernel: pid 11506 (fragments), uid 2007 inumber 14087 on /mnt: filesystem full Mar 31 09:19:56 mercat1 kernel: pid 12734 (fragments), uid 2007 inumber 14146 on /mnt: filesystem full Mar 31 09:19:57 mercat1 kernel: pid 12737 (fragments), uid 2007 inumber 14160 on /mnt: filesystem full Mar 31 09:19:58 mercat1 kernel: pid 12731 (fragments), uid 2007 inumber 14121 on /mnt: filesystem full Mar 31 09:19:59 mercat1 kernel: pid 12738 (fragments), uid 2007 inumber 14127 on /mnt: filesystem full Mar 31 09:20:00 mercat1 kernel: pid 12732 (fragments), uid 2007 inumber 14107 on /mnt: filesystem full Mar 31 09:20:01 mercat1 kernel: pid 12733 (fragments), uid 2007 inumber 14127 on /mnt: filesystem full Mar 31 09:20:02 mercat1 kernel: pid 12733 (fragments), uid 2007 inumber 14121 on /mnt: filesystem full Mar 31 09:20:03 mercat1 kernel: pid 12736 (fragments), uid 2007 inumber 14124 on /mnt: filesystem full Mar 31 09:20:04 mercat1 kernel: pid 13967 (fragments), uid 2007 inumber 14184 on /mnt: filesystem full Mar 31 09:20:05 mercat1 kernel: pid 13964 (fragments), uid 2007 inumber 14134 on /mnt: filesystem full Mar 31 09:20:06 mercat1 kernel: pid 13969 (fragments), uid 2007 inumber 14135 on /mnt: filesystem full Mar 31 09:20:07 mercat1 kernel: pid 13969 (fragments), uid 2007 inumber 14133 on /mnt: filesystem full Mar 31 09:20:08 mercat1 kernel: pid 13963 (fragments), uid 2007 inumber 14211 on /mnt: filesystem full Mar 31 09:20:09 mercat1 kernel: pid 13979 (fragments), uid 2007 inumber 14129 on /mnt: filesystem full Mar 31 09:20:10 mercat1 kernel: pid 13976 (fragments), uid 2007 inumber 14149 on /mnt: filesystem full Mar 31 09:20:11 mercat1 kernel: pid 13976 (fragments), uid 2007 inumber 14132 on /mnt: filesystem full Mar 31 09:20:12 mercat1 kernel: pid 13981 (fragments), uid 2007 inumber 14080 on /mnt: filesystem full Mar 31 09:20:13 mercat1 kernel: pid 13981 (fragments), uid 2007 inumber 14087 on /mnt: filesystem full Mar 31 09:20:14 mercat1 kernel: pid 13981 (fragments), uid 2007 inumber 14100 on /mnt: filesystem full Mar 31 09:20:15 mercat1 kernel: pid 15201 (fragments), uid 2007 inumber 14165 on /mnt: filesystem full Mar 31 09:20:16 mercat1 kernel: pid 15202 (fragments), uid 2007 inumber 14105 on /mnt: filesystem full Mar 31 09:20:17 mercat1 kernel: pid 15206 (fragments), uid 2007 inumber 14151 on /mnt: filesystem full Mar 31 09:20:18 mercat1 kernel: pid 15201 (fragments), uid 2007 inumber 14081 on /mnt: filesystem full Mar 31 09:20:19 mercat1 kernel: pid 15205 (fragments), uid 2007 inumber 14101 on /mnt: filesystem full Mar 31 09:20:20 mercat1 kernel: pid 15215 (fragments), uid 2007 inumber 14135 on /mnt: filesystem full Mar 31 09:20:21 mercat1 kernel: pid 15215 (fragments), uid 2007 inumber 14205 on /mnt: filesystem full Mar 31 09:20:22 mercat1 kernel: pid 15213 (fragments), uid 2007 inumber 14290 on /mnt: filesystem full Mar 31 09:20:23 mercat1 kernel: pid 15216 (fragments), uid 2007 inumber 14086 on /mnt: filesystem full Mar 31 09:20:24 mercat1 kernel: pid 16442 (fragments), uid 2007 inumber 14117 on /mnt: filesystem full Mar 31 09:20:25 mercat1 kernel: pid 16442 (fragments), uid 2007 inumber 14250 on /mnt: filesystem full Mar 31 09:20:26 mercat1 kernel: pid 16442 (fragments), uid 2007 inumber 14152 on /mnt: filesystem full Mar 31 09:20:27 mercat1 kernel: pid 16441 (fragments), uid 2007 inumber 14124 on /mnt: filesystem full Mar 31 09:20:28 mercat1 kernel: pid 16442 (fragments), uid 2007 inumber 14126 on /mnt: filesystem full Mar 31 09:20:29 mercat1 kernel: pid 16445 (fragments), uid 2007 inumber 14118 on /mnt: filesystem full Mar 31 09:20:30 mercat1 kernel: pid 16457 (fragments), uid 2007 inumber 14142 on /mnt: filesystem full Mar 31 09:20:31 mercat1 kernel: pid 16451 (fragments), uid 2007 inumber 14165 on /mnt: filesystem full Mar 31 09:20:32 mercat1 kernel: pid 16457 (fragments), uid 2007 inumber 14185 on /mnt: filesystem full Mar 31 09:20:33 mercat1 kernel: pid 16451 (fragments), uid 2007 inumber 14194 on /mnt: filesystem full Mar 31 09:20:34 mercat1 kernel: pid 16457 (fragments), uid 2007 inumber 14164 on /mnt: filesystem full Mar 31 09:20:35 mercat1 kernel: pid 16454 (fragments), uid 2007 inumber 14113 on /mnt: filesystem full Mar 31 09:20:36 mercat1 kernel: pid 16454 (fragments), uid 2007 inumber 14181 on /mnt: filesystem full Mar 31 09:20:37 mercat1 kernel: pid 17680 (fragments), uid 2007 inumber 14157 on /mnt: filesystem full Mar 31 09:20:38 mercat1 kernel: pid 17684 (fragments), uid 2007 inumber 14294 on /mnt: filesystem full Mar 31 09:20:39 mercat1 kernel: pid 17679 (fragments), uid 2007 inumber 14179 on /mnt: filesystem full Mar 31 09:20:40 mercat1 kernel: pid 17680 (fragments), uid 2007 inumber 14102 on /mnt: filesystem full Mar 31 09:20:41 mercat1 kernel: pid 17677 (fragments), uid 2007 inumber 14094 on /mnt: filesystem full Mar 31 09:20:42 mercat1 kernel: pid 17677 (fragments), uid 2007 inumber 14114 on /mnt: filesystem full Mar 31 09:20:43 mercat1 kernel: pid 17677 (fragments), uid 2007 inumber 14094 on /mnt: filesystem full Mar 31 09:20:44 mercat1 kernel: pid 18914 (fragments), uid 2007 inumber 14118 on /mnt: filesystem full Mar 31 09:20:45 mercat1 kernel: pid 18912 (fragments), uid 2007 inumber 14132 on /mnt: filesystem full Mar 31 09:20:46 mercat1 kernel: pid 18913 (fragments), uid 2007 inumber 14264 on /mnt: filesystem full Mar 31 09:20:47 mercat1 kernel: pid 18908 (fragments), uid 2007 inumber 14085 on /mnt: filesystem full Mar 31 09:20:48 mercat1 kernel: pid 18911 (fragments), uid 2007 inumber 14120 on /mnt: filesystem full Mar 31 09:20:49 mercat1 kernel: pid 18913 (fragments), uid 2007 inumber 14185 on /mnt: filesystem full Mar 31 09:20:50 mercat1 kernel: pid 18914 (fragments), uid 2007 inumber 14147 on /mnt: filesystem full Mar 31 09:20:51 mercat1 kernel: pid 18926 (fragments), uid 2007 inumber 14233 on /mnt: filesystem full Mar 31 09:20:52 mercat1 kernel: pid 18919 (fragments), uid 2007 inumber 14135 on /mnt: filesystem full Mar 31 09:20:53 mercat1 kernel: pid 18925 (fragments), uid 2007 inumber 14128 on /mnt: filesystem full Mar 31 09:20:54 mercat1 kernel: pid 18919 (fragments), uid 2007 inumber 14121 on /mnt: filesystem full Mar 31 09:20:55 mercat1 kernel: pid 18920 (fragments), uid 2007 inumber 14107 on /mnt: filesystem full Mar 31 09:20:56 mercat1 kernel: pid 20151 (fragments), uid 2007 inumber 14165 on /mnt: filesystem full Mar 31 09:20:57 mercat1 kernel: pid 20147 (fragments), uid 2007 inumber 14149 on /mnt: filesystem full Mar 31 09:20:58 mercat1 kernel: pid 20153 (fragments), uid 2007 inumber 14094 on /mnt: filesystem full Mar 31 09:20:59 mercat1 kernel: pid 20148 (fragments), uid 2007 inumber 14088 on /mnt: filesystem full Mar 31 09:21:00 mercat1 kernel: pid 20148 (fragments), uid 2007 inumber 14129 on /mnt: filesystem full Mar 31 09:21:01 mercat1 kernel: pid 20151 (fragments), uid 2007 inumber 14144 on /mnt: filesystem full Mar 31 09:21:02 mercat1 kernel: pid 20163 (fragments), uid 2007 inumber 14146 on /mnt: filesystem full Mar 31 09:21:03 mercat1 kernel: pid 20161 (fragments), uid 2007 inumber 14116 on /mnt: filesystem full Mar 31 09:21:04 mercat1 kernel: pid 20159 (fragments), uid 2007 inumber 14159 on /mnt: filesystem full Mar 31 09:21:05 mercat1 kernel: pid 20162 (fragments), uid 2007 inumber 14103 on /mnt: filesystem full Mar 31 09:21:06 mercat1 kernel: pid 21388 (fragments), uid 2007 inumber 14121 on /mnt: filesystem full Mar 31 09:21:07 mercat1 kernel: pid 21387 (fragments), uid 2007 inumber 14168 on /mnt: filesystem full Mar 31 09:21:08 mercat1 kernel: pid 21390 (fragments), uid 2007 inumber 14112 on /mnt: filesystem full Mar 31 09:21:09 mercat1 kernel: pid 21391 (fragments), uid 2007 inumber 14077 on /mnt: filesystem full Mar 31 09:21:10 mercat1 kernel: pid 21385 (fragments), uid 2007 inumber 14123 on /mnt: filesystem full Mar 31 09:21:11 mercat1 kernel: pid 21385 (fragments), uid 2007 inumber 14080 on /mnt: filesystem full Mar 31 09:21:12 mercat1 kernel: pid 21403 (fragments), uid 2007 inumber 14094 on /mnt: filesystem full Mar 31 09:21:13 mercat1 kernel: pid 21403 (fragments), uid 2007 inumber 14115 on /mnt: filesystem full Mar 31 09:21:14 mercat1 kernel: pid 21403 (fragments), uid 2007 inumber 14154 on /mnt: filesystem full Mar 31 09:21:15 mercat1 kernel: pid 21402 (fragments), uid 2007 inumber 14241 on /mnt: filesystem full Mar 31 09:21:16 mercat1 kernel: pid 21406 (fragments), uid 2007 inumber 14132 on /mnt: filesystem full Mar 31 09:21:17 mercat1 kernel: pid 21406 (fragments), uid 2007 inumber 14090 on /mnt: filesystem full Mar 31 09:21:18 mercat1 kernel: pid 22633 (fragments), uid 2007 inumber 14204 on /mnt: filesystem full Mar 31 09:21:19 mercat1 kernel: pid 22631 (fragments), uid 2007 inumber 14294 on /mnt: filesystem full Mar 31 09:21:20 mercat1 kernel: pid 22630 (fragments), uid 2007 inumber 14227 on /mnt: filesystem full Mar 31 09:21:21 mercat1 kernel: pid 22632 (fragments), uid 2007 inumber 14168 on /mnt: filesystem full Mar 31 09:21:22 mercat1 kernel: pid 22637 (fragments), uid 2007 inumber 14126 on /mnt: filesystem full Mar 31 09:21:23 mercat1 kernel: pid 22635 (fragments), uid 2007 inumber 14145 on /mnt: filesystem full Mar 31 09:21:24 mercat1 kernel: pid 22638 (fragments), uid 2007 inumber 14148 on /mnt: filesystem full Mar 31 09:21:25 mercat1 kernel: pid 22639 (fragments), uid 2007 inumber 14088 on /mnt: filesystem full Mar 31 09:21:26 mercat1 kernel: pid 22639 (fragments), uid 2007 inumber 14125 on /mnt: filesystem full Mar 31 09:21:27 mercat1 kernel: pid 23868 (fragments), uid 2007 inumber 14090 on /mnt: filesystem full Mar 31 09:21:28 mercat1 kernel: pid 23868 (fragments), uid 2007 inumber 14112 on /mnt: filesystem full Mar 31 09:21:29 mercat1 kernel: pid 23868 (fragments), uid 2007 inumber 14189 on /mnt: filesystem full Mar 31 09:21:30 mercat1 kernel: pid 23863 (fragments), uid 2007 inumber 14129 on /mnt: filesystem full Mar 31 09:21:31 mercat1 kernel: pid 23866 (fragments), uid 2007 inumber 14122 on /mnt: filesystem full Mar 31 09:21:32 mercat1 kernel: pid 23862 (fragments), uid 2007 inumber 14078 on /mnt: filesystem full Mar 31 09:21:33 mercat1 kernel: pid 23865 (fragments), uid 2007 inumber 14182 on /mnt: filesystem full Mar 31 09:21:35 mercat1 kernel: pid 23862 (fragments), uid 2007 inumber 14092 on /mnt: filesystem full Mar 31 09:21:35 mercat1 kernel: pid 25092 (fragments), uid 2007 inumber 14195 on /mnt: filesystem full Mar 31 09:21:36 mercat1 kernel: pid 25093 (fragments), uid 2007 inumber 14085 on /mnt: filesystem full Mar 31 09:21:37 mercat1 kernel: pid 25091 (fragments), uid 2007 inumber 14111 on /mnt: filesystem full Mar 31 09:21:38 mercat1 kernel: pid 25093 (fragments), uid 2007 inumber 14248 on /mnt: filesystem full Mar 31 09:21:39 mercat1 kernel: pid 25098 (fragments), uid 2007 inumber 14080 on /mnt: filesystem full Mar 31 09:21:40 mercat1 kernel: pid 25098 (fragments), uid 2007 inumber 14095 on /mnt: filesystem full Mar 31 09:21:41 mercat1 kernel: pid 25098 (fragments), uid 2007 inumber 14116 on /mnt: filesystem full Mar 31 09:21:42 mercat1 kernel: pid 25110 (fragments), uid 2007 inumber 14183 on /mnt: filesystem full Mar 31 09:21:43 mercat1 kernel: pid 25108 (fragments), uid 2007 inumber 14157 on /mnt: filesystem full Mar 31 09:21:44 mercat1 kernel: pid 25106 (fragments), uid 2007 inumber 14109 on /mnt: filesystem full Mar 31 09:21:46 mercat1 kernel: pid 25103 (fragments), uid 2007 inumber 14180 on /mnt: filesystem full Mar 31 09:21:47 mercat1 kernel: pid 25109 (fragments), uid 2007 inumber 14078 on /mnt: filesystem full Mar 31 09:21:48 mercat1 kernel: pid 25104 (fragments), uid 2007 inumber 14104 on /mnt: filesystem full Mar 31 09:21:49 mercat1 kernel: pid 25104 (fragments), uid 2007 inumber 14088 on /mnt: filesystem full Mar 31 09:21:49 mercat1 kernel: pid 26336 (fragments), uid 2007 inumber 14097 on /mnt: filesystem full Mar 31 09:21:50 mercat1 kernel: pid 26336 (fragments), uid 2007 inumber 14305 on /mnt: filesystem full Mar 31 09:21:51 mercat1 kernel: pid 26340 (fragments), uid 2007 inumber 14088 on /mnt: filesystem full Mar 31 09:21:53 mercat1 kernel: pid 26340 (fragments), uid 2007 inumber 14085 on /mnt: filesystem full Mar 31 09:21:54 mercat1 kernel: pid 26338 (fragments), uid 2007 inumber 14132 on /mnt: filesystem full Mar 31 09:21:55 mercat1 kernel: pid 26340 (fragments), uid 2007 inumber 14176 on /mnt: filesystem full Mar 31 09:21:56 mercat1 kernel: pid 26352 (fragments), uid 2007 inumber 14179 on /mnt: filesystem full Mar 31 09:21:57 mercat1 kernel: pid 26351 (fragments), uid 2007 inumber 14160 on /mnt: filesystem full Mar 31 09:21:58 mercat1 kernel: pid 26351 (fragments), uid 2007 inumber 14132 on /mnt: filesystem full Mar 31 09:21:59 mercat1 kernel: pid 26357 (fragments), uid 2007 inumber 14090 on /mnt: filesystem full Mar 31 09:22:00 mercat1 kernel: pid 26358 (fragments), uid 2007 inumber 14123 on /mnt: filesystem full Mar 31 09:22:01 mercat1 kernel: pid 26353 (fragments), uid 2007 inumber 14094 on /mnt: filesystem full Mar 31 09:22:02 mercat1 kernel: pid 26355 (fragments), uid 2007 inumber 14085 on /mnt: filesystem full Mar 31 09:22:03 mercat1 kernel: pid 27583 (fragments), uid 2007 inumber 14163 on /mnt: filesystem full Mar 31 09:22:04 mercat1 kernel: pid 27581 (fragments), uid 2007 inumber 14278 on /mnt: filesystem full Mar 31 09:22:05 mercat1 kernel: pid 27587 (fragments), uid 2007 inumber 14119 on /mnt: filesystem full Mar 31 09:22:06 mercat1 kernel: pid 27586 (fragments), uid 2007 inumber 14167 on /mnt: filesystem full Mar 31 09:22:07 mercat1 kernel: pid 27586 (fragments), uid 2007 inumber 14124 on /mnt: filesystem full Mar 31 09:22:08 mercat1 kernel: pid 28817 (fragments), uid 2007 inumber 14212 on /mnt: filesystem full Mar 31 09:22:09 mercat1 kernel: pid 28814 (fragments), uid 2007 inumber 14288 on /mnt: filesystem full Mar 31 09:22:10 mercat1 kernel: pid 28817 (fragments), uid 2007 inumber 14354 on /mnt: filesystem full Mar 31 09:22:11 mercat1 kernel: pid 28813 (fragments), uid 2007 inumber 14079 on /mnt: filesystem full Mar 31 09:22:12 mercat1 kernel: pid 28813 (fragments), uid 2007 inumber 14132 on /mnt: filesystem full Mar 31 09:22:13 mercat1 kernel: pid 28813 (fragments), uid 2007 inumber 14113 on /mnt: filesystem full Mar 31 09:22:14 mercat1 kernel: pid 28835 (fragments), uid 2007 inumber 14247 on /mnt: filesystem full Mar 31 09:22:15 mercat1 kernel: pid 28833 (fragments), uid 2007 inumber 14141 on /mnt: filesystem full Mar 31 09:22:16 mercat1 kernel: pid 28837 (fragments), uid 2007 inumber 14252 on /mnt: filesystem full Mar 31 09:22:17 mercat1 kernel: pid 28839 (fragments), uid 2007 inumber 14212 on /mnt: filesystem full Mar 31 09:22:18 mercat1 kernel: pid 28840 (fragments), uid 2007 inumber 14114 on /mnt: filesystem full Mar 31 09:22:19 mercat1 kernel: pid 30059 (fragments), uid 2007 inumber 14093 on /mnt: filesystem full Mar 31 09:22:20 mercat1 kernel: pid 30061 (fragments), uid 2007 inumber 14283 on /mnt: filesystem full Mar 31 09:22:21 mercat1 kernel: pid 30060 (fragments), uid 2007 inumber 14128 on /mnt: filesystem full Mar 31 09:22:22 mercat1 kernel: pid 30065 (fragments), uid 2007 inumber 14173 on /mnt: filesystem full Mar 31 09:22:23 mercat1 kernel: pid 30060 (fragments), uid 2007 inumber 14118 on /mnt: filesystem full Mar 31 09:22:24 mercat1 kernel: pid 30060 (fragments), uid 2007 inumber 14087 on /mnt: filesystem full Mar 31 09:22:25 mercat1 kernel: pid 30066 (fragments), uid 2007 inumber 14080 on /mnt: filesystem full Mar 31 09:22:26 mercat1 kernel: pid 30076 (fragments), uid 2007 inumber 14134 on /mnt: filesystem full Mar 31 09:22:27 mercat1 kernel: pid 30077 (fragments), uid 2007 inumber 14208 on /mnt: filesystem full Mar 31 09:22:28 mercat1 kernel: pid 30077 (fragments), uid 2007 inumber 14165 on /mnt: filesystem full Mar 31 09:22:29 mercat1 kernel: pid 30071 (fragments), uid 2007 inumber 14092 on /mnt: filesystem full Mar 31 09:22:30 mercat1 kernel: pid 30075 (fragments), uid 2007 inumber 14118 on /mnt: filesystem full Mar 31 09:22:31 mercat1 kernel: pid 30074 (fragments), uid 2007 inumber 14077 on /mnt: filesystem full Mar 31 09:22:32 mercat1 kernel: pid 30078 (fragments), uid 2007 inumber 14114 on /mnt: filesystem full Mar 31 09:22:33 mercat1 kernel: pid 30078 (fragments), uid 2007 inumber 14112 on /mnt: filesystem full Mar 31 09:22:34 mercat1 kernel: pid 30078 (fragments), uid 2007 inumber 14141 on /mnt: filesystem full Mar 31 09:22:35 mercat1 kernel: pid 31307 (fragments), uid 2007 inumber 14296 on /mnt: filesystem full Mar 31 09:22:36 mercat1 kernel: pid 31303 (fragments), uid 2007 inumber 14117 on /mnt: filesystem full Mar 31 09:22:37 mercat1 kernel: pid 31306 (fragments), uid 2007 inumber 14160 on /mnt: filesystem full Mar 31 09:22:38 mercat1 kernel: pid 31304 (fragments), uid 2007 inumber 14090 on /mnt: filesystem full Mar 31 09:22:39 mercat1 kernel: pid 31304 (fragments), uid 2007 inumber 14092 on /mnt: filesystem full Mar 31 09:22:40 mercat1 kernel: pid 31304 (fragments), uid 2007 inumber 14088 on /mnt: filesystem full Mar 31 09:22:41 mercat1 kernel: pid 32527 (fragments), uid 2007 inumber 14081 on /mnt: filesystem full Mar 31 09:22:42 mercat1 kernel: pid 32527 (fragments), uid 2007 inumber 14191 on /mnt: filesystem full Mar 31 09:22:43 mercat1 kernel: pid 32531 (fragments), uid 2007 inumber 14099 on /mnt: filesystem full Mar 31 09:22:44 mercat1 kernel: pid 32530 (fragments), uid 2007 inumber 14086 on /mnt: filesystem full Mar 31 09:22:45 mercat1 kernel: pid 32531 (fragments), uid 2007 inumber 14147 on /mnt: filesystem full Mar 31 09:22:46 mercat1 kernel: pid 32534 (fragments), uid 2007 inumber 14111 on /mnt: filesystem full Mar 31 09:22:47 mercat1 kernel: pid 32529 (fragments), uid 2007 inumber 14159 on /mnt: filesystem full Mar 31 09:22:48 mercat1 kernel: pid 32530 (fragments), uid 2007 inumber 14177 on /mnt: filesystem full Mar 31 09:22:49 mercat1 kernel: pid 33393 (fragments), uid 2007 inumber 14155 on /mnt: filesystem full Mar 31 09:22:50 mercat1 kernel: pid 33396 (fragments), uid 2007 inumber 14153 on /mnt: filesystem full Mar 31 09:22:51 mercat1 kernel: pid 33389 (fragments), uid 2007 inumber 14189 on /mnt: filesystem full Mar 31 09:22:52 mercat1 kernel: pid 33398 (fragments), uid 2007 inumber 14210 on /mnt: filesystem full Mar 31 09:22:53 mercat1 kernel: pid 33398 (fragments), uid 2007 inumber 14092 on /mnt: filesystem full Mar 31 09:22:54 mercat1 kernel: pid 33398 (fragments), uid 2007 inumber 14209 on /mnt: filesystem full Mar 31 09:22:55 mercat1 kernel: pid 33775 (fragments), uid 2007 inumber 14157 on /mnt: filesystem full Mar 31 09:22:56 mercat1 kernel: pid 33777 (fragments), uid 2007 inumber 14119 on /mnt: filesystem full Mar 31 09:22:57 mercat1 kernel: pid 33777 (fragments), uid 2007 inumber 14115 on /mnt: filesystem full Mar 31 09:22:58 mercat1 kernel: pid 33778 (fragments), uid 2007 inumber 14082 on /mnt: filesystem full Mar 31 09:22:59 mercat1 kernel: pid 33778 (fragments), uid 2007 inumber 14088 on /mnt: filesystem full Mar 31 09:23:00 mercat1 kernel: pid 33778 (fragments), uid 2007 inumber 14079 on /mnt: filesystem full Mar 31 09:23:01 mercat1 kernel: pid 34998 (fragments), uid 2007 inumber 14152 on /mnt: filesystem full Mar 31 09:23:02 mercat1 kernel: pid 35001 (fragments), uid 2007 inumber 14258 on /mnt: filesystem full Mar 31 09:23:03 mercat1 kernel: pid 35003 (fragments), uid 2007 inumber 14212 on /mnt: filesystem full Mar 31 09:23:04 mercat1 kernel: pid 34999 (fragments), uid 2007 inumber 14107 on /mnt: filesystem full Mar 31 09:23:05 mercat1 kernel: pid 35001 (fragments), uid 2007 inumber 14079 on /mnt: filesystem full 20230331 09:23:07 all (68/358): fs.sh Mar 31 09:25:10 mercat1 kernel: pid 48760 (rw), uid 2007 inumber 7 on /mnt: filesystem full Mar 31 09:26:18 mercat1 kernel: pid 54955 (rw), uid 2007 inumber 1826 on /mnt: filesystem full Mar 31 09:26:33 mercat1 kernel: pid 54940 (rw), uid 2007 inumber 2562 on /mnt: filesystem full Mar 31 09:30:10 mercat1 kernel: pid 82146 (rw), uid 2007 inumber 2308 on /mnt: filesystem full Mar 31 09:30:21 mercat1 kernel: pid 82147 (creat), uid 2007 inumber 5 on /mnt: out of inodes Mar 31 09:30:22 mercat1 kernel: pid 82139 (creat), uid 2007 inumber 770 on /mnt: out of inodes Mar 31 09:30:24 mercat1 kernel: pid 82167 (creat), uid 2007 inumber 1540 on /mnt: out of inodes Mar 31 09:30:25 mercat1 kernel: pid 82157 (creat), uid 2007 inumber 6 on /mnt: out of inodes Mar 31 09:30:27 mercat1 kernel: pid 82153 (creat), uid 2007 inumber 2310 on /mnt: out of inodes Mar 31 09:30:28 mercat1 kernel: pid 82155 (rw), uid 2007 inumber 2309 on /mnt: out of inodes Mar 31 09:30:29 mercat1 kernel: pid 82160 (creat), uid 2007 inumber 771 on /mnt: out of inodes Mar 31 09:30:31 mercat1 kernel: pid 82147 (creat), uid 2007 inumber 5 on /mnt: out of inodes Mar 31 09:30:32 mercat1 kernel: pid 82153 (creat), uid 2007 inumber 2310 on /mnt: out of inodes Mar 31 09:30:33 mercat1 kernel: pid 82163 (creat), uid 2007 inumber 768 on /mnt: out of inodes Mar 31 09:30:35 mercat1 kernel: pid 82165 (creat), uid 2007 inumber 769 on /mnt: out of inodes Mar 31 09:30:38 mercat1 kernel: pid 82139 (creat), uid 2007 inumber 770 on /mnt: out of inodes Mar 31 09:30:40 mercat1 kernel: pid 82157 (creat), uid 2007 inumber 6 on /mnt: out of inodes Mar 31 09:30:42 mercat1 kernel: pid 82141 (creat), uid 2007 inumber 2306 on /mnt: out of inodes Mar 31 09:30:43 mercat1 kernel: pid 82144 (creat), uid 2007 inumber 4 on /mnt: out of inodes Mar 31 09:30:45 mercat1 syslogd: last message repeated 1 times Mar 31 09:30:47 mercat1 kernel: pid 82163 (creat), uid 2007 inumber 768 on /mnt: out of inodes Mar 31 09:30:49 mercat1 kernel: pid 82153 (creat), uid 2007 inumber 2310 on /mnt: out of inodes Mar 31 09:30:50 mercat1 kernel: pid 82160 (creat), uid 2007 inumber 771 on /mnt: out of inodes Mar 31 09:30:52 mercat1 kernel: pid 82157 (creat), uid 2007 inumber 6 on /mnt: out of inodes Mar 31 09:30:54 mercat1 kernel: pid 82147 (creat), uid 2007 inumber 5 on /mnt: out of inodes Mar 31 09:30:55 mercat1 kernel: pid 82139 (creat), uid 2007 inumber 770 on /mnt: out of inodes Mar 31 09:30:57 mercat1 kernel: pid 82167 (creat), uid 2007 inumber 1540 on /mnt: out of inodes Mar 31 09:30:59 mercat1 kernel: pid 82163 (creat), uid 2007 inumber 768 on /mnt: out of inodes Mar 31 09:31:02 mercat1 kernel: pid 82147 (creat), uid 2007 inumber 5 on /mnt: out of inodes Mar 31 09:31:03 mercat1 kernel: pid 82163 (creat), uid 2007 inumber 768 on /mnt: out of inodes Mar 31 09:31:05 mercat1 kernel: pid 82147 (creat), uid 2007 inumber 5 on /mnt: out of inodes Mar 31 09:31:06 mercat1 kernel: pid 82160 (creat), uid 2007 inumber 771 on /mnt: out of inodes Mar 31 09:31:08 mercat1 kernel: pid 82165 (creat), uid 2007 inumber 769 on /mnt: out of inodes Mar 31 09:31:09 mercat1 syslogd: last message repeated 1 times Mar 31 09:31:16 mercat1 kernel: pid 88360 (rw), uid 2007 inumber 1563 on /mnt: filesystem full Mar 31 09:31:53 mercat1 kernel: pid 88372 (rw), uid 2007 inumber 1608 on /mnt: filesystem full Mar 31 09:32:28 mercat1 kernel: pid 95788 (creat), uid 2007 inumber 17 on /mnt: out of inodes Mar 31 09:32:31 mercat1 kernel: pid 95794 (rw), uid 2007 inumber 778 on /mnt: out of inodes Mar 31 09:32:38 mercat1 kernel: pid 95796 (creat), uid 2007 inumber 790 on /mnt: out of inodes Mar 31 09:32:40 mercat1 kernel: pid 95792 (creat), uid 2007 inumber 787 on /mnt: out of inodes Mar 31 09:32:42 mercat1 kernel: pid 95784 (creat), uid 2007 inumber 12 on /mnt: out of inodes Mar 31 09:32:43 mercat1 kernel: pid 95788 (creat), uid 2007 inumber 17 on /mnt: out of inodes Mar 31 09:32:44 mercat1 kernel: pid 95796 (creat), uid 2007 inumber 790 on /mnt: out of inodes Mar 31 09:32:46 mercat1 kernel: pid 95784 (creat), uid 2007 inumber 12 on /mnt: out of inodes Mar 31 09:32:49 mercat1 kernel: pid 95788 (creat), uid 2007 inumber 17 on /mnt: out of inodes Mar 31 09:32:51 mercat1 kernel: pid 95796 (creat), uid 2007 inumber 790 on /mnt: out of inodes Mar 31 09:32:54 mercat1 kernel: pid 95790 (creat), uid 2007 inumber 21 on /mnt: out of inodes Mar 31 09:33:24 mercat1 kernel: pid 3230 (creat), uid 2007 inumber 6 on /mnt: out of inodes Mar 31 09:33:26 mercat1 kernel: pid 3238 (creat), uid 2007 inumber 10 on /mnt: out of inodes Mar 31 09:33:27 mercat1 syslogd: last message repeated 1 times Mar 31 09:33:29 mercat1 kernel: pid 3233 (creat), uid 2007 inumber 2313 on /mnt: out of inodes Mar 31 09:33:30 mercat1 kernel: pid 3230 (creat), uid 2007 inumber 6 on /mnt: out of inodes Mar 31 09:33:33 mercat1 kernel: pid 3219 (creat), uid 2007 inumber 9 on /mnt: out of inodes Mar 31 09:33:35 mercat1 kernel: pid 3229 (creat), uid 2007 inumber 2309 on /mnt: out of inodes Mar 31 09:33:36 mercat1 kernel: pid 3231 (creat), uid 2007 inumber 8 on /mnt: out of inodes Mar 31 09:33:38 mercat1 kernel: pid 3219 (creat), uid 2007 inumber 9 on /mnt: out of inodes Mar 31 09:33:39 mercat1 kernel: pid 3213 (creat), uid 2007 inumber 1538 on /mnt: out of inodes Mar 31 09:33:42 mercat1 kernel: pid 3221 (creat), uid 2007 inumber 1543 on /mnt: out of inodes Mar 31 09:33:43 mercat1 kernel: pid 3213 (creat), uid 2007 inumber 1538 on /mnt: out of inodes Mar 31 09:33:44 mercat1 kernel: pid 3236 (creat), uid 2007 inumber 769 on /mnt: out of inodes Mar 31 09:33:45 mercat1 kernel: pid 3234 (creat), uid 2007 inumber 768 on /mnt: out of inodes Mar 31 09:33:46 mercat1 kernel: pid 3224 (creat), uid 2007 inumber 770 on /mnt: out of inodes Mar 31 09:33:48 mercat1 kernel: pid 3226 (creat), uid 2007 inumber 1544 on /mnt: out of inodes Mar 31 09:33:50 mercat1 kernel: pid 3231 (creat), uid 2007 inumber 8 on /mnt: out of inodes Mar 31 09:33:51 mercat1 kernel: pid 3230 (creat), uid 2007 inumber 6 on /mnt: out of inodes Mar 31 09:33:55 mercat1 kernel: pid 3224 (creat), uid 2007 inumber 770 on /mnt: out of inodes Mar 31 09:33:56 mercat1 kernel: pid 3238 (creat), uid 2007 inumber 10 on /mnt: out of inodes Mar 31 09:33:57 mercat1 kernel: pid 3237 (creat), uid 2007 inumber 1539 on /mnt: out of inodes Mar 31 09:33:58 mercat1 kernel: pid 3231 (creat), uid 2007 inumber 8 on /mnt: out of inodes Mar 31 09:34:00 mercat1 kernel: pid 3238 (creat), uid 2007 inumber 10 on /mnt: out of inodes Mar 31 09:34:01 mercat1 kernel: pid 3230 (creat), uid 2007 inumber 6 on /mnt: out of inodes Mar 31 09:34:02 mercat1 kernel: pid 3237 (creat), uid 2007 inumber 1539 on /mnt: out of inodes Mar 31 09:34:05 mercat1 kernel: pid 3221 (creat), uid 2007 inumber 1543 on /mnt: out of inodes Mar 31 09:34:07 mercat1 kernel: pid 3219 (creat), uid 2007 inumber 9 on /mnt: out of inodes Mar 31 09:34:08 mercat1 kernel: pid 3221 (creat), uid 2007 inumber 1543 on /mnt: out of inodes Mar 31 09:34:11 mercat1 kernel: pid 3216 (creat), uid 2007 inumber 2311 on /mnt: out of inodes Mar 31 09:34:12 mercat1 kernel: pid 3231 (creat), uid 2007 inumber 8 on /mnt: out of inodes Mar 31 09:34:14 mercat1 kernel: pid 3236 (creat), uid 2007 inumber 769 on /mnt: out of inodes Mar 31 09:34:16 mercat1 kernel: pid 3228 (creat), uid 2007 inumber 2312 on /mnt: out of inodes Mar 31 09:34:22 mercat1 kernel: pid 9425 (rw), uid 2007 inumber 793 on /mnt: filesystem full Mar 31 09:34:28 mercat1 kernel: pid 9446 (mkdir), uid 2007 inumber 1182 on /mnt: out of inodes Mar 31 09:34:30 mercat1 kernel: pid 9463 (mkdir), uid 2007 inumber 3004 on /mnt: out of inodes Mar 31 09:34:42 mercat1 kernel: pid 9464 (creat), uid 2007 inumber 11 on /mnt: out of inodes Mar 31 09:34:58 mercat1 kernel: pid 9429 (creat), uid 2007 inumber 1538 on /mnt: out of inodes Mar 31 09:35:05 mercat1 kernel: pid 9444 (mkdir), uid 2007 inumber 1015 on /mnt: out of inodes Mar 31 09:35:10 mercat1 kernel: pid 9448 (mkdir), uid 2007 inumber 3011 on /mnt: out of inodes Mar 31 09:35:47 mercat1 kernel: pid 15645 (creat), uid 2007 inumber 1541 on /mnt: out of inodes Mar 31 09:36:27 mercat1 kernel: pid 23038 (rw), uid 2007 inumber 2311 on /mnt: filesystem full Mar 31 09:36:30 mercat1 kernel: pid 23056 (rw), uid 2007 inumber 777 on /mnt: filesystem full Mar 31 09:36:31 mercat1 kernel: pid 23050 (rw), uid 2007 inumber 1796 on /mnt: filesystem full Mar 31 09:36:39 mercat1 kernel: pid 23062 (rw), uid 2007 inumber 2493 on /mnt: filesystem full Mar 31 09:36:40 mercat1 kernel: pid 23065 (rw), uid 2007 inumber 1117 on /mnt: filesystem full Mar 31 09:36:43 mercat1 kernel: pid 23041 (rw), uid 2007 inumber 3048 on /mnt: filesystem full Mar 31 09:37:28 mercat1 kernel: pid 30484 (rw), uid 2007 inumber 1546 on /mnt: filesystem full Mar 31 09:38:32 mercat1 kernel: pid 37890 (rw), uid 2007 inumber 1540 on /mnt: filesystem full 20230331 09:39:32 all (69/358): fsck.sh 20230331 09:40:35 all (70/358): fsck3.sh 20230331 09:40:38 all (71/358): fsck5.sh 20230331 09:40:49 all (72/358): fsck6.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt 20230331 09:41:29 all (73/358): fsck7.sh 20230331 09:41:32 all (74/358): fsck8.sh 20230331 09:46:35 all (75/358): fsck9.sh 20230331 09:51:39 all (76/358): fstat.sh 20230331 09:53:42 all (77/358): fsync2.sh 20230331 09:54:44 all (78/358): fsync3.sh 20230331 09:56:05 all (79/358): fsync4.sh 20230331 09:57:24 all (80/358): ftruncate2.sh Mar 31 09:57:26 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 59 on /mnt: filesystem full Mar 31 09:57:27 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 321 on /mnt: filesystem full Mar 31 09:57:28 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 316 on /mnt: filesystem full Mar 31 09:57:30 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 272 on /mnt: filesystem full Mar 31 09:57:31 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 200 on /mnt: filesystem full Mar 31 09:57:32 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 409 on /mnt: filesystem full Mar 31 09:57:34 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 199 on /mnt: filesystem full Mar 31 09:57:35 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 405 on /mnt: filesystem full Mar 31 09:57:36 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 6 on /mnt: filesystem full Mar 31 09:57:38 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 414 on /mnt: filesystem full Mar 31 09:57:39 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 219 on /mnt: filesystem full Mar 31 09:57:40 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 449 on /mnt: filesystem full Mar 31 09:57:42 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 455 on /mnt: filesystem full Mar 31 09:57:43 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 221 on /mnt: filesystem full Mar 31 09:57:44 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 498 on /mnt: filesystem full Mar 31 09:57:46 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 149 on /mnt: filesystem full Mar 31 09:57:47 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 410 on /mnt: filesystem full Mar 31 09:57:48 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 255 on /mnt: filesystem full Mar 31 09:57:49 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 329 on /mnt: filesystem full Mar 31 09:57:51 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 34 on /mnt: filesystem full Mar 31 09:57:52 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 62 on /mnt: filesystem full Mar 31 09:57:53 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 55 on /mnt: filesystem full Mar 31 09:57:55 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 320 on /mnt: filesystem full Mar 31 09:57:56 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 474 on /mnt: filesystem full Mar 31 09:57:58 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 470 on /mnt: filesystem full Mar 31 09:57:59 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 353 on /mnt: filesystem full Mar 31 09:58:00 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 211 on /mnt: filesystem full Mar 31 09:58:02 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 466 on /mnt: filesystem full Mar 31 09:58:03 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 258 on /mnt: filesystem full Mar 31 09:58:04 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 232 on /mnt: filesystem full Mar 31 09:58:05 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 7 on /mnt: filesystem full Mar 31 09:58:07 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 127 on /mnt: filesystem full Mar 31 09:58:08 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 493 on /mnt: filesystem full Mar 31 09:58:09 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 115 on /mnt: filesystem full Mar 31 09:58:11 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 96 on /mnt: filesystem full Mar 31 09:58:12 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 482 on /mnt: filesystem full Mar 31 09:58:13 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 382 on /mnt: filesystem full Mar 31 09:58:15 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 134 on /mnt: filesystem full Mar 31 09:58:16 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 387 on /mnt: filesystem full Mar 31 09:58:17 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 430 on /mnt: filesystem full Mar 31 09:58:19 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 18 on /mnt: filesystem full Mar 31 09:58:20 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 39 on /mnt: filesystem full Mar 31 09:58:22 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 433 on /mnt: filesystem full Mar 31 09:58:23 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 252 on /mnt: filesystem full Mar 31 09:58:24 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 404 on /mnt: filesystem full Mar 31 09:58:26 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 187 on /mnt: filesystem full Mar 31 09:58:27 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 194 on /mnt: filesystem full Mar 31 09:58:28 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 446 on /mnt: filesystem full Mar 31 09:58:30 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 257 on /mnt: filesystem full Mar 31 09:58:31 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 238 on /mnt: filesystem full Mar 31 09:58:32 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 476 on /mnt: filesystem full Mar 31 09:58:34 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 109 on /mnt: filesystem full Mar 31 09:58:35 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 411 on /mnt: filesystem full Mar 31 09:58:36 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 434 on /mnt: filesystem full Mar 31 09:58:38 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 254 on /mnt: filesystem full Mar 31 09:58:39 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 46 on /mnt: filesystem full Mar 31 09:58:40 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 302 on /mnt: filesystem full Mar 31 09:58:42 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 22 on /mnt: filesystem full Mar 31 09:58:43 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 85 on /mnt: filesystem full Mar 31 09:58:44 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 260 on /mnt: filesystem full Mar 31 09:58:46 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 102 on /mnt: filesystem full Mar 31 09:58:47 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 350 on /mnt: filesystem full Mar 31 09:58:49 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 191 on /mnt: filesystem full Mar 31 09:58:50 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 246 on /mnt: filesystem full Mar 31 09:58:51 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 447 on /mnt: filesystem full Mar 31 09:58:52 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 173 on /mnt: filesystem full Mar 31 09:58:54 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 119 on /mnt: filesystem full Mar 31 09:58:55 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 187 on /mnt: filesystem full Mar 31 09:58:57 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 347 on /mnt: filesystem full Mar 31 09:58:58 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 393 on /mnt: filesystem full Mar 31 09:58:59 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 80 on /mnt: filesystem full Mar 31 09:59:01 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 297 on /mnt: filesystem full Mar 31 09:59:02 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 307 on /mnt: filesystem full Mar 31 09:59:03 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 94 on /mnt: filesystem full Mar 31 09:59:05 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 113 on /mnt: filesystem full Mar 31 09:59:06 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 414 on /mnt: filesystem full Mar 31 09:59:07 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 278 on /mnt: filesystem full Mar 31 09:59:09 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 328 on /mnt: filesystem full Mar 31 09:59:10 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 255 on /mnt: filesystem full Mar 31 09:59:12 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 420 on /mnt: filesystem full Mar 31 09:59:13 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 373 on /mnt: filesystem full Mar 31 09:59:14 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 244 on /mnt: filesystem full Mar 31 09:59:16 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 423 on /mnt: filesystem full Mar 31 09:59:17 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 200 on /mnt: filesystem full Mar 31 09:59:18 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 48 on /mnt: filesystem full Mar 31 09:59:20 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 126 on /mnt: filesystem full Mar 31 09:59:21 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 337 on /mnt: filesystem full Mar 31 09:59:22 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 106 on /mnt: filesystem full Mar 31 09:59:24 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 421 on /mnt: filesystem full Mar 31 09:59:25 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 262 on /mnt: filesystem full Mar 31 09:59:26 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 291 on /mnt: filesystem full Mar 31 09:59:28 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 191 on /mnt: filesystem full Mar 31 09:59:29 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 99 on /mnt: filesystem full Mar 31 09:59:30 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 364 on /mnt: filesystem full Mar 31 09:59:32 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 67 on /mnt: filesystem full Mar 31 09:59:33 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 52 on /mnt: filesystem full Mar 31 09:59:34 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 478 on /mnt: filesystem full Mar 31 09:59:36 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 121 on /mnt: filesystem full Mar 31 09:59:37 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 267 on /mnt: filesystem full Mar 31 09:59:38 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 10 on /mnt: filesystem full Mar 31 09:59:40 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 45 on /mnt: filesystem full Mar 31 09:59:41 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 213 on /mnt: filesystem full Mar 31 09:59:43 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 473 on /mnt: filesystem full Mar 31 09:59:44 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 278 on /mnt: filesystem full Mar 31 09:59:45 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 250 on /mnt: filesystem full Mar 31 09:59:47 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 403 on /mnt: filesystem full Mar 31 09:59:48 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 125 on /mnt: filesystem full Mar 31 09:59:49 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 282 on /mnt: filesystem full Mar 31 09:59:51 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 51 on /mnt: filesystem full Mar 31 09:59:52 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 483 on /mnt: filesystem full Mar 31 09:59:53 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 354 on /mnt: filesystem full Mar 31 09:59:55 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 407 on /mnt: filesystem full Mar 31 09:59:56 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 45 on /mnt: filesystem full Mar 31 09:59:57 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 397 on /mnt: filesystem full Mar 31 09:59:59 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 468 on /mnt: filesystem full Mar 31 10:00:00 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 241 on /mnt: filesystem full Mar 31 10:00:02 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 483 on /mnt: filesystem full Mar 31 10:00:03 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 85 on /mnt: filesystem full Mar 31 10:00:04 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 421 on /mnt: filesystem full Mar 31 10:00:06 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 379 on /mnt: filesystem full Mar 31 10:00:07 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 24 on /mnt: filesystem full Mar 31 10:00:08 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 232 on /mnt: filesystem full Mar 31 10:00:09 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 13 on /mnt: filesystem full Mar 31 10:00:11 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 376 on /mnt: filesystem full Mar 31 10:00:12 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 54 on /mnt: filesystem full Mar 31 10:00:14 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 402 on /mnt: filesystem full Mar 31 10:00:15 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 293 on /mnt: filesystem full Mar 31 10:00:16 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 211 on /mnt: filesystem full Mar 31 10:00:18 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 412 on /mnt: filesystem full Mar 31 10:00:19 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 310 on /mnt: filesystem full Mar 31 10:00:21 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 272 on /mnt: filesystem full Mar 31 10:00:22 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 496 on /mnt: filesystem full Mar 31 10:00:23 mercat1 kernel: pid 46358 (ftruncate2), uid 65534 inumber 152 on /mnt: filesystem full 20230331 10:00:27 all (81/358): fts.sh 20230331 10:21:13 all (82/358): fts2.sh 20230331 10:22:18 all (83/358): fts3.sh 20230331 10:24:23 all (84/358): full.sh 20230331 10:35:41 all (85/358): fullpath2.sh 20230331 10:40:56 all (86/358): gbde.sh Mar 31 10:41:52 mercat1 kernel: pid 20279 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Mar 31 10:58:00 mercat1 kernel: pid 67681 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20230331 11:01:28 all (87/358): geli.sh GEOM_ELI: Device md10.eli created. GEOM_ELI: Encryption: AES-XTS 128 GEOM_ELI: Crypto: accelerated software GEOM_ELI: md10 has been killed. GEOM_ELI: Device md10.eli destroyed. 20230331 11:09:09 all (88/358): geomleak.sh 20230331 11:09:11 all (89/358): geomleak2.sh 20230331 11:10:13 all (90/358): gnop.sh GEOM_NOP: Device md10.nop created. Mar 31 11:10:55 mercat1 kernel: pid 73802 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20230331 11:27:01 all (91/358): gnop11.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. g_vfs_done(): md10.nop converting all errors to ENXIO g_vfs_done():md10.nop[WRITE(offset=3374940160, length=32768)]error = 6 supressing further ENXIO UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt 20230331 11:29:04 all (92/358): gnop12.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt 20230331 11:52:42 all (93/358): gnop2.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20230331 11:53:58 all (94/358): gnop3.sh 20230331 11:54:00 all (95/358): gnop4.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20230331 12:05:14 all (96/358): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20230331 12:05:17 all (97/358): gnop6.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20230331 12:11:17 all (98/358): graid0.sh GEOM_STRIPE: Device data created (id=1025499423). GEOM_STRIPE: Disk md10 attached to data. GEOM_STRIPE: Disk md11 attached to data. GEOM_STRIPE: Disk md12 attached to data. GEOM_STRIPE: Device stripe/data activated. GEOM_STRIPE: Cannot add disk ufsid/6426b1c7a3a4f713 to data (error=17). Mar 31 12:12:48 mercat1 kernel: pid 13583 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Mar 31 12:13:23 mercat1 kernel: pid 13553 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Mar 31 12:14:19 mercat1 kernel: pid 15380 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page GEOM_STRIPE: Cannot add disk ufsid/6426b1c7a3a4f713 to data (error=17). GEOM_STRIPE: Disk md12 removed from data. GEOM_STRIPE: Device stripe/data deactivated. GEOM_STRIPE: Disk md11 removed from data. GEOM_STRIPE: Disk md10 removed from data. GEOM_STRIPE: Device data destroyed. 20230331 12:22:17 all (99/358): graid1.sh Mar 31 12:31:30 mercat1 kernel: pid 37321 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Mar 31 12:32:01 mercat1 kernel: pid 37325 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20230331 12:33:07 all (100/358): graid1_10.sh 20230331 12:35:14 all (101/358): graid1_4.sh Mar 31 12:36:21 mercat1 kernel: pid 54972 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page UFS: forcibly unmounting /dev/mirror/test from /mnt 20230331 12:47:41 all (102/358): graid1_5.sh GEOM_NOP: Device md11.nop created. GEOM_NOP: Device md12.nop created. GEOM_NOP: Device md11.nop removed. GEOM_NOP: Device md12.nop removed. 20230331 12:53:55 all (103/358): graid1_6.sh 20230331 13:00:12 all (104/358): graid1_7.sh Mar 31 13:00:56 mercat1 kernel: pid 31278 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Mar 31 13:01:28 mercat1 kernel: pid 31318 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20230331 13:08:23 all (105/358): graid3.sh GEOM_RAID3: Device raid3/data launched (3/3). swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio GEOM_RAID3: Device data: provider raid3/data destroyed. GEOM_RAID3: Device data destroyed. 20230331 13:30:06 all (106/358): growfs.sh g_dev_taste: g_dev_taste(ufsid/6426c43fb3966fcf) failed to g_attach, error=6 g_dev_taste: g_dev_taste(gptid/63b011d5-cfb7-11ed-aed0-0cc47aa8cdda) failed to g_attach, error=6 20230331 13:30:11 all (107/358): growfs2.sh 20230331 13:30:14 all (108/358): gunion.sh Mar 31 13:35:53 mercat1 kernel: pid 4366 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20230331 13:37:30 all (109/358): gunion2.sh Mar 31 13:44:02 mercat1 kernel: pid 13584 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20230331 13:44:28 all (110/358): holdcnt0.sh 20230331 13:44:30 all (111/358): holdcnt04.sh 20230331 13:44:32 all (112/358): indir.sh Mar 31 13:49:08 mercat1 kernel: pid 24253 (indir), uid 0 inumber 364859 on /mnt: out of inodes 20230331 13:51:50 all (113/358): indir_trunc.sh 20230331 13:56:56 all (114/358): isofs3.sh 20230331 14:03:14 all (115/358): kevent11.sh Mar 31 14:06:29 mercat1 kernel: pid 82978 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20230331 14:06:31 all (116/358): kevent6.sh 20230331 14:06:48 all (117/358): kevent7.sh 20230331 14:11:56 all (118/358): kevent8.sh 20230331 14:12:00 all (119/358): laundry.sh 20230331 14:17:02 all (120/358): linger.sh 20230331 14:27:19 all (121/358): linger2.sh Mar 31 14:27:23 mercat1 kernel: pid 58724 (linger2), uid 2007 inumber 889 on /mnt: filesystem full 20230331 14:27:26 all (122/358): linger3.sh 20230331 14:28:54 all (123/358): linger4.sh 20230331 14:39:23 all (124/358): link.sh Mar 31 14:40:22 mercat1 kernel: pid 42627 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page Mar 31 14:40:53 mercat1 kernel: pid 42645 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20230331 14:47:19 all (125/358): link2.sh 20230331 14:52:35 all (126/358): lockf3.sh Mar 31 14:53:18 mercat1 kernel: pid 72419 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page stress2: GEOM leak: 17/91 20230331 14:54:32 all (127/358): lockf4.sh 20230331 14:57:07 all (128/358): lstat.sh 20230331 15:07:09 all (129/358): mac_chkexec.sh 20230331 15:07:11 all (130/358): marcus.sh 20230331 15:28:03 all (131/358): marcus2.sh 20230331 15:50:12 all (132/358): marcus5.sh 20230331 16:05:56 all (133/358): marcus6.sh 20230331 16:08:51 all (134/358): marcus7.sh 20230331 16:21:15 all (135/358): marcus8.sh 20230331 16:27:49 all (136/358): md.sh Mar 31 16:29:53 mercat1 kernel: pid 54459 (rw), uid 0 inumber 130 on /mnt: filesystem full Mar 31 16:29:58 mercat1 kernel: pid 54460 (rw), uid 0 inumber 5 on /mnt: filesystem full Mar 31 16:30:02 mercat1 kernel: pid 55703 (rw), uid 0 inumber 144 on /mnt: filesystem full Mar 31 16:30:03 mercat1 kernel: pid 55715 (rw), uid 0 inumber 141 on /mnt: filesystem full Mar 31 16:30:05 mercat1 kernel: pid 55713 (rw), uid 0 inumber 129 on /mnt: filesystem full Mar 31 16:30:06 mercat1 kernel: pid 55712 (rw), uid 0 inumber 8 on /mnt: filesystem full Mar 31 16:30:07 mercat1 kernel: pid 55716 (rw), uid 0 inumber 5 on /mnt: filesystem full Mar 31 16:30:09 mercat1 kernel: pid 55701 (rw), uid 0 inumber 6 on /mnt: filesystem full Mar 31 16:36:02 mercat1 kernel: pid 96308 (rw), uid 0 inumber 13 on /mnt: filesystem full Mar 31 16:36:06 mercat1 kernel: pid 96305 (rw), uid 0 inumber 11 on /mnt: filesystem full Mar 31 16:38:03 mercat1 kernel: pid 9882 (rw), uid 0 inumber 5 on /mnt: filesystem full Mar 31 16:38:04 mercat1 kernel: pid 9883 (rw), uid 0 inumber 132 on /mnt: filesystem full Mar 31 16:38:08 mercat1 kernel: pid 9881 (rw), uid 0 inumber 131 on /mnt: filesystem full Mar 31 16:38:09 mercat1 kernel: pid 9884 (rw), uid 0 inumber 129 on /mnt: filesystem full Mar 31 16:38:10 mercat1 kernel: pid 12296 (rw), uid 0 inumber 5 on /mnt: filesystem full Mar 31 16:38:11 mercat1 kernel: pid 12290 (rw), uid 0 inumber 4 on /mnt: filesystem full Mar 31 16:38:13 mercat1 kernel: pid 12291 (rw), uid 0 inumber 133 on /mnt: filesystem full Mar 31 16:38:15 mercat1 kernel: pid 12292 (rw), uid 0 inumber 130 on /mnt: filesystem full Mar 31 16:38:17 mercat1 kernel: pid 12294 (rw), uid 0 inumber 129 on /mnt: filesystem full Mar 31 16:38:20 mercat1 kernel: pid 12355 (rw), uid 0 inumber 136 on /mnt: filesystem full Mar 31 16:38:21 mercat1 kernel: pid 12361 (rw), uid 0 inumber 129 on /mnt: filesystem full Mar 31 16:38:23 mercat1 kernel: pid 12359 (rw), uid 0 inumber 7 on /mnt: filesystem full Mar 31 16:38:25 mercat1 kernel: pid 12357 (rw), uid 0 inumber 4 on /mnt: filesystem full Mar 31 16:38:29 mercat1 kernel: pid 12358 (rw), uid 0 inumber 129 on /mnt: filesystem full Mar 31 16:38:32 mercat1 kernel: pid 13606 (rw), uid 0 inumber 130 on /mnt: filesystem full Mar 31 16:38:34 mercat1 kernel: pid 13608 (rw), uid 0 inumber 129 on /mnt: filesystem full Mar 31 16:38:37 mercat1 kernel: pid 14839 (rw), uid 0 inumber 132 on /mnt: filesystem full Mar 31 16:38:40 mercat1 kernel: pid 14840 (rw), uid 0 inumber 129 on /mnt: filesystem full Mar 31 16:38:44 mercat1 kernel: pid 14841 (rw), uid 0 inumber 5 on /mnt: filesystem full Mar 31 16:38:47 mercat1 kernel: pid 16073 (rw), uid 0 inumber 137 on /mnt: filesystem full Mar 31 16:38:49 mercat1 kernel: pid 16076 (rw), uid 0 inumber 133 on /mnt: filesystem full Mar 31 16:38:54 mercat1 kernel: pid 16070 (rw), uid 0 inumber 130 on /mnt: filesystem full Mar 31 16:40:45 mercat1 kernel: pid 29594 (rw), uid 0 inumber 5 on /mnt: filesystem full Mar 31 16:40:48 mercat1 kernel: pid 29593 (rw), uid 0 inumber 133 on /mnt: filesystem full Mar 31 16:40:50 mercat1 kernel: pid 29592 (rw), uid 0 inumber 131 on /mnt: filesystem full Mar 31 16:40:52 mercat1 kernel: pid 29590 (rw), uid 0 inumber 131 on /mnt: filesystem full Mar 31 16:40:54 mercat1 kernel: pid 29595 (rw), uid 0 inumber 129 on /mnt: filesystem full Mar 31 16:43:01 mercat1 kernel: pid 44347 (rw), uid 0 inumber 129 on /mnt: filesystem full Mar 31 16:43:03 mercat1 kernel: pid 44340 (rw), uid 0 inumber 133 on /mnt: filesystem full Mar 31 16:44:57 mercat1 kernel: pid 57879 (rw), uid 0 inumber 139 on /mnt: filesystem full Mar 31 16:45:00 mercat1 kernel: pid 57882 (rw), uid 0 inumber 131 on /mnt: filesystem full Mar 31 16:45:02 mercat1 kernel: pid 57885 (rw), uid 0 inumber 8 on /mnt: filesystem full Mar 31 16:45:04 mercat1 kernel: pid 57877 (rw), uid 0 inumber 6 on /mnt: filesystem full Mar 31 16:45:05 mercat1 kernel: pid 57883 (rw), uid 0 inumber 4 on /mnt: filesystem full Mar 31 16:45:06 mercat1 kernel: pid 57878 (rw), uid 0 inumber 129 on /mnt: filesystem full Mar 31 16:46:59 mercat1 kernel: pid 72402 (rw), uid 0 inumber 5 on /mnt: filesystem full Mar 31 16:47:02 mercat1 kernel: pid 72401 (rw), uid 0 inumber 131 on /mnt: filesystem full 20230331 16:47:03 all (137/358): md2.sh Mar 31 16:48:19 mercat1 kernel: pid 72804 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page Mar 31 16:48:56 mercat1 kernel: pid 72787 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20230331 17:07:56 all (138/358): md3.sh Mar 31 17:12:53 mercat1 kernel: pid 54979 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page Mar 31 17:13:32 mercat1 kernel: pid 54971 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page Mar 31 17:16:14 mercat1 kernel: pid 56829 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20230331 17:18:33 all (139/358): md5.sh 20230331 17:18:35 all (140/358): md9.sh 20230331 17:18:37 all (141/358): mdconfig4.sh 20230331 17:18:39 all (142/358): mdconfig5.sh 20230331 17:20:44 all (143/358): memguard4.sh 20230331 17:20:46 all (144/358): mkdir.sh 20230331 17:23:47 all (145/358): mkfifo.sh Mar 31 17:34:16 mercat1 kernel: pid 48942 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20230331 17:45:11 all (146/358): mkfifo2c.sh 20230331 18:00:51 all (147/358): mkfifo2d.sh 20230331 18:07:13 all (148/358): mkfifo8.sh 20230331 18:08:18 all (149/358): mknod.sh 20230331 18:09:19 all (150/358): mlockall5.sh 20230331 18:09:21 all (151/358): mlockall6.sh Mar 31 18:10:14 mercat1 kernel: pid 23639 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page panic: vm_page_unwire: wire count underflow for page 0xfffffe000e2c06d8 cpuid = 5 time = 1680279545 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0196811b20 vpanic() at vpanic+0x152/frame 0xfffffe0196811b70 panic() at panic+0x43/frame 0xfffffe0196811bd0 vm_page_unwire_managed() at vm_page_unwire_managed+0x18f/frame 0xfffffe0196811c20 vm_object_unwire() at vm_object_unwire+0x289/frame 0xfffffe0196811c80 vm_map_entry_unwire() at vm_map_entry_unwire+0x8c/frame 0xfffffe0196811cb0 vm_map_delete() at vm_map_delete+0x162/frame 0xfffffe0196811d20 vm_map_remove() at vm_map_remove+0x80/frame 0xfffffe0196811d50 vmspace_exit() at vmspace_exit+0xa9/frame 0xfffffe0196811d80 exit1() at exit1+0x533/frame 0xfffffe0196811df0 sys_exit() at sys_exit+0xd/frame 0xfffffe0196811e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe0196811f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0196811f30 --- syscall (1, FreeBSD ELF64, exit), ri67e8, rbp = 0x820636820 --- KDB: enter: panic [ thread pid 37902 tid 197225 ] Stopped at kdb_enter+0x32: movq $0,0x128fc03(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 3597 out of 32617 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 37902 tid 197225 td 0xfffffe01800c4c80 kdb_enter() at kdb_enter+0x32/frame 0xfffffe0196811b20 vpanic() at vpanic+0x183/frame 0xfffffe0196811b70 panic() at panic+0x43/frame 0xfffffe0196811bd0 vm_page_unwire_managed() at vm_page_unwire_managed+0x18f/frame 0xfffffe0196811c20 vm_object_unwire() at vm_object_unwire+0x289/frame 0xfffffe0196811c80 vm_map_entry_unwire() at vm_map_entry_unwire+0x8c/frame 0xfffffe0196811cb0 vm_map_delete() at vm_map_delete+0x162/frame 0xfffffe0196811d20 vm_map_remove() at vm_map_remove+0x80/frame 0xfffffe0196811d50 vmspace_exit() at vmspace_exit+0xa9/frame 0xfffffe0196811d80 exit1() at exit1+0x533/frame 0xfffffe0196811df0 sys_exit() at sys_exit+0xd/frame 0xfffffe0196811e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe0196811f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0196811f30 --- syscall (1, FreeBSD ELF64, exit), rip = 0x82152353a, rsp = 0x8206367e8, rbp = 0x820636820 --- db:1:pho1> show allpcpu Current CPU: 5 cpuid = 0 dynamic pcpu = 0x9c8500 curthread = 0xfffffe018c4c1020: pid 23645 tid 210948 critnest 0 "swap" curpcb = 0xfffffe018c4c1540 fpcurthread = 0xfffffe018c4c1020: pid 23645 "swap" idlethread = 0xfffffe00e4c693a0: tid 100003 "idle: cpu0" self = 0xffffffff82610000 curpmap = 0xfffffe018a0e5b30 tssp = 0xffffffff82610384 rsp0 = 0xfffffe01a736e000 kcr3 = 0x800000066e278309 ucr3 = 0x800000068b841b09 scr3 = 0x4708f1b01 gs32p = 0xffffffff82610404 ldt = 0xffffffff82610444 tss = 0xffffffff82610434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bb275500 curthread = 0xfffffe018c1d2020: pid 23651 tid 210640 critnest 0 "swap" curpcb = 0xfffffe018c1d2540 fpcurthread = 0xfffffe018c1d2020: pid 23651 "swap" idlethread = 0xfffffe00e4c68c80: tid 100004 "idle: cpu1" self = 0xffffffff82611000 curpmap = 0xfffffe018dd4f130 tssp = 0xffffffff82611384 rsp0 = 0xfffffe01a6d6a000 kcr3 = 0x80000001d415d0d1 ucr3 = 0x800000050174b8d1 scr3 = 0x24a490e58 gs32p = 0xffffffff82611404 ldt = 0xffffffff82611444 tss = 0xffffffff82611434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bb284500 curthread = 0xfffffe0145ecbac0: pid 23656 tid 658880 critnest 0 "swap" curpcb = 0xfffffe0145ecbfe0 fpcurthread = 0xfffffe0145ecbac0: pid 23656 "swap" idlethread = 0xfffffe00e4c68560: tid 100005 "idle: cpu2" self = 0xffffffff82612000 curpmap = 0xfffffe01437f7530 tssp = 0xffffffff82612384 rsp0 = 0xfffffe01ab06d000 kcr3 = 0x8000000638c9708b ucr3 = 0x800000023494888b scr3 = 0x4708f5df0 gs32p = 0xffffffff82612404 ldt = 0xffffffff82612444 tss = 0xffffffff82612434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bb293500 curthread = 0xfffffe018c3cc1e0: pid 37912 tid 210858 critnest 0 "mlockall6" curpcb = 0xfffffe018c3cc700 fpcurthread = 0xfffffe018c3cc1e0: pid 37912 "mlockall6" idlethread = 0xfffffe00e4c67e40: tid 100006 "idle: cpu3" self = 0xffffffff82613000 curpmap = 0xfffffe0180b64130 tssp = 0xffffffff82613384 rsp0 = 0xfffffe01a71ac000 kcr3 = 0x800000020f1fe00c ucr3 = 0x800000023498c80c scr3 = 0x16b17a80b gs32p = 0xffffffff82613404 ldt = 0xffffffff82613444 tss = 0xffffffff82613434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bb2a2500 curthread = 0xfffffe0192e65000: pid 23649 tid 199137 critnest 0 "swap" curpcb = 0xfffffe0192e65520 fpcurthread = 0xfffffe0192e65000: pid 23649 "swap" idlethread = 0xfffffe00e4c67720: tid 100007 "idle: cpu4" self = 0xffffffff82614000 curpmap = 0xfffffe0194ba6130 tssp = 0xffffffff82614384 rsp0 = 0xfffffe0198d3d000 kcr3 = 0x800000037807215b ucr3 = 0x80000004f5d0395b scr3 = 0x2535afd84 gs32p = 0xffffffff82614404 ldt = 0xffffffff82614444 tss = 0xffffffff82614434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bb2b1500 curthread = 0xfffffe01800c4c80: pid 37902 tid 197225 critnest 1 "mlockall6" curpcb = 0xfffffe01800c51a0 fpcurthread = 0xfffffe01800c4c80: pid 37902 "mlockall6" idlethread = 0xfffffe00e4c67000: tid 100008 "idle: cpu5" self = 0xffffffff82615000 curpmap = 0xffffffff81e846f0 tssp = 0xffffffff82615384 rsp0 = 0xfffffe0196812000 kcr3 = 0x800000000257e002 ucr3 = 0xffffffffffffffff scr3 = 0x66ecc29ed gs32p = 0xffffffff82615404 ldt = 0xffffffff82615444 tss = 0xffffffff82615434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bb2c0500 curthread = 0xfffffe010c80eac0: pid 23648 tid 197508 critnest 0 "swap" curpcb = 0xfffffe010c80efe0 fpcurthread = 0xfffffe010c80eac0: pid 23648 "swap" idlethread = 0xfffffe00e4c71c80: tid 100009 "idle: cpu6" self = 0xffffffff82616000 curpmap = 0xfffffe014bc4a530 tssp = 0xffffffff82616384 rsp0 = 0xfffffe0196d99000 kcr3 = 0x80000003768a9358 ucr3 = 0x8000000714b55b58 scr3 = 0x64ffe9b56 gs32p = 0xffffffff82616404 ldt = 0xffffffff82616444 tss = 0xffffffff82616434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bb2cf500 curthread = 0xfffffe018ffbb560: pid 23658 tid 218583 critnest 0 "swap" curpcb = 0xfffffe018ffbba80 fpcurthread = 0xfffffe018ffbb560: pid 23658 "swap" idlethread = 0xfffffe00e4c71560: tid 100010 "idle: cpu7" self = 0xffffffff82617000 curpmap = 0xfffffe0141a8a130 tssp = 0xffffffff82617384 rsp0 = 0xfffffe01b088d000 kcr3 = 0x800000066da90536 ucr3 = 0x800000073f345d36 scr3 = 0x16b17ad5f gs32p = 0xffffffff82617404 ldt = 0xffffffff82617444 tss = 0xffffffff82617434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bb2de500 curthread = 0xfffffe0190ff7900: pid 23655 tid 220573 critnest 0 "swap" curpcb = 0xfffffe0190ff7e20 fpcurthread = 0xfffffe0190ff7900: pid 23655 "swap" idlethread = 0xfffffe00e4c70e40: tid 100011 "idle: cpu8" self = 0xffffffff82618000 curpmap = 0xfffffe0195177b30 tssp = 0xffffffff82618384 rsp0 = 0xfffffe01b2f6b000 kcr3 = 0x80000007ca55a084 ucr3 = 0x80000006c8830884 scr3 = 0x7c20e7fb4 gs32p = 0xffffffff82618404 ldt = 0xffffffff82618444 tss = 0xffffffff82618434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bb2ed500 curthread = 0xfffffe0194013020: pid 37890 tid 203112 critnest 1 "mlockall6" curpcb = 0xfffffe0194013540 fpcurthread = 0xfffffe0194013020: pid 37890 "mlockall6" idlethread = 0xfffffe00e4c70720: tid 100012 "idle: cpu9" self = 0xffffffff82619000 curpmap = 0xfffffe019485d530 tssp = 0xffffffff82619384 rsp0 = 0xfffffe019da59000 kcr3 = 0x8000000589d5d60a ucr3 = 0x8000000114fb9e0a scr3 = 0x114fb9e0a gs32p = 0xffffffff82619404 ldt = 0xffffffff82619444 tss = 0xffffffff82619434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bb2fc500 curthread = 0xfffffe01bebdb740: pid 23646 tid 661230 critnest 0 "swap" curpcb = 0xfffffe01bebdbc60 fpcurthread = 0xfffffe01bebdb740: pid 23646 "swap" idlethread = 0xfffffe00e4c70000: tid 100013 "idle: cpu10" self = 0xffffffff8261a000 curpmap = 0xfffffe0194bd9130 tssp = 0xffffffff8261a384 rsp0 = 0xfffffe01418bd000 kcr3 = 0x800000043d2db082 ucr3 = 0x80000007691db882 scr3 = 0x47857f87f gs32p = 0xffffffff8261a404 ldt = 0xffffffff8261a444 tss = 0xffffffff8261a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bb30b500 curthread = 0xfffffe01c14c1560: pid 23640 tid 232675 critnest 0 "swap" curpcb = 0xfffffe01c14c1a80 fpcurthread = 0xfffffe01c14c1560: pid 23640 "swap" idlethread = 0xfffffe00e4c6b740: tid 100014 "idle: cpu11" self = 0xffffffff8261b000 curpmap = 0xfffffe014b2fe130 tssp = 0xffffffff8261b384 rsp0 = 0xfffffe01c6610000 kcr3 = 0x8000000033391689 ucr3 = 0x80000005aaf70e89 scr3 = 0x32ad67e87 gs32p = 0xffffffff8261b404 ldt = 0xffffffff8261b444 tss = 0xffffffff8261b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show mount 0xfffffe010e3c1700 /dev/gpt/work on / (ufs) 0xfffffe010e3c2280 devfs on /dev (devfs) 0xfffffe0143fb1280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe015b3b8280 /dev/md10 on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 103365 Buf domain 0 freebufs 15077 lofreebufs 219 hifreebufs 329 bufspace 1085440 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 36 (864256) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 2, 4, 2, 1, 0, 1, 8, 0, 1, 1, 0, Locked buffers: 0 space 0 Total buffers: 62547 space 1085440 Buf domain 1 freebufs 15086 lofreebufs 219 hifreebufs 329 bufspace 851968 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 35 (712704) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 1, 0, 1, 1, 1, 1, 4, 1, 0, 0, 1, Locked buffers: 0 space 0 Total buffers: 6520 space 851968 Buf domain 2 freebufs 13146 lofreebufs 219 hifreebufs 329 bufspace 64434176 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1881 (61075456) dirtyq count 1 (32768) wakeup 0 lim 25 CPU 18, 11, 12, 17, 2, 3, 19, 3, 1, 10, 6, 3, Locked buffers: 0 space 0 Total buffers: 10277 space 64434176 Buf domain 3 freebufs 15087 lofreebufs 219 hifreebufs 329 bufspace 655360 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 25 (475136) dirtyq count 0 (0) wakeup 0 lim 25 CPU 2, 1, 1, 0, 0, 0, 2, 8, 0, 1, 0, 6, Locked buffers: 0 space 0 Total buffers: 6584 space 655360 Buf domain 4 freebufs 15075 lofreebufs 219 hifreebufs 329 bufspace 1167360 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 33 (753664) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 1, 7, 1, 0, 1, 0, 13, 0, 1, 1, 0, Locked buffers: 0 space 0 Total buffers: 6439 space 1167360 Buf domain 5 freebufs 15062 lofreebufs 219 hifreebufs 329 bufspace 1724416 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 66 (1646592) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 0, 0, 0, 0, 2, 0, 1, 1, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 6892 space 1724416 Buf domain 6 freebufs 14996 lofreebufs 219 hifreebufs 329 bufspace 3825664 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 10 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 93 (2629632) dirtyq count 10 (327680) wakeup 0 lim 25 CPU 2, 0, 0, 2, 3, 11, 2, 10, 3, 0, 1, 0, Locked buffers: 0 space 0 Total buffers: 6672 space 3825664 db:1:pho1> show page vm_cnt.v_free_count: 271750 vm_cnt.v_inactive_count: 186399 vm_cnt.v_active_count: 6394947 vm_cnt.v_laundry_count: 524742 vm_cnt.v_wire_count: 737849 vm_cnt.v_free_reserved: 10641 vm_cnt.v_free_min: 51252 vm_cnt.v_free_target: 173085 vm_cnt.v_inactive_target: 259627 db:1:pho1> show pageq pq_free 271750 dom 0 page_cnt 8122272 free 271750 pq_act 6394947 pq_inact 186399 pq_laund 524742 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000425 | 000000 05 (000128K) | 003580 | 000000 04 (000064K) | 002174 | 000001 03 (000032K) | 002779 | 000003 02 (000016K) | 006249 | 000044 01 (000008K) | 005651 | 000271 00 (000004K) | 005712 | 000217 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000007 | 000000 00 (000004K) | 000031 | 000001 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree FFS inode 1160 72757 232772 571180401 0 8 354413640 0 VNODE 600 72954 349819 1123916457 0 16 253663800 0 VM OBJECT 264 54721 581684 778743493 0 30 168010920 0 malloc-4096 4096 34134 8 389206 0 2 139845632 0 FFS2 dinode 256 72757 350813 554091033 0 62 108433920 0 VMSPACE 2560 94 37931 21913802 0 4 97344000 0 RADIX NODE 144 518579 23750 1937586482 0 130 78095376 0 THREAD 1824 38250 4111 70082230 0 8 77266464 0 S VFS Cache 104 71833 447842 663406068 0 126 54046200 0 PROC 1368 115 37934 21925507 0 8 52051032 0 Files 80 134 571866 1246923191 0 126 45760000 0 FPU_save_area 832 38252 241 73415217 0 16 32026176 0 mbuf_cluster 2048 14079 31 1970519 0 8 28897280 0 swblk 136 40596 153182 10313818 0 62 26353808 0 BUF TRIE 144 358 105594 413229045 0 62 15257088 0 malloc-128 128 111673 4701 184221744 0 126 14895872 0 malloc-384 384 38073 57 78678 0 30 14641920 0 vmem btag 56 186269 60031 6643973 0 254 13792800 0 malloc-256 256 38438 2287 135666914 0 62 10425600 0 TURNSTILE 136 42362 310 42362 0 62 5803392 0 mbuf 256 16481 5889 380325783 0 254 5726720 0 UMA Slabs 0 112 44135 5035 1332762 0 126 5507040 0 malloc-128 128 18659 21734 1203410093 0 126 5170304 0 ksiginfo 112 38038 1958 4591483 0 126 4479552 0 SLEEPQUEUE 88 42362 358 42362 0 126 3759360 0 malloc-256 256 754 11096 1557346628 0 62 3033600 0 malloc-256 256 727 7868 1045294345 0 62 2200320 0 pbuf 2776 0 772 0 0 0 2143072 0 swpctrie 144 3325 11263 777505 0 62 2100672 0 malloc-384 384 31 5359 660565354 0 30 2069760 0 256 Bucket 2048 612 370 42054695 0 22 2011136 0 malloc-128 128 12673 1773 70080457 0 126 1849088 0 L VFS Cache 320 1232 3628 4042193 0 30 1555200 0 malloc-32768 32768 11 35 2417717 0 1 1507328 0 malloc-4096 4096 337 6 1889931 0 2 1404928 0 32 Bucket 256 243 4812 88770101 0 62 1294080 0 MAP ENTRY 96 3835 9185 1105760223 0 137 1249920 0 malloc-64 64 11700 2853 7351279748 0 254 931392 0 64 Bucket 512 297 1519 57932568 0 30 929792 0 malloc-4096 4096 150 65 22116591 0 2 880640 0 malloc-512 512 1110 554 154686809 0 30 851968 0 malloc-64 64 8672 4117 2945896126 0 254 818496 0 128 Bucket 1024 236 547 54959286 0 16 801792 0 malloc-8192 8192 90 4 235 0 1 770048 0 malloc-65536 65536 3 8 15567 0 1 720896 0 malloc-32768 32768 13 7 1693114 0 1 655360 0 rl_entry 40 13475 2281 1105549 0 254 630240 0 filedesc0 1072 112 441 21921763 0 8 592816 0 malloc-65536 65536 2 6 45513 0 1 524288 0 malloc-64 64 3967 4160 89377890 0 254 520128 0 DIRHASH 1024 0 480 10639779 0 16 491520 0 malloc-32768 32768 12 3 21 0 1 491520 0 UMA Zones 2048 228 7 237 0 8 481280 0 malloc-16384 16384 29 0 887222 0 1 475136 0 malloc-64 64 4630 2615 100184260 0 254 463680 0 mbuf_packet 256 15 1780 108148902 0 254 459520 0 g_bio 408 0 1120 1478946721 0 46 456960 0 malloc-1024 1024 149 247 353799127 0 16 405504 0 lkpimm 168 3 2325 3 0 62 391104 0 lkpicurr 168 13 2315 13 0 62 391104 0 Mountpoints 2944 4 128 391402 0 4 388608 0 malloc-32 32 8872 3098 49234 0 254 383040 0 TMPFS node 232 0 1547 670733 0 62 358904 0 16 Bucket 144 257 2151 157535163 0 62 346752 0 malloc-128 128 722 1634 126701258 0 126 301568 0 malloc-8192 8192 28 8 404632 0 1 294912 0 malloc-16 16 15832 2418 52517 0 254 292000 0 NAMEI 1024 0 276 11737300764 0 16 282624 0 malloc-2048 2048 125 1 179 0 8 258048 0 malloc-64 64 128 3904 21925377 0 254 258048 0 malloc-128 128 17 1936 99131732 0 126 249984 0 malloc-1024 1024 13 215 17861 0 16 233472 0 malloc-1024 1024 30 194 81007 0 16 229376 0 malloc-1024 1024 171 49 3049915 0 16 225280 0 pipe 728 12 296 5916162 0 16 224224 0 malloc-256 256 229 626 11644472 0 62 218880 0 malloc-2048 2048 23 81 116276 0 8 212992 0 malloc-256 256 35 745 8280386 0 62 199680 0 malloc-64 64 9 3078 11633126 0 254 197568 0 malloc-64 64 26 3061 3515226 0 254 197568 0 malloc-65536 65536 3 0 3 0 1 196608 0 malloc-65536 65536 3 0 2404 0 1 196608 0 8 Bucket 80 113 2337 100631015 0 126 196000 0 udp_inpcb 448 11 421 5950 0 30 193536 0 4 Bucket 48 35 3829 6674368 0 254 185472 0 socket 960 43 145 2235212 0 16 180480 0 2 Bucket 32 237 5307 43948294 0 254 177408 0 PGRP 88 41 1799 108452 0 126 161920 0 fakepg 104 0 1521 3752 0 126 158184 0 malloc-256 256 240 375 11036625 0 62 157440 0 unpcb 256 22 563 2228757 0 62 149760 0 PWD 32 23 4639 222097200 0 254 149184 0 malloc-8192 8192 14 3 15384349 0 1 139264 0 ada_ccb 272 0 504 19908961 0 30 137088 0 tcp_inpcb 1296 7 95 215 0 8 132192 0 malloc-65536 65536 2 0 19 0 1 131072 0 malloc-16384 16384 5 3 29 0 1 131072 0 malloc-32 32 1177 2855 19416218 0 254 129024 0 malloc-8192 8192 15 0 45 0 1 122880 0 malloc-32 32 376 3152 12306369 0 254 112896 0 udp_inpcb ports 32 3 3273 654 0 254 104832 0 malloc-32 32 140 3136 12253566 0 254 104832 0 DEVCTL 1024 0 100 1570613 0 0 102400 0 malloc-384 384 14 246 26883 0 30 99840 0 malloc-32768 32768 3 0 5 0 1 98304 0 malloc-32768 32768 3 0 3 0 1 98304 0 malloc-8192 8192 12 0 12 0 1 98304 0 malloc-4096 4096 23 0 1131 0 2 94208 0 malloc-512 512 0 184 23338 0 30 94208 0 malloc-64 64 656 793 667384 0 254 92736 0 ttyinq 160 345 230 43978230 0 62 92000 0 malloc-2048 2048 11 33 22351622 0 8 90112 0 ttyoutq 256 181 164 23455047 0 62 88320 0 malloc-1024 1024 67 17 2605682 0 16 86016 0 malloc-128 128 241 410 5529916496 0 126 83328 0 malloc-128 128 4 647 67425 0 126 83328 0 malloc-512 512 4 156 109127777 0 30 81920 0 UMA Kegs 384 198 5 207 0 30 77952 0 malloc-32 32 223 2171 4976618 0 254 76608 0 malloc-2048 2048 28 6 95 0 8 69632 0 malloc-16 16 102 4148 41480254 0 254 68000 0 malloc-65536 65536 1 0 3 0 1 65536 0 malloc-16384 16384 0 4 5064922 0 1 65536 0 tcp_inpcb ports 32 2 2014 141 0 254 64512 0 swrbuf 2776 0 21 2142174 23524 2 58296 0 malloc-384 384 109 41 114 0 30 57600 0 malloc-32 32 198 1566 878594 0 254 56448 0 malloc-1024 1024 4 48 85340 0 16 53248 0 swwbuf 2776 0 19 5717934 0 1 52744 0 malloc-16 16 651 2599 529263425 0 254 52000 0 malloc-4096 4096 12 0 164 0 2 49152 0 pcpu-64 64 470 298 483 0 254 49152 0 pcpu-16 16 132 2940 132 0 254 49152 0 malloc-16 16 626 2374 48377598 0 254 48000 0 malloc-16 16 436 2564 1583759 0 254 48000 0 pcpu-8 8 3520 1600 3558 0 254 40960 0 malloc-16 16 71 2429 91 0 254 40000 0 malloc-384 384 56 44 1640 0 30 38400 0 cpuset 104 27 314 27 0 126 35464 0 malloc-16384 16384 2 0 9 0 1 32768 0 malloc-4096 4096 4 4 1706966 0 2 32768 0 malloc-1024 1024 19 13 2932632 0 16 32768 0 malloc-16 16 13 1737 264166 0 254 28000 0 malloc-128 128 24 193 539698045 0 126 27776 0 malloc-384 384 30 40 81 0 30 26880 0 malloc-512 512 26 22 67499 0 30 24576 0 rtentry 168 12 132 14 0 62 24192 0 malloc-32 32 14 742 79476 0 254 24192 0 malloc-256 256 17 73 2968067 0 62 23040 0 routing nhops 256 9 66 14 0 62 19200 0 malloc-16384 16384 1 0 5 0 1 16384 0 malloc-4096 4096 0 4 144426297 0 2 16384 0 malloc-2048 2048 4 4 9 0 8 16384 0 ertt 72 7 217 215 0 126 16128 0 ripcb 416 1 35 8 0 30 14976 0 malloc-1024 1024 8 4 33717 0 16 12288 0 malloc-512 512 4 20 8 0 30 12288 0 ertt_txseginfo 40 0 303 24607642 0 254 12120 0 hostcache 64 0 189 3 0 254 12096 0 KNOTE 160 4 71 8038240 0 62 12000 0 malloc-256 256 5 40 63046232 0 62 11520 0 malloc-8192 8192 1 0 6 0 1 8192 0 malloc-4096 4096 2 0 2 0 2 8192 0 STS VFS Cache 144 0 56 3 0 62 8064 0 KMAP ENTRY 96 48 33 133 0 0 7776 0 kenv 258 18 12 27404 0 30 7740 0 malloc-384 384 20 0 20 0 30 7680 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 malloc-2048 2048 2 0 7 0 8 4096 0 malloc-2048 2048 1 1 1 0 8 4096 0 malloc-512 512 1 7 2 0 30 4096 0 malloc-512 512 1 7 1 0 30 4096 0 SMR CPU 32 7 120 7 0 254 4064 0 malloc-32 32 2 124 33 0 254 4032 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 malloc-16 16 1 249 40 0 254 4000 0 UMA Slabs 1 176 9 13 9 0 62 3872 0 vmem 1856 1 1 1 0 8 3712 0 SMR SHARED 24 7 120 7 0 254 3048 0 FFS1 dinode 128 0 0 17022382 0 126 0 0 da_ccb 544 0 0 0 0 16 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 1 0 254 0 0 syncache 168 0 0 65 0 62 0 0 ipq 56 0 0 0 0 254 0 0 tcp_log_id_node 120 0 0 0 0 126 0 0 tcp_log_id_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 30 0 0 tcpreass 48 0 0 1 0 254 0 0 ripcb ports 32 0 0 0 0 254 0 0 udplite_inpcb ports 32 0 0 0 0 254 0 0 udplite_inpcb 448 0 0 0 0 30 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 272 0 0 0 0 30 0 0 AIOCB 552 0 0 0 0 16 0 0 AIO 208 0 0 0 0 62 0 0 NCLNODE 760 0 0 5 0 16 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 cryptop 280 0 0 448 0 30 0 0 linux_dma_object 32 0 0 0 0 254 0 0 linux_dma_pctrie 144 0 0 0 0 62 0 0 IOMMU_MAP_ENTRY 104 0 0 0 0 126 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 62177457 0 2 0 0 audit_record 1280 0 0 2 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 2776 0 0 0 0 4 0 0 clpbuf 2776 0 0 12232332 0 2 0 0 mdpbuf 2776 0 0 84405 0 1 0 0 nfspbuf 2776 0 0 0 0 2 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-32768 32768 0 0 10 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-32768 32768 0 0 9791 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-8192 8192 0 0 0 0 1 0 0 malloc-8192 8192 0 0 0 0 1 0 0 malloc-2048 2048 0 0 2 0 8 0 0 malloc-512 512 0 0 0 0 30 0 0 malloc-384 384 0 0 263140 0 30 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 vm pgcache 4096 247165 2476 1168604035 132 vm pgcache 4096 6751385 3637 6083707234 169 buf free cache 848 2402 164 440393285 16 buffer arena-65 65536 0 0 3 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 78 222 139179885 1 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 5 21 33359353 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 8 2 kstack_cache 16384 38250 18 70082230 1 db:0:pho> acttrace Tracing command mlockall6 pid 37890 tid 203112 td 0xfffffe0194013020 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce98df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce98e00 trap() at trap+0x57/frame 0xfffffe003ce98f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce98f20 --- trap 0x13, rip = 0xffffffff810d0c1f, rsp = 0xfffffe019da58b10, rbp = 0xfffffe019da58b20 --- pmap_invalidate_page_pcid_invpcid_cb() at pmap_invalidate_page_pcid_invpcid_cb+0x5f/frame 0xfffffe019da58b20 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0x103/frame 0xfffffe019da58b80 pmap_enter() at pmap_enter+0xf05/frame 0xfffffe019da58c40 vm_fault() at vm_fault+0x146f/frame 0xfffffe019da58d70 vm_fault_trap() at vm_fault_trap+0x71/frame 0xfffffe019da58db0 trap_pfault() at trap_pfault+0x22c/frame 0xfffffe019da58e10 trap() at trap+0x48c/frame 0xfffffe019da58f30 calltrap() at calltrap+0x8/frame 0xfffffe019da58f30 --- trap 0xc, rip = 0x201e6c, rsp = 0x8206367e0, rbp = 0x8206367e0 --- Tracing command mlockall6 pid 37902 tid 197225 td 0xfffffe01800c4c80 (CPU 5) kdb_enter() at kdb_enter+0x32/frame 0xfffffe0196811b20 vpanic() at vpanic+0x183/frame 0xfffffe0196811b70 panic() at panic+0x43/frame 0xfffffe0196811bd0 vm_page_unwire_managed() at vm_page_unwire_managed+0x18f/frame 0xfffffe0196811c20 vm_object_unwire() at vm_object_unwire+0x289/frame 0xfffffe0196811c80 vm_map_entry_unwire() at vm_map_entry_unwire+0x8c/frame 0xfffffe0196811cb0 vm_map_delete() at vm_map_delete+0x162/frame 0xfffffe0196811d20 vm_map_remove() at vm_map_remove+0x80/frame 0xfffffe0196811d50 vmspace_exit() at vmspace_exit+0xa9/frame 0xfffffe0196811d80 exit1() at exit1+0x533/frame 0xfffffe0196811df0 sys_exit() at sys_exit+0xd/frame 0xfffffe0196811e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe0196811f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0196811f30 --- syscall (1, FreeBSD ELF64, exit), rip = 0x82152353a, rsp = 0x8206367e8, rbp = 0x820636820 --- Tracing command mlockall6 pid 37912 tid 210858 td 0xfffffe018c3cc1e0 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3edf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ee00 trap() at trap+0x57/frame 0xfffffe003ce3ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3ef20 --- trap 0x13, rip = 0xffffffff80fb189e, rsp = 0xfffffe01a71abbb0, rbp = 0xfffffe01a71abbb0 --- vm_radix_lookup() at vm_radix_lookup+0x1e/frame 0xfffffe01a71abbb0 vm_fault() at vm_fault+0x360/frame 0xfffffe01a71abce0 vm_map_wire_locked() at vm_map_wire_locked+0x386/frame 0xfffffe01a71abd90 vm_map_wire() at vm_map_wire+0x6a/frame 0xfffffe01a71abdc0 sys_mlockall() at sys_mlockall+0x139/frame 0xfffffe01a71abe00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01a71abf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01a71abf30 --- syscall (324, FreeBSD ELF64, mlockall), rip = 0x821521b5a, rsp = 0x8206367e8, rbp = 0x820636820 --- Tracing command swap pid 23640 tid 232675 td 0xfffffe01c14c1560 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ceb6df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ceb6e00 trap() at trap+0x57/frame 0xfffffe003ceb6f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ceb6f20 --- trap 0x13, rip = 0x2130a2b5b4ec, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- Tracing command swap pid 23645 tid 210948 td 0xfffffe018c4c1020 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81fe6c00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81fe6c10 trap() at trap+0x57/frame 0xffffffff81fe6d30 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fe6d30 --- trap 0x13, rip = 0x2130a2b5b4ec, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- Tracing command swap pid 23646 tid 661230 td 0xfffffe01bebdb740 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea7df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea7e00 trap() at trap+0x57/frame 0xfffffe003cea7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea7f20 --- trap 0x13, rip = 0x2130a2b5b4ec, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- Tracing command swap pid 23648 tid 197508 td 0xfffffe010c80eac0 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6be00 trap() at trap+0x57/frame 0xfffffe003ce6bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6bf20 --- trap 0x13, rip = 0x2130a2b5b4ec, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- Tracing command swap pid 23649 tid 199137 td 0xfffffe0192e65000 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce4ddf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce4de00 trap() at trap+0x57/frame 0xfffffe003ce4df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce4df20 --- trap 0x13, rip = 0x2130a2b5b4e0, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- Tracing command swap pid 23651 tid 210640 td 0xfffffe018c1d2020 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e00 trap() at trap+0x57/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0x2130a2b5b4ef, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- Tracing command swap pid 23655 tid 220573 td 0xfffffe0190ff7900 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce89df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce89e00 trap() at trap+0x57/frame 0xfffffe003ce89f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce89f20 --- trap 0x13, rip = 0x2130a2b5b4ec, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- Tracing command swap pid 23656 tid 658880 td 0xfffffe0145ecbac0 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce2fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce2fe00 trap() at trap+0x57/frame 0xfffffe003ce2ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce2ff20 --- trap 0x13, rip = 0x2130a2b5b4ec, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- Tracing command swap pid 23658 tid 218583 td 0xfffffe018ffbb560 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7adf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7ae00 trap() at trap+0x57/frame 0xfffffe003ce7af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7af20 --- trap 0x13, rip = 0x2130a2b5b4ef, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 37914 37865 4250 0 R egrep 37912 37906 4160 0 R+ CPU 3 mlockall6 37907 37891 4160 0 R+ mlockall6 37906 37846 4160 0 R+ mlockall6 37903 37881 4160 0 R+ mlockall6 37902 37890 4160 0 RE+ CPU 5 mlockall6 37895 37842 4160 0 R+ mlockall6 37891 37845 4160 0 R+ mlockall6 37890 37849 4160 0 R+ CPU 9 mlockall6 37882 37847 4160 0 RE+ mlockall6 37881 37843 4160 0 R+ mlockall6 37865 4288 4250 0 S wait 0xfffffe015b38d008 sh 37849 23660 4160 0 S+ wait 0xfffffe015cb5b008 mlockall6 37847 23660 4160 0 S+ wait 0xfffffe0191828568 mlockall6 37846 23660 4160 0 S+ wait 0xfffffe0182cc8558 mlockall6 37845 23660 4160 0 S+ wait 0xfffffe0191d84ab0 mlockall6 37843 23660 4160 0 S+ wait 0xfffffe016ea1eac0 mlockall6 37842 23660 4160 0 S+ wait 0xfffffe010e3c5010 mlockall6 37726 47169 47169 0 S+ nanslp 0xffffffff81ea3da3 sleep 23660 23659 4160 0 S+ wait 0xfffffe015b38c558 mlockall6 23659 23612 4160 0 SW+ wait 0xfffffe018f04b008 sh 23658 23638 23636 0 R CPU 7 swap 23657 23638 23636 0 R swap 23656 23638 23636 0 R CPU 2 swap 23655 23638 23636 0 R CPU 8 swap 23654 23638 23636 0 R swap 23653 23638 23636 0 R swap 23652 23638 23636 0 R swap 23651 23638 23636 0 R CPU 1 swap 23650 23638 23636 0 R swap 23649 23638 23636 0 R CPU 4 swap 23648 23638 23636 0 R CPU 6 swap 23647 23638 23636 0 R swap 23646 23638 23636 0 R CPU 10 swap 23645 23638 23636 0 R CPU 0 swap 23644 23638 23636 0 R swap 23643 23638 23636 0 R swap 23642 23638 23636 0 R swap 23641 23638 23636 0 R swap 23640 23638 23636 0 R CPU 11 swap 23638 23636 23636 0 SW wait 0xfffffe018c45b558 swap 23636 1 23636 0 Ss nanslp 0xffffffff81ea3da3 swap 23632 0 0 0 DL mdwait 0xfffff80147667000 [md10] 23612 23610 4160 0 SW+ wait 0xfffffe018c335000 sh 23611 55130 4160 0 S+ piperd 0xfffffe014f5e26c0 tee 23610 55130 4160 0 SW+ wait 0xfffffe01444cc000 sh 93401 1 93397 0 S+ select 0xfffff80270027bc0 tail 93398 93397 93397 0 SW+ kqread 0xfffff80003a44700 tail 93397 46782 93397 0 SW+ wait 0xfffffe019174d010 bash 46782 46652 46782 0 SW+ wait 0xfffffe01623df010 bash 46652 46651 46652 0 SW+ pause 0xfffffe015b38e0c0 csh 46651 544 46651 2006 SW+ wait 0xfffffe016ea1f018 su 544 543 544 2006 SWs+ wait 0xfffffe0173e59570 bash 543 540 540 2006 S select 0xfffff8017ff41e40 sshd 540 3656 540 0 Ss select 0xfffff807fc4ae540 sshd 55130 4160 4160 0 SW+ wait 0xfffffe003ce56ab0 sh 47169 4079 47169 0 S+ wait 0xfffffe01444ce010 sh 4291 4250 4250 0 S piperd 0xfffffe013afce998 sh 4289 4250 4250 0 S piperd 0xfffffe0141a9c000 awk 4288 4250 4250 0 S wait 0xfffffe01444c4000 sh 4250 1 4250 0 SWs wait 0xfffffe0141aa7560 sh 4160 3692 4160 0 SW+ wait 0xfffffe0143640008 sh 4079 4077 4079 0 SW+ wait 0xfffffe01444cf570 bash 4077 4076 4077 0 SW+ pause 0xfffffe0143641618 csh 4076 4070 4076 2006 SW+ wait 0xfffffe01444cd560 su 4070 4069 4070 2006 SWs+ wait 0xfffffe010d9f7568 bash 4069 4066 4066 2006 S select 0xfffff80003f98ac0 sshd 4066 3656 4066 0 Ss select 0xfffff80004186ec0 sshd 3692 3690 3692 0 SW+ wait 0xfffffe0141a8f560 bash 3690 3689 3690 0 SW+ pause 0xfffffe014363f608 csh 3689 3683 3689 2006 SW+ wait 0xfffffe010d9f5ab0 su 3683 3682 3683 2006 SWs+ wait 0xfffffe01444c4558 bash 3682 3679 3679 2006 S select 0xfffff8000518b640 sshd 3679 3656 3679 0 Ss select 0xfffff80003cebdc0 sshd 3678 1 3678 0 Ss+ ttyin 0xfffff8000586f8b0 getty 3677 1 3677 0 Ss+ ttyin 0xfffff800279ef8b0 getty 3676 1 3676 0 Ss+ ttyin 0xfffff800279efcb0 getty 3675 1 3675 0 Ss+ ttyin 0xfffff800279ee0b0 getty 3674 1 3674 0 Ss+ ttyin 0xfffff800279ee4b0 getty 3673 1 3673 0 Ss+ ttyin 0xfffff800279ee8b0 getty 3672 1 3672 0 Ss+ ttyin 0xfffff800279eecb0 getty 3671 1 3671 0 Ss+ ttyin 0xfffff800279ed0b0 getty 3670 1 3670 0 Ss+ ttyin 0xfffff800279ed4b0 getty 3656 1 3656 0 Ss select 0xfffff80004186cc0 sshd 3639 1 3639 0 Ss nanslp 0xffffffff81ea3da6 cron 3635 1 3635 0 Ss select 0xfffff80003f98c40 inetd 3617 1 3617 0 Ss select 0xfffff80003ce80c0 powerd 3614 1 3614 123 Ss (threaded) ntpd 100276 S select 0xfffff8000518a3c0 ntpd 3554 1 3554 0 Ss nanslp 0xffffffff81ea3da8 watchdogd 3534 1 3534 0 Ss select 0xfffff80003ce96c0 syslogd 3326 1 3326 0 Ss select 0xfffff80003f98dc0 devd 3294 1 3294 65 Ss select 0xfffff80003f98d40 dhclient 3235 1 3235 0 Ss select 0xfffff800047c7140 dhclient 3232 1 3232 0 Ss select 0xfffff80003ce9ec0 dhclient 19 0 0 0 DL vlruwt 0xfffffe010d9f8570 [vnlru] 18 0 0 0 DL syncer 0xffffffff81f94a38 [syncer] 17 0 0 0 DL (threaded) [bufdaemon] 100197 D psleep 0xffffffff81f93a50 [bufdaemon] 100198 D - 0xffffffff81a0b140 [bufspacedaemon-0] 100199 D - 0xffffffff81a13400 [bufspacedaemon-1] 100200 D - 0xffffffff81a1b6c0 [bufspacedaemon-2] 100201 D - 0xffffffff81a23980 [bufspacedaemon-3] 100202 D - 0xffffffff81a2bc40 [bufspacedaemon-4] 100203 D - 0xffffffff81a33f00 [bufspacedaemon-5] 100204 D - 0xffffffff81a3c1c0 [bufspacedaemon-6] 100226 D sdflush 0xfffff80027a82ce8 [/ worker] 100240 D sdflush 0xfffff80038238ce8 [/tmp worker] 935850 D sdflush 0xfffff805279cece8 [/mnt worker] 16 0 0 0 DL psleep 0xffffffff81fbcc50 [vmdaemon] 9 0 0 0 DL (threaded) [pagedaemon] 100195 D psleep 0xffffffff81fb10b8 [dom0] 100205 D launds 0xffffffff81fb10c4 [laundry: dom0] 100206 D umarcl 0xffffffff80f7e510 [uma] 8 0 0 0 DL idle 0xfffffe010d9f6ab8 [enc_daemon1] 7 0 0 0 DL idle 0xfffffe010d9f7010 [enc_daemon0] 6 0 0 0 DL - 0xffffffff81ce58c8 [rand_harvestq] 15 0 0 0 DL (threaded) [usb] 100127 D - 0xfffffe010a1ba440 [usbus0] 100128 D - 0xfffffe010a1ba498 [usbus0] 100129 D - 0xfffffe010a1ba4f0 [usbus0] 100130 D - 0xfffffe010a1ba548 [usbus0] 100131 D - 0xfffffe010a1ba5a0 [usbus0] 100133 D - 0xfffffe00e4d81cf0 [usbus1] 100134 D - 0xfffffe00e4d81d48 [usbus1] 100135 D - 0xfffffe00e4d81da0 [usbus1] 100136 D - 0xfffffe00e4d81df8 [usbus1] 100137 D - 0xfffffe00e4d81e50 [usbus1] 100138 D - 0xfffffe010a578cf0 [usbus2] 100139 D - 0xfffffe010a578d48 [usbus2] 100140 D - 0xfffffe010a578da0 [usbus2] 100141 D - 0xfffffe010a578df8 [usbus2] 100142 D - 0xfffffe010a578e50 [usbus2] 5 0 0 0 DL - 0xffffffff81fc68a8 [busdma] 4 0 0 0 DL (threaded) [cam] 100120 D - 0xffffffff81bcf2c0 [doneq0] 100121 D - 0xffffffff81bcf340 [doneq1] 100122 D - 0xffffffff81bcf3c0 [doneq2] 100123 D - 0xffffffff81bcf240 [async] 100152 D - 0xffffffff81bcf110 [scanner] 14 0 0 0 DL seqstat 0xfffff80003ba6488 [sequencer 00] 3 0 0 0 DL (threaded) [crypto] 100106 D crypto_ 0xffffffff81fae5b0 [crypto] 100107 D crypto_ 0xfffff8000444cc30 [crypto returns 0] 100108 D crypto_ 0xfffff8000444cc80 [crypto returns 1] 100109 D crypto_ 0xfffff8000444ccd0 [crypto returns 2] 100110 D crypto_ 0xfffff8000444cd20 [crypto returns 3] 100111 D crypto_ 0xfffff8000444cd70 [crypto returns 4] 100112 D crypto_ 0xfffff8000444cdc0 [crypto returns 5] 100113 D crypto_ 0xfffff8000444ce10 [crypto returns 6] 100114 D crypto_ 0xfffff8000444ce60 [crypto returns 7] 100115 D crypto_ 0xfffff8000444ceb0 [crypto returns 8] 100116 D crypto_ 0xfffff8000444cf00 [crypto returns 9] 100117 D crypto_ 0xfffff8000444cf50 [crypto returns 10] 100118 D crypto_ 0xfffff8000444cfa0 [crypto returns 11] 13 0 0 0 DL (threaded) [geom] 100091 D - 0xffffffff81e83390 [g_event] 100092 D - 0xffffffff81e83398 [g_up] 100093 D - 0xffffffff81e833a0 [g_down] 2 0 0 0 WL (threaded) [clock] 100077 I [clock (0)] 100078 I [clock (1)] 100079 I [clock (2)] 100080 I [clock (3)] 100081 I [clock (4)] 100082 I [clock (5)] 100083 I [clock (6)] 100084 I [clock (7)] 100085 I [clock (8)] 100086 I [clock (9)] 100087 I [clock (10)] 100088 I [clock (11)] 12 0 0 0 WL (threaded) [intr] 100041 I [swi5: fast taskq] 100045 I [swi6: task queue] 100050 I [swi6: Giant taskq] 100089 I [swi1: netisr 0] 100124 I [irq56: ahci0] 100126 I [irq19: xhci0] 100132 I [irq18: ehci0 ehci1+] 100143 I [irq71: ahci1] 100144 I [swi4: apei] 100145 I [swi0: uart uart] 100159 I [irq73: mlx5_core0] 100160 I [irq74: mlx5_core0] 100161 I [irq72: mlx5_core0] 100162 I [irq75: mlx5_core0] 100163 I [irq76: mlx5_core0] 100164 I [irq77: mlx5_core0] 100165 I [irq78: mlx5_core0] 100166 I [irq79: mlx5_core0] 100167 I [irq80: mlx5_core0] 100168 I [irq81: mlx5_core0] 100169 I [irq82: mlx5_core0] 100170 I [irq83: mlx5_core0] 100171 I [irq84: mlx5_core0] 100172 I [irq85: mlx5_core0] 100173 I [irq86: mlx5_core0] 100179 I [irq88: mlx5_core1] 100180 I [irq89: mlx5_core1] 100181 I [irq87: mlx5_core1] 100182 I [irq90: mlx5_core1] 100183 I [irq91: mlx5_core1] 100184 I [irq92: mlx5_core1] 100185 I [irq93: mlx5_core1] 100186 I [irq94: mlx5_core1] 100187 I [irq95: mlx5_core1] 100188 I [irq96: mlx5_core1] 100189 I [irq97: mlx5_core1] 100190 I [irq98: mlx5_core1] 100191 I [irq99: mlx5_core1] 100192 I [irq100: mlx5_core1] 100193 I [irq101: mlx5_core1] 100232 I [irq102: ioat0] 100233 I [irq103: ioat1] 100234 I [irq104: ioat2] 100235 I [irq105: ioat3] 100236 I [irq106: ioat4] 100237 I [irq107: ioat5] 100238 I [irq108: ioat6] 100239 I [irq109: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffffe00e4c65010 [init] 10 0 0 0 DL audit_w 0xffffffff81faeaa8 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81e83910 [swapper] 100015 D - 0xfffff80003c04100 [if_config_tqg_0] 100016 D - 0xfffff80003c04000 [softirq_0] 100017 D - 0xfffff80003c05e00 [softirq_1] 100018 D - 0xfffff80003c05d00 [softirq_2] 100019 D - 0xfffff80003c05c00 [softirq_3] 100020 D - 0xfffff80003c05b00 [softirq_4] 100021 D - 0xfffff80003c05a00 [softirq_5] 100022 D - 0xfffff80003c05900 [softirq_6] 100023 D - 0xfffff80003c05800 [softirq_7] 100024 D - 0xfffff80003c05700 [softirq_8] 100025 D - 0xfffff80003c05600 [softirq_9] 100026 D - 0xfffff80003c05500 [softirq_10] 100027 D - 0xfffff80003c05400 [softirq_11] 100028 D - 0xfffff80003c05300 [if_io_tqg_0] 100029 D - 0xfffff80003c05200 [if_io_tqg_1] 100030 D - 0xfffff80003c05100 [if_io_tqg_2] 100031 D - 0xfffff80003c05000 [if_io_tqg_3] 100032 D - 0xfffff80003c06e00 [if_io_tqg_4] 100033 D - 0xfffff80003c06d00 [if_io_tqg_5] 100034 D - 0xfffff80003c06c00 [if_io_tqg_6] 100035 D - 0xfffff80003c06b00 [if_io_tqg_7] 100036 D - 0xfffff80003c06a00 [if_io_tqg_8] 100037 D - 0xfffff80003c06900 [if_io_tqg_9] 100038 D - 0xfffff80003c06800 [if_io_tqg_10] 100039 D - 0xfffff80003c06700 [if_io_tqg_11] 100040 D - 0xfffff80003bf1700 [thread taskq] 100042 D - 0xfffff80003bf1200 [pci_hp taskq] 100043 D - 0xfffff80003bf1000 [kqueue_ctx taskq] 100044 D - 0xfffff80003bf2d00 [in6m_free taskq] 100046 D - 0xfffff80003bf2800 [inm_free taskq] 100047 D - 0xfffff80003bf2600 [aiod_kick taskq] 100048 D - 0xfffff80003bf2400 [deferred_unmount ta] 100049 D - 0xfffff80003bf2200 [linuxkpi_irq_wq] 100051 D - 0xfffff80003a10c00 [linuxkpi_short_wq_0] 100052 D - 0xfffff80003a10c00 [linuxkpi_short_wq_1] 100053 D - 0xfffff80003a10c00 [linuxkpi_short_wq_2] 100054 D - 0xfffff80003a10c00 [linuxkpi_short_wq_3] 100055 D - 0xfffff80003a10c00 [linuxkpi_short_wq_4] 100056 D - 0xfffff80003a10c00 [linuxkpi_short_wq_5] 100057 D - 0xfffff80003a10c00 [linuxkpi_short_wq_6] 100058 D - 0xfffff80003a10c00 [linuxkpi_short_wq_7] 100059 D - 0xfffff80003a10c00 [linuxkpi_short_wq_8] 100060 D - 0xfffff80003a10c00 [linuxkpi_short_wq_9] 100061 D - 0xfffff80003a10c00 [linuxkpi_short_wq_1] 100062 D - 0xfffff80003a10c00 [linuxkpi_short_wq_1] 100063 D - 0xfffff80003a10c00 [linuxkpi_short_wq_1] 100064 D - 0xfffff80003be2200 [linuxkpi_long_wq_0] 100065 D - 0xfffff80003be2200 [linuxkpi_long_wq_1] 100066 D - 0xfffff80003be2200 [linuxkpi_long_wq_2] 100067 D - 0xfffff80003be2200 [linuxkpi_long_wq_3] 100068 D - 0xfffff80003be2200 [linuxkpi_long_wq_4] 100069 D - 0xfffff80003be2200 [linuxkpi_long_wq_5] 100070 D - 0xfffff80003be2200 [linuxkpi_long_wq_6] 100071 D - 0xfffff80003be2200 [linuxkpi_long_wq_7] 100072 D - 0xfffff80003be2200 [linuxkpi_long_wq_8] 100073 D - 0xfffff80003be2200 [linuxkpi_long_wq_9] 100074 D - 0xfffff80003be2200 [linuxkpi_long_wq_10] 100075 D - 0xfffff80003be2200 [linuxkpi_long_wq_11] 100076 D - 0xfffff80003be2200 [linuxkpi_long_wq_12] 100090 D - 0xfffff80003be4300 [firmware taskq] 100094 D - 0xfffff80003be5c00 [crypto_0] 100095 D - 0xfffff80003be5c00 [crypto_1] 100096 D - 0xfffff80003be5c00 [crypto_2] 100097 D - 0xfffff80003be5c00 [crypto_3] 100098 D - 0xfffff80003be5c00 [crypto_4] 100099 D - 0xfffff80003be5c00 [crypto_5] 100100 D - 0xfffff80003be5c00 [crypto_6] 100101 D - 0xfffff80003be5c00 [crypto_7] 100102 D - 0xfffff80003be5c00 [crypto_8] 100103 D - 0xfffff80003be5c00 [crypto_9] 100104 D - 0xfffff80003be5c00 [crypto_10] 100105 D - 0xfffff80003be5c00 [crypto_11] 100146 D - 0xfffff80003fd9b00 [acpi_task_0] 100147 D - 0xfffff80003fd9b00 [acpi_task_1] 100148 D - 0xfffff80003fd9b00 [acpi_task_2] 100150 D - 0xfffff80003a10100 [mca taskq] 100151 D - 0xfffff80004445400 [CAM taskq] 100155 D - 0xfffff80003fd9300 [mlx5_core0-rec] 100156 D - 0xfffff80003fd9100 [mlx5_core0-wdg] 100157 D - 0xfffff80003fdae00 [mlx5_core0-cmd] 100158 D - 0xfffff80003fdac00 [mlx5_page_allocator] 100174 D - 0xfffff8002d01c500 [mlx5_esw_wq] 100175 D - 0xfffff8002d01c300 [mlx5_core1-rec] 100176 D - 0xfffff8002d01c100 [mlx5_core1-wdg] 100177 D - 0xfffff8002d01de00 [mlx5_core1-cmd] 100178 D - 0xfffff8002d01dc00 [mlx5_page_allocator] 100194 D - 0xfffff80003f61400 [mlx5_esw_wq] 100530 D - 0xfffff800042e5200 [unionfs_rele taskq] 37844 23660 4160 0 Z+ mlockall6 37848 23660 4160 0 Z+ mlockall6 db:0:pho> allt Tracing command kernel pid 0 tid 100000 td 0xffffffff81e83e80 sched_switch() at sched_switch+0x5a8/frame 0xffffffff82574e10 mi_switch() at mi_switch+0x175/frame 0xffffffff82574e30 sleepq_switch() at sleepq_switch+0x107/frame 0xffffffff82574e70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82574eb0 _sleep() at _sleep+0x2d6/frame 0xffffffff82574f40 swapper() at swapper+0x75/frame 0xffffffff82574fa0 mi_startup() at mi_startup+0x30e/frame 0xffffffff82574ff0 btext() at btext+0x23 Tracing command kernel pid 0 tid 100015 td 0xfffffe00e4c6b020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4858de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4858e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4858e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4858ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4858ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4858f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4858f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100016 td 0xfffffe00e4c6a900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4853de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4853e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4853e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4853ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4853ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4853f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4853f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100017 td 0xfffffe00e4cf3720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4862de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4862e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4862e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4862ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4862ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4862f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4862f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100018 td 0xfffffe00e4cf3000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e485dde0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e485de00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e485de40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e485dec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e485def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e485df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e485df30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100019 td 0xfffffe00e4c74740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e486cde0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e486ce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e486ce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e486cec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e486cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e486cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e486cf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100020 td 0xfffffe00e4c74020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4867de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4867e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4867e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4867ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4867ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4867f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4867f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100021 td 0xfffffe00e4c73900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4876de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4876e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4876e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4876ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4876ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4876f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4876f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100022 td 0xfffffe00e4c731e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4871de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4871e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4871e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4871ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4871ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4871f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4871f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100023 td 0xfffffe00e4c72ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4880de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4880e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4880e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4880ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4880ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4880f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4880f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100024 td 0xfffffe00e4c723a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e487bde0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e487be00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e487be40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e487bec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e487bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e487bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e487bf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100025 td 0xfffffe00e4cf7020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e488ade0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e488ae00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e488ae40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e488aec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e488aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488af30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100026 td 0xfffffe00e4cf6900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4885de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4885e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4885e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4885ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4885ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4885f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4885f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100027 td 0xfffffe00e4cf61e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4894de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4894e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4894e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4894ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4894ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4894f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4894f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100028 td 0xfffffe00e4cf5ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e488fde0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e488fe00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e488fe40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e488fec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e488fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488ff30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100029 td 0xfffffe00e4cf53a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e489ede0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e489ee00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e489ee40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e489eec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e489eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e489ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e489ef30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100030 td 0xfffffe00e4cf4c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4899de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4899e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4899e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4899ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4899ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4899f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4899f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100031 td 0xfffffe00e4cf4560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48a8de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48a8e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48a8e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48a8ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48a8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a8f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100032 td 0xfffffe00e4cf3e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48a3de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48a3e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48a3e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48a3ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48a3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a3f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100033 td 0xfffffe00e4d00ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48b2de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48b2e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48b2e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48b2ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48b2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b2f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100034 td 0xfffffe00e4d003a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48adde0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48ade00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48ade40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48adec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48adef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48adf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48adf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100035 td 0xfffffe00e4cffc80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48bcde0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48bce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48bce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48bcec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48bcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48bcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48bcf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100036 td 0xfffffe00e4cff560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48b7de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48b7e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48b7e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48b7ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48b7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b7f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100037 td 0xfffffe00e4cfee40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48c6de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48c6e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48c6e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48c6ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48c6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c6f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100038 td 0xfffffe00e4cfe720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48c1de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48c1e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48c1e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48c1ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48c1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c1f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100039 td 0xfffffe00e4cfe000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48d0de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48d0e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48d0e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48d0ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48d0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d0f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100040 td 0xfffffe00e4cf7740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48cbdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48cbdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48cbe30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48cbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48cbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48cbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48cbf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100042 td 0xfffffe00e4d03e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48d5dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48d5df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48d5e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48d5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48d5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d5f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100043 td 0xfffffe00e4d03720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48e4dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48e4df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48e4e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48e4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48e4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48e4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e4f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100044 td 0xfffffe00e4d03000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48dfdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48dfdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48dfe30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48dfec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48dfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48dff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48dff30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100046 td 0xfffffe00e4d02020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48e9dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48e9df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48e9e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48e9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48e9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48e9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e9f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100047 td 0xfffffe00e4d01900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48f8dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48f8df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48f8e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48f8ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48f8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48f8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f8f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100048 td 0xfffffe00e4d011e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48f3dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48f3df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48f3e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48f3ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48f3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48f3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f3f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100049 td 0xfffffe00e4d0c000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4902de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4902e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4902e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4902ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4902ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4902f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4902f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100051 td 0xfffffe00e4d07020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e490cdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e490cdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e490ce30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e490cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e490cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e490cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e490cf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100052 td 0xfffffe00e4d06900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4907dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4907df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4907e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4907ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4907ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4907f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4907f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100053 td 0xfffffe00e4d061e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4916dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4916df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4916e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4916ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4916ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4916f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4916f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100054 td 0xfffffe00e4d05ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4911dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4911df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4911e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4911ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4911ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4911f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4911f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100055 td 0xfffffe00e4d053a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4920dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4920df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4920e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4920ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4920ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4920f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4920f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100056 td 0xfffffe00e4d04c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e491bdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e491bdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e491be30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e491bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e491bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e491bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e491bf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100057 td 0xfffffe00e4d0f900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e492add0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e492adf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e492ae30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e492aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e492aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e492af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492af30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100058 td 0xfffffe00e4d0f1e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4925dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4925df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4925e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4925ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4925ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4925f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4925f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100059 td 0xfffffe00e4d0eac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4934dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4934df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4934e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4934ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4934ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4934f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4934f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100060 td 0xfffffe00e4d0e3a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e492fdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e492fdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e492fe30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e492fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e492fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e492ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492ff30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100061 td 0xfffffe00e4d0dc80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e493edd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e493edf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e493ee30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e493eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e493eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e493ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e493ef30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100062 td 0xfffffe00e4d0d560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4939dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4939df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4939e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4939ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4939ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4939f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4939f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100063 td 0xfffffe00e4d0ce40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4948dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4948df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4948e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4948ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4948ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4948f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4948f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100064 td 0xfffffe00e4d0c720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4943dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4943df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4943e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4943ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4943ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4943f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4943f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100065 td 0xfffffe00e4d153a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4952dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4952df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4952e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4952ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4952ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4952f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4952f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100066 td 0xfffffe00e4d14c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e494ddd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e494ddf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e494de30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e494dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e494def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e494df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e494df30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100067 td 0xfffffe00e4d14560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e495cdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e495cdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e495ce30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e495cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e495cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e495cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e495cf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100068 td 0xfffffe00e4d13e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4957dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4957df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4957e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4957ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4957ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4957f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4957f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100069 td 0xfffffe00e4d13720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4966dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4966df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4966e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4966ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4966ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4966f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4966f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100070 td 0xfffffe00e4d13000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4961dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4961df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4961e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4961ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4961ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4961f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4961f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100071 td 0xfffffe00e4d10740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4970dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4970df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4970e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4970ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4970ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4970f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4970f30 --- trap 0xc7206389, rip = 0x44c63f5a2444c6e5, rsp = 0x4da95f2444c60d5e, rbp = 0x1e3d402444c70000 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe00e4d10020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e496bdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e496bdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e496be30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e496bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e496bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e496bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e496bf30 --- trap 0x6c0053, rip = 0, rsp = 0xd5058948f98b48da, rbp = 0x5c29 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe00e4d18e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e497add0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e497adf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e497ae30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e497aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e497aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497af30 --- trap 0x9010010, rip = 0x3f0070900000000, rsp = 0x1af0001009103dd, rbp = 0x407090002001010 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe00e4d18720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4975dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4975df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4975e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4975ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4975ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4975f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4975f30 --- trap 0x14f8, rip = 0xc48348c38b48001f, rsp = 0x302464834820ec, rbp = 0x7b850f3b3c0874c0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe00e4d18000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4984dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4984df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4984e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4984ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4984ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4984f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4984f30 --- trap 0x41002f00, rip = 0x4e1400000034004e, rsp = 0x41002f004e140000, rbp = 0x65007000530020 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe00e4d17740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e497fdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e497fdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e497fe30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e497fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e497fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497ff30 --- trap 0x8090003, rip = 0x101005e08090007, rsp = 0x10100620809000a, rbp = 0x9405000500040003 --- Tracing command kernel pid 0 tid 100090 td 0xfffffe00e4d24ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49f5dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49f5df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e49f5e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e49f5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e49f5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100094 td 0xfffffe00e4d22e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e39dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e39df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e39e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e39ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e39ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e39f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100095 td 0xfffffe00e4d22720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e48dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e48df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e48e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e48ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e48ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e48f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffffe00e4d22000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e43dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e43df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e43e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e43ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e43ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e43f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100097 td 0xfffffe00e4d3dc80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e52dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e52df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e52e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e52ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e52ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e52f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e52f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffffe00e4d3d560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e4ddd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e4ddf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e4de30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e4dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e4def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e4df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e4df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100099 td 0xfffffe00e4d3ce40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e5cdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e5cdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e5ce30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e5cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e5cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e5cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffffe00e4d3c720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e57dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e57df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e57e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e57ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e57ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e57f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100101 td 0xfffffe00e4d3c000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e66dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e66df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e66e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e66ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e66ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e66f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffffe00e4d26740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e61dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e61df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e61e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e61ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e61ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e61f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100103 td 0xfffffe00e4d26020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e70dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e70df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e70e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e70ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e70ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e70f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e70f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffffe00e4d25900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e6bdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e6bdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e6be30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e6bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e6bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e6bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e6bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100105 td 0xfffffe00e4d41720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e7add0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e7adf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e7ae30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e7aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e7aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100146 td 0xfffffe010d9bc3a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da34de0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da34e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da34e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da34ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da34ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da34f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da34f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100147 td 0xfffffe010d9bbc80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ffcde0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ffce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ffce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4ffcec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4ffcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ffcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ffcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100148 td 0xfffffe010d9bb560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da3ede0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da3ee00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da3ee40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da3eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da3eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100150 td 0xfffffe010d9ba720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da48de0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da48e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da48e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da48ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da48ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da48f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100151 td 0xfffffe010d9ba000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da43dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da43df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da43e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da43ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da43ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da43f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100155 td 0xfffffe010a343020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da4ddd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da4ddf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da4de30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da4dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da4def0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da4df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da4df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100156 td 0xfffffe010ddec740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da66dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da66df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da66e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da66ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da66ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da66f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100157 td 0xfffffe010ddec020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da61dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da61df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da61e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da61ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da61ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da61f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100158 td 0xfffffe010ddeb900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da70dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da70df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da70e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da70ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da70ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da70f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da70f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100174 td 0xfffffe010e0e7e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dac0dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010dac0df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dac0e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010dac0ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dac0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dac0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100175 td 0xfffffe010e0e7720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dabbdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010dabbdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dabbe30 _sleep() at _sleep+0x2ef/frame 0xfffffe010dabbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dabbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dabbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dabbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100176 td 0xfffffe010e0e7000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dacadd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010dacadf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dacae30 _sleep() at _sleep+0x2ef/frame 0xfffffe010dacaec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dacaef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dacaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dacaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100177 td 0xfffffe010deb8740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dac5dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010dac5df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dac5e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010dac5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dac5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dac5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100178 td 0xfffffe010deb8020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dad4dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010dad4df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dad4e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010dad4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dad4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dad4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dad4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100194 td 0xfffffe010e1ce560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db24dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010db24df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db24e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010db24ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010db24ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db24f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db24f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100530 td 0xfffffe01437611e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01419d4dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe01419d4df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01419d4e30 _sleep() at _sleep+0x2ef/frame 0xfffffe01419d4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe01419d4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01419d4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01419d4f30 --- trap 0xc, rip = 0x8233e651a, rsp = 0x82ea80f48, rbp = 0x82ea80f60 --- Tracing command init pid 1 tid 100002 td 0xfffffe00e4c69ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00377e1a20 mi_switch() at mi_switch+0x175/frame 0xfffffe00377e1a40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00377e1a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00377e1ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00377e1ae0 _sleep() at _sleep+0x2e5/frame 0xfffffe00377e1b70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe00377e1c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00377e1e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe00377e1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00377e1f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x29037a, rsp = 0x820493bf8, rbp = 0x820493c60 --- Tracing command clock pid 2 tid 100077 td 0xfffffe00e4d17020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49beea0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49beec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49beef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49bef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49bef30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command clock pid 2 tid 100078 td 0xfffffe00e4d16900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49b9ea0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49b9ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49b9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49b9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49b9f30 --- trap 0xfa803d72, rip = 0x7280000000f88141, rsp = 0x49a7ebd7470f4480, rbp = 0x330a89480a75c084 --- Tracing command clock pid 2 tid 100079 td 0xfffffe00e4d161e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49c8ea0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49c8ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49c8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c8f30 --- trap 0xc6b60f40, rip = 0x4b81804b70f44d3, rsp = 0xc6b60f40ffffeec0, rbp = 0xd9e800000478cf81 --- Tracing command clock pid 2 tid 100080 td 0xfffffe00e4d15ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49c3ea0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49c3ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49c3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c3f30 --- trap 0xfff00000, rip = 0, rsp = 0x100000000, rbp = 0x30000016b --- Tracing command clock pid 2 tid 100081 td 0xfffffe00e4d1c740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49d2ea0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49d2ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49d2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49d2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49d2f30 --- trap 0xce0c1c1, rip = 0x2444b60fc80b05e0, rsp = 0x69e800000188cc81, rbp = 0x30bed6beeb60f40 --- Tracing command clock pid 2 tid 100082 td 0xfffffe00e4d1c020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49cdea0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49cdec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49cdef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49cdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49cdf30 --- trap 0xffff9ef8, rip = 0x8b44ce8b4818048b, rsp = 0x4824448944fef000, rbp = 0x1586c607eb000000 --- Tracing command clock pid 2 tid 100083 td 0xfffffe00e4d1b900 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100084 td 0xfffffe00e4d1b1e0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100085 td 0xfffffe00e4d1aac0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100086 td 0xfffffe00e4d1a3a0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100087 td 0xfffffe00e4d19c80 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100088 td 0xfffffe00e4d19560 fork_trampoline() at fork_trampoline Tracing command crypto pid 3 tid 100106 td 0xfffffe00e4d41000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e75dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e75de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e75e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e75eb0 crypto_dispatch_thread() at crypto_dispatch_thread+0x193/frame 0xfffffe00e4e75ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e75f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e75f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100107 td 0xfffffe00e4d40740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e84dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e84de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e84e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e84eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e84ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e84f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e84f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100108 td 0xfffffe00e4d40020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e7fdc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e7fde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e7fe20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e7feb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e7fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100109 td 0xfffffe00e4d3f900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e8edc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e8ede0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e8ee20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e8eeb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e8eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e8ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e8ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100110 td 0xfffffe00e4d3f1e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e89dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e89de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e89e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e89eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e89ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e89f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e89f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100111 td 0xfffffe00e4d3eac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e98dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e98de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e98e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e98eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e98ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e98f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e98f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100112 td 0xfffffe00e4d3e3a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e93dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e93de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e93e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e93eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e93ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e93f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e93f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100113 td 0xfffffe00e4d45020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ea2dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ea2de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ea2e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ea2eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ea2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100114 td 0xfffffe00e4d44900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e9ddc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e9dde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e9de20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e9deb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e9def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e9df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e9df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100115 td 0xfffffe00e4d441e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4eacdc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4eacde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eace20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4eaceb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eacef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eacf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eacf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100116 td 0xfffffe00e4d43ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ea7dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ea7de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ea7e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ea7eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ea7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100117 td 0xfffffe00e4d433a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4eb6dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4eb6de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eb6e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4eb6eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eb6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100118 td 0xfffffe00e4d42c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4eb1dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4eb1de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eb1e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4eb1eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eb1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100120 td 0xfffffe00e4d41e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ebbdb0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ebbdd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ebbe10 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ebbea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ebbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ebbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ebbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100121 td 0xfffffe00e4d58ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ecadb0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ecadd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ecae10 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ecaea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ecaef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ecaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100122 td 0xfffffe00e4d583a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ec5db0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ec5dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ec5e10 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ec5ea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ec5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100123 td 0xfffffe00e4d57c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ed4db0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ed4dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ed4e10 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ed4ea0 xpt_async_td() at xpt_async_td+0x74/frame 0xfffffe00e4ed4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100152 td 0xfffffe010a343740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da52dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da52df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da52e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da52ec0 xpt_scanner_thread() at xpt_scanner_thread+0x154/frame 0xfffffe010da52ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da52f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da52f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command busdma pid 5 tid 100125 td 0xfffffe00e4d93e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ed9dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ed9df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ed9e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ed9ec0 busdma_thread() at busdma_thread+0xb5/frame 0xfffffe00e4ed9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 6 tid 100149 td 0xfffffe010d9bae40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da39d30 mi_switch() at mi_switch+0x175/frame 0xfffffe010da39d50 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da39d90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010da39dd0 _sleep() at _sleep+0x2d6/frame 0xfffffe010da39e60 random_kthread() at random_kthread+0xa7/frame 0xfffffe010da39ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da39f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 7 tid 100153 td 0xfffffe010dde8e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da5cd90 mi_switch() at mi_switch+0x175/frame 0xfffffe010da5cdb0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da5cdf0 _sleep() at _sleep+0x2ef/frame 0xfffffe010da5ce80 enc_daemon() at enc_daemon+0xde/frame 0xfffffe010da5cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da5cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 8 tid 100154 td 0xfffffe010dde8720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da57d90 mi_switch() at mi_switch+0x175/frame 0xfffffe010da57db0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da57df0 _sleep() at _sleep+0x2ef/frame 0xfffffe010da57e80 enc_daemon() at enc_daemon+0xde/frame 0xfffffe010da57ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da57f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100195 td 0xfffffe010e3c9ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db469c0 mi_switch() at mi_switch+0x175/frame 0xfffffe010db469e0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db46a20 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db46a60 _sleep() at _sleep+0x2d6/frame 0xfffffe010db46af0 vm_pageout_worker() at vm_pageout_worker+0x29c/frame 0xfffffe010db46eb0 vm_pageout() at vm_pageout+0x1c7/frame 0xfffffe010db46ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db46f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db46f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100205 td 0xfffffe00e4d953a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe011194da80 mi_switch() at mi_switch+0x175/frame 0xfffffe011194daa0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe011194dae0 _sleep() at _sleep+0x2ef/frame 0xfffffe011194db70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xb37/frame 0xfffffe011194def0 fork_exit() at fork_exit+0x80/frame 0xfffffe011194df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe011194df30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command pagedaemon pid 9 tid 100206 td 0xfffffe00e4d94c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe011bba3d90 mi_switch() at mi_switch+0x175/frame 0xfffffe011bba3db0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe011bba3df0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe011bba3e30 _sleep() at _sleep+0x2d6/frame 0xfffffe011bba3ec0 uma_reclaim_worker() at uma_reclaim_worker+0xc8/frame 0xfffffe011bba3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe011bba3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe011bba3f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command audit pid 10 tid 100001 td 0xfffffe00e4c6a1e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00377e6dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00377e6df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00377e6e30 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00377e6e90 audit_worker() at audit_worker+0x8f/frame 0xfffffe00377e6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e6f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100003 td 0xfffffe00e4c693a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00377f0e30 mi_switch() at mi_switch+0x175/frame 0xfffffe00377f0e50 sched_idletd() at sched_idletd+0x4f7/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100004 td 0xfffffe00e4c68c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00377ebe30 mi_switch() at mi_switch+0x175/frame 0xfffffe00377ebe50 sched_idletd() at sched_idletd+0x4f7/frame 0xfffffe00377ebef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ebf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100005 td 0xfffffe00e4c68560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00377fae30 mi_switch() at mi_switch+0x175/frame 0xfffffe00377fae50 sched_idletd() at sched_idletd+0x4f7/frame 0xfffffe00377faef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377faf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100006 td 0xfffffe00e4c67e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00377f5e30 mi_switch() at mi_switch+0x175/frame 0xfffffe00377f5e50 sched_idletd() at sched_idletd+0x4f7/frame 0xfffffe00377f5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f5f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100007 td 0xfffffe00e4c67720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4830e30 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4830e50 sched_idletd() at sched_idletd+0xa1/frame 0xfffffe00e4830ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4830f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4830f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100008 td 0xfffffe00e4c67000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00377ffe30 mi_switch() at mi_switch+0x175/frame 0xfffffe00377ffe50 sched_idletd() at sched_idletd+0x4f7/frame 0xfffffe00377ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377fff30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100009 td 0xfffffe00e4c71c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e483ae30 mi_switch() at mi_switch+0x175/frame 0xfffffe00e483ae50 sched_idletd() at sched_idletd+0x4f7/frame 0xfffffe00e483aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483af30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100010 td 0xfffffe00e4c71560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4835e30 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4835e50 sched_idletd() at sched_idletd+0x4f7/frame 0xfffffe00e4835ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4835f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4835f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100011 td 0xfffffe00e4c70e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4844e30 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4844e50 sched_idletd() at sched_idletd+0x4f7/frame 0xfffffe00e4844ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4844f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4844f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100012 td 0xfffffe00e4c70720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e483fe30 mi_switch() at mi_switch+0x175/frame 0xfffffe00e483fe50 sched_idletd() at sched_idletd+0x4f7/frame 0xfffffe00e483fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483ff30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100013 td 0xfffffe00e4c70000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e484ee30 mi_switch() at mi_switch+0x175/frame 0xfffffe00e484ee50 sched_idletd() at sched_idletd+0x4f7/frame 0xfffffe00e484eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e484ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e484ef30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100014 td 0xfffffe00e4c6b740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4849e30 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4849e50 sched_idletd() at sched_idletd+0xa1/frame 0xfffffe00e4849ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4849f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4849f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command intr pid 12 tid 100041 td 0xfffffe00e4d04560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffffe00e4d02740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48eee40 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48eee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e48eeef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48eef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48eef30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command intr pid 12 tid 100050 td 0xfffffe00e4d07740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100089 td 0xfffffe00e4d251e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49fae40 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49fae60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49faef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49faf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command intr pid 12 tid 100124 td 0xfffffe00e4d94560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4edee40 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4edee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4edeef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4edef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4edef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100126 td 0xfffffe00e4d93720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ee8e40 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ee8e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ee8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ee8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100132 td 0xfffffe010a33f000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f06e40 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f06e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f06ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f06f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f06f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100143 td 0xfffffe010a340560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100144 td 0xfffffe010a33fe40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100145 td 0xfffffe010a33f720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f55e40 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f55e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f55ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f55f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f55f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100159 td 0xfffffe010ddeb1e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da6be40 mi_switch() at mi_switch+0x175/frame 0xfffffe010da6be60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010da6bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da6bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da6bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100160 td 0xfffffe010ddeaac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da7ae40 mi_switch() at mi_switch+0x175/frame 0xfffffe010da7ae60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010da7aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da7af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da7af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100161 td 0xfffffe010ddea3a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100162 td 0xfffffe010dde9c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100163 td 0xfffffe010dde9560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100164 td 0xfffffe010deb71e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100165 td 0xfffffe010deb6ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100166 td 0xfffffe010deb63a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100167 td 0xfffffe010deb5c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100168 td 0xfffffe010deb5560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100169 td 0xfffffe010deb4e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100170 td 0xfffffe010deb4720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100171 td 0xfffffe010deb4000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100172 td 0xfffffe010e0e8c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100173 td 0xfffffe010e0e8560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe010deb7900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dacfe40 mi_switch() at mi_switch+0x175/frame 0xfffffe010dacfe60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010dacfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dacff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dacff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100180 td 0xfffffe010e1cd720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dadee40 mi_switch() at mi_switch+0x175/frame 0xfffffe010dadee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010dadeef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dadef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dadef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100181 td 0xfffffe010e1cd000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffffe010e0eb740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffffe010e0eb020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffffe010e0ea900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffffe010e0ea1e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffffe010e0e9ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffffe010e0e93a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffffe010e1d1020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffffe010e1d0900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffffe010e1d01e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100191 td 0xfffffe010e1cfac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100192 td 0xfffffe010e1cf3a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100193 td 0xfffffe010e1cec80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100232 td 0xfffffe013afa23a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100233 td 0xfffffe013afa1c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100234 td 0xfffffe013afa1560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100235 td 0xfffffe013afa0e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100236 td 0xfffffe013afa0720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100237 td 0xfffffe0143dac720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100238 td 0xfffffe0143dac000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100239 td 0xfffffe0142b5a740 fork_trampoline() at fork_trampoline Tracing command geom pid 13 tid 100091 td 0xfffffe00e4d243a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e34dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e34df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e34e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e34ec0 g_run_events() at g_run_events+0x444/frame 0xfffffe00e4e34ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e34f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e34f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100092 td 0xfffffe00e4d23c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49ffdc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49ffde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e49ffe20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e49ffeb0 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe00e49ffee0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00e49ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49fff30 --- trap 0x3b490001, rip = 0x90ffcf8b48d38b48, rsp = 0x8838e800009e, rbp = 0xaa2f1d89480001 --- Tracing command geom pid 13 tid 100093 td 0xfffffe00e4d23560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e3edc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e3ede0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e3ee20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e3eeb0 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe00e4e3eee0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe00e4e3eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100119 td 0xfffffe00e4d42560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ec0db0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ec0dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ec0e10 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4ec0e70 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe00e4ec0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100127 td 0xfffffe00e4d93000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ee3e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ee3e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ee3e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4ee3ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ee3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ee3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100128 td 0xfffffe00e4d5a740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ef2e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ef2e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ef2e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4ef2ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100129 td 0xfffffe00e4d5a020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4eede00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4eede20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eede60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4eedec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eedef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eedf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eedf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100130 td 0xfffffe00e4d59900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4efce00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4efce20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4efce60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4efcec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4efcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4efcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4efcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100131 td 0xfffffe00e4d591e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ef7e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ef7e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ef7e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4ef7ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100133 td 0xfffffe00e4d97740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f01e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f01e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f01e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f01ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f01ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f01f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f01f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100134 td 0xfffffe00e4d97020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f10e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f10e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f10e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f10ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f10ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f10f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f10f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100135 td 0xfffffe00e4d96900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f0be00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f0be20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f0be60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f0bec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f0bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f0bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f0bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100136 td 0xfffffe00e4d961e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f1ae00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f1ae20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f1ae60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f1aec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f1aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f1af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f1af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100137 td 0xfffffe00e4d95ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f15e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f15e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f15e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f15ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f15ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f15f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f15f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100138 td 0xfffffe010a342900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f3ce00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f3ce20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f3ce60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f3cec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f3cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f3cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f3cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100139 td 0xfffffe010a3421e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f37e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f37e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f37e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f37ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f37ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f37f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f37f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100140 td 0xfffffe010a341ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f46e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f46e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f46e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f46ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f46ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f46f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f46f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100141 td 0xfffffe010a3413a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f41e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f41e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f41e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f41ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f41ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f41f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f41f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100142 td 0xfffffe010a340c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f50e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f50e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f50e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f50ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f50ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f50f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f50f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 16 tid 100196 td 0xfffffe010e3c93a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db41d90 mi_switch() at mi_switch+0x175/frame 0xfffffe010db41db0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db41df0 _sleep() at _sleep+0x2ef/frame 0xfffffe010db41e80 vm_daemon() at vm_daemon+0x82/frame 0xfffffe010db41ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db41f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db41f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100197 td 0xfffffe010e3c8c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db50d70 mi_switch() at mi_switch+0x175/frame 0xfffffe010db50d90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db50dd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db50e10 _sleep() at _sleep+0x2d6/frame 0xfffffe010db50ea0 buf_daemon() at buf_daemon+0x121/frame 0xfffffe010db50ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db50f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db50f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100198 td 0xfffffe010e3d8560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010f116d50 mi_switch() at mi_switch+0x175/frame 0xfffffe010f116d70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010f116db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010f116df0 _sleep() at _sleep+0x2d6/frame 0xfffffe010f116e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010f116ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010f116f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010f116f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100199 td 0xfffffe010e3d7e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010f111d50 mi_switch() at mi_switch+0x175/frame 0xfffffe010f111d70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010f111db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010f111df0 _sleep() at _sleep+0x2d6/frame 0xfffffe010f111e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010f111ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010f111f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010f111f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100200 td 0xfffffe010e3d7720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db55d50 mi_switch() at mi_switch+0x175/frame 0xfffffe010db55d70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db55db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db55df0 _sleep() at _sleep+0x2d6/frame 0xfffffe010db55e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010db55ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db55f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db55f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100201 td 0xfffffe010e3d7000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010f721d50 mi_switch() at mi_switch+0x175/frame 0xfffffe010f721d70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010f721db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010f721df0 _sleep() at _sleep+0x2d6/frame 0xfffffe010f721e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010f721ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010f721f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010f721f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100202 td 0xfffffe010e3cb740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010fd2cd50 mi_switch() at mi_switch+0x175/frame 0xfffffe010fd2cd70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010fd2cdb0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010fd2cdf0 _sleep() at _sleep+0x2d6/frame 0xfffffe010fd2ce80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010fd2cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010fd2cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010fd2cf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command bufdaemon pid 17 tid 100203 td 0xfffffe010e3cb020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db5ad50 mi_switch() at mi_switch+0x175/frame 0xfffffe010db5ad70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db5adb0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db5adf0 _sleep() at _sleep+0x2d6/frame 0xfffffe010db5ae80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010db5aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db5af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db5af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100204 td 0xfffffe010e3ca900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db64d50 mi_switch() at mi_switch+0x175/frame 0xfffffe010db64d70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db64db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db64df0 _sleep() at _sleep+0x2d6/frame 0xfffffe010db64e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010db64ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db64f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db64f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100226 td 0xfffffe013affd900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe013adf7d80 mi_switch() at mi_switch+0x175/frame 0xfffffe013adf7da0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013adf7de0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe013adf7e20 _sleep() at _sleep+0x2d6/frame 0xfffffe013adf7eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe013adf7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe013adf7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe013adf7f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command bufdaemon pid 17 tid 100240 td 0xfffffe0143db0020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db96d80 mi_switch() at mi_switch+0x175/frame 0xfffffe010db96da0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db96de0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db96e20 _sleep() at _sleep+0x2d6/frame 0xfffffe010db96eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe010db96ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db96f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db96f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 935850 td 0xfffffe0157eb03a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0193b4ed80 mi_switch() at mi_switch+0x175/frame 0xfffffe0193b4eda0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0193b4ede0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0193b4ee20 _sleep() at _sleep+0x2d6/frame 0xfffffe0193b4eeb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe0193b4eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0193b4ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0193b4ef30 --- trap 0xc, rip = 0x828a6bd2c, rsp = 0x83a982328, rbp = 0x83a982350 --- Tracing command syncer pid 18 tid 100207 td 0xfffffe010e3c8560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db4bd40 mi_switch() at mi_switch+0x175/frame 0xfffffe010db4bd60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db4bda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db4bde0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x199/frame 0xfffffe010db4be60 sched_sync() at sched_sync+0x66e/frame 0xfffffe010db4bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db4bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db4bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 19 tid 100208 td 0xfffffe010e3c7e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe013ad9dd20 mi_switch() at mi_switch+0x175/frame 0xfffffe013ad9dd40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013ad9dd80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe013ad9ddc0 _sleep() at _sleep+0x2d6/frame 0xfffffe013ad9de50 vnlru_proc() at vnlru_proc+0x91f/frame 0xfffffe013ad9def0 fork_exit() at fork_exit+0x80/frame 0xfffffe013ad9df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe013ad9df30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command sshd pid 540 tid 101099 td 0xfffffe016fd80e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe015b5b2ae0 mi_switch() at mi_switch+0x175/frame 0xfffffe015b5b2b00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe015b5b2b40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe015b5b2b90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe015b5b2ba0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe015b5b2c00 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe015b5b2c90 kern_poll() at kern_poll+0x9f/frame 0xfffffe015b5b2de0 sys_poll() at sys_poll+0x50/frame 0xfffffe015b5b2e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe015b5b2f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe015b5b2f30 --- syscall (209, FreeBSD ELF64, poll), rip = 0xc56ce9089a, rsp = 0xc5648c1908, rbp = 0xc5648c1940 --- Tracing command sshd pid 543 tid 122375 td 0xfffffe0173f09740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0180c81ab0 mi_switch() at mi_switch+0x175/frame 0xfffffe0180c81ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0180c81b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0180c81b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0180c81b70 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe0180c81bd0 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe0180c81c60 kern_poll() at kern_poll+0x9f/frame 0xfffffe0180c81db0 sys_ppoll() at sys_ppoll+0x6f/frame 0xfffffe0180c81e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe0180c81f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0180c81f30 --- syscall (545, FreeBSD ELF64, ppoll), rip = 0xc56ce908ba, rsp = 0xc5648c16c8, rbp = 0xc5648c1700 --- Tracing command bash pid 544 tid 100732 td 0xfffffe0157dbe900 --- swapped out Tracing command dhclient pid 3232 tid 100259 td 0xfffffe0142b56000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe014188aab0 mi_switch() at mi_switch+0x175/frame 0xfffffe014188aad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014188ab10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014188ab60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014188ab70 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe014188abd0 kern_select() at kern_select+0xa96/frame 0xfffffe014188adc0 sys_select() at sys_select+0x56/frame 0xfffffe014188ae00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe014188af30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014188af30 --- syscall (93, FreeBSD ELF64, select), rip = 0x21b0dbe0299a, rsp = 0x21b0d9363278, rbp = 0x21b0d9363330 --- Tracing command dhclient pid 3235 tid 100266 td 0xfffffe014452e560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01418a8ae0 mi_switch() at mi_switch+0x175/frame 0xfffffe01418a8b00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01418a8b40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01418a8b90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01418a8ba0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe01418a8c00 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe01418a8c90 kern_poll() at kern_poll+0x9f/frame 0xfffffe01418a8de0 sys_poll() at sys_poll+0x50/frame 0xfffffe01418a8e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01418a8f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01418a8f30 --- syscall (209, FreeBSD ELF64, poll), rip = 0x21b0dbe0289a, rsp = 0x21b0d93634b8, rbp = 0x21b0d93634f0 --- Tracing command bash pid 93397 tid 221528 td 0xfffffe01916fd1e0 --- swapped out Tracing command tail pid 93398 tid 216521 td 0xfffffe018f0441e0 --- swapped out Tracing command tail pid 93401 tid 100298 td 0xfffffe01445861e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01418f3ab0 mi_switch() at mi_switch+0x175/frame 0xfffffe01418f3ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01418f3b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01418f3b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01418f3b70 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe01418f3bd0 kern_select() at kern_select+0xa96/frame 0xfffffe01418f3dc0 sys_select() at sys_select+0x56/frame 0xfffffe01418f3e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01418f3f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01418f3f30 --- syscall (93, FreeBSD ELF64, select), rip = 0x1d1ef89c699a, rsp = 0x1d1ef3a73728, rbp = 0x1d1ef3a737e0 --- Tracing command dhclient pid 3294 tid 100279 td 0xfffffe013affae40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe013adcfa90 mi_switch() at mi_switch+0x175/frame 0xfffffe013adcfab0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013adcfaf0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe013adcfb40 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe013adcfb80 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x199/frame 0xfffffe013adcfc00 kern_poll_kfds() at kern_poll_kfds+0x4a9/frame 0xfffffe013adcfc90 kern_poll() at kern_poll+0x9f/frame 0xfffffe013adcfde0 sys_poll() at sys_poll+0x50/frame 0xfffffe013adcfe00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe013adcff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013adcff30 --- syscall (209, FreeBSD ELF64, poll), rip = 0x21b0dbe0289a, rsp = 0x21b0d93634b8, rbp = 0x21b0d93634f0 --- Tracing command devd pid 3326 tid 100244 td 0xfffffe010d9bd900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dbd5a60 mi_switch() at mi_switch+0x175/frame 0xfffffe010dbd5a80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbd5ac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbd5b10 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010dbd5b50 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x199/frame 0xfffffe010dbd5bd0 kern_select() at kern_select+0xa70/frame 0xfffffe010dbd5dc0 sys_select() at sys_select+0x56/frame 0xfffffe010dbd5e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe010dbd5f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbd5f30 --- syscall (93, FreeBSD ELF64, select), rip = 0x10c0ef5e399a, rsp = 0x10c0eb565c88, rbp = 0x10c0eb567e20 --- Tracing command syslogd pid 3534 tid 100267 td 0xfffffe0141aab560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01418b2ab0 mi_switch() at mi_switch+0x175/frame 0xfffffe01418b2ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01418b2b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01418b2b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01418b2b70 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe01418b2bd0 kern_select() at kern_select+0xa96/frame 0xfffffe01418b2dc0 sys_select() at sys_select+0x56/frame 0xfffffe01418b2e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01418b2f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01418b2f30 --- syscall (93, FreeBSD ELF64, select), rip = 0x38ff8f3fa99a, rsp = 0x38ff8d425ad8, rbp = 0x38ff8d426050 --- Tracing command watchdogd pid 3554 tid 100297 td 0xfffffe013affa000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01418e4bc0 mi_switch() at mi_switch+0x175/frame 0xfffffe01418e4be0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01418e4c20 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01418e4c70 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01418e4cb0 _sleep() at _sleep+0x2c4/frame 0xfffffe01418e4d40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1c1/frame 0xfffffe01418e4dc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01418e4e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01418e4f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01418e4f30 --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x3849d79f481a, rsp = 0x3849d65bbab8, rbp = 0x3849d65bbb00 --- Tracing command ntpd pid 3614 tid 100276 td 0xfffffe0143dadc80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01418c1ab0 mi_switch() at mi_switch+0x175/frame 0xfffffe01418c1ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01418c1b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01418c1b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01418c1b70 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe01418c1bd0 kern_select() at kern_select+0xa96/frame 0xfffffe01418c1dc0 sys_select() at sys_select+0x56/frame 0xfffffe01418c1e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01418c1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01418c1f30 --- syscall (93, FreeBSD ELF64, select), rip = 0x36099564899a, rsp = 0x360991db12d8, rbp = 0x360991db1310 --- Tracing command powerd pid 3617 tid 100217 td 0xfffffe013affa720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe013adcaa60 mi_switch() at mi_switch+0x175/frame 0xfffffe013adcaa80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013adcaac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe013adcab10 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe013adcab50 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x199/frame 0xfffffe013adcabd0 kern_select() at kern_select+0xa70/frame 0xfffffe013adcadc0 sys_select() at sys_select+0x56/frame 0xfffffe013adcae00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe013adcaf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013adcaf30 --- syscall (93, FreeBSD ELF64, select), rip = 0x36eb1d0c199a, rsp = 0x36eb19fcf5d8, rbp = 0x36eb19fcf710 --- Tracing command inetd pid 3635 tid 100307 td 0xfffffe014375ee40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe014192aab0 mi_switch() at mi_switch+0x175/frame 0xfffffe014192aad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014192ab10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014192ab60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014192ab70 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe014192abd0 kern_select() at kern_select+0xa96/frame 0xfffffe014192adc0 sys_select() at sys_select+0x56/frame 0xfffffe014192ae00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe014192af30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014192af30 --- syscall (93, FreeBSD ELF64, select), rip = 0x34430fd3b99a, rsp = 0x34430b95c7d8, rbp = 0x34430b95d660 --- Tracing command cron pid 3639 tid 100242 td 0xfffffe013affcac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dbd0bc0 mi_switch() at mi_switch+0x175/frame 0xfffffe010dbd0be0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbd0c20 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbd0c70 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010dbd0cb0 _sleep() at _sleep+0x2c4/frame 0xfffffe010dbd0d40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1c1/frame 0xfffffe010dbd0dc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe010dbd0e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe010dbd0f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbd0f30 --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x2063e255d81a, rsp = 0x2063deaf26d8, rbp = 0x2063deaf28b0 --- Tracing command sshd pid 3656 tid 100305 td 0xfffffe0143dace40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01418cbab0 mi_switch() at mi_switch+0x175/frame 0xfffffe01418cbad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01418cbb10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01418cbb60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01418cbb70 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe01418cbbd0 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe01418cbc60 kern_poll() at kern_poll+0x9f/frame 0xfffffe01418cbdb0 sys_ppoll() at sys_ppoll+0x6f/frame 0xfffffe01418cbe00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01418cbf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01418cbf30 --- syscall (545, FreeBSD ELF64, ppoll), rip = 0x2ec87604f8ba, rsp = 0x2ec86e176088, rbp = 0x2ec86e1760c0 --- Tracing command getty pid 3670 tid 100250 td 0xfffffe0141aacac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe013ade8b00 mi_switch() at mi_switch+0x175/frame 0xfffffe013ade8b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013ade8b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe013ade8bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe013ade8bc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe013ade8c20 tty_wait() at tty_wait+0x42/frame 0xfffffe013ade8c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe013ade8cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe013ade8cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe013ade8d50 dofileread() at dofileread+0x83/frame 0xfffffe013ade8d90 sys_read() at sys_read+0xc0/frame 0xfffffe013ade8e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe013ade8f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013ade8f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x3bcb1885891a, rsp = 0x3bcb152d5338, rbp = 0x3bcb152d5380 --- Tracing command getty pid 3671 tid 100256 td 0xfffffe0143daeac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dbe9b00 mi_switch() at mi_switch+0x175/frame 0xfffffe010dbe9b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbe9b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbe9bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbe9bc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe010dbe9c20 tty_wait() at tty_wait+0x42/frame 0xfffffe010dbe9c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe010dbe9cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010dbe9cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010dbe9d50 dofileread() at dofileread+0x83/frame 0xfffffe010dbe9d90 sys_read() at sys_read+0xc0/frame 0xfffffe010dbe9e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe010dbe9f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbe9f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x312913be191a, rsp = 0x31290fd386f8, rbp = 0x31290fd38740 --- Tracing command getty pid 3672 tid 100255 td 0xfffffe01444d1560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe014187bb00 mi_switch() at mi_switch+0x175/frame 0xfffffe014187bb20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014187bb60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014187bbb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014187bbc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe014187bc20 tty_wait() at tty_wait+0x42/frame 0xfffffe014187bc50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe014187bcc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe014187bcf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe014187bd50 dofileread() at dofileread+0x83/frame 0xfffffe014187bd90 sys_read() at sys_read+0xc0/frame 0xfffffe014187be00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe014187bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014187bf30 --- syscall (3, FreeBSD ELF64, read), rip = 0x3f28da55691a, rsp = 0x3f28d6e1f388, rbp = 0x3f28d6e1f3d0 --- Tracing command getty pid 3673 tid 100211 td 0xfffffe013afd13a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe013adbbb00 mi_switch() at mi_switch+0x175/frame 0xfffffe013adbbb20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013adbbb60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe013adbbbb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe013adbbbc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe013adbbc20 tty_wait() at tty_wait+0x42/frame 0xfffffe013adbbc50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe013adbbcc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe013adbbcf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe013adbbd50 dofileread() at dofileread+0x83/frame 0xfffffe013adbbd90 sys_read() at sys_read+0xc0/frame 0xfffffe013adbbe00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe013adbbf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013adbbf30 --- syscall (3, FreeBSD ELF64, read), rip = 0x182bb1ed591a, rsp = 0x182bb06867b8, rbp = 0x182bb0686800 --- Tracing command getty pid 3674 tid 100254 td 0xfffffe01444d1c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0141880b00 mi_switch() at mi_switch+0x175/frame 0xfffffe0141880b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141880b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141880bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141880bc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe0141880c20 tty_wait() at tty_wait+0x42/frame 0xfffffe0141880c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe0141880cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0141880cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0141880d50 dofileread() at dofileread+0x83/frame 0xfffffe0141880d90 sys_read() at sys_read+0xc0/frame 0xfffffe0141880e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe0141880f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141880f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x38b3b571c91a, rsp = 0x38b3b3181f38, rbp = 0x38b3b3181f80 --- Tracing command getty pid 3675 tid 100221 td 0xfffffe010e3c7000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe013ade3b00 mi_switch() at mi_switch+0x175/frame 0xfffffe013ade3b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013ade3b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe013ade3bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe013ade3bc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe013ade3c20 tty_wait() at tty_wait+0x42/frame 0xfffffe013ade3c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe013ade3cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe013ade3cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe013ade3d50 dofileread() at dofileread+0x83/frame 0xfffffe013ade3d90 sys_read() at sys_read+0xc0/frame 0xfffffe013ade3e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe013ade3f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013ade3f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x32538c9aa91a, rsp = 0x32538a356338, rbp = 0x32538a356380 --- Tracing command getty pid 3676 tid 100248 td 0xfffffe0143daf1e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dbeeb00 mi_switch() at mi_switch+0x175/frame 0xfffffe010dbeeb20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbeeb60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbeebb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbeebc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe010dbeec20 tty_wait() at tty_wait+0x42/frame 0xfffffe010dbeec50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe010dbeecc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010dbeecf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010dbeed50 dofileread() at dofileread+0x83/frame 0xfffffe010dbeed90 sys_read() at sys_read+0xc0/frame 0xfffffe010dbeee00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe010dbeef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbeef30 --- syscall (3, FreeBSD ELF64, read), rip = 0x2eb22c69791a, rsp = 0x2eb229814758, rbp = 0x2eb2298147a0 --- Tracing command getty pid 3677 tid 100253 td 0xfffffe01444d23a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dbf3b00 mi_switch() at mi_switch+0x175/frame 0xfffffe010dbf3b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbf3b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbf3bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbf3bc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe010dbf3c20 tty_wait() at tty_wait+0x42/frame 0xfffffe010dbf3c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe010dbf3cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010dbf3cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010dbf3d50 dofileread() at dofileread+0x83/frame 0xfffffe010dbf3d90 sys_read() at sys_read+0xc0/frame 0xfffffe010dbf3e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe010dbf3f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbf3f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x2521c3f9691a, rsp = 0x2521c157ef18, rbp = 0x2521c157ef60 --- Tracing command getty pid 3678 tid 100252 td 0xfffffe0141aac3a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0141876b00 mi_switch() at mi_switch+0x175/frame 0xfffffe0141876b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141876b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141876bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141876bc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe0141876c20 tty_wait() at tty_wait+0x42/frame 0xfffffe0141876c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe0141876cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0141876cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0141876d50 dofileread() at dofileread+0x83/frame 0xfffffe0141876d90 sys_read() at sys_read+0xc0/frame 0xfffffe0141876e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe0141876f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141876f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x263ac15ce91a, rsp = 0x263abf5dd658, rbp = 0x263abf5dd6a0 --- Tracing command sshd pid 3679 tid 100264 td 0xfffffe00e4d56720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe011196dae0 mi_switch() at mi_switch+0x175/frame 0xfffffe011196db00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe011196db40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe011196db90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe011196dba0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe011196dc00 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe011196dc90 kern_poll() at kern_poll+0x9f/frame 0xfffffe011196dde0 sys_poll() at sys_poll+0x50/frame 0xfffffe011196de00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe011196df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe011196df30 --- syscall (209, FreeBSD ELF64, poll), rip = 0xf517fe7489a, rsp = 0xf5178aee9f8, rbp = 0xf5178aeea30 --- Tracing command sshd pid 3682 tid 100210 td 0xfffffe013afa3900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe013adb1ab0 mi_switch() at mi_switch+0x175/frame 0xfffffe013adb1ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013adb1b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe013adb1b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe013adb1b70 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe013adb1bd0 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe013adb1c60 kern_poll() at kern_poll+0x9f/frame 0xfffffe013adb1db0 sys_ppoll() at sys_ppoll+0x6f/frame 0xfffffe013adb1e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe013adb1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013adb1f30 --- syscall (545, FreeBSD ELF64, ppoll), rip = 0xf517fe748ba, rsp = 0xf5178aee7b8, rbp = 0xf5178aee7f0 --- Tracing command bash pid 3683 tid 100308 td 0xfffffe014375e720 --- swapped out Tracing command su pid 3689 tid 100251 td 0xfffffe010d9bd1e0 --- swapped out Tracing command csh pid 3690 tid 100299 td 0xfffffe0144585ac0 --- swapped out Tracing command bash pid 3692 tid 100223 td 0xfffffe013affe020 --- swapped out Tracing command sshd pid 4066 tid 100275 td 0xfffffe0141aaa720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db7bae0 mi_switch() at mi_switch+0x175/frame 0xfffffe010db7bb00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db7bb40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db7bb90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db7bba0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe010db7bc00 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe010db7bc90 kern_poll() at kern_poll+0x9f/frame 0xfffffe010db7bde0 sys_poll() at sys_poll+0x50/frame 0xfffffe010db7be00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe010db7bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db7bf30 --- syscall (209, FreeBSD ELF64, poll), rip = 0x34a6a406589a, rsp = 0x34a69c4edad8, rbp = 0x34a69c4edb10 --- Tracing command sshd pid 4069 tid 100421 td 0xfffffe0143643e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe014194dab0 mi_switch() at mi_switch+0x175/frame 0xfffffe014194dad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014194db10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014194db60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014194db70 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe014194dbd0 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe014194dc60 kern_poll() at kern_poll+0x9f/frame 0xfffffe014194ddb0 sys_ppoll() at sys_ppoll+0x6f/frame 0xfffffe014194de00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe014194df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014194df30 --- syscall (545, FreeBSD ELF64, ppoll), rip = 0x34a6a40658ba, rsp = 0x34a69c4ed898, rbp = 0x34a69c4ed8d0 --- Tracing command bash pid 4070 tid 100245 td 0xfffffe0143daf900 --- swapped out Tracing command su pid 4076 tid 100249 td 0xfffffe01444d2ac0 --- swapped out Tracing command csh pid 4077 tid 100315 td 0xfffffe0143644560 --- swapped out Tracing command bash pid 4079 tid 100301 td 0xfffffe0144584c80 --- swapped out Tracing command sh pid 4160 tid 100507 td 0xfffffe0144587740 --- swapped out Tracing command sh pid 4250 tid 100295 td 0xfffffe0144586900 --- swapped out Tracing command sh pid 4288 tid 100310 td 0xfffffe014375e000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe014193ea20 mi_switch() at mi_switch+0x175/frame 0xfffffe014193ea40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014193ea80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014193ead0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014193eae0 _sleep() at _sleep+0x2e5/frame 0xfffffe014193eb70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe014193ec00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014193ee00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe014193ef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014193ef30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x40f3257cafa, rsp = 0x40f306e85b8, rbp = 0x40f306e8660 --- Tracing command awk pid 4289 tid 100462 td 0xfffffe0143643720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0111963b90 mi_switch() at mi_switch+0x175/frame 0xfffffe0111963bb0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0111963bf0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0111963c40 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0111963c50 _sleep() at _sleep+0x2e5/frame 0xfffffe0111963ce0 pipe_read() at pipe_read+0x42a/frame 0xfffffe0111963d50 dofileread() at dofileread+0x83/frame 0xfffffe0111963d90 sys_read() at sys_read+0xc0/frame 0xfffffe0111963e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe0111963f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0111963f30 --- syscall (3, FreeBSD ELF64, read), rip = 0xf7e3a63c91a, rsp = 0xf7e38738888, rbp = 0xf7e387388a0 --- Tracing command sh pid 4291 tid 100246 td 0xfffffe0142b56e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dbe4b90 mi_switch() at mi_switch+0x175/frame 0xfffffe010dbe4bb0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbe4bf0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbe4c40 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbe4c50 _sleep() at _sleep+0x2e5/frame 0xfffffe010dbe4ce0 pipe_read() at pipe_read+0x42a/frame 0xfffffe010dbe4d50 dofileread() at dofileread+0x83/frame 0xfffffe010dbe4d90 sys_read() at sys_read+0xc0/frame 0xfffffe010dbe4e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe010dbe4f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbe4f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x40f3257c91a, rsp = 0x40f306e8048, rbp = 0x40f306e8570 --- Tracing command sleep pid 37726 tid 215545 td 0xfffffe018e7fe1e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01acd36bc0 mi_switch() at mi_switch+0x175/frame 0xfffffe01acd36be0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01acd36c20 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01acd36c70 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01acd36cb0 _sleep() at _sleep+0x2c4/frame 0xfffffe01acd36d40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1c1/frame 0xfffffe01acd36dc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01acd36e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01acd36f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01acd36f30 --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x57511f9281a, rsp = 0x57510727378, rbp = 0x575107273e0 --- Tracing command mlockall6 pid 37842 tid 661346 td 0xfffffe01947edac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe015b454a20 mi_switch() at mi_switch+0x175/frame 0xfffffe015b454a40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe015b454a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe015b454ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe015b454ae0 _sleep() at _sleep+0x2e5/frame 0xfffffe015b454b70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe015b454c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe015b454e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe015b454f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe015b454f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x821523afa, rsp = 0x820636828, rbp = 0x820636850 --- Tracing command mlockall6 pid 37843 tid 659898 td 0xfffffe01916fe020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01ca481a20 mi_switch() at mi_switch+0x175/frame 0xfffffe01ca481a40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01ca481a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01ca481ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01ca481ae0 _sleep() at _sleep+0x2e5/frame 0xfffffe01ca481b70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe01ca481c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01ca481e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01ca481f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01ca481f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x821523afa, rsp = 0x820636828, rbp = 0x820636850 --- Tracing command mlockall6 pid 37844 tid 221737 td 0xfffffe01918b5020 thread_exit() at thread_exit+0x1f6/frame 0xfffffe01b4626d80 exit1() at exit1+0xe01/frame 0xfffffe01b4626df0 sys_exit() at sys_exit+0xd/frame 0xfffffe01b4626e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01b4626f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01b4626f30 --- syscall (1, FreeBSD ELF64, exit), rip = 0x82152353a, rsp = 0x820636828, rbp = 0x820636850 --- Tracing command mlockall6 pid 37845 tid 222406 td 0xfffffe0191e101e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01b5332a20 mi_switch() at mi_switch+0x175/frame 0xfffffe01b5332a40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01b5332a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01b5332ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01b5332ae0 _sleep() at _sleep+0x2e5/frame 0xfffffe01b5332b70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe01b5332c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01b5332e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01b5332f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01b5332f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x821523afa, rsp = 0x820636828, rbp = 0x820636850 --- Tracing command mlockall6 pid 37846 tid 197038 td 0xfffffe018748e3a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe019646aa20 mi_switch() at mi_switch+0x175/frame 0xfffffe019646aa40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe019646aa80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe019646aad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe019646aae0 _sleep() at _sleep+0x2e5/frame 0xfffffe019646ab70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe019646ac00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe019646ae00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe019646af30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe019646af30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x821523afa, rsp = 0x820636828, rbp = 0x820636850 --- Tracing command mlockall6 pid 37847 tid 221640 td 0xfffffe01917da720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01b4441a20 mi_switch() at mi_switch+0x175/frame 0xfffffe01b4441a40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01b4441a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01b4441ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01b4441ae0 _sleep() at _sleep+0x2e5/frame 0xfffffe01b4441b70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe01b4441c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01b4441e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01b4441f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01b4441f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x821523afa, rsp = 0x820636828, rbp = 0x820636850 --- Tracing command mlockall6 pid 37848 tid 197238 td 0xfffffe01800c61e0 thread_exit() at thread_exit+0x1f6/frame 0xfffffe0196852d80 exit1() at exit1+0xe01/frame 0xfffffe0196852df0 sys_exit() at sys_exit+0xd/frame 0xfffffe0196852e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe0196852f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0196852f30 --- syscall (1, FreeBSD ELF64, exit), rip = 0x82152353a, rsp = 0x820636828, rbp = 0x820636850 --- Tracing command mlockall6 pid 37849 tid 661838 td 0xfffffe018b9b6560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01899b9a20 mi_switch() at mi_switch+0x175/frame 0xfffffe01899b9a40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01899b9a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01899b9ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01899b9ae0 _sleep() at _sleep+0x2e5/frame 0xfffffe01899b9b70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe01899b9c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01899b9e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01899b9f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01899b9f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x821523afa, rsp = 0x820636828, rbp = 0x820636850 --- Tracing command sh pid 37865 tid 660420 td 0xfffffe018cdd5e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0193a4fa20 mi_switch() at mi_switch+0x175/frame 0xfffffe0193a4fa40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0193a4fa80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0193a4fad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0193a4fae0 _sleep() at _sleep+0x2e5/frame 0xfffffe0193a4fb70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe0193a4fc00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0193a4fe00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe0193a4ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0193a4ff30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x40f3257cafa, rsp = 0x40f306e8378, rbp = 0x40f306e8420 --- Tracing command mlockall6 pid 37881 tid 230596 td 0xfffffe01c24f4ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01c2f69e90 mi_switch() at mi_switch+0x175/frame 0xfffffe01c2f69eb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe01c2f69ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01c2f69f10 ast() at ast+0x20/frame 0xfffffe01c2f69f30 doreti_ast() at doreti_ast+0x1c/frame 0x8206367e0 Tracing command mlockall6 pid 37882 tid 203134 td 0xfffffe01940121e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe019dac6c30 mi_switch() at mi_switch+0x175/frame 0xfffffe019dac6c50 vm_page_free_prep() at vm_page_free_prep+0x196/frame 0xfffffe019dac6c70 vm_page_free_toq() at vm_page_free_toq+0x12/frame 0xfffffe019dac6ca0 vm_object_terminate() at vm_object_terminate+0x10d/frame 0xfffffe019dac6cd0 vm_object_deallocate() at vm_object_deallocate+0x2bb/frame 0xfffffe019dac6d00 vm_map_process_deferred() at vm_map_process_deferred+0xab/frame 0xfffffe019dac6d20 vm_map_remove() at vm_map_remove+0xed/frame 0xfffffe019dac6d50 vmspace_exit() at vmspace_exit+0xa9/frame 0xfffffe019dac6d80 exit1() at exit1+0x533/frame 0xfffffe019dac6df0 sys_exit() at sys_exit+0xd/frame 0xfffffe019dac6e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe019dac6f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe019dac6f30 --- syscall (1, FreeBSD ELF64, exit), rip = 0x82152353a, rsp = 0x8206367e8, rbp = 0x820636820 --- Tracing command mlockall6 pid 37890 tid 203112 td 0xfffffe0194013020 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce98df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce98e00 trap() at trap+0x57/frame 0xfffffe003ce98f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce98f20 --- trap 0x13, rip = 0xffffffff810d0c1f, rsp = 0xfffffe019da58b10, rbp = 0xfffffe019da58b20 --- pmap_invalidate_page_pcid_invpcid_cb() at pmap_invalidate_page_pcid_invpcid_cb+0x5f/frame 0xfffffe019da58b20 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0x103/frame 0xfffffe019da58b80 pmap_enter() at pmap_enter+0xf05/frame 0xfffffe019da58c40 vm_fault() at vm_fault+0x146f/frame 0xfffffe019da58d70 vm_fault_trap() at vm_fault_trap+0x71/frame 0xfffffe019da58db0 trap_pfault() at trap_pfault+0x22c/frame 0xfffffe019da58e10 trap() at trap+0x48c/frame 0xfffffe019da58f30 calltrap() at calltrap+0x8/frame 0xfffffe019da58f30 --- trap 0xc, rip = 0x201e6c, rsp = 0x8206367e0, rbp = 0x8206367e0 --- Tracing command mlockall6 pid 37891 tid 211545 td 0xfffffe018c923720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01a7f16e90 mi_switch() at mi_switch+0x175/frame 0xfffffe01a7f16eb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe01a7f16ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01a7f16f10 ast() at ast+0x20/frame 0xfffffe01a7f16f30 doreti_ast() at doreti_ast+0x1c/frame 0x8206367e0 Tracing command mlockall6 pid 37895 tid 199677 td 0xfffffe019312a000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01997c8e90 mi_switch() at mi_switch+0x175/frame 0xfffffe01997c8eb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe01997c8ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01997c8f10 ast() at ast+0x20/frame 0xfffffe01997c8f30 doreti_ast() at doreti_ast+0x1c/frame 0x8206367e0 Tracing command mlockall6 pid 37902 tid 197225 td 0xfffffe01800c4c80 (CPU 5) kdb_enter() at kdb_enter+0x32/frame 0xfffffe0196811b20 vpanic() at vpanic+0x183/frame 0xfffffe0196811b70 panic() at panic+0x43/frame 0xfffffe0196811bd0 vm_page_unwire_managed() at vm_page_unwire_managed+0x18f/frame 0xfffffe0196811c20 vm_object_unwire() at vm_object_unwire+0x289/frame 0xfffffe0196811c80 vm_map_entry_unwire() at vm_map_entry_unwire+0x8c/frame 0xfffffe0196811cb0 vm_map_delete() at vm_map_delete+0x162/frame 0xfffffe0196811d20 vm_map_remove() at vm_map_remove+0x80/frame 0xfffffe0196811d50 vmspace_exit() at vmspace_exit+0xa9/frame 0xfffffe0196811d80 exit1() at exit1+0x533/frame 0xfffffe0196811df0 sys_exit() at sys_exit+0xd/frame 0xfffffe0196811e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe0196811f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0196811f30 --- syscall (1, FreeBSD ELF64, exit), rip = 0x82152353a, rsp = 0x8206367e8, rbp = 0x820636820 --- Tracing command mlockall6 pid 37903 tid 232956 td 0xfffffe01c6969c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01c6d8de90 mi_switch() at mi_switch+0x175/frame 0xfffffe01c6d8deb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe01c6d8ded0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01c6d8df10 ast() at ast+0x20/frame 0xfffffe01c6d8df30 doreti_ast() at doreti_ast+0x1c/frame 0x820636820 Tracing command mlockall6 pid 37906 tid 203106 td 0xfffffe0193f683a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe019da3ae90 mi_switch() at mi_switch+0x175/frame 0xfffffe019da3aeb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe019da3aed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe019da3af10 ast() at ast+0x20/frame 0xfffffe019da3af30 doreti_ast() at doreti_ast+0x1c/frame 0x8206367e0 Tracing command mlockall6 pid 37907 tid 214081 td 0xfffffe018dd74c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01ab09eaa0 mi_switch() at mi_switch+0x175/frame 0xfffffe01ab09eac0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01ab09eb00 _blockcount_sleep() at _blockcount_sleep+0x10d/frame 0xfffffe01ab09eb60 _vm_page_busy_sleep() at _vm_page_busy_sleep+0x50/frame 0xfffffe01ab09ebb0 vm_fault() at vm_fault+0xd2e/frame 0xfffffe01ab09ece0 vm_map_wire_locked() at vm_map_wire_locked+0x386/frame 0xfffffe01ab09ed90 vm_map_wire() at vm_map_wire+0x6a/frame 0xfffffe01ab09edc0 sys_mlockall() at sys_mlockall+0x139/frame 0xfffffe01ab09ee00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01ab09ef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01ab09ef30 --- syscall (324, FreeBSD ELF64, mlockall), rip = 0x821521b5a, rsp = 0x8206367e8, rbp = 0x820636820 --- Tracing command mlockall6 pid 37912 tid 210858 td 0xfffffe018c3cc1e0 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3edf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ee00 trap() at trap+0x57/frame 0xfffffe003ce3ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3ef20 --- trap 0x13, rip = 0xffffffff80fb189e, rsp = 0xfffffe01a71abbb0, rbp = 0xfffffe01a71abbb0 --- vm_radix_lookup() at vm_radix_lookup+0x1e/frame 0xfffffe01a71abbb0 vm_fault() at vm_fault+0x360/frame 0xfffffe01a71abce0 vm_map_wire_locked() at vm_map_wire_locked+0x386/frame 0xfffffe01a71abd90 vm_map_wire() at vm_map_wire+0x6a/frame 0xfffffe01a71abdc0 sys_mlockall() at sys_mlockall+0x139/frame 0xfffffe01a71abe00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01a71abf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01a71abf30 --- syscall (324, FreeBSD ELF64, mlockall), rip = 0x821521b5a, rsp = 0x8206367e8, rbp = 0x820636820 --- Tracing command egrep pid 37914 tid 657307 td 0xfffffe018cc2fac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01ca53ab90 mi_switch() at mi_switch+0x175/frame 0xfffffe01ca53abb0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01ca53abf0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01ca53ac40 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01ca53ac50 _sleep() at _sleep+0x2e5/frame 0xfffffe01ca53ace0 pipe_read() at pipe_read+0x42a/frame 0xfffffe01ca53ad50 dofileread() at dofileread+0x83/frame 0xfffffe01ca53ad90 sys_read() at sys_read+0xc0/frame 0xfffffe01ca53ae00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01ca53af30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01ca53af30 --- syscall (3, FreeBSD ELF64, read), rip = 0x1c8f80ef791a, rsp = 0x1c8f7e7cbaa8, rbp = 0x1c8f7e7cbbc0 --- Tracing command su pid 46651 tid 138012 td 0xfffffe015d91e720 --- swapped out Tracing command csh pid 46652 tid 100546 td 0xfffffe0157f9cc80 --- swapped out Tracing command bash pid 46782 tid 137926 td 0xfffffe01623f6000 --- swapped out Tracing command sh pid 55130 tid 100230 td 0xfffffe00e4d56e40 --- swapped out Tracing command sh pid 47169 tid 100589 td 0xfffffe0143761900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01581a7a20 mi_switch() at mi_switch+0x175/frame 0xfffffe01581a7a40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01581a7a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01581a7ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01581a7ae0 _sleep() at _sleep+0x2e5/frame 0xfffffe01581a7b70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe01581a7c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01581a7e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01581a7f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01581a7f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0xf2a70405afa, rsp = 0xf2a6cddb468, rbp = 0xf2a6cddb510 --- Tracing command sh pid 23610 tid 661736 td 0xfffffe018cdd9740 --- swapped out Tracing command tee pid 23611 tid 232343 td 0xfffffe01c5986e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01c5d92b90 mi_switch() at mi_switch+0x175/frame 0xfffffe01c5d92bb0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01c5d92bf0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01c5d92c40 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01c5d92c50 _sleep() at _sleep+0x2e5/frame 0xfffffe01c5d92ce0 pipe_read() at pipe_read+0x42a/frame 0xfffffe01c5d92d50 dofileread() at dofileread+0x83/frame 0xfffffe01c5d92d90 sys_read() at sys_read+0xc0/frame 0xfffffe01c5d92e00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01c5d92f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01c5d92f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x3676612d391a, rsp = 0x36765f0224b8, rbp = 0x36765f022510 --- Tracing command sh pid 23612 tid 210718 td 0xfffffe018c2f61e0 --- swapped out Tracing command md10 pid 23632 tid 210699 td 0xfffffe018c2f6900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01a6e90db0 mi_switch() at mi_switch+0x175/frame 0xfffffe01a6e90dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01a6e90e10 _sleep() at _sleep+0x2ef/frame 0xfffffe01a6e90ea0 md_kthread() at md_kthread+0xd5/frame 0xfffffe01a6e90ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01a6e90f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01a6e90f30 --- trap 0xc, rip = 0x33608fe653a, rsp = 0x33605edbf98, rbp = 0x33605edbfb0 --- Tracing command swap pid 23636 tid 214845 td 0xfffffe018e2fde40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01abf8abc0 mi_switch() at mi_switch+0x175/frame 0xfffffe01abf8abe0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01abf8ac20 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01abf8ac70 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01abf8acb0 _sleep() at _sleep+0x2c4/frame 0xfffffe01abf8ad40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1c1/frame 0xfffffe01abf8adc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01abf8ae00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01abf8af30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01abf8af30 --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x2138c475e81a, rsp = 0x2138c36becc8, rbp = 0x2138c36bed10 --- Tracing command swap pid 23638 tid 210952 td 0xfffffe018c4e8e40 --- swapped out Tracing command swap pid 23640 tid 232675 td 0xfffffe01c14c1560 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ceb6df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ceb6e00 trap() at trap+0x57/frame 0xfffffe003ceb6f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ceb6f20 --- trap 0x13, rip = 0x2130a2b5b4ec, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- Tracing command swap pid 23641 tid 661764 td 0xfffffe0157f9d3a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe015b44fe90 mi_switch() at mi_switch+0x175/frame 0xfffffe015b44feb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe015b44fed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe015b44ff10 ast() at ast+0x20/frame 0xfffffe015b44ff30 doreti_ast() at doreti_ast+0x1c/frame 0x2138c36bed10 Tracing command swap pid 23642 tid 197509 td 0xfffffe010c80e3a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0196d9de90 mi_switch() at mi_switch+0x175/frame 0xfffffe0196d9deb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe0196d9ded0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0196d9df10 ast() at ast+0x20/frame 0xfffffe0196d9df30 doreti_ast() at doreti_ast+0x1c/frame 0x2138c36bed10 Tracing command swap pid 23643 tid 660262 td 0xfffffe015b3fe900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01a241ce90 mi_switch() at mi_switch+0x175/frame 0xfffffe01a241ceb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe01a241ced0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01a241cf10 ast() at ast+0x20/frame 0xfffffe01a241cf30 doreti_ast() at doreti_ast+0x1c/frame 0x2138c36bed10 Tracing command swap pid 23644 tid 218684 td 0xfffffe019014d720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01b0a85e90 mi_switch() at mi_switch+0x175/frame 0xfffffe01b0a85eb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe01b0a85ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01b0a85f10 ast() at ast+0x20/frame 0xfffffe01b0a85f30 doreti_ast() at doreti_ast+0x1c/frame 0x2138c36bed10 Tracing command swap pid 23645 tid 210948 td 0xfffffe018c4c1020 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81fe6c00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81fe6c10 trap() at trap+0x57/frame 0xffffffff81fe6d30 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fe6d30 --- trap 0x13, rip = 0x2130a2b5b4ec, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- Tracing command swap pid 23646 tid 661230 td 0xfffffe01bebdb740 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea7df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea7e00 trap() at trap+0x57/frame 0xfffffe003cea7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea7f20 --- trap 0x13, rip = 0x2130a2b5b4ec, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- Tracing command swap pid 23647 tid 199470 td 0xfffffe0192f82900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01993bde90 mi_switch() at mi_switch+0x175/frame 0xfffffe01993bdeb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe01993bded0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01993bdf10 ast() at ast+0x20/frame 0xfffffe01993bdf30 doreti_ast() at doreti_ast+0x1c/frame 0x2138c36bed10 Tracing command swap pid 23648 tid 197508 td 0xfffffe010c80eac0 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6be00 trap() at trap+0x57/frame 0xfffffe003ce6bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6bf20 --- trap 0x13, rip = 0x2130a2b5b4ec, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- Tracing command swap pid 23649 tid 199137 td 0xfffffe0192e65000 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce4ddf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce4de00 trap() at trap+0x57/frame 0xfffffe003ce4df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce4df20 --- trap 0x13, rip = 0x2130a2b5b4e0, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- Tracing command swap pid 23650 tid 230847 td 0xfffffe01c32e0e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01c3652e90 mi_switch() at mi_switch+0x175/frame 0xfffffe01c3652eb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe01c3652ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01c3652f10 ast() at ast+0x20/frame 0xfffffe01c3652f30 doreti_ast() at doreti_ast+0x1c/frame 0x2138c36bed10 Tracing command swap pid 23651 tid 210640 td 0xfffffe018c1d2020 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e00 trap() at trap+0x57/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0x2130a2b5b4ef, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- Tracing command swap pid 23652 tid 660336 td 0xfffffe018dca1560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01c774ae90 mi_switch() at mi_switch+0x175/frame 0xfffffe01c774aeb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe01c774aed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01c774af10 ast() at ast+0x20/frame 0xfffffe01c774af30 doreti_ast() at doreti_ast+0x1c/frame 0x2138c36bed10 Tracing command swap pid 23653 tid 218640 td 0xfffffe01900a9560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01b09a9e90 mi_switch() at mi_switch+0x175/frame 0xfffffe01b09a9eb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe01b09a9ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01b09a9f10 ast() at ast+0x20/frame 0xfffffe01b09a9f30 doreti_ast() at doreti_ast+0x1c/frame 0x2138c36bed10 Tracing command swap pid 23654 tid 232333 td 0xfffffe01c5954e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01c5d60e90 mi_switch() at mi_switch+0x175/frame 0xfffffe01c5d60eb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe01c5d60ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01c5d60f10 ast() at ast+0x20/frame 0xfffffe01c5d60f30 doreti_ast() at doreti_ast+0x1c/frame 0x2138c36bed10 Tracing command swap pid 23655 tid 220573 td 0xfffffe0190ff7900 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce89df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce89e00 trap() at trap+0x57/frame 0xfffffe003ce89f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce89f20 --- trap 0x13, rip = 0x2130a2b5b4ec, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- Tracing command swap pid 23656 tid 658880 td 0xfffffe0145ecbac0 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce2fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce2fe00 trap() at trap+0x57/frame 0xfffffe003ce2ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce2ff20 --- trap 0x13, rip = 0x2130a2b5b4ec, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- Tracing command swap pid 23657 tid 220691 td 0xfffffe01910f21e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01b31c2e90 mi_switch() at mi_switch+0x175/frame 0xfffffe01b31c2eb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe01b31c2ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01b31c2f10 ast() at ast+0x20/frame 0xfffffe01b31c2f30 doreti_ast() at doreti_ast+0x1c/frame 0x2138c36bed10 Tracing command swap pid 23658 tid 218583 td 0xfffffe018ffbb560 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7adf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7ae00 trap() at trap+0x57/frame 0xfffffe003ce7af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7af20 --- trap 0x13, rip = 0x2130a2b5b4ef, rsp = 0x2138c36bece0, rbp = 0x2138c36bed10 --- Tracing command sh pid 23659 tid 659762 td 0xfffffe01947ec560 --- swapped out Tracing command mlockall6 pid 23660 tid 660280 td 0xfffffe0158a00e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01bb6aaa20 mi_switch() at mi_switch+0x175/frame 0xfffffe01bb6aaa40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01bb6aaa80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01bb6aaad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01bb6aaae0 _sleep() at _sleep+0x2e5/frame 0xfffffe01bb6aab70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe01bb6aac00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01bb6aae00 amd64_syscall() at amd64_syscall+0x157/frame 0xfffffe01bb6aaf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01bb6aaf30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x821523afa, rsp = 0x820636858, rbp = 0x8206368c0 --- db> reset Uptime: 21h38m26s (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:59 #1 doadump (textdump=textdump@entry=0x0) at ../../../kern/kern_shutdown.c:407 #2 0xffffffff804b476a in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:593 #3 0xffffffff804b456d in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:506 #4 0xffffffff804b46b6 in db_command_script (command=command@entry=0xffffffff81bda7d0 "dump") at ../../../ddb/db_command.c:571 #5 0xffffffff804b9a28 in db_script_exec (scriptname=0xffffffff81bda140 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #6 0xffffffff804b456d in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:506 #7 0xffffffff804b46b6 in db_command_script (command=command@entry=0xffffffff81bda762 "run pho1") at ../../../ddb/db_command.c:571 #8 0xffffffff804b9a28 in db_script_exec (scriptname=0xffffffff81bda140 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #9 0xffffffff804b456d in db_command (last_cmdp=, cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:506 #10 0xffffffff804b423d in db_command_loop () at ../../../ddb/db_command.c:553 #11 0xffffffff804b78f6 in db_trap (type=, code=) at ../../../ddb/db_main.c:270 #12 0xffffffff80c4134e in kdb_trap (type=type@entry=0x3, code=code@entry=0x0, tf=tf@entry=0xfffffe0196811a60) at ../../../kern/subr_kdb.c:745 #13 0xffffffff810ed716 in trap (frame=0xfffffe0196811a60) at ../../../amd64/amd64/trap.c:610 #14 #15 kdb_enter (why=, msg=) at ../../../kern/subr_kdb.c:509 #16 0xffffffff80bf23c3 in vpanic (fmt=, ap=ap@entry=0xfffffe0196811bb0) at ../../../kern/kern_shutdown.c:960 #17 0xffffffff80bf2183 in panic (fmt=0xffffffff81e853f0 "\306s\036\201\377\377\377\377") at ../../../kern/kern_shutdown.c:896 #18 0xffffffff80fa49cf in vm_page_unwire_managed (m=m@entry=0x0, nqueue=0x1, noreuse=0x0) at ../../../vm/vm_page.c:4053 #19 0xffffffff80f9f569 in vm_page_unwire (m=0xffffffff81e853f0 , m@entry=0xfffffe000e2c06d8, nqueue=nqueue@entry=0x1) at ../../../vm/vm_page.c:4108 #20 0xffffffff80f9cb39 in vm_object_unwire (object=0xfffff802cf568c60, offset=, length=length@entry=0x9000, queue=queue@entry=0x1) at ../../../vm/vm_object.c:2437 #21 0xffffffff80f9184c in vm_map_entry_unwire (map=map@entry=0xfffffe014bc49000, entry=entry@entry=0xfffff8014c7c9de0) at ../../../vm/vm_map.c:3798 #22 0xffffffff80f8e612 in vm_map_delete (map=map@entry=0xfffffe014bc49000, start=start@entry=0x1000, end=end@entry=0x800000000000) at ../../../vm/vm_map.c:3958 #23 0xffffffff80f92c70 in vm_map_remove (map=map@entry=0xfffffe014bc49000, start=0x1000, end=0x800000000000) at ../../../vm/vm_map.c:3996 #24 0xffffffff80f8ac79 in vmspace_dofree (vm=0xfffffe014bc49000) at ../../../vm/vm_map.c:381 #25 vmspace_exit (td=td@entry=0xfffffe01800c4c80) at ../../../vm/vm_map.c:456 #26 0xffffffff80ba2ff3 in exit1 (td=0xfffffe01800c4c80, rval=, signo=signo@entry=0x0) at ../../../kern/kern_exit.c:423 #27 0xffffffff80ba2abd in sys_exit (td=0xffffffff81e853f0 , uap=) at ../../../kern/kern_exit.c:212 #28 0xffffffff810ee587 in syscallenter (td=0xfffffe01800c4c80) at ../../../amd64/amd64/../../kern/subr_syscall.c:190 #29 amd64_syscall (td=0xfffffe01800c4c80, traced=0x0) at ../../../amd64/amd64/trap.c:1199 #30 #31 0x000000082152353a in ?? () Backtrace stopped: Cannot access memory at address 0x8206367e8 (kgdb) f 18 #18 0xffffffff80fa49cf in vm_page_unwire_managed (m=m@entry=0x0, nqueue=0x1, noreuse=0x0) at ../../../vm/vm_page.c:4053 4053 KASSERT(VPRC_WIRE_COUNT(old) > 0, (kgdb) l 4048 * Use a release store when updating the reference count to 4049 * synchronize with vm_page_free_prep(). 4050 */ 4051 old = m->ref_count; 4052 do { 4053 KASSERT(VPRC_WIRE_COUNT(old) > 0, 4054 ("vm_page_unwire: wire count underflow for page %p", m)); 4055 4056 if (old > VPRC_OBJREF + 1) { 4057 /* (kgdb) info loc old = (kgdb) f 19 #19 0xffffffff80f9f569 in vm_page_unwire (m=0xffffffff81e853f0 , m@entry=0xfffffe000e2c06d8, nqueue=nqueue@entry=0x1) at ../../../vm/vm_page.c:4108 4108 vm_page_unwire_managed(m, nqueue, false); (kgdb) l 4103 if ((m->oflags & VPO_UNMANAGED) != 0) { 4104 if (vm_page_unwire_noq(m) && m->ref_count == 0) 4105 vm_page_free(m); 4106 return; 4107 } 4108 vm_page_unwire_managed(m, nqueue, false); 4109 } 4110 4111 /* 4112 * Unwire a page without (re-)inserting it into a page queue. It is up (kgdb) info loc No locals. (kgdb) p *m $1 = {plinks = {q = {tqe_next = 0xffffffff811e73c6, tqe_prev = 0x10000}, s = {ss = {sle_next = 0xffffffff811e73c6}}, memguard = {p = 0xffffffff811e73c6, v = 0x10000}, uma = {slab = 0xffffffff811e73c6, zone = 0x10000}}, listq = {tqe_next = 0x0, tqe_prev = 0x0}, object = 0x0, pindex = 0x0, phys_addr = 0xffffffff812261b1, md = {pv_list = {tqh_first = 0x1030000, tqh_last = 0xfffff8087fd78500}, pv_gen = 0x0, pat_mode = 0x0}, ref_count = 0x0, busy_lock = 0x0, a = {{flags = 0x0, queue = 0x0, act_count = 0x0}, _bits = 0x0}, order = 0x0, pool = 0x0, flags = 0x0, oflags = 0x0, psind = 0x0, segind = 0x0, valid = 0x0, dirty = 0x0} (kgdb) p m@entry $3 = (vm_page_t) 0xfffffe000e2c06d8 (kgdb) p *m@entry $4 = {plinks = {q = {tqe_next = 0xfffffe000a266270, tqe_prev = 0xfffffe0002c9d708}, s = {ss = {sle_next = 0xfffffe000a266270}}, memguard = { p = 0xfffffe000a266270, v = 0xfffffe0002c9d708}, uma = {slab = 0xfffffe000a266270, zone = 0xfffffe0002c9d708}}, listq = { tqe_next = 0xfffffe00025e2c98, tqe_prev = 0xfffff802cf568ca8}, object = 0xfffff802cf568c60, pindex = 0x0, phys_addr = 0x22e297000, md = {pv_list = { tqh_first = 0x0, tqh_last = 0xfffffe000e2c0710}, pv_gen = 0x6ea, pat_mode = 0x6}, ref_count = 0x80000000, busy_lock = 0x9, a = {{flags = 0x8, queue = 0x0, act_count = 0x0}, _bits = 0x8}, order = 0xd, pool = 0x0, flags = 0x1, oflags = 0x0, psind = 0x0, segind = 0x5, valid = 0x0, dirty = 0x0} (kgdb) p *m@entry->object $2 = {lock = {lock_object = {lo_name = 0xffffffff811d22b9 "vmobject", lo_flags = 0x25630000, lo_data = 0x0, lo_witness = 0xfffff8087fd77600}, rw_lock = 0x21}, object_list = {tqe_next = 0xfffff802cf568d68, tqe_prev = 0xfffff802cf568b78}, shadow_head = {lh_first = 0x0}, shadow_list = { le_next = 0xffffffffffffffff, le_prev = 0xffffffffffffffff}, memq = {tqh_first = 0xfffffe000e2c06d8, tqh_last = 0xfffffe0006dd2fe0}, rtree = { rt_root = 0xfffff8055e9d36c0}, size = 0x9, domain = {dr_policy = 0x0, dr_iter = 0x0}, generation = 0x1, cleangeneration = 0x1, ref_count = 0x11, shadow_count = 0x0, memattr = 0x6, type = 0x1, flags = 0x1210, pg_color = 0x15bd, paging_in_progress = {__count = 0x0}, busy = {__count = 0x0}, resident_page_count = 0x9, backing_object = 0xfffff80005084d68, backing_object_offset = 0x1d6000, pager_object_list = {tqe_next = 0x0, tqe_prev = 0x0}, rvq = {lh_first = 0x0}, handle = 0xfffff80005084d68, un_pager = {vnp = {vnp_size = 0x0, writemappings = 0x0}, devp = {devp_pglist = {tqh_first = 0x0, tqh_last = 0x0}, ops = 0x0, dev = 0x0}, sgp = {sgp_pglist = {tqh_first = 0x0, tqh_last = 0x0}}, swp = {swp_priv = 0x0, swp_blks = {pt_root = 0x0}, writemappings = 0x0}, phys = {ops = 0x0, {data_ptr = 0x0, data_val = 0x0}}}, cred = 0xfffff80003f7b600, charge = 0x9000, umtx_data = 0x0} (kgdb) diff --git a/sys/fs/unionfs/union_vnops.c b/sys/fs/unionfs/union_vnops.c index 04d7889598927..2f45a5bb0e52e 100644 --- a/sys/fs/unionfs/union_vnops.c +++ b/sys/fs/unionfs/union_vnops.c @@ -628,7 +628,7 @@ unionfs_close(struct vop_close_args *ap) if (unsp->uns_lower_opencnt <= 0 && unsp->uns_upper_opencnt <= 0) { #ifdef DIAGNOSTIC - printf("unionfs_close: warning: open count is 0\n"); +// printf("unionfs_close: warning: open count is 0\n"); #endif if (unp->un_uppervp != NULLVP) ovp = unp->un_uppervp; @@ -1389,6 +1389,7 @@ unionfs_mkdir(struct vop_mkdir_args *ap) { struct unionfs_node *dunp; struct componentname *cnp; + struct vnode *dvp; struct vnode *udvp; struct vnode *uvp; struct vattr va; @@ -1400,17 +1401,19 @@ unionfs_mkdir(struct vop_mkdir_args *ap) KASSERT_UNIONFS_VNODE(ap->a_dvp); error = EROFS; - dunp = VTOUNIONFS(ap->a_dvp); + dvp = ap->a_dvp; + dunp = VTOUNIONFS(dvp); cnp = ap->a_cnp; lkflags = cnp->cn_lkflags; udvp = dunp->un_uppervp; if (udvp != NULLVP) { + vref(udvp); /* check opaque */ if (!(cnp->cn_flags & ISWHITEOUT)) { error = VOP_GETATTR(udvp, &va, cnp->cn_cred); if (error != 0) - return (error); + goto unionfs_mkdir_cleanup; if ((va.va_flags & OPAQUE) != 0) cnp->cn_flags |= ISWHITEOUT; } @@ -1418,13 +1421,35 @@ unionfs_mkdir(struct vop_mkdir_args *ap) if ((error = VOP_MKDIR(udvp, &uvp, cnp, ap->a_vap)) == 0) { VOP_UNLOCK(uvp); cnp->cn_lkflags = LK_EXCLUSIVE; - error = unionfs_nodeget(ap->a_dvp->v_mount, uvp, NULLVP, - ap->a_dvp, ap->a_vpp, cnp); + /* + * The underlying VOP_MKDIR() implementation may have + * temporarily dropped the parent directory vnode lock. + * Because the unionfs vnode ordinarily shares that + * lock, this may allow the unionfs vnode to be reclaimed + * and its lock field reset. In that case, the unionfs + * vnode is effectively no longer locked, and we must + * explicitly lock it before returning in order to meet + * the locking requirements of VOP_MKDIR(). + */ + if (__predict_false(VTOUNIONFS(dvp) == NULL)) { + error = ENOENT; + goto unionfs_mkdir_cleanup; + } + error = unionfs_nodeget(dvp->v_mount, uvp, NULLVP, + dvp, ap->a_vpp, cnp); cnp->cn_lkflags = lkflags; vrele(uvp); } } +unionfs_mkdir_cleanup: + + if (__predict_false(VTOUNIONFS(dvp) == NULL)) { + vput(udvp); + vn_lock(dvp, LK_EXCLUSIVE | LK_RETRY); + } else if (udvp != NULLVP) + vrele(udvp); + UNIONFS_INTERNAL_DEBUG("unionfs_mkdir: leave (%d)\n", error); return (error); @@ -1852,24 +1877,6 @@ unionfs_print(struct vop_print_args *ap) return (0); } -static int -unionfs_islocked(struct vop_islocked_args *ap) -{ - struct unionfs_node *unp; - - KASSERT_UNIONFS_VNODE(ap->a_vp); - - unp = VTOUNIONFS(ap->a_vp); - if (unp == NULL) - return (vop_stdislocked(ap)); - - if (unp->un_uppervp != NULLVP) - return (VOP_ISLOCKED(unp->un_uppervp)); - if (unp->un_lowervp != NULLVP) - return (VOP_ISLOCKED(unp->un_lowervp)); - return (vop_stdislocked(ap)); -} - static int unionfs_get_llt_revlock(struct vnode *vp, int flags) { @@ -1982,14 +1989,6 @@ unionfs_lock(struct vop_lock1_args *ap) vholdnz(uvp); uhold = 1; VOP_UNLOCK(uvp); - unp = VTOUNIONFS(vp); - if (unp == NULL) { - /* vnode is released. */ - VI_UNLOCK(vp); - VOP_UNLOCK(lvp); - vdrop(uvp); - return (EBUSY); - } } VI_LOCK_FLAGS(lvp, MTX_DUPOK); flags |= LK_INTERLOCK; @@ -2010,7 +2009,7 @@ unionfs_lock(struct vop_lock1_args *ap) vdrop(lvp); if (uhold != 0) vdrop(uvp); - return (vop_stdlock(ap)); + goto unionfs_lock_fallback; } } @@ -2043,7 +2042,7 @@ unionfs_lock(struct vop_lock1_args *ap) VOP_UNLOCK(lvp); vdrop(lvp); } - return (vop_stdlock(ap)); + goto unionfs_lock_fallback; } if (error != 0 && lvp != NULLVP) { /* rollback */ @@ -2065,6 +2064,22 @@ unionfs_lock(struct vop_lock1_args *ap) unionfs_lock_null_vnode: ap->a_flags |= LK_INTERLOCK; return (vop_stdlock(ap)); + +unionfs_lock_fallback: + /* + * If we reach this point, we've discovered the unionfs vnode + * has been reclaimed while the upper/lower vnode locks were + * temporarily dropped. Such temporary droppage may happen + * during the course of an LK_UPGRADE operation itself, and in + * that case LK_UPGRADE must be cleared as the unionfs vnode's + * lock has been reset to point to the standard v_lock field, + * which has not previously been held. + */ + if (flags & LK_UPGRADE) { + ap->a_flags &= ~LK_TYPE_MASK; + ap->a_flags |= LK_EXCLUSIVE; + } + return (vop_stdlock(ap)); } static int @@ -2782,7 +2797,7 @@ struct vop_vector unionfs_vnodeops = { .vop_getwritemount = unionfs_getwritemount, .vop_inactive = unionfs_inactive, .vop_need_inactive = vop_stdneed_inactive, - .vop_islocked = unionfs_islocked, + .vop_islocked = vop_stdislocked, .vop_ioctl = unionfs_ioctl, .vop_link = unionfs_link, .vop_listextattr = unionfs_listextattr, diff --git a/sys/kern/vfs_lookup.c b/sys/kern/vfs_lookup.c index e7f1deea0fae8..563700f6109d0 100644 --- a/sys/kern/vfs_lookup.c +++ b/sys/kern/vfs_lookup.c @@ -833,6 +833,8 @@ vfs_lookup_failifexists(struct nameidata *ndp) return (EEXIST); } +long pho; + /* * Search a pathname. * This is a very central and rather complicated routine. @@ -1279,6 +1281,10 @@ vfs_lookup(struct nameidata *ndp) error = ENOENT; goto bad2; } + if (dp->v_mountedhere != mp) { + pho++; + continue; + } } else crosslkflags &= ~LK_NODDLKTREAT; } diff --git a/tools/test/stress2/misc/all.exclude b/tools/test/stress2/misc/all.exclude index 022075e63cb48..9ddeffc200a23 100644 --- a/tools/test/stress2/misc/all.exclude +++ b/tools/test/stress2/misc/all.exclude @@ -75,7 +75,7 @@ syzkaller55.sh panic: Counter goes negative 20220525 syzkaller59.sh Page fault 20220625 syzkaller65.sh Waiting for fix 20230318 truss3.sh WiP 20200915 -unionfs9.sh https://people.freebsd.org/~pho/stress/log/log0404.txt 20230110 +Xunionfs9.sh https://people.freebsd.org/~pho/stress/log/log0404.txt 20230110 # Test not to run for other reasons: -- Test scenario: misc/mlockall6.sh