KDB: enter: watchdog timeout, vmcore.521 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2022 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 14.0-CURRENT #0 main-n253608-965e2154e7682: Fri Mar 4 06:27:01 CET 2022 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 13.0.0 (git@github.com:llvm/llvm-project.git llvmorg-13.0.0-0-gd7b669b3a303) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.16-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33176547328 (31639 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 2 9 7 5 10 4 11 6 3 8 random: entropy device external interface kbd1 at kbdmux0 vtvga0: smbios0: at iomem 0xf0560-0xf057e smbios0: Version: 2.8, BCD Revision: 2.7 aesni0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 apei0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: EEPROM V1.63-0 eTrack 0x800009fa igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: EEPROM V1.63-0 eTrack 0x800009fa igb1: Using 1024 TX descriptors and 1024 RX descriptors igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounter "TSC-low" frequency 1749998937 Hz quality 1000 Timecounters tick every 1.000 msec Expensive timeout(9) function: 0xffffffff8050ba80(0xfffffe0109fa4000) 0.004290004 s ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> Expensive timeout(9) function: 0xffffffff80a59bd0(0xffffffff81ae9b58) 0.007403974 s ses0: ada0 in 'Slot 01', SATA Slot: scbus1 target 0 mlx5_core0: mem 0xf8000000-0xf9ffffff irq 32 at device 0.0 on pci3 mlx5: Mellanox Core driver 3.7.0 (July 2021)ugen1.1: at usbus1 ugen2.1: at usbus2 ugen0.1: at usbus0 uhub0 on usbus1 uhub0: on usbus1 uhub1 on usbus2 uhub1: on usbus2 uhub2 on usbus0 uhub2: on usbus0 mlx5_core0: WARN: mlx5_vsc_set_space:127:(pid 0): Space 0x7 is not supported. mlx5_core0: WARN: mlx5_fwdump_prep:102:(pid 0): VSC scan space is4) mlx5_core0: Failed to initialize SR-IOV support, error 2 mlx5_core1: mem 0xf6000000-0xf7ffffff irq 32 at device 0.1 on pci3 ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts UNREF FILE I=160514 OWNER=test MODE=120777 SIZE=0 MTIME=Mar 5 10:43 2022 CLEAR? yes ** Phase 5 - Check Cyl groups FREE BLK COUNT(S) WRONG IN SUPERBLK SALVAGE? yes SUMMARY INFORMATION BAD SALVAGE? yes BLK(S) MISSING IN BIT MAPS SALVAGE? yes 129 files, 14652 used, 1250755 free (163 frags, 156324 blocks, 0.0% fragmentation) ***** FILE SYSTEM MARKED CLEAN ***** ***** FILE SYSTEM WAS MODIFIED ***** Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.00-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc10 /usr/local/lib/gcc8 /usr/local/lib/gcc9 /usr/local/lib/perl5/5.32/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: mercat1.netperf.freebsd.org. Setting up harvesting: PURE_RDRAND,[CALLOUT],[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . Autoloading module: acpi_wmi.ko Autoloading module: ichsmb.ko Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 ichsmb0: port 0x580-0x59f mem 0xfb431000-0xfb4310ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device lo0: link state changed to UP Autoloading module: acpi_wmi.ko Autoloading module: mlx5.ko interface mlx5.1 already present in the KLD 'kernel'! linker_load_file: /boot/kernel/mlx5.ko - unsupported file type kldload: an error occurred while loading module mlx5.ko. Please check dmesg(8) for more details. Autoloading moduinterface mlx5.1 already present in the KLD 'kernel'! linker_load_file: /boot/kernel/mlx5.ko - unsupported file type le: mlx5.ko kldload: an error occurred while loading module mlx5.ko. Please check dmesg(8) for more details. Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: ichsmb.ko Starting Network: mce0. mce0: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce1. mce1: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko Autoloading module: usbhid.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. if_delmulti_locked: detaching ifnet instance 0xfffff800041f5000 DHCPDISCOVER on igb0 to 255.255.255.255 port 67 interval 5 DHCPOFFER from 192.168.5.1 DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff800041f5000 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Recovering vi editor sessions:. Updating motd:. Clearing /tmp (X related). Starting syslogd. Starting watchdogd. Mar 5 12:12:24 mercat1 savecore[2631]: reboot after panic: buf_alloc: BUF_LOCK on free buf 0xfffffe003b6e1720: 16. Setting date via ntp. 5 Mar 12:13:41 ntpdate[2636]: step time server 192.168.5.1 offset -1.032772 sec Starting rpcbind. NFS access cache time=60 Starting statd. Starting lockd. Starting powerd. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Mounting late filesystems:. Starting inetd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. sysctl: unknown oid 'debug.fail_point.pmap_allocpte_page_alloc' at line 12 Sat Mar 5 12:13 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: Mar 5 12:15:24 mercat1 su[2794]: pho to root on /dev/pts/0 20220305 12:37:47 all (1/197): graid1_3.sh 20220305 12:43:02 all (2/197): zfs14.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) 20220305 12:48:12 all (3/197): umountf10.sh 20220305 12:53:19 all (4/197): lockf2.sh 20220305 12:58:35 all (5/197): ext4fs.sh Mar 5 13:03:36 mercat1 kernel: pid 46508 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20220305 13:04:29 all (6/197): gunion.sh 20220305 13:12:36 all (7/197): mmap34.sh Mar 5 13:13:54 mercat1 kernel: pid 71624 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20220305 13:18:14 all (8/197): pipe3.sh 20220305 13:23:34 all (9/197): sendfile13.sh lock order reversal: 1st 0xfffff8002d394140 so_snd_sx (so_snd_sx, sx) @ kern/uipc_socket.c:4179 2nd 0xfffffe0176f33c90 ufs (ufs, lockmgr) @ kern/kern_sendfile.c:863 lock order so_snd_sx -> ufs attempted at: #0 0xffffffff80c80c4d at witness_checkorder+0xbdd #1 0xffffffff80bdd39c at lockmgr_lock_flags+0x7c #2 0xffffffff80f5eb2d at ffs_lock+0x9d #3 0xffffffff811c271c at VOP_LOCK1_APV+0x3c #4 0xffffffff80d18c84 at _vn_lock+0x54 #5 0xffffffff80c0b8ad at vn_sendfile+0x72d #6 0xffffffff80c0d737 at sendfile+0x117 #7 0xffffffff810f6435 at amd64_syscall+0x145 #8 0xffffffff810c6f6b at fast_syscall_common+0xf8 20220305 13:29:43 all (10/197): overcommit.sh Mar 5 13:29:53 mercat1 kernel: pid 59498 (link), uid 2007 inumber 65667 on /mnt: filesystem full Mar 5 13:30:13 mercat1 kernel: pid 59529 (rw), uid 2007 inumber 8492 on /mnt: filesystem full Mar 5 13:30:33 mercat1 kernel: pid 59540 (mkdir), uid 2007 inumber 253023 on /mnt: filesystem full Mar 5 13:38:09 mercat1 kernel: pid 75956 (mkdir), uid 2007 inumber 200060 on /mnt: filesystem full 20220305 13:40:04 all (11/197): procstat2.sh Mar 5 13:40:37 mercat1 kernel: pid 81986 (swap), jid 0, uid 2007, was killed: failed to reclaim memory Mar 5 13:45:27 mercat1 kernel: pid 86340 (creat), uid 2007 inumber 65661 on /mnt: out of inodes Mar 5 13:45:39 mercat1 kernel: pid 86415 (mkfifo), uid 2007 inumber 65536 on /mnt: out of inodes 20220305 13:45:48 all (12/197): cmp.sh Mar 5 13:46:42 mercat1 kernel: pid 88480 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page stress2: freework leak: 10943/10949. stress2: newblk leak: 3422/3427. 20220305 13:51:06 all (13/197): zfs8.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) 20220305 13:56:30 all (14/197): ext3fs.sh Mar 5 13:59:56 mercat1 kernel: pid 44869 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Mar 5 14:01:29 mercat1 kernel: pid 46213 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20220305 14:02:21 all (15/197): crossmp10.sh 20220305 14:07:36 all (16/197): bio.sh Mar 5 14:08:35 mercat1 kernel: pid 74462 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20220305 14:13:07 all (17/197): swap6.sh Mar 5 14:15:10 mercat1 kernel: pid 80779 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20220305 14:15:24 all (18/197): socketpair2.sh 20220305 14:15:29 all (19/197): tar.sh stress2: freework leak: 207017/207025. stress2: newblk leak: 10781/10789. 20220305 14:20:49 all (20/197): fullpath2.sh 20220305 14:26:28 all (21/197): kevent5.sh lock order reversal: 1st 0xfffffe010e7630e0 filedesc structure (filedesc structure, sx) @ kern/kern_descrip.c:1385 2nd 0xfffffe017755ae80 ufs (ufs, lockmgr) @ kern/vfs_subr.c:6184 lock order filedesc structure -> ufs attempted at: #0 0xffffffff80c80c4d at witness_checkorder+0xbdd #1 0xffffffff80bdd48c at lockmgr_lock_flags+0x16c #2 0xffffffff80f5eb2d at ffs_lock+0x9d #3 0xffffffff811c271c at VOP_LOCK1_APV+0x3c #4 0xffffffff80d18c84 at _vn_lock+0x54 #5 0xffffffff80bbb07b at knlist_remove_kq+0x8b #6 0xffffffff80d0c424 at filt_vfsdetach+0x24 #7 0xffffffff80bbbad1 at knote_fdclose+0x181 #8 0xffffffff80bb3a6c at closefp_impl+0x9c #9 0xffffffff810f6435 at amd64_syscall+0x145 #10 0xffffffff810c6f6b at fast_syscall_common+0xf8 20220305 14:32:29 all (22/197): rename2.sh 20220305 14:38:30 all (23/197): zfs10.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) 20220305 14:42:05 all (24/197): sendfile7.sh 20220305 14:48:32 all (25/197): pmc3.sh hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 lock order reversal: (sleepable after non-sleepable) 1st 0xfffff800044d5008 seqflq (seqflq, sleep mutex) @ dev/sound/midi/sequencer.c:757 2nd 0xffffffff81ce5650 midistat lock (midistat lock, sx) @ dev/sound/midi/midi.c:1481 lock order seqflq -> midistat lock attempted at: #0 0xffffffff80c80c4d at witness_checkorder+0xbdd #1 0xffffffff80c19a83 at _sx_xlock+0x63 #2 0xffffffff809a6772 at midimapper_open+0x22 #3 0xffffffff809a95e2 at mseq_open+0xf2 #4 0xffffffff80a9c2f0 at devfs_open+0x130 #5 0xffffffff811bf806 at VOP_OPEN_APV+0x56 #6 0xffffffff80d18a69 at vn_open_vnode+0x1c9 #7 0xffffffff80d18478 at vn_open_cred+0x548 #8 0xffffffff80d0ed96 at kern_openat+0x286 #9 0xffffffff810f6435 at amd64_syscall+0x145 #10 0xffffffff810c6f6b at fast_syscall_common+0xf8 20220305 14:54:34 all (26/197): crossmp11.sh Mar 5 14:54:37 mercat1 kernel: pid 16903 (rw), uid 2007 inumber 49158 on /mnt12: filesystem full Mar 5 14:54:37 mercat1 kernel: pid 16920 (rw), uid 2007 inumber 73750 on /mnt11: filesystem full Mar 5 14:54:37 mercat1 kernel: pid 16919 (rw), uid 2007 inumber 73747 on /mnt13: filesystem full Mar 5 14:54:39 mercat1 kernel: pid 17805 (rw), uid 2007 inumber 24591 on /mnt13: filesystem full Mar 5 14:54:41 mercat1 kernel: pid 16969 (creat), uid 2007 inumber 73739 on /mnt10: out of inodes Mar 5 14:54:42 mercat1 kernel: pid 16951 (mkdir), uid 2007 inumber 49088 on /mnt11: out of inodes Mar 5 14:54:43 mercat1 kernel: pid 16938 (mkdir), uid 2007 inumber 24471 on /mnt12: out of inodes Mar 5 14:54:45 mercat1 kernel: pid 16982 (creat), uid 2007 inumber 73764 on /mnt11: out of inodes Mar 5 14:54:54 mercat1 syslogd: last message repeated 1 times Mar 5 14:55:05 mercat1 kernel: pid 17793 (creat), uid 2007 inumber 24587 on /mnt13: out of inodes Mar 5 14:55:14 mercat1 kernel: pid 17804 (mkdir), uid 2007 inumber 97819 on /mnt13: out of inodes Mar 5 14:55:15 mercat1 kernel: pid 16944 (mkdir), uid 2007 inumber 49151 on /mnt12: out of inodes Mar 5 14:55:23 mercat1 kernel: pid 16931 (mkdir), uid 2007 inumber 46961 on /mnt10: out of inodes Mar 5 14:55:32 mercat1 kernel: pid 16890 (rw), uid 2007 inumber 17129 on /mnt10: filesystem full Mar 5 14:55:34 mercat1 kernel: pid 16966 (creat), uid 2007 inumber 73752 on /mnt11: out of inodes Mar 5 14:55:46 mercat1 kernel: pid 17784 (creat), uid 2007 inumber 24585 on /mnt13: out of inodes Mar 5 14:55:50 mercat1 kernel: pid 16975 (creat), uid 2007 inumber 73741 on /mnt10: out of inodes Mar 5 14:55:50 mercat1 kernel: pid 16948 (mkdir), uid 2007 inumber 98287 on /mnt12: out of inodes Mar 5 14:55:54 mercat1 kernel: pid 17787 (creat), uid 2007 inumber 24584 on /mnt13: out of inodes Mar 5 14:55:55 mercat1 kernel: pid 16937 (mkdir), uid 2007 inumber 49115 on /mnt11: out of inodes Mar 5 14:56:01 mercat1 kernel: pid 17787 (creat), uid 2007 inumber 24584 on /mnt13: out of inodes Mar 5 14:56:04 mercat1 kernel: pid 16983 (creat), uid 2007 inumber 73760 on /mnt11: out of inodes Mar 5 14:56:11 mercat1 kernel: pid 16959 (creat), uid 2007 inumber 73734 on /mnt10: out of inodes Mar 5 14:56:18 mercat1 kernel: pid 16967 (creat), uid 2007 inumber 73738 on /mnt10: out of inodes Mar 5 14:56:36 mercat1 kernel: pid 16936 (mkdir), uid 2007 inumber 73704 on /mnt12: out of inodes Mar 5 14:56:38 mercat1 kernel: pid 29499 (rw), uid 2007 inumber 24599 on /mnt12: filesystem full Mar 5 14:56:38 mercat1 kernel: pid 29585 (rw), uid 2007 inumber 73735 on /mnt11: filesystem full Mar 5 14:56:38 mercat1 kernel: pid 29530 (rw), uid 2007 inumber 73736 on /mnt10: filesystem full Mar 5 14:56:40 mercat1 kernel: pid 29756 (rw), uid 2007 inumber 49210 on /mnt13: filesystem full Mar 5 14:56:41 mercat1 kernel: pid 29526 (rw), uid 2007 inumber 66271 on /mnt10: filesystem full Mar 5 14:56:42 mercat1 kernel: pid 29587 (rw), uid 2007 inumber 30291 on /mnt11: filesystem full Mar 5 14:56:44 mercat1 kernel: pid 29564 (mkdir), uid 2007 inumber 48961 on /mnt11: out of inodes Mar 5 14:56:52 mercat1 kernel: pid 29537 (creat), uid 2007 inumber 49160 on /mnt10: out of inodes Mar 5 14:56:55 mercat1 kernel: pid 29776 (creat), uid 2007 inumber 49187 on /mnt13: out of inodes Mar 5 14:56:56 mercat1 kernel: pid 29505 (rw), uid 2007 inumber 34604 on /mnt12: filesystem full Mar 5 14:57:01 mercat1 kernel: pid 29536 (creat), uid 2007 inumber 49159 on /mnt10: out of inodes Mar 5 14:57:05 mercat1 kernel: pid 29537 (creat), uid 2007 inumber 49160 on /mnt10: out of inodes Mar 5 14:57:12 mercat1 kernel: pid 29588 (creat), uid 2007 inumber 11 on /mnt11: out of inodes Mar 5 14:57:16 mercat1 kernel: pid 29492 (creat), uid 2007 inumber 49153 on /mnt12: out of inodes Mar 5 14:57:17 mercat1 kernel: pid 29565 (creat), uid 2007 inumber 49152 on /mnt11: out of inodes Mar 5 14:57:20 mercat1 kernel: pid 29569 (creat), uid 2007 inumber 10 on /mnt11: out of inodes Mar 5 14:57:25 mercat1 kernel: pid 29531 (creat), uid 2007 inumber 73737 on /mnt10: out of inodes Mar 5 14:57:28 mercat1 kernel: pid 29565 (creat), uid 2007 inumber 49152 on /mnt11: out of inodes Mar 5 14:57:28 mercat1 kernel: pid 29771 (creat), uid 2007 inumber 49191 on /mnt13: out of inodes Mar 5 14:57:42 mercat1 kernel: pid 29539 (creat), uid 2007 inumber 49162 on /mnt10: out of inodes Mar 5 14:57:43 mercat1 kernel: pid 29584 (creat), uid 2007 inumber 24582 on /mnt11: out of inodes Mar 5 14:57:55 mercat1 kernel: pid 29486 (creat), uid 2007 inumber 24613 on /mnt12: out of inodes Mar 5 14:57:58 mercat1 kernel: pid 29774 (creat), uid 2007 inumber 49189 on /mnt13: out of inodes Mar 5 14:58:04 mercat1 kernel: pid 29765 (creat), uid 2007 inumber 49193 on /mnt13: out of inodes Mar 5 14:58:38 mercat1 kernel: pid 41327 (rw), uid 2007 inumber 4 on /mnt10: filesystem full Mar 5 14:58:39 mercat1 kernel: pid 41509 (rw), uid 2007 inumber 49160 on /mnt13: filesystem full Mar 5 14:58:40 mercat1 kernel: pid 41363 (rw), uid 2007 inumber 73749 on /mnt12: filesystem full Mar 5 14:58:40 mercat1 kernel: pid 41541 (rw), uid 2007 inumber 6 on /mnt10: filesystem full Mar 5 14:58:43 mercat1 kernel: pid 41608 (rw), uid 2007 inumber 13 on /mnt12: filesystem full Mar 5 14:58:46 mercat1 kernel: pid 41544 (mkdir), uid 2007 inumber 72678 on /mnt10: out of inodes Mar 5 14:58:55 mercat1 kernel: pid 41447 (rw), uid 2007 inumber 10484 on /mnt11: filesystem full Mar 5 14:59:13 mercat1 kernel: pid 41552 (creat), uid 2007 inumber 49162 on /mnt10: out of inodes Mar 5 14:59:14 mercat1 kernel: pid 41621 (mkdir), uid 2007 inumber 49152 on /mnt12: out of inodes Mar 5 14:59:41 mercat1 kernel: pid 41448 (creat), uid 2007 inumber 24598 on /mnt11: out of inodes Mar 5 14:59:44 mercat1 kernel: pid 41551 (creat), uid 2007 inumber 49160 on /mnt10: out of inodes Mar 5 14:59:46 mercat1 kernel: pid 41450 (creat), uid 2007 inumber 24607 on /mnt11: out of inodes Mar 5 14:59:56 mercat1 kernel: pid 41422 (creat), uid 2007 inumber 24609 on /mnt11: out of inodes 20220305 15:00:41 all (27/197): geli.sh GEOM_ELI: Device md10.eli created. GEOM_ELI: Encryption: AES-XTS 128 GEOM_ELI: Crypto: accelerated software Mar 5 15:02:09 mercat1 kernel: pid 54863 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page GEOM_ELI: md10 has been killed. GEOM_ELI: Device md10.eli destroyed. 20220305 15:06:37 all (28/197): suj3.sh GEOM_ELI: Device md10.eli created. GEOM_ELI: Encryption: AES-XTS 128 GEOM_ELI: Crypto: accelerated software GEOM_ELI: md10 has been killed. GEOM_ELI: Device md10.eli destroyed. 20220305 15:12:52 all (29/197): mmap38.sh 20220305 15:19:09 all (30/197): aesni.sh GEOM_ELI: Device md10.eli created. GEOM_ELI: Encryption: AES-XTS 128 GEOM_ELI: Crypto: accelerated software GEOM_ELI: md10 has been killed. GEOM_ELI: Device md10.eli destroyed. stress2: newblk leak: 16939/16943. 20220305 15:24:41 all (31/197): audit2.sh Mar 5 15:24:56 mercat1 kernel: pid 59807 (rw), uid 2007 inumber 107072 on /mnt: filesystem full Mar 5 15:25:41 mercat1 kernel: pid 59805 (rw), uid 2007 inumber 125568 on /mnt: filesystem full Mar 5 15:26:03 mercat1 kernel: pid 59811 (rw), uid 2007 inumber 127325 on /mnt: filesystem full Mar 5 15:26:30 mercat1 kernel: pid 59826 (rw), uid 2007 inumber 129158 on /mnt: filesystem full Mar 5 15:28:47 mercat1 kernel: pid 64008 (symlink), uid 2007 inumber 65601 on /mnt: out of inodes Mar 5 15:29:06 mercat1 kernel: pid 66004 (mkfifo), uid 2007 inumber 98304 on /mnt: out of inodes 20220305 15:30:59 all (32/197): isofs3.sh Mar 5 15:32:16 mercat1 kernel: pid 80754 (symlink), uid 0 inumber 32773 on /mnt: out of inodes lock order reversal: 1st 0xfffffe0144125588 ufs (ufs, lockmgr) @ kern/vfs_mount.c:2122 2nd 0xfffffe0164cc9c28 isofs (isofs, lockmgr) @ kern/vfs_subr.c:3742 lock order isofs -> ufs established at: #0 0xffffffff80c8038e at witness_checkorder+0x31e #1 0xffffffff80bdd48c at lockmgr_lock_flags+0x16c #2 0xffffffff80f5eb2d at ffs_lock+0x9d #3 0xffffffff811c271c at VOP_LOCK1_APV+0x3c #4 0xffffffff80d18c84 at _vn_lock+0x54 #5 0xffffffff80d0039a at vget_finish+0x7a #6 0xffffffff80f5c013 at ffs_sync+0x193 #7 0xffffffff80d1aad5 at vfs_write_suspend+0x165 #8 0xffffffff80d1ac95 at vfs_write_suspend_umnt+0x35 #9 0xffffffff80f5bbb8 at ffs_unmount+0x398 #10 0xffffffff80cf5f0a at dounmount+0x7ea #11 0xffffffff80cf56d7 at kern_unmount+0x2d7 #12 0xffffffff810f6435 at amd64_syscall+0x145 #13 0xffffffff810c6f6b at fast_syscall_common+0xf8 lock order ufs -> isofs attempted at: #0 0xffffffff80c80c4d at witness_checkorder+0xbdd #1 0xffffffff80bdd48c at lockmgr_lock_flags+0x16c #2 0xffffffff811c271c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d18c84 at _vn_lock+0x54 #4 0xffffffff80d01860 at vflush+0xd0 #5 0xffffffff80b894a5 at cd9660_unmount+0x25 #6 0xffffffff80cf5f0a at dounmount+0x7ea #7 0xffffffff80cf56d7 at kern_unmount+0x2d7 #8 0xffffffff810f6435 at amd64_syscall+0x145 #9 0xffffffff810c6f6b at fast_syscall_common+0xf8 stress2: freework leak: 1250/1258. 20220305 15:37:21 all (33/197): mkfifo2d.sh 20220305 15:43:43 all (34/197): mkfifo4.sh 20220305 15:51:00 all (35/197): sort2.sh 20220305 15:57:43 all (36/197): suj29.sh Mar 5 16:04:17 mercat1 kernel: pid 82315 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20220305 16:04:29 all (37/197): graid1_7.sh Mar 5 16:09:18 mercat1 kernel: pid 40124 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Mar 5 16:10:43 mercat1 kernel: pid 40211 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20220305 16:12:38 all (38/197): posix_openpt2.sh stress2: pts leak: 58/59 20220305 16:18:58 all (39/197): swap2.sh 20220305 16:25:23 all (40/197): graid1_5.sh GEOM_NOP: Device md11.nop created. GEOM_NOP: Device md12.nop created. GEOM_NOP: Device md11.nop removed. GEOM_NOP: Device md12.nop removed. 20220305 16:31:38 all (41/197): marcus8.sh Mar 5 16:36:38 mercat1 kernel: pid 19568 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Mar 5 16:36:53 mercat1 kernel: pid 19689 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20220305 16:38:17 all (42/197): swap.sh 20220305 16:44:47 all (43/197): unionfs6.sh lock order reversal: 1st 0xfffffe015cabba38 ufs (ufs, lockmgr) @ /usr/src/sys/fs/unionfs/union_vnops.c:2041 2nd 0xfffffe01630e8e80 unionfs (unionfs, lockmgr) @ kern/vfs_subr.c:2994 lock order unionfs -> ufs established at: #0 0xffffffff80c8038e at witness_checkorder+0x31e #1 0xffffffff80bdd48c at lockmgr_lock_flags+0x16c #2 0xffffffff80f5eb2d at ffs_lock+0x9d #3 0xffffffff811c271c at VOP_LOCK1_APV+0x3c #4 0xffffffff80d18c84 at _vn_lock+0x54 #5 0xffffffff80d00b1e at vput_final+0x16e #6 0xffffffff82570b39 at unionfs_noderem+0x2f9 #7 0xffffffff8257680d at unionfs_reclaim+0xd #8 0xffffffff811c2599 at VOP_RECLAIM_APV+0x59 #9 0xffffffff80d02623 at vgonel+0x423 #10 0xffffffff80d02d4c at vrecycle+0x5c #11 0xffffffff825767fc at unionfs_inactive+0x1c #12 0xffffffff811c22a9 at VOP_INACTIVE_APV+0x59 #13 0xffffffff80d016da at vinactivef+0xda #14 0xffffffff80d00c5a at vput_final+0x2aa #15 0xffffffff80d1903c at vn_close1+0x13c #16 0xffffffff80d175cd at vn_closefile+0x3d #17 0xffffffff80babbdb at _fdrop+0x1b lock order ufs -> unionfs attempted at: #0 0xffffffff80c80c4d at witness_checkorder+0xbdd #1 0xffffffff80bdd48c at lockmgr_lock_flags+0x16c #2 0xffffffff82576c67 at unionfs_lock+0x447 #3 0xffffffff811c271c at VOP_LOCK1_APV+0x3c #4 0xffffffff80d18c84 at _vn_lock+0x54 #5 0xffffffff80d0039a at vget_finish+0x7a #6 0xffffffff80cdb314 at cache_lookup+0x314 #7 0xffffffff80cdfffb at vfs_cache_lookup+0x7b #8 0xffffffff811bef4a at VOP_LOOKUP_APV+0x5a #9 0xffffffff80cf1041 at lookup+0x4c1 #10 0xffffffff80cefed8 at namei+0x3f8 #11 0xffffffff80d10535 at kern_funlinkat+0x175 #12 0xffffffff80d103b8 at sys_unlink+0x28 #13 0xffffffff810f6435 at amd64_syscall+0x145 #14 0xffffffff810c6f6b at fast_syscall_common+0xf8 Mar 5 16:45:49 mercat1 kernel: pid 44761 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Mar 5 16:47:39 mercat1 kernel: pid 47330 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 20220305 16:51:15 all (44/197): stealer.sh swp_pager_getswapspace(32): failed Mar 5 16:52:33 mercat1 kernel: pid 54845 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Mar 5 16:52:33 mercat1 kernel: pid 54688 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Mar 5 16:52:33 mercat1 kernel: pid 54847 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Mar 5 16:52:33 mercat1 kernel: pid 54846 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Mar 5 16:52:33 mercat1 kernel: pid 54838 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Mar 5 16:52:33 mercat1 kernel: pid 54832 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Mar 5 16:52:33 mercat1 kernel: pid 54831 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Mar 5 16:52:33 mercat1 kernel: pid 54823 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Mar 5 16:52:37 mercat1 kernel: pid 54844 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Mar 5 16:52:38 mercat1 kernel: pid 54837 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory 20220305 16:57:48 all (45/197): umount2.sh 20220305 17:04:19 all (46/197): unionfs8.sh unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 Mar 5 17:06:11 mercat1 kernel: pid 67221 (rw), uid 2007 inumber 171154 on /mnt11: filesystem full unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 Mar 5 17:07:20 mercat1 kernel: pid 72036 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 20220305 17:11:01 all (47/197): smrstress2.sh Completed 10000000 loops with 0 failures lock order reversal: 1st 0xffffffff81a02a40 proctree (proctree, sx) @ kern/imgact_elf.c:2419 2nd 0xfffffe0161509070 ufs (ufs, lockmgr) @ kern/vfs_vnops.c:661 lock order ufs -> proctree established at: #0 0xffffffff80c8038e at witness_checkorder+0x31e #1 0xffffffff80c1ab07 at _sx_slock_int+0x67 #2 0xffffffff80c6250b at uprintf+0x6b #3 0xffffffff80f293b1 at ffs_realloccg+0x891 #4 0xffffffff80f30947 at ffs_balloc_ufs2+0x517 #5 0xffffffff80f69a67 at ufs_direnter+0x3a7 #6 0xffffffff80f70853 at ufs_link+0x1a3 #7 0xffffffff811c16a5 at VOP_LINK_APV+0x85 #8 0xffffffff80d0fdb0 at kern_linkat_vp+0x2b0 #9 0xffffffff80d0fa61 at kern_linkat+0x241 #10 0xffffffff80d0f818 at sys_link+0x28 #11 0xffffffff810f6435 at amd64_syscall+0x145 #12 0xffffffff810c6f6b at fast_syscall_common+0xf8 lock order proctree -> ufs attempted at: #0 0xffffffff80c80c4d at witness_checkorder+0xbdd #1 0xffffffff80bdd48c at lockmgr_lock_flags+0x16c #2 0xffffffff80f5eb2d at ffs_lock+0x9d #3 0xffffffff811c271c at VOP_LOCK1_APV+0x3c #4 0xffffffff80d18c84 at _vn_lock+0x54 #5 0xffffffff80d19269 at vn_rdwr+0x1b9 #6 0xffffffff80d19910 at vn_rdwr_inchunks+0x90 #7 0xffffffff80bbffde at sbuf_drain_core_output+0xae #8 0xffffffff80c69762 at sbuf_drain+0x52 #9 0xffffffff80c698ae at sbuf_put_bytes+0x9e #10 0xffffffff80c697fe at sbuf_bcat+0xe #11 0xffffffff80bf276b at kern_proc_out+0xeb #12 0xffffffff80b8d906 at elf64_note_procstat_proc+0x96 #13 0xffffffff80b8bd60 at elf64_coredump+0x370 #14 0xffffffff80c142c7 at sigexit+0xd57 #15 0xffffffff80c14aca at postsig+0x1aa #16 0xffffffff80c75a6b at ast+0x4fb #17 0xffffffff810c9059 at doreti_ast+0x1f Mar 5 17:11:43 mercat1 kernel: pid 76585 (rw), uid 0 inumber 131729 on /mnt: filesystem full Completed 10000000 loops with 0 failures Mar 5 17:11:57 mercat1 kernel: pid 76584 (rw), uid 0 inumber 158712 on /mnt: filesystem full Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Expensive timeout(9) function: 0xffffffff80e0d090(0xfffffe01685c28a0) 0.007986259 s Expensive timeout(9) function: 0xffffffff80a59bd0(0xffffffff81ae9b58) 0.008647890 s Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Expensive timeout(9) function: 0xffffffff80ec2a40(0xfffffe010e341000) 0.010509328 s Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Expensive timeout(9) function: 0xffffffff80a061c0(0xfffffe010a564cd8) 0.013383693 s Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Mar 5 17:16:12 mercat1 kernel: pid 82888 (rw), uid 0 inumber 89778 on /mnt: filesystem full Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures Completed 10000000 loops with 0 failures stress2: newblk leak: 252/256. 20220305 17:17:41 all (48/197): unionfs7.sh unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 Mar 5 17:18:31 mercat1 kernel: pid 88406 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 Mar 5 17:19:23 mercat1 kernel: pid 88366 (rw), uid 2007 inumber 189083 on /mnt10: filesystem full unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 unionfs_close: warning: open count is 0 stress2: mount leak: 13/44 stress2: GEOM leak: 11/85 20220305 17:24:54 all (49/197): pmc.sh hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 20220305 17:24:57 all (50/197): msdos12.sh 20220305 17:30:26 all (51/197): msync2.sh 20220305 17:37:10 all (52/197): sysctl2.sh Expensive timeout(9) function: 0xffffffff80f841d0(0) 0.013611436 s Expensive timeout(9) function: 0xffffffff80f841d0(0) 0.039215019 s Mar 5 17:40:06 mercat1 kernel: pid 94032 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page Mar 5 17:41:14 mercat1 kernel: pid 94014 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page stress2: freework leak: 1127/1133. stress2: newblk leak: 91109/91113. 20220305 17:43:40 all (53/197): truss.sh 20220305 17:50:05 all (54/197): gnop6.sh GEOM_NOP: Device md10.nop created. Mar 5 17:50:59 mercat1 kernel: pid 45800 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Mar 5 17:51:16 mercat1 kernel: pid 45848 (rw), uid 2007 inumber 143134 on /mnt: filesystem full GEOM_NOP: Device md10.nop removed. 20220305 17:56:59 all (55/197): fragments.sh Mar 5 17:57:04 mercat1 kernel: pid 53491 (fragments), uid 2007 inumber 5329 on /mnt: filesystem full Mar 5 17:57:05 mercat1 kernel: pid 53491 (fragments), uid 2007 inumber 5381 on /mnt: filesystem full Mar 5 17:57:06 mercat1 kernel: pid 53491 (fragments), uid 2007 inumber 5433 on /mnt: filesystem full Mar 5 17:57:07 mercat1 kernel: pid 53491 (fragments), uid 2007 inumber 5482 on /mnt: filesystem full Mar 5 17:57:08 mercat1 kernel: pid 53491 (fragments), uid 2007 inumber 5534 on /mnt: filesystem full Mar 5 17:57:09 mercat1 kernel: pid 54734 (fragments), uid 2007 inumber 5610 on /mnt: filesystem full Mar 5 17:57:10 mercat1 kernel: pid 54738 (fragments), uid 2007 inumber 5645 on /mnt: filesystem full Mar 5 17:57:11 mercat1 kernel: pid 54734 (fragments), uid 2007 inumber 5584 on /mnt: filesystem full Mar 5 17:57:12 mercat1 kernel: pid 54737 (fragments), uid 2007 inumber 5631 on /mnt: filesystem full Mar 5 17:57:13 mercat1 kernel: pid 54734 (fragments), uid 2007 inumber 5627 on /mnt: filesystem full Mar 5 17:57:14 mercat1 kernel: pid 54733 (fragments), uid 2007 inumber 5683 on /mnt: filesystem full Mar 5 17:57:15 mercat1 kernel: pid 54740 (fragments), uid 2007 inumber 5621 on /mnt: filesystem full Mar 5 17:57:16 mercat1 kernel: pid 54740 (fragments), uid 2007 inumber 5648 on /mnt: filesystem full Mar 5 17:57:17 mercat1 kernel: pid 54735 (fragments), uid 2007 inumber 5591 on /mnt: filesystem full Mar 5 17:57:18 mercat1 kernel: pid 54735 (fragments), uid 2007 inumber 5575 on /mnt: filesystem full Mar 5 17:57:19 mercat1 kernel: pid 54740 (fragments), uid 2007 inumber 5662 on /mnt: filesystem full Mar 5 17:57:20 mercat1 kernel: pid 55982 (fragments), uid 2007 inumber 5608 on /mnt: filesystem full Mar 5 17:57:21 mercat1 kernel: pid 55984 (fragments), uid 2007 inumber 5712 on /mnt: filesystem full Mar 5 17:57:22 mercat1 kernel: pid 55983 (fragments), uid 2007 inumber 5755 on /mnt: filesystem full Mar 5 17:57:23 mercat1 kernel: pid 55984 (fragments), uid 2007 inumber 5618 on /mnt: filesystem full Mar 5 17:57:24 mercat1 kernel: pid 55987 (fragments), uid 2007 inumber 5602 on /mnt: filesystem full Mar 5 17:57:25 mercat1 kernel: pid 55984 (fragments), uid 2007 inumber 5594 on /mnt: filesystem full Mar 5 17:57:26 mercat1 kernel: pid 55987 (fragments), uid 2007 inumber 5646 on /mnt: filesystem full Mar 5 17:57:27 mercat1 kernel: pid 55988 (fragments), uid 2007 inumber 5587 on /mnt: filesystem full Mar 5 17:57:28 mercat1 kernel: pid 55987 (fragments), uid 2007 inumber 5633 on /mnt: filesystem full Mar 5 17:57:29 mercat1 kernel: pid 55984 (fragments), uid 2007 inumber 5580 on /mnt: filesystem full Mar 5 17:57:30 mercat1 kernel: pid 55989 (fragments), uid 2007 inumber 5621 on /mnt: filesystem full Mar 5 17:57:31 mercat1 kernel: pid 55989 (fragments), uid 2007 inumber 5593 on /mnt: filesystem full Mar 5 17:57:32 mercat1 kernel: pid 55989 (fragments), uid 2007 inumber 5647 on /mnt: filesystem full Mar 5 17:57:33 mercat1 kernel: pid 57234 (fragments), uid 2007 inumber 5600 on /mnt: filesystem full Mar 5 17:57:34 mercat1 kernel: pid 57240 (fragments), uid 2007 inumber 5630 on /mnt: filesystem full Mar 5 17:57:35 mercat1 kernel: pid 57233 (fragments), uid 2007 inumber 5605 on /mnt: filesystem full Mar 5 17:57:36 mercat1 kernel: pid 57234 (fragments), uid 2007 inumber 5666 on /mnt: filesystem full Mar 5 17:57:37 mercat1 kernel: pid 57234 (fragments), uid 2007 inumber 5671 on /mnt: filesystem full Mar 5 17:57:38 mercat1 kernel: pid 57240 (fragments), uid 2007 inumber 5707 on /mnt: filesystem full Mar 5 17:57:39 mercat1 kernel: pid 57239 (fragments), uid 2007 inumber 5718 on /mnt: filesystem full Mar 5 17:57:40 mercat1 kernel: pid 57238 (fragments), uid 2007 inumber 5598 on /mnt: filesystem full Mar 5 17:57:41 mercat1 kernel: pid 57235 (fragments), uid 2007 inumber 5574 on /mnt: filesystem full Mar 5 17:57:42 mercat1 kernel: pid 57238 (fragments), uid 2007 inumber 5656 on /mnt: filesystem full Mar 5 17:57:43 mercat1 kernel: pid 57235 (fragments), uid 2007 inumber 5600 on /mnt: filesystem full Mar 5 17:57:44 mercat1 kernel: pid 57238 (fragments), uid 2007 inumber 5610 on /mnt: filesystem full Mar 5 17:57:45 mercat1 kernel: pid 57235 (fragments), uid 2007 inumber 5591 on /mnt: filesystem full Mar 5 17:57:46 mercat1 kernel: pid 58486 (fragments), uid 2007 inumber 5631 on /mnt: filesystem full Mar 5 17:57:47 mercat1 kernel: pid 58487 (fragments), uid 2007 inumber 5692 on /mnt: filesystem full Mar 5 17:57:48 mercat1 kernel: pid 58482 (fragments), uid 2007 inumber 5600 on /mnt: filesystem full Mar 5 17:57:49 mercat1 kernel: pid 58482 (fragments), uid 2007 inumber 5654 on /mnt: filesystem full Mar 5 17:57:51 mercat1 kernel: pid 58484 (fragments), uid 2007 inumber 5633 on /mnt: filesystem full Mar 5 17:57:51 mercat1 kernel: pid 58488 (fragments), uid 2007 inumber 5681 on /mnt: filesystem full Mar 5 17:57:52 mercat1 kernel: pid 58482 (fragments), uid 2007 inumber 5651 on /mnt: filesystem full Mar 5 17:57:53 mercat1 kernel: pid 58484 (fragments), uid 2007 inumber 5583 on /mnt: filesystem full Mar 5 17:57:54 mercat1 kernel: pid 58486 (fragments), uid 2007 inumber 5597 on /mnt: filesystem full Mar 5 17:57:55 mercat1 kernel: pid 58483 (fragments), uid 2007 inumber 5633 on /mnt: filesystem full Mar 5 17:57:56 mercat1 kernel: pid 58485 (fragments), uid 2007 inumber 5585 on /mnt: filesystem full Mar 5 17:57:57 mercat1 kernel: pid 58488 (fragments), uid 2007 inumber 5623 on /mnt: filesystem full Mar 5 17:57:58 mercat1 kernel: pid 58488 (fragments), uid 2007 inumber 5614 on /mnt: filesystem full Mar 5 17:58:00 mercat1 kernel: pid 58485 (fragments), uid 2007 inumber 5616 on /mnt: filesystem full Mar 5 17:58:01 mercat1 kernel: pid 58489 (fragments), uid 2007 inumber 5628 on /mnt: filesystem full Mar 5 17:58:02 mercat1 kernel: pid 60973 (fragments), uid 2007 inumber 5611 on /mnt: filesystem full Mar 5 17:58:02 mercat1 kernel: pid 60978 (fragments), uid 2007 inumber 5591 on /mnt: filesystem full Mar 5 17:58:03 mercat1 kernel: pid 60977 (fragments), uid 2007 inumber 5574 on /mnt: filesystem full Mar 5 17:58:04 mercat1 kernel: pid 60977 (fragments), uid 2007 inumber 5700 on /mnt: filesystem full Mar 5 17:58:06 mercat1 kernel: pid 60976 (fragments), uid 2007 inumber 5578 on /mnt: filesystem full Mar 5 17:58:07 mercat1 kernel: pid 60977 (fragments), uid 2007 inumber 5614 on /mnt: filesystem full Mar 5 17:58:08 mercat1 kernel: pid 60974 (fragments), uid 2007 inumber 5591 on /mnt: filesystem full Mar 5 17:58:09 mercat1 kernel: pid 60979 (fragments), uid 2007 inumber 5629 on /mnt: filesystem full Mar 5 17:58:10 mercat1 kernel: pid 60974 (fragments), uid 2007 inumber 5710 on /mnt: filesystem full Mar 5 17:58:11 mercat1 kernel: pid 60979 (fragments), uid 2007 inumber 5677 on /mnt: filesystem full Mar 5 17:58:12 mercat1 kernel: pid 60974 (fragments), uid 2007 inumber 5658 on /mnt: filesystem full Mar 5 17:58:13 mercat1 kernel: pid 60973 (fragments), uid 2007 inumber 5679 on /mnt: filesystem full Mar 5 17:58:14 mercat1 kernel: pid 60976 (fragments), uid 2007 inumber 5602 on /mnt: filesystem full Mar 5 17:58:15 mercat1 kernel: pid 60974 (fragments), uid 2007 inumber 5584 on /mnt: filesystem full Mar 5 17:58:16 mercat1 kernel: pid 60976 (fragments), uid 2007 inumber 5612 on /mnt: filesystem full Mar 5 17:58:17 mercat1 kernel: pid 60976 (fragments), uid 2007 inumber 5576 on /mnt: filesystem full Mar 5 17:58:18 mercat1 kernel: pid 60976 (fragments), uid 2007 inumber 5644 on /mnt: filesystem full Mar 5 17:58:19 mercat1 kernel: pid 62225 (fragments), uid 2007 inumber 5651 on /mnt: filesystem full Mar 5 17:58:20 mercat1 kernel: pid 62223 (fragments), uid 2007 inumber 5665 on /mnt: filesystem full Mar 5 17:58:21 mercat1 kernel: pid 62226 (fragments), uid 2007 inumber 5612 on /mnt: filesystem full Mar 5 17:58:22 mercat1 kernel: pid 62221 (fragments), uid 2007 inumber 5670 on /mnt: filesystem full Mar 5 17:58:23 mercat1 kernel: pid 62223 (fragments), uid 2007 inumber 5720 on /mnt: filesystem full Mar 5 17:58:24 mercat1 kernel: pid 62225 (fragments), uid 2007 inumber 5583 on /mnt: filesystem full Mar 5 17:58:25 mercat1 kernel: pid 62224 (fragments), uid 2007 inumber 5672 on /mnt: filesystem full Mar 5 17:58:26 mercat1 kernel: pid 62225 (fragments), uid 2007 inumber 5732 on /mnt: filesystem full Mar 5 17:58:27 mercat1 kernel: pid 62224 (fragments), uid 2007 inumber 5621 on /mnt: filesystem full Mar 5 17:58:28 mercat1 kernel: pid 62224 (fragments), uid 2007 inumber 5666 on /mnt: filesystem full Mar 5 17:58:29 mercat1 kernel: pid 62223 (fragments), uid 2007 inumber 5602 on /mnt: filesystem full Mar 5 17:58:30 mercat1 kernel: pid 62226 (fragments), uid 2007 inumber 5609 on /mnt: filesystem full Mar 5 17:58:31 mercat1 kernel: pid 62228 (fragments), uid 2007 inumber 5605 on /mnt: filesystem full Mar 5 17:58:32 mercat1 kernel: pid 62228 (fragments), uid 2007 inumber 5639 on /mnt: filesystem full Mar 5 17:58:33 mercat1 kernel: pid 64181 (fragments), uid 2007 inumber 5603 on /mnt: filesystem full Mar 5 17:58:34 mercat1 kernel: pid 64186 (fragments), uid 2007 inumber 5728 on /mnt: filesystem full Mar 5 17:58:35 mercat1 kernel: pid 64185 (fragments), uid 2007 inumber 5688 on /mnt: filesystem full Mar 5 17:58:36 mercat1 kernel: pid 64182 (fragments), uid 2007 inumber 5648 on /mnt: filesystem full Mar 5 17:58:37 mercat1 kernel: pid 64183 (fragments), uid 2007 inumber 5627 on /mnt: filesystem full Mar 5 17:58:38 mercat1 kernel: pid 64183 (fragments), uid 2007 inumber 5630 on /mnt: filesystem full Mar 5 17:58:39 mercat1 kernel: pid 64183 (fragments), uid 2007 inumber 5586 on /mnt: filesystem full Mar 5 17:58:40 mercat1 kernel: pid 64186 (fragments), uid 2007 inumber 5596 on /mnt: filesystem full Mar 5 17:58:41 mercat1 kernel: pid 64181 (fragments), uid 2007 inumber 5587 on /mnt: filesystem full Mar 5 17:58:42 mercat1 kernel: pid 64184 (fragments), uid 2007 inumber 5606 on /mnt: filesystem full Mar 5 17:58:43 mercat1 kernel: pid 64184 (fragments), uid 2007 inumber 5578 on /mnt: filesystem full Mar 5 17:58:44 mercat1 kernel: pid 64186 (fragments), uid 2007 inumber 5625 on /mnt: filesystem full Mar 5 17:58:45 mercat1 kernel: pid 64186 (fragments), uid 2007 inumber 5633 on /mnt: filesystem full Mar 5 17:58:46 mercat1 kernel: pid 64183 (fragments), uid 2007 inumber 5663 on /mnt: filesystem full Mar 5 17:58:47 mercat1 kernel: pid 64183 (fragments), uid 2007 inumber 5664 on /mnt: filesystem full Mar 5 17:58:48 mercat1 kernel: pid 64182 (fragments), uid 2007 inumber 5615 on /mnt: filesystem full Mar 5 17:58:49 mercat1 kernel: pid 64183 (fragments), uid 2007 inumber 5624 on /mnt: filesystem full Mar 5 17:58:50 mercat1 kernel: pid 65963 (fragments), uid 2007 inumber 5593 on /mnt: filesystem full Mar 5 17:58:51 mercat1 kernel: pid 65966 (fragments), uid 2007 inumber 5615 on /mnt: filesystem full Mar 5 17:58:52 mercat1 kernel: pid 65965 (fragments), uid 2007 inumber 5593 on /mnt: filesystem full Mar 5 17:58:53 mercat1 kernel: pid 65964 (fragments), uid 2007 inumber 5666 on /mnt: filesystem full Mar 5 17:58:54 mercat1 kernel: pid 65965 (fragments), uid 2007 inumber 5638 on /mnt: filesystem full Mar 5 17:58:55 mercat1 kernel: pid 65969 (fragments), uid 2007 inumber 5659 on /mnt: filesystem full Mar 5 17:58:56 mercat1 kernel: pid 65969 (fragments), uid 2007 inumber 5574 on /mnt: filesystem full Mar 5 17:58:57 mercat1 kernel: pid 65964 (fragments), uid 2007 inumber 5660 on /mnt: filesystem full Mar 5 17:58:58 mercat1 kernel: pid 65964 (fragments), uid 2007 inumber 5630 on /mnt: filesystem full Mar 5 17:58:59 mercat1 kernel: pid 65968 (fragments), uid 2007 inumber 5713 on /mnt: filesystem full Mar 5 17:59:00 mercat1 kernel: pid 65962 (fragments), uid 2007 inumber 5670 on /mnt: filesystem full Mar 5 17:59:01 mercat1 kernel: pid 65965 (fragments), uid 2007 inumber 5589 on /mnt: filesystem full Mar 5 17:59:02 mercat1 kernel: pid 65963 (fragments), uid 2007 inumber 5614 on /mnt: filesystem full Mar 5 17:59:03 mercat1 kernel: pid 65969 (fragments), uid 2007 inumber 5628 on /mnt: filesystem full Mar 5 17:59:04 mercat1 kernel: pid 65969 (fragments), uid 2007 inumber 5610 on /mnt: filesystem full Mar 5 17:59:05 mercat1 kernel: pid 68251 (fragments), uid 2007 inumber 5599 on /mnt: filesystem full Mar 5 17:59:06 mercat1 kernel: pid 68250 (fragments), uid 2007 inumber 5670 on /mnt: filesystem full Mar 5 17:59:07 mercat1 kernel: pid 68253 (fragments), uid 2007 inumber 5733 on /mnt: filesystem full Mar 5 17:59:08 mercat1 kernel: pid 68255 (fragments), uid 2007 inumber 5591 on /mnt: filesystem full Mar 5 17:59:09 mercat1 kernel: pid 68249 (fragments), uid 2007 inumber 5633 on /mnt: filesystem full Mar 5 17:59:10 mercat1 kernel: pid 68256 (fragments), uid 2007 inumber 5623 on /mnt: filesystem full Mar 5 17:59:11 mercat1 kernel: pid 68250 (fragments), uid 2007 inumber 5578 on /mnt: filesystem full Mar 5 17:59:12 mercat1 kernel: pid 68251 (fragments), uid 2007 inumber 5639 on /mnt: filesystem full Mar 5 17:59:13 mercat1 kernel: pid 68254 (fragments), uid 2007 inumber 5578 on /mnt: filesystem full Mar 5 17:59:14 mercat1 kernel: pid 68249 (fragments), uid 2007 inumber 5594 on /mnt: filesystem full Mar 5 17:59:15 mercat1 kernel: pid 68252 (fragments), uid 2007 inumber 5642 on /mnt: filesystem full Mar 5 17:59:16 mercat1 kernel: pid 68249 (fragments), uid 2007 inumber 5591 on /mnt: filesystem full Mar 5 17:59:17 mercat1 kernel: pid 68254 (fragments), uid 2007 inumber 5662 on /mnt: filesystem full Mar 5 17:59:18 mercat1 kernel: pid 68254 (fragments), uid 2007 inumber 5672 on /mnt: filesystem full Mar 5 17:59:19 mercat1 kernel: pid 68252 (fragments), uid 2007 inumber 5594 on /mnt: filesystem full Mar 5 17:59:20 mercat1 kernel: pid 68249 (fragments), uid 2007 inumber 5578 on /mnt: filesystem full Mar 5 17:59:21 mercat1 kernel: pid 69713 (fragments), uid 2007 inumber 5581 on /mnt: filesystem full Mar 5 17:59:22 mercat1 kernel: pid 69716 (fragments), uid 2007 inumber 5631 on /mnt: filesystem full Mar 5 17:59:23 mercat1 kernel: pid 69712 (fragments), uid 2007 inumber 5612 on /mnt: filesystem full Mar 5 17:59:24 mercat1 kernel: pid 69714 (fragments), uid 2007 inumber 5660 on /mnt: filesystem full Mar 5 17:59:25 mercat1 kernel: pid 69714 (fragments), uid 2007 inumber 5619 on /mnt: filesystem full Mar 5 17:59:26 mercat1 kernel: pid 69716 (fragments), uid 2007 inumber 5575 on /mnt: filesystem full Mar 5 17:59:27 mercat1 kernel: pid 69719 (fragments), uid 2007 inumber 5679 on /mnt: filesystem full Mar 5 17:59:28 mercat1 kernel: pid 69716 (fragments), uid 2007 inumber 5621 on /mnt: filesystem full Mar 5 17:59:29 mercat1 kernel: pid 69714 (fragments), uid 2007 inumber 5630 on /mnt: filesystem full Mar 5 17:59:31 mercat1 kernel: pid 69713 (fragments), uid 2007 inumber 5580 on /mnt: filesystem full Mar 5 17:59:32 mercat1 kernel: pid 69716 (fragments), uid 2007 inumber 5670 on /mnt: filesystem full Mar 5 17:59:32 mercat1 kernel: pid 69712 (fragments), uid 2007 inumber 5665 on /mnt: filesystem full Mar 5 17:59:33 mercat1 kernel: pid 69719 (fragments), uid 2007 inumber 5607 on /mnt: filesystem full Mar 5 17:59:35 mercat1 kernel: pid 69715 (fragments), uid 2007 inumber 5671 on /mnt: filesystem full Mar 5 17:59:36 mercat1 kernel: pid 69715 (fragments), uid 2007 inumber 5654 on /mnt: filesystem full Mar 5 17:59:37 mercat1 kernel: pid 69715 (fragments), uid 2007 inumber 5597 on /mnt: filesystem full Mar 5 17:59:37 mercat1 kernel: pid 69715 (fragments), uid 2007 inumber 5585 on /mnt: filesystem full Mar 5 17:59:38 mercat1 kernel: pid 72206 (fragments), uid 2007 inumber 5652 on /mnt: filesystem full Mar 5 17:59:40 mercat1 kernel: pid 72206 (fragments), uid 2007 inumber 5606 on /mnt: filesystem full Mar 5 17:59:41 mercat1 kernel: pid 72204 (fragments), uid 2007 inumber 5689 on /mnt: filesystem full Mar 5 17:59:42 mercat1 kernel: pid 72210 (fragments), uid 2007 inumber 5658 on /mnt: filesystem full Mar 5 17:59:43 mercat1 kernel: pid 72211 (fragments), uid 2007 inumber 5591 on /mnt: filesystem full Mar 5 17:59:44 mercat1 kernel: pid 72210 (fragments), uid 2007 inumber 5577 on /mnt: filesystem full Mar 5 17:59:45 mercat1 kernel: pid 72207 (fragments), uid 2007 inumber 5654 on /mnt: filesystem full Mar 5 17:59:46 mercat1 kernel: pid 72209 (fragments), uid 2007 inumber 5713 on /mnt: filesystem full Mar 5 17:59:47 mercat1 kernel: pid 72204 (fragments), uid 2007 inumber 5628 on /mnt: filesystem full Mar 5 17:59:48 mercat1 kernel: pid 72208 (fragments), uid 2007 inumber 5683 on /mnt: filesystem full Mar 5 17:59:49 mercat1 kernel: pid 72208 (fragments), uid 2007 inumber 5577 on /mnt: filesystem full Mar 5 17:59:50 mercat1 kernel: pid 72209 (fragments), uid 2007 inumber 5631 on /mnt: filesystem full Mar 5 17:59:51 mercat1 kernel: pid 72208 (fragments), uid 2007 inumber 5575 on /mnt: filesystem full Mar 5 17:59:52 mercat1 kernel: pid 73459 (fragments), uid 2007 inumber 5658 on /mnt: filesystem full Mar 5 17:59:53 mercat1 kernel: pid 73453 (fragments), uid 2007 inumber 5762 on /mnt: filesystem full Mar 5 17:59:54 mercat1 kernel: pid 73458 (fragments), uid 2007 inumber 5802 on /mnt: filesystem full Mar 5 17:59:55 mercat1 kernel: pid 73459 (fragments), uid 2007 inumber 5623 on /mnt: filesystem full Mar 5 17:59:56 mercat1 kernel: pid 73459 (fragments), uid 2007 inumber 5585 on /mnt: filesystem full Mar 5 17:59:57 mercat1 kernel: pid 73458 (fragments), uid 2007 inumber 5647 on /mnt: filesystem full Mar 5 17:59:58 mercat1 kernel: pid 73454 (fragments), uid 2007 inumber 5648 on /mnt: filesystem full Mar 5 17:59:59 mercat1 kernel: pid 73459 (fragments), uid 2007 inumber 5668 on /mnt: filesystem full Mar 5 18:00:00 mercat1 kernel: pid 73457 (fragments), uid 2007 inumber 5611 on /mnt: filesystem full Mar 5 18:00:01 mercat1 kernel: pid 73454 (fragments), uid 2007 inumber 5607 on /mnt: filesystem full Mar 5 18:00:02 mercat1 kernel: pid 73454 (fragments), uid 2007 inumber 5578 on /mnt: filesystem full Mar 5 18:00:03 mercat1 kernel: pid 73459 (fragments), uid 2007 inumber 5618 on /mnt: filesystem full Mar 5 18:00:04 mercat1 kernel: pid 73459 (fragments), uid 2007 inumber 5622 on /mnt: filesystem full Mar 5 18:00:05 mercat1 kernel: pid 74716 (fragments), uid 2007 inumber 5634 on /mnt: filesystem full Mar 5 18:00:06 mercat1 kernel: pid 74718 (fragments), uid 2007 inumber 5725 on /mnt: filesystem full Mar 5 18:00:07 mercat1 kernel: pid 74714 (fragments), uid 2007 inumber 5784 on /mnt: filesystem full Mar 5 18:00:08 mercat1 kernel: pid 74715 (fragments), uid 2007 inumber 5863 on /mnt: filesystem full Mar 5 18:00:09 mercat1 kernel: pid 74717 (fragments), uid 2007 inumber 5646 on /mnt: filesystem full Mar 5 18:00:10 mercat1 kernel: pid 74713 (fragments), uid 2007 inumber 5698 on /mnt: filesystem full Mar 5 18:00:11 mercat1 kernel: pid 74713 (fragments), uid 2007 inumber 5664 on /mnt: filesystem full Mar 5 18:00:12 mercat1 kernel: pid 74714 (fragments), uid 2007 inumber 5589 on /mnt: filesystem full Mar 5 18:00:13 mercat1 kernel: pid 74717 (fragments), uid 2007 inumber 5587 on /mnt: filesystem full Mar 5 18:00:14 mercat1 kernel: pid 74719 (fragments), uid 2007 inumber 5645 on /mnt: filesystem full Mar 5 18:00:15 mercat1 kernel: pid 74713 (fragments), uid 2007 inumber 5612 on /mnt: filesystem full Mar 5 18:00:16 mercat1 kernel: pid 74714 (fragments), uid 2007 inumber 5574 on /mnt: filesystem full Mar 5 18:00:17 mercat1 kernel: pid 74714 (fragments), uid 2007 inumber 5585 on /mnt: filesystem full Mar 5 18:00:18 mercat1 kernel: pid 74714 (fragments), uid 2007 inumber 5576 on /mnt: filesystem full Mar 5 18:00:19 mercat1 kernel: pid 74714 (fragments), uid 2007 inumber 5574 on /mnt: filesystem full Mar 5 18:00:20 mercat1 kernel: pid 74714 (fragments), uid 2007 inumber 5618 on /mnt: filesystem full Mar 5 18:00:21 mercat1 kernel: pid 77206 (fragments), uid 2007 inumber 5651 on /mnt: filesystem full Mar 5 18:00:22 mercat1 kernel: pid 77209 (fragments), uid 2007 inumber 5623 on /mnt: filesystem full Mar 5 18:00:23 mercat1 kernel: pid 77203 (fragments), uid 2007 inumber 5687 on /mnt: filesystem full Mar 5 18:00:24 mercat1 kernel: pid 77206 (fragments), uid 2007 inumber 5579 on /mnt: filesystem full Mar 5 18:00:25 mercat1 kernel: pid 77203 (fragments), uid 2007 inumber 5612 on /mnt: filesystem full Mar 5 18:00:26 mercat1 kernel: pid 77208 (fragments), uid 2007 inumber 5607 on /mnt: filesystem full Mar 5 18:00:27 mercat1 kernel: pid 77204 (fragments), uid 2007 inumber 5608 on /mnt: filesystem full Mar 5 18:00:28 mercat1 kernel: pid 77205 (fragments), uid 2007 inumber 5574 on /mnt: filesystem full Mar 5 18:00:29 mercat1 kernel: pid 77204 (fragments), uid 2007 inumber 5640 on /mnt: filesystem full Mar 5 18:00:30 mercat1 kernel: pid 77204 (fragments), uid 2007 inumber 5655 on /mnt: filesystem full Mar 5 18:00:31 mercat1 kernel: pid 77208 (fragments), uid 2007 inumber 5601 on /mnt: filesystem full Mar 5 18:00:32 mercat1 kernel: pid 77203 (fragments), uid 2007 inumber 5583 on /mnt: filesystem full Mar 5 18:00:33 mercat1 kernel: pid 77203 (fragments), uid 2007 inumber 5590 on /mnt: filesystem full Mar 5 18:00:34 mercat1 kernel: pid 77203 (fragments), uid 2007 inumber 5583 on /mnt: filesystem full Mar 5 18:00:35 mercat1 kernel: pid 77203 (fragments), uid 2007 inumber 5636 on /mnt: filesystem full Mar 5 18:00:36 mercat1 kernel: pid 78454 (fragments), uid 2007 inumber 5660 on /mnt: filesystem full Mar 5 18:00:37 mercat1 kernel: pid 78455 (fragments), uid 2007 inumber 5719 on /mnt: filesystem full Mar 5 18:00:38 mercat1 kernel: pid 78461 (fragments), uid 2007 inumber 5691 on /mnt: filesystem full Mar 5 18:00:39 mercat1 kernel: pid 78460 (fragments), uid 2007 inumber 5607 on /mnt: filesystem full Mar 5 18:00:40 mercat1 kernel: pid 78460 (fragments), uid 2007 inumber 5641 on /mnt: filesystem full Mar 5 18:00:41 mercat1 kernel: pid 78460 (fragments), uid 2007 inumber 5583 on /mnt: filesystem full Mar 5 18:00:42 mercat1 kernel: pid 78455 (fragments), uid 2007 inumber 5633 on /mnt: filesystem full Mar 5 18:00:43 mercat1 kernel: pid 78454 (fragments), uid 2007 inumber 5695 on /mnt: filesystem full Mar 5 18:00:44 mercat1 kernel: pid 78457 (fragments), uid 2007 inumber 5672 on /mnt: filesystem full Mar 5 18:00:45 mercat1 kernel: pid 78455 (fragments), uid 2007 inumber 5588 on /mnt: filesystem full Mar 5 18:00:46 mercat1 kernel: pid 78457 (fragments), uid 2007 inumber 5584 on /mnt: filesystem full Mar 5 18:00:47 mercat1 kernel: pid 79703 (fragments), uid 2007 inumber 5611 on /mnt: filesystem full Mar 5 18:00:48 mercat1 kernel: pid 79708 (fragments), uid 2007 inumber 5697 on /mnt: filesystem full Mar 5 18:00:49 mercat1 kernel: pid 79705 (fragments), uid 2007 inumber 5767 on /mnt: filesystem full Mar 5 18:00:50 mercat1 kernel: pid 79703 (fragments), uid 2007 inumber 5646 on /mnt: filesystem full Mar 5 18:00:51 mercat1 kernel: pid 79710 (fragments), uid 2007 inumber 5672 on /mnt: filesystem full Mar 5 18:00:52 mercat1 kernel: pid 79703 (fragments), uid 2007 inumber 5693 on /mnt: filesystem full Mar 5 18:00:53 mercat1 kernel: pid 79704 (fragments), uid 2007 inumber 5581 on /mnt: filesystem full Mar 5 18:00:54 mercat1 kernel: pid 79704 (fragments), uid 2007 inumber 5726 on /mnt: filesystem full Mar 5 18:00:56 mercat1 kernel: pid 79706 (fragments), uid 2007 inumber 5582 on /mnt: filesystem full Mar 5 18:00:56 mercat1 kernel: pid 79706 (fragments), uid 2007 inumber 5601 on /mnt: filesystem full Mar 5 18:00:57 mercat1 kernel: pid 79704 (fragments), uid 2007 inumber 5646 on /mnt: filesystem full Mar 5 18:00:58 mercat1 kernel: pid 79709 (fragments), uid 2007 inumber 5655 on /mnt: filesystem full Mar 5 18:01:00 mercat1 kernel: pid 79709 (fragments), uid 2007 inumber 5674 on /mnt: filesystem full Mar 5 18:01:01 mercat1 kernel: pid 79709 (fragments), uid 2007 inumber 5593 on /mnt: filesystem full Mar 5 18:01:01 mercat1 kernel: pid 80959 (fragments), uid 2007 inumber 5634 on /mnt: filesystem full Mar 5 18:01:02 mercat1 kernel: pid 80959 (fragments), uid 2007 inumber 5621 on /mnt: filesystem full Mar 5 18:01:03 mercat1 kernel: pid 80957 (fragments), uid 2007 inumber 5689 on /mnt: filesystem full Mar 5 18:01:04 mercat1 kernel: pid 80958 (fragments), uid 2007 inumber 5653 on /mnt: filesystem full Mar 5 18:01:05 mercat1 kernel: pid 80958 (fragments), uid 2007 inumber 5707 on /mnt: filesystem full Mar 5 18:01:06 mercat1 kernel: pid 80955 (fragments), uid 2007 inumber 5589 on /mnt: filesystem full Mar 5 18:01:07 mercat1 kernel: pid 80953 (fragments), uid 2007 inumber 5583 on /mnt: filesystem full Mar 5 18:01:09 mercat1 kernel: pid 80952 (fragments), uid 2007 inumber 5665 on /mnt: filesystem full Mar 5 18:01:10 mercat1 kernel: pid 80953 (fragments), uid 2007 inumber 5594 on /mnt: filesystem full Mar 5 18:01:10 mercat1 kernel: pid 80952 (fragments), uid 2007 inumber 5574 on /mnt: filesystem full Mar 5 18:01:12 mercat1 kernel: pid 80952 (fragments), uid 2007 inumber 5689 on /mnt: filesystem full Mar 5 18:01:13 mercat1 kernel: pid 82202 (fragments), uid 2007 inumber 5583 on /mnt: filesystem full Mar 5 18:01:14 mercat1 kernel: pid 82209 (fragments), uid 2007 inumber 5598 on /mnt: filesystem full Mar 5 18:01:15 mercat1 kernel: pid 82205 (fragments), uid 2007 inumber 5630 on /mnt: filesystem full Mar 5 18:01:16 mercat1 kernel: pid 82201 (fragments), uid 2007 inumber 5587 on /mnt: filesystem full Mar 5 18:01:17 mercat1 kernel: pid 82209 (fragments), uid 2007 inumber 5623 on /mnt: filesystem full Mar 5 18:01:18 mercat1 kernel: pid 82201 (fragments), uid 2007 inumber 5592 on /mnt: filesystem full Mar 5 18:01:19 mercat1 kernel: pid 82204 (fragments), uid 2007 inumber 5641 on /mnt: filesystem full Mar 5 18:01:20 mercat1 kernel: pid 82207 (fragments), uid 2007 inumber 5596 on /mnt: filesystem full Mar 5 18:01:21 mercat1 kernel: pid 82204 (fragments), uid 2007 inumber 5592 on /mnt: filesystem full Mar 5 18:01:22 mercat1 kernel: pid 82204 (fragments), uid 2007 inumber 5624 on /mnt: filesystem full Mar 5 18:01:23 mercat1 kernel: pid 82207 (fragments), uid 2007 inumber 5579 on /mnt: filesystem full Mar 5 18:01:24 mercat1 kernel: pid 82207 (fragments), uid 2007 inumber 5602 on /mnt: filesystem full Mar 5 18:01:25 mercat1 kernel: pid 82204 (fragments), uid 2007 inumber 5656 on /mnt: filesystem full Mar 5 18:01:26 mercat1 kernel: pid 82202 (fragments), uid 2007 inumber 5601 on /mnt: filesystem full Mar 5 18:01:27 mercat1 kernel: pid 82204 (fragments), uid 2007 inumber 5638 on /mnt: filesystem full Mar 5 18:01:28 mercat1 kernel: pid 84697 (fragments), uid 2007 inumber 5583 on /mnt: filesystem full Mar 5 18:01:29 mercat1 kernel: pid 84696 (fragments), uid 2007 inumber 5660 on /mnt: filesystem full Mar 5 18:01:30 mercat1 kernel: pid 84695 (fragments), uid 2007 inumber 5586 on /mnt: filesystem full Mar 5 18:01:31 mercat1 kernel: pid 84697 (fragments), uid 2007 inumber 5612 on /mnt: filesystem full Mar 5 18:01:32 mercat1 kernel: pid 84697 (fragments), uid 2007 inumber 5648 on /mnt: filesystem full Mar 5 18:01:33 mercat1 kernel: pid 84691 (fragments), uid 2007 inumber 5650 on /mnt: filesystem full Mar 5 18:01:34 mercat1 kernel: pid 84695 (fragments), uid 2007 inumber 5645 on /mnt: filesystem full Mar 5 18:01:35 mercat1 kernel: pid 84693 (fragments), uid 2007 inumber 5683 on /mnt: filesystem full Mar 5 18:01:36 mercat1 kernel: pid 84698 (fragments), uid 2007 inumber 5585 on /mnt: filesystem full Mar 5 18:01:37 mercat1 kernel: pid 84692 (fragments), uid 2007 inumber 5688 on /mnt: filesystem full Mar 5 18:01:38 mercat1 kernel: pid 84697 (fragments), uid 2007 inumber 5663 on /mnt: filesystem full Mar 5 18:01:39 mercat1 kernel: pid 84696 (fragments), uid 2007 inumber 5590 on /mnt: filesystem full Mar 5 18:01:40 mercat1 kernel: pid 84697 (fragments), uid 2007 inumber 5605 on /mnt: filesystem full Mar 5 18:01:41 mercat1 kernel: pid 85948 (fragments), uid 2007 inumber 5649 on /mnt: filesystem full Mar 5 18:01:42 mercat1 kernel: pid 85942 (fragments), uid 2007 inumber 5642 on /mnt: filesystem full Mar 5 18:01:43 mercat1 kernel: pid 85945 (fragments), uid 2007 inumber 5721 on /mnt: filesystem full Mar 5 18:01:44 mercat1 kernel: pid 85946 (fragments), uid 2007 inumber 5666 on /mnt: filesystem full Mar 5 18:01:45 mercat1 kernel: pid 85945 (fragments), uid 2007 inumber 5648 on /mnt: filesystem full Mar 5 18:01:46 mercat1 kernel: pid 85948 (fragments), uid 2007 inumber 5614 on /mnt: filesystem full Mar 5 18:01:47 mercat1 kernel: pid 85948 (fragments), uid 2007 inumber 5575 on /mnt: filesystem full Mar 5 18:01:48 mercat1 kernel: pid 85946 (fragments), uid 2007 inumber 5715 on /mnt: filesystem full Mar 5 18:01:49 mercat1 kernel: pid 85945 (fragments), uid 2007 inumber 5625 on /mnt: filesystem full Mar 5 18:01:50 mercat1 kernel: pid 85949 (fragments), uid 2007 inumber 5592 on /mnt: filesystem full Mar 5 18:01:51 mercat1 kernel: pid 85947 (fragments), uid 2007 inumber 5639 on /mnt: filesystem full Mar 5 18:01:52 mercat1 kernel: pid 85949 (fragments), uid 2007 inumber 5578 on /mnt: filesystem full Mar 5 18:01:53 mercat1 kernel: pid 85947 (fragments), uid 2007 inumber 5653 on /mnt: filesystem full Mar 5 18:01:54 mercat1 kernel: pid 85947 (fragments), uid 2007 inumber 5587 on /mnt: filesystem full Mar 5 18:01:55 mercat1 kernel: pid 85947 (fragments), uid 2007 inumber 5634 on /mnt: filesystem full Mar 5 18:01:56 mercat1 kernel: pid 87942 (fragments), uid 2007 inumber 5599 on /mnt: filesystem full Mar 5 18:01:57 mercat1 kernel: pid 87945 (fragments), uid 2007 inumber 5608 on /mnt: filesystem full Mar 5 18:01:58 mercat1 kernel: pid 87946 (fragments), uid 2007 inumber 5632 on /mnt: filesystem full Mar 5 18:01:59 mercat1 kernel: pid 87943 (fragments), uid 2007 inumber 5663 on /mnt: filesystem full Mar 5 18:02:00 mercat1 kernel: pid 87941 (fragments), uid 2007 inumber 5586 on /mnt: filesystem full Mar 5 18:02:01 mercat1 kernel: pid 87947 (fragments), uid 2007 inumber 5662 on /mnt: filesystem full Mar 5 18:02:02 mercat1 kernel: pid 87942 (fragments), uid 2007 inumber 5754 on /mnt: filesystem full Mar 5 18:02:03 mercat1 kernel: pid 87944 (fragments), uid 2007 inumber 5623 on /mnt: filesystem full Mar 5 18:02:04 mercat1 kernel: pid 87944 (fragments), uid 2007 inumber 5633 on /mnt: filesystem full Mar 5 18:02:05 mercat1 kernel: pid 87945 (fragments), uid 2007 inumber 5592 on /mnt: filesystem full Mar 5 18:02:06 mercat1 kernel: pid 87945 (fragments), uid 2007 inumber 5620 on /mnt: filesystem full Mar 5 18:02:07 mercat1 kernel: pid 87946 (fragments), uid 2007 inumber 5604 on /mnt: filesystem full Mar 5 18:02:08 mercat1 kernel: pid 87944 (fragments), uid 2007 inumber 5674 on /mnt: filesystem full Mar 5 18:02:09 mercat1 kernel: pid 87944 (fragments), uid 2007 inumber 5576 on /mnt: filesystem full Mar 5 18:02:10 mercat1 kernel: pid 87940 (fragments), uid 2007 inumber 5605 on /mnt: filesystem full Mar 5 18:02:11 mercat1 kernel: pid 87946 (fragments), uid 2007 inumber 5670 on /mnt: filesystem full Mar 5 18:02:12 mercat1 kernel: pid 89686 (fragments), uid 2007 inumber 5637 on /mnt: filesystem full Mar 5 18:02:13 mercat1 kernel: pid 89686 (fragments), uid 2007 inumber 5606 on /mnt: filesystem full Mar 5 18:02:14 mercat1 kernel: pid 89681 (fragments), uid 2007 inumber 5627 on /mnt: filesystem full Mar 5 18:02:15 mercat1 kernel: pid 89684 (fragments), uid 2007 inumber 5588 on /mnt: filesystem full Mar 5 18:02:16 mercat1 kernel: pid 89685 (fragments), uid 2007 inumber 5618 on /mnt: filesystem full Mar 5 18:02:17 mercat1 kernel: pid 89688 (fragments), uid 2007 inumber 5650 on /mnt: filesystem full Mar 5 18:02:18 mercat1 kernel: pid 89687 (fragments), uid 2007 inumber 5691 on /mnt: filesystem full Mar 5 18:02:19 mercat1 kernel: pid 89682 (fragments), uid 2007 inumber 5594 on /mnt: filesystem full Mar 5 18:02:20 mercat1 kernel: pid 89685 (fragments), uid 2007 inumber 5585 on /mnt: filesystem full Mar 5 18:02:21 mercat1 kernel: pid 89686 (fragments), uid 2007 inumber 5640 on /mnt: filesystem full Mar 5 18:02:22 mercat1 kernel: pid 89688 (fragments), uid 2007 inumber 5577 on /mnt: filesystem full Mar 5 18:02:23 mercat1 kernel: pid 89688 (fragments), uid 2007 inumber 5672 on /mnt: filesystem full Mar 5 18:02:25 mercat1 kernel: pid 89688 (fragments), uid 2007 inumber 5584 on /mnt: filesystem full Mar 5 18:02:25 mercat1 kernel: pid 89688 (fragments), uid 2007 inumber 5629 on /mnt: filesystem full Mar 5 18:02:26 mercat1 kernel: pid 89688 (fragments), uid 2007 inumber 5641 on /mnt: filesystem full Mar 5 18:02:27 mercat1 kernel: pid 89688 (fragments), uid 2007 inumber 5627 on /mnt: filesystem full Mar 5 18:02:28 mercat1 kernel: pid 91674 (fragments), uid 2007 inumber 5649 on /mnt: filesystem full Mar 5 18:02:30 mercat1 kernel: pid 91679 (fragments), uid 2007 inumber 5732 on /mnt: filesystem full Mar 5 18:02:31 mercat1 kernel: pid 91679 (fragments), uid 2007 inumber 5757 on /mnt: filesystem full Mar 5 18:02:32 mercat1 kernel: pid 91676 (fragments), uid 2007 inumber 5663 on /mnt: filesystem full Mar 5 18:02:33 mercat1 kernel: pid 91680 (fragments), uid 2007 inumber 5615 on /mnt: filesystem full Mar 5 18:02:34 mercat1 kernel: pid 91679 (fragments), uid 2007 inumber 5628 on /mnt: filesystem full Mar 5 18:02:35 mercat1 kernel: pid 91680 (fragments), uid 2007 inumber 5665 on /mnt: filesystem full Mar 5 18:02:36 mercat1 kernel: pid 91675 (fragments), uid 2007 inumber 5625 on /mnt: filesystem full Mar 5 18:02:37 mercat1 kernel: pid 91675 (fragments), uid 2007 inumber 5685 on /mnt: filesystem full Mar 5 18:02:38 mercat1 kernel: pid 91679 (fragments), uid 2007 inumber 5579 on /mnt: filesystem full Mar 5 18:02:39 mercat1 kernel: pid 91678 (fragments), uid 2007 inumber 5622 on /mnt: filesystem full Mar 5 18:02:40 mercat1 kernel: pid 91673 (fragments), uid 2007 inumber 5598 on /mnt: filesystem full Mar 5 18:02:41 mercat1 kernel: pid 91673 (fragments), uid 2007 inumber 5604 on /mnt: filesystem full Mar 5 18:02:42 mercat1 kernel: pid 91673 (fragments), uid 2007 inumber 5599 on /mnt: filesystem full Mar 5 18:02:43 mercat1 kernel: pid 91673 (fragments), uid 2007 inumber 5625 on /mnt: filesystem full Mar 5 18:02:44 mercat1 kernel: pid 93424 (fragments), uid 2007 inumber 5613 on /mnt: filesystem full Mar 5 18:02:45 mercat1 kernel: pid 93423 (fragments), uid 2007 inumber 5667 on /mnt: filesystem full Mar 5 18:02:46 mercat1 kernel: pid 93425 (fragments), uid 2007 inumber 5621 on /mnt: filesystem full Mar 5 18:02:47 mercat1 kernel: pid 93424 (fragments), uid 2007 inumber 5579 on /mnt: filesystem full Mar 5 18:02:48 mercat1 kernel: pid 93427 (fragments), uid 2007 inumber 5579 on /mnt: filesystem full Mar 5 18:02:49 mercat1 kernel: pid 93425 (fragments), uid 2007 inumber 5576 on /mnt: filesystem full Mar 5 18:02:50 mercat1 kernel: pid 93429 (fragments), uid 2007 inumber 5609 on /mnt: filesystem full Mar 5 18:02:51 mercat1 kernel: pid 93423 (fragments), uid 2007 inumber 5611 on /mnt: filesystem full Mar 5 18:02:52 mercat1 kernel: pid 93429 (fragments), uid 2007 inumber 5664 on /mnt: filesystem full Mar 5 18:02:53 mercat1 kernel: pid 93422 (fragments), uid 2007 inumber 5659 on /mnt: filesystem full Mar 5 18:02:54 mercat1 kernel: pid 93429 (fragments), uid 2007 inumber 5583 on /mnt: filesystem full Mar 5 18:02:55 mercat1 kernel: pid 93428 (fragments), uid 2007 inumber 5642 on /mnt: filesystem full Mar 5 18:02:56 mercat1 kernel: pid 93422 (fragments), uid 2007 inumber 5579 on /mnt: filesystem full Mar 5 18:02:57 mercat1 kernel: pid 93429 (fragments), uid 2007 inumber 5577 on /mnt: filesystem full Mar 5 18:02:58 mercat1 syslogd: last message repeated 1 times Mar 5 18:02:59 mercat1 kernel: pid 94675 (fragments), uid 2007 inumber 5666 on /mnt: filesystem full Mar 5 18:03:00 mercat1 kernel: pid 94673 (fragments), uid 2007 inumber 5589 on /mnt: filesystem full Mar 5 18:03:01 mercat1 kernel: pid 94673 (fragments), uid 2007 inumber 5585 on /mnt: filesystem full Mar 5 18:03:02 mercat1 kernel: pid 94674 (fragments), uid 2007 inumber 5606 on /mnt: filesystem full Mar 5 18:03:03 mercat1 kernel: pid 94676 (fragments), uid 2007 inumber 5575 on /mnt: filesystem full Mar 5 18:03:04 mercat1 kernel: pid 94676 (fragments), uid 2007 inumber 5674 on /mnt: filesystem full Mar 5 18:03:05 mercat1 kernel: pid 94676 (fragments), uid 2007 inumber 5580 on /mnt: filesystem full Mar 5 18:03:06 mercat1 kernel: pid 94672 (fragments), uid 2007 inumber 5632 on /mnt: filesystem full Mar 5 18:03:07 mercat1 kernel: pid 94676 (fragments), uid 2007 inumber 5760 on /mnt: filesystem full Mar 5 18:03:08 mercat1 kernel: pid 94672 (fragments), uid 2007 inumber 5648 on /mnt: filesystem full Mar 5 18:03:09 mercat1 kernel: pid 94672 (fragments), uid 2007 inumber 5613 on /mnt: filesystem full Mar 5 18:03:10 mercat1 kernel: pid 94677 (fragments), uid 2007 inumber 5591 on /mnt: filesystem full Mar 5 18:03:11 mercat1 kernel: pid 94677 (fragments), uid 2007 inumber 5597 on /mnt: filesystem full Mar 5 18:03:12 mercat1 kernel: pid 94678 (fragments), uid 2007 inumber 5616 on /mnt: filesystem full Mar 5 18:03:13 mercat1 syslogd: last message repeated 1 times Mar 5 18:03:14 mercat1 kernel: pid 97167 (fragments), uid 2007 inumber 5587 on /mnt: filesystem full Mar 5 18:03:15 mercat1 kernel: pid 97168 (fragments), uid 2007 inumber 5655 on /mnt: filesystem full Mar 5 18:03:16 mercat1 kernel: pid 97166 (fragments), uid 2007 inumber 5697 on /mnt: filesystem full Mar 5 18:03:17 mercat1 kernel: pid 97164 (fragments), uid 2007 inumber 5631 on /mnt: filesystem full Mar 5 18:03:18 mercat1 kernel: pid 97168 (fragments), uid 2007 inumber 5612 on /mnt: filesystem full Mar 5 18:03:19 mercat1 kernel: pid 97164 (fragments), uid 2007 inumber 5601 on /mnt: filesystem full Mar 5 18:03:20 mercat1 kernel: pid 97165 (fragments), uid 2007 inumber 5578 on /mnt: filesystem full Mar 5 18:03:21 mercat1 kernel: pid 97168 (fragments), uid 2007 inumber 5596 on /mnt: filesystem full Mar 5 18:03:22 mercat1 kernel: pid 97161 (fragments), uid 2007 inumber 5622 on /mnt: filesystem full Mar 5 18:03:23 mercat1 kernel: pid 97161 (fragments), uid 2007 inumber 5628 on /mnt: filesystem full Mar 5 18:03:24 mercat1 kernel: pid 97165 (fragments), uid 2007 inumber 5591 on /mnt: filesystem full Mar 5 18:03:25 mercat1 kernel: pid 97164 (fragments), uid 2007 inumber 5602 on /mnt: filesystem full Mar 5 18:03:26 mercat1 kernel: pid 97164 (fragments), uid 2007 inumber 5650 on /mnt: filesystem full Mar 5 18:03:27 mercat1 kernel: pid 97164 (fragments), uid 2007 inumber 5621 on /mnt: filesystem full Mar 5 18:03:28 mercat1 kernel: pid 97164 (fragments), uid 2007 inumber 5601 on /mnt: filesystem full Mar 5 18:03:30 mercat1 kernel: pid 98411 (fragments), uid 2007 inumber 5658 on /mnt: filesystem full Mar 5 18:03:31 mercat1 kernel: pid 98411 (fragments), uid 2007 inumber 5744 on /mnt: filesystem full Mar 5 18:03:32 mercat1 kernel: pid 98412 (fragments), uid 2007 inumber 5796 on /mnt: filesystem full Mar 5 18:03:33 mercat1 kernel: pid 98410 (fragments), uid 2007 inumber 5675 on /mnt: filesystem full Mar 5 18:03:34 mercat1 kernel: pid 98410 (fragments), uid 2007 inumber 5622 on /mnt: filesystem full Mar 5 18:03:34 mercat1 kernel: pid 98413 (fragments), uid 2007 inumber 5585 on /mnt: filesystem full Mar 5 18:03:35 mercat1 kernel: pid 98410 (fragments), uid 2007 inumber 5601 on /mnt: filesystem full Mar 5 18:03:37 mercat1 kernel: pid 98413 (fragments), uid 2007 inumber 5608 on /mnt: filesystem full Mar 5 18:03:38 mercat1 kernel: pid 98410 (fragments), uid 2007 inumber 5660 on /mnt: filesystem full Mar 5 18:03:39 mercat1 kernel: pid 98415 (fragments), uid 2007 inumber 5631 on /mnt: filesystem full Mar 5 18:03:40 mercat1 kernel: pid 98411 (fragments), uid 2007 inumber 5645 on /mnt: filesystem full Mar 5 18:03:41 mercat1 kernel: pid 98411 (fragments), uid 2007 inumber 5639 on /mnt: filesystem full Mar 5 18:03:42 mercat1 kernel: pid 99667 (fragments), uid 2007 inumber 5604 on /mnt: filesystem full Mar 5 18:03:43 mercat1 kernel: pid 99666 (fragments), uid 2007 inumber 5674 on /mnt: filesystem full Mar 5 18:03:44 mercat1 kernel: pid 99664 (fragments), uid 2007 inumber 5586 on /mnt: filesystem full Mar 5 18:03:45 mercat1 kernel: pid 99667 (fragments), uid 2007 inumber 5605 on /mnt: filesystem full Mar 5 18:03:46 mercat1 kernel: pid 99664 (fragments), uid 2007 inumber 5624 on /mnt: filesystem full Mar 5 18:03:47 mercat1 kernel: pid 99668 (fragments), uid 2007 inumber 5667 on /mnt: filesystem full Mar 5 18:03:48 mercat1 kernel: pid 99667 (fragments), uid 2007 inumber 5764 on /mnt: filesystem full Mar 5 18:03:49 mercat1 kernel: pid 99666 (fragments), uid 2007 inumber 5707 on /mnt: filesystem full Mar 5 18:03:50 mercat1 kernel: pid 99663 (fragments), uid 2007 inumber 5605 on /mnt: filesystem full Mar 5 18:03:51 mercat1 kernel: pid 99662 (fragments), uid 2007 inumber 5628 on /mnt: filesystem full Mar 5 18:03:52 mercat1 kernel: pid 99668 (fragments), uid 2007 inumber 5594 on /mnt: filesystem full Mar 5 18:03:53 mercat1 kernel: pid 931 (fragments), uid 2007 inumber 5591 on /mnt: filesystem full Mar 5 18:03:54 mercat1 kernel: pid 936 (fragments), uid 2007 inumber 5681 on /mnt: filesystem full Mar 5 18:03:55 mercat1 kernel: pid 935 (fragments), uid 2007 inumber 5748 on /mnt: filesystem full Mar 5 18:03:56 mercat1 kernel: pid 937 (fragments), uid 2007 inumber 5671 on /mnt: filesystem full Mar 5 18:03:57 mercat1 kernel: pid 933 (fragments), uid 2007 inumber 5648 on /mnt: filesystem full Mar 5 18:03:58 mercat1 kernel: pid 937 (fragments), uid 2007 inumber 5763 on /mnt: filesystem full Mar 5 18:03:59 mercat1 kernel: pid 932 (fragments), uid 2007 inumber 5691 on /mnt: filesystem full Mar 5 18:04:00 mercat1 kernel: pid 932 (fragments), uid 2007 inumber 5663 on /mnt: filesystem full Mar 5 18:04:01 mercat1 kernel: pid 932 (fragments), uid 2007 inumber 5604 on /mnt: filesystem full Mar 5 18:04:02 mercat1 kernel: pid 932 (fragments), uid 2007 inumber 5593 on /mnt: filesystem full Mar 5 18:04:03 mercat1 kernel: pid 932 (fragments), uid 2007 inumber 5621 on /mnt: filesystem full Mar 5 18:04:04 mercat1 kernel: pid 930 (fragments), uid 2007 inumber 5623 on /mnt: filesystem full Mar 5 18:04:05 mercat1 kernel: pid 930 (fragments), uid 2007 inumber 5621 on /mnt: filesystem full Mar 5 18:04:06 mercat1 kernel: pid 3461 (fragments), uid 2007 inumber 5581 on /mnt: filesystem full Mar 5 18:04:07 mercat1 kernel: pid 3461 (fragments), uid 2007 inumber 5618 on /mnt: filesystem full Mar 5 18:04:08 mercat1 kernel: pid 3466 (fragments), uid 2007 inumber 5692 on /mnt: filesystem full Mar 5 18:04:09 mercat1 kernel: pid 3468 (fragments), uid 2007 inumber 5662 on /mnt: filesystem full Mar 5 18:04:10 mercat1 kernel: pid 3464 (fragments), uid 2007 inumber 5602 on /mnt: filesystem full Mar 5 18:04:11 mercat1 kernel: pid 3463 (fragments), uid 2007 inumber 5589 on /mnt: filesystem full Mar 5 18:04:12 mercat1 kernel: pid 3468 (fragments), uid 2007 inumber 5734 on /mnt: filesystem full Mar 5 18:04:13 mercat1 kernel: pid 3465 (fragments), uid 2007 inumber 5675 on /mnt: filesystem full Mar 5 18:04:14 mercat1 kernel: pid 3463 (fragments), uid 2007 inumber 5621 on /mnt: filesystem full Mar 5 18:04:15 mercat1 kernel: pid 3461 (fragments), uid 2007 inumber 5599 on /mnt: filesystem full Mar 5 18:04:16 mercat1 kernel: pid 3461 (fragments), uid 2007 inumber 5585 on /mnt: filesystem full Mar 5 18:04:17 mercat1 kernel: pid 3461 (fragments), uid 2007 inumber 5645 on /mnt: filesystem full Mar 5 18:04:18 mercat1 kernel: pid 3461 (fragments), uid 2007 inumber 5611 on /mnt: filesystem full Mar 5 18:04:19 mercat1 kernel: pid 4711 (fragments), uid 2007 inumber 5620 on /mnt: filesystem full Mar 5 18:04:20 mercat1 kernel: pid 4714 (fragments), uid 2007 inumber 5626 on /mnt: filesystem full Mar 5 18:04:21 mercat1 kernel: pid 4718 (fragments), uid 2007 inumber 5673 on /mnt: filesystem full Mar 5 18:04:22 mercat1 kernel: pid 4713 (fragments), uid 2007 inumber 5718 on /mnt: filesystem full Mar 5 18:04:23 mercat1 kernel: pid 4711 (fragments), uid 2007 inumber 5688 on /mnt: filesystem full Mar 5 18:04:24 mercat1 kernel: pid 4712 (fragments), uid 2007 inumber 5758 on /mnt: filesystem full Mar 5 18:04:25 mercat1 kernel: pid 4716 (fragments), uid 2007 inumber 5605 on /mnt: filesystem full Mar 5 18:04:26 mercat1 kernel: pid 4715 (fragments), uid 2007 inumber 5635 on /mnt: filesystem full Mar 5 18:04:27 mercat1 kernel: pid 4715 (fragments), uid 2007 inumber 5607 on /mnt: filesystem full Mar 5 18:04:28 mercat1 kernel: pid 5968 (fragments), uid 2007 inumber 5583 on /mnt: filesystem full Mar 5 18:04:29 mercat1 kernel: pid 5970 (fragments), uid 2007 inumber 5576 on /mnt: filesystem full Mar 5 18:04:30 mercat1 kernel: pid 5964 (fragments), uid 2007 inumber 5726 on /mnt: filesystem full Mar 5 18:04:31 mercat1 kernel: pid 5964 (fragments), uid 2007 inumber 5605 on /mnt: filesystem full Mar 5 18:04:32 mercat1 kernel: pid 5968 (fragments), uid 2007 inumber 5654 on /mnt: filesystem full Mar 5 18:04:33 mercat1 kernel: pid 5967 (fragments), uid 2007 inumber 5705 on /mnt: filesystem full Mar 5 18:04:34 mercat1 kernel: pid 5966 (fragments), uid 2007 inumber 5598 on /mnt: filesystem full Mar 5 18:04:35 mercat1 kernel: pid 5970 (fragments), uid 2007 inumber 5618 on /mnt: filesystem full Mar 5 18:04:36 mercat1 kernel: pid 5964 (fragments), uid 2007 inumber 5644 on /mnt: filesystem full Mar 5 18:04:37 mercat1 kernel: pid 5970 (fragments), uid 2007 inumber 5588 on /mnt: filesystem full Mar 5 18:04:38 mercat1 kernel: pid 5971 (fragments), uid 2007 inumber 5683 on /mnt: filesystem full Mar 5 18:04:39 mercat1 kernel: pid 5964 (fragments), uid 2007 inumber 5660 on /mnt: filesystem full Mar 5 18:04:40 mercat1 kernel: pid 7217 (fragments), uid 2007 inumber 5650 on /mnt: filesystem full Mar 5 18:04:41 mercat1 kernel: pid 7218 (fragments), uid 2007 inumber 5605 on /mnt: filesystem full Mar 5 18:04:42 mercat1 kernel: pid 7219 (fragments), uid 2007 inumber 5618 on /mnt: filesystem full Mar 5 18:04:44 mercat1 kernel: pid 7219 (fragments), uid 2007 inumber 5663 on /mnt: filesystem full Mar 5 18:04:45 mercat1 kernel: pid 7219 (fragments), uid 2007 inumber 5596 on /mnt: filesystem full Mar 5 18:04:46 mercat1 kernel: pid 7217 (fragments), uid 2007 inumber 5634 on /mnt: filesystem full Mar 5 18:04:47 mercat1 kernel: pid 7219 (fragments), uid 2007 inumber 5621 on /mnt: filesystem full Mar 5 18:04:48 mercat1 kernel: pid 7217 (fragments), uid 2007 inumber 5587 on /mnt: filesystem full Mar 5 18:04:49 mercat1 kernel: pid 7217 (fragments), uid 2007 inumber 5600 on /mnt: filesystem full Mar 5 18:04:50 mercat1 kernel: pid 7216 (fragments), uid 2007 inumber 5596 on /mnt: filesystem full Mar 5 18:04:51 mercat1 kernel: pid 7216 (fragments), uid 2007 inumber 5594 on /mnt: filesystem full Mar 5 18:04:52 mercat1 kernel: pid 7219 (fragments), uid 2007 inumber 5634 on /mnt: filesystem full Mar 5 18:04:53 mercat1 kernel: pid 7221 (fragments), uid 2007 inumber 5608 on /mnt: filesystem full Mar 5 18:04:54 mercat1 kernel: pid 7221 (fragments), uid 2007 inumber 5647 on /mnt: filesystem full Mar 5 18:04:55 mercat1 kernel: pid 7221 (fragments), uid 2007 inumber 5583 on /mnt: filesystem full Mar 5 18:04:56 mercat1 kernel: pid 7221 (fragments), uid 2007 inumber 5634 on /mnt: filesystem full Mar 5 18:04:57 mercat1 kernel: pid 8469 (fragments), uid 2007 inumber 5640 on /mnt: filesystem full Mar 5 18:04:58 mercat1 kernel: pid 8467 (fragments), uid 2007 inumber 5678 on /mnt: filesystem full Mar 5 18:04:59 mercat1 kernel: pid 8464 (fragments), uid 2007 inumber 5672 on /mnt: filesystem full Mar 5 18:05:00 mercat1 kernel: pid 8471 (fragments), uid 2007 inumber 5655 on /mnt: filesystem full Mar 5 18:05:01 mercat1 kernel: pid 8471 (fragments), uid 2007 inumber 5721 on /mnt: filesystem full Mar 5 18:05:02 mercat1 kernel: pid 8468 (fragments), uid 2007 inumber 5574 on /mnt: filesystem full Mar 5 18:05:03 mercat1 kernel: pid 8468 (fragments), uid 2007 inumber 5629 on /mnt: filesystem full Mar 5 18:05:04 mercat1 kernel: pid 8470 (fragments), uid 2007 inumber 5579 on /mnt: filesystem full Mar 5 18:05:05 mercat1 kernel: pid 8468 (fragments), uid 2007 inumber 5661 on /mnt: filesystem full Mar 5 18:05:06 mercat1 kernel: pid 8470 (fragments), uid 2007 inumber 5590 on /mnt: filesystem full Mar 5 18:05:07 mercat1 kernel: pid 8468 (fragments), uid 2007 inumber 5581 on /mnt: filesystem full Mar 5 18:05:08 mercat1 kernel: pid 8468 (fragments), uid 2007 inumber 5577 on /mnt: filesystem full Mar 5 18:05:09 mercat1 kernel: pid 8468 (fragments), uid 2007 inumber 5598 on /mnt: filesystem full Mar 5 18:05:10 mercat1 kernel: pid 8468 (fragments), uid 2007 inumber 5602 on /mnt: filesystem full Mar 5 18:05:11 mercat1 kernel: pid 10963 (fragments), uid 2007 inumber 5647 on /mnt: filesystem full Mar 5 18:05:12 mercat1 kernel: pid 10961 (fragments), uid 2007 inumber 5627 on /mnt: filesystem full Mar 5 18:05:13 mercat1 kernel: pid 10958 (fragments), uid 2007 inumber 5682 on /mnt: filesystem full Mar 5 18:05:14 mercat1 kernel: pid 10963 (fragments), uid 2007 inumber 5615 on /mnt: filesystem full Mar 5 18:05:15 mercat1 kernel: pid 10962 (fragments), uid 2007 inumber 5631 on /mnt: filesystem full Mar 5 18:05:16 mercat1 kernel: pid 10958 (fragments), uid 2007 inumber 5590 on /mnt: filesystem full Mar 5 18:05:17 mercat1 kernel: pid 10962 (fragments), uid 2007 inumber 5622 on /mnt: filesystem full Mar 5 18:05:18 mercat1 kernel: pid 10963 (fragments), uid 2007 inumber 5677 on /mnt: filesystem full Mar 5 18:05:19 mercat1 kernel: pid 10956 (fragments), uid 2007 inumber 5592 on /mnt: filesystem full Mar 5 18:05:20 mercat1 kernel: pid 10963 (fragments), uid 2007 inumber 5642 on /mnt: filesystem full Mar 5 18:05:21 mercat1 kernel: pid 10961 (fragments), uid 2007 inumber 5604 on /mnt: filesystem full Mar 5 18:05:22 mercat1 kernel: pid 10957 (fragments), uid 2007 inumber 5611 on /mnt: filesystem full Mar 5 18:05:23 mercat1 kernel: pid 10957 (fragments), uid 2007 inumber 5609 on /mnt: filesystem full Mar 5 18:05:24 mercat1 kernel: pid 10960 (fragments), uid 2007 inumber 5672 on /mnt: filesystem full Mar 5 18:05:25 mercat1 kernel: pid 10956 (fragments), uid 2007 inumber 5629 on /mnt: filesystem full Mar 5 18:05:26 mercat1 kernel: pid 10961 (fragments), uid 2007 inumber 5682 on /mnt: filesystem full Mar 5 18:05:27 mercat1 kernel: pid 12206 (fragments), uid 2007 inumber 5667 on /mnt: filesystem full Mar 5 18:05:28 mercat1 kernel: pid 12206 (fragments), uid 2007 inumber 5737 on /mnt: filesystem full Mar 5 18:05:29 mercat1 kernel: pid 12210 (fragments), uid 2007 inumber 5629 on /mnt: filesystem full Mar 5 18:05:30 mercat1 kernel: pid 12212 (fragments), uid 2007 inumber 5656 on /mnt: filesystem full Mar 5 18:05:31 mercat1 kernel: pid 12208 (fragments), uid 2007 inumber 5687 on /mnt: filesystem full Mar 5 18:05:32 mercat1 kernel: pid 12205 (fragments), uid 2007 inumber 5655 on /mnt: filesystem full Mar 5 18:05:33 mercat1 kernel: pid 12211 (fragments), uid 2007 inumber 5654 on /mnt: filesystem full Mar 5 18:05:34 mercat1 kernel: pid 12205 (fragments), uid 2007 inumber 5612 on /mnt: filesystem full Mar 5 18:05:35 mercat1 kernel: pid 12211 (fragments), uid 2007 inumber 5591 on /mnt: filesystem full Mar 5 18:05:36 mercat1 kernel: pid 12210 (fragments), uid 2007 inumber 5616 on /mnt: filesystem full Mar 5 18:05:37 mercat1 kernel: pid 12207 (fragments), uid 2007 inumber 5577 on /mnt: filesystem full Mar 5 18:05:38 mercat1 kernel: pid 12207 (fragments), uid 2007 inumber 5666 on /mnt: filesystem full Mar 5 18:05:39 mercat1 kernel: pid 13457 (fragments), uid 2007 inumber 5621 on /mnt: filesystem full Mar 5 18:05:40 mercat1 kernel: pid 13457 (fragments), uid 2007 inumber 5693 on /mnt: filesystem full Mar 5 18:05:41 mercat1 kernel: pid 13456 (fragments), uid 2007 inumber 5581 on /mnt: filesystem full Mar 5 18:05:42 mercat1 kernel: pid 13458 (fragments), uid 2007 inumber 5610 on /mnt: filesystem full Mar 5 18:05:43 mercat1 kernel: pid 13458 (fragments), uid 2007 inumber 5614 on /mnt: filesystem full Mar 5 18:05:44 mercat1 kernel: pid 13458 (fragments), uid 2007 inumber 5633 on /mnt: filesystem full Mar 5 18:05:45 mercat1 kernel: pid 13460 (fragments), uid 2007 inumber 5658 on /mnt: filesystem full Mar 5 18:05:46 mercat1 kernel: pid 13462 (fragments), uid 2007 inumber 5603 on /mnt: filesystem full Mar 5 18:05:47 mercat1 kernel: pid 13460 (fragments), uid 2007 inumber 5596 on /mnt: filesystem full Mar 5 18:05:48 mercat1 kernel: pid 13459 (fragments), uid 2007 inumber 5607 on /mnt: filesystem full Mar 5 18:05:49 mercat1 kernel: pid 13458 (fragments), uid 2007 inumber 5590 on /mnt: filesystem full Mar 5 18:05:50 mercat1 kernel: pid 13463 (fragments), uid 2007 inumber 5658 on /mnt: filesystem full Mar 5 18:05:51 mercat1 kernel: pid 13463 (fragments), uid 2007 inumber 5599 on /mnt: filesystem full Mar 5 18:05:52 mercat1 kernel: pid 13462 (fragments), uid 2007 inumber 5671 on /mnt: filesystem full Mar 5 18:05:53 mercat1 kernel: pid 13462 (fragments), uid 2007 inumber 5658 on /mnt: filesystem full Mar 5 18:05:54 mercat1 kernel: pid 13462 (fragments), uid 2007 inumber 5576 on /mnt: filesystem full Mar 5 18:05:55 mercat1 syslogd: last message repeated 1 times Mar 5 18:05:56 mercat1 kernel: pid 15952 (fragments), uid 2007 inumber 5597 on /mnt: filesystem full Mar 5 18:05:57 mercat1 kernel: pid 15952 (fragments), uid 2007 inumber 5669 on /mnt: filesystem full Mar 5 18:05:58 mercat1 kernel: pid 15949 (fragments), uid 2007 inumber 5625 on /mnt: filesystem full Mar 5 18:05:59 mercat1 kernel: pid 15948 (fragments), uid 2007 inumber 5601 on /mnt: filesystem full Mar 5 18:06:00 mercat1 kernel: pid 15951 (fragments), uid 2007 inumber 5683 on /mnt: filesystem full Mar 5 18:06:02 mercat1 kernel: pid 15951 (fragments), uid 2007 inumber 5574 on /mnt: filesystem full Mar 5 18:06:03 mercat1 kernel: pid 15947 (fragments), uid 2007 inumber 5649 on /mnt: filesystem full Mar 5 18:06:04 mercat1 kernel: pid 15948 (fragments), uid 2007 inumber 5585 on /mnt: filesystem full Mar 5 18:06:05 mercat1 kernel: pid 15947 (fragments), uid 2007 inumber 5674 on /mnt: filesystem full Mar 5 18:06:06 mercat1 kernel: pid 15947 (fragments), uid 2007 inumber 5650 on /mnt: filesystem full Mar 5 18:06:07 mercat1 kernel: pid 15953 (fragments), uid 2007 inumber 5643 on /mnt: filesystem full Mar 5 18:06:08 mercat1 kernel: pid 15953 (fragments), uid 2007 inumber 5661 on /mnt: filesystem full Mar 5 18:06:09 mercat1 kernel: pid 15947 (fragments), uid 2007 inumber 5621 on /mnt: filesystem full Mar 5 18:06:10 mercat1 kernel: pid 15952 (fragments), uid 2007 inumber 5588 on /mnt: filesystem full Mar 5 18:06:11 mercat1 kernel: pid 15950 (fragments), uid 2007 inumber 5678 on /mnt: filesystem full Mar 5 18:06:12 mercat1 kernel: pid 15947 (fragments), uid 2007 inumber 5610 on /mnt: filesystem full Mar 5 18:06:13 mercat1 kernel: pid 17199 (fragments), uid 2007 inumber 5635 on /mnt: filesystem full Mar 5 18:06:14 mercat1 kernel: pid 17201 (fragments), uid 2007 inumber 5733 on /mnt: filesystem full Mar 5 18:06:15 mercat1 kernel: pid 17196 (fragments), uid 2007 inumber 5661 on /mnt: filesystem full Mar 5 18:06:16 mercat1 kernel: pid 17202 (fragments), uid 2007 inumber 5592 on /mnt: filesystem full Mar 5 18:06:17 mercat1 kernel: pid 17195 (fragments), uid 2007 inumber 5624 on /mnt: filesystem full Mar 5 18:06:18 mercat1 kernel: pid 17195 (fragments), uid 2007 inumber 5648 on /mnt: filesystem full Mar 5 18:06:19 mercat1 kernel: pid 17196 (fragments), uid 2007 inumber 5612 on /mnt: filesystem full Mar 5 18:06:20 mercat1 kernel: pid 17199 (fragments), uid 2007 inumber 5647 on /mnt: filesystem full Mar 5 18:06:21 mercat1 kernel: pid 17200 (fragments), uid 2007 inumber 5717 on /mnt: filesystem full Mar 5 18:06:22 mercat1 kernel: pid 17197 (fragments), uid 2007 inumber 5667 on /mnt: filesystem full Mar 5 18:06:23 mercat1 kernel: pid 17195 (fragments), uid 2007 inumber 5611 on /mnt: filesystem full Mar 5 18:06:24 mercat1 kernel: pid 17196 (fragments), uid 2007 inumber 5636 on /mnt: filesystem full Mar 5 18:06:25 mercat1 kernel: pid 17196 (fragments), uid 2007 inumber 5634 on /mnt: filesystem full Mar 5 18:06:26 mercat1 kernel: pid 17199 (fragments), uid 2007 inumber 5697 on /mnt: filesystem full Mar 5 18:06:27 mercat1 kernel: pid 17195 (fragments), uid 2007 inumber 5590 on /mnt: filesystem full Mar 5 18:06:28 mercat1 kernel: pid 17195 (fragments), uid 2007 inumber 5642 on /mnt: filesystem full Mar 5 18:06:29 mercat1 kernel: pid 19685 (fragments), uid 2007 inumber 5641 on /mnt: filesystem full Mar 5 18:06:30 mercat1 kernel: pid 19685 (fragments), uid 2007 inumber 5678 on /mnt: filesystem full Mar 5 18:06:31 mercat1 kernel: pid 19692 (fragments), uid 2007 inumber 5722 on /mnt: filesystem full Mar 5 18:06:32 mercat1 kernel: pid 19688 (fragments), uid 2007 inumber 5660 on /mnt: filesystem full Mar 5 18:06:33 mercat1 kernel: pid 19685 (fragments), uid 2007 inumber 5706 on /mnt: filesystem full Mar 5 18:06:34 mercat1 kernel: pid 19686 (fragments), uid 2007 inumber 5618 on /mnt: filesystem full Mar 5 18:06:35 mercat1 kernel: pid 19688 (fragments), uid 2007 inumber 5586 on /mnt: filesystem full Mar 5 18:06:36 mercat1 kernel: pid 19687 (fragments), uid 2007 inumber 5679 on /mnt: filesystem full Mar 5 18:06:37 mercat1 kernel: pid 20939 (fragments), uid 2007 inumber 5600 on /mnt: filesystem full Mar 5 18:06:38 mercat1 kernel: pid 20941 (fragments), uid 2007 inumber 5652 on /mnt: filesystem full Mar 5 18:06:39 mercat1 kernel: pid 20939 (fragments), uid 2007 inumber 5595 on /mnt: filesystem full Mar 5 18:06:40 mercat1 kernel: pid 20936 (fragments), uid 2007 inumber 5591 on /mnt: filesystem full Mar 5 18:06:41 mercat1 kernel: pid 20940 (fragments), uid 2007 inumber 5640 on /mnt: filesystem full Mar 5 18:06:42 mercat1 kernel: pid 20938 (fragments), uid 2007 inumber 5600 on /mnt: filesystem full Mar 5 18:06:43 mercat1 kernel: pid 20939 (fragments), uid 2007 inumber 5682 on /mnt: filesystem full Mar 5 18:06:44 mercat1 kernel: pid 20938 (fragments), uid 2007 inumber 5594 on /mnt: filesystem full Mar 5 18:06:45 mercat1 kernel: pid 20937 (fragments), uid 2007 inumber 5615 on /mnt: filesystem full Mar 5 18:06:46 mercat1 kernel: pid 20943 (fragments), uid 2007 inumber 5590 on /mnt: filesystem full Mar 5 18:06:47 mercat1 kernel: pid 20941 (fragments), uid 2007 inumber 5607 on /mnt: filesystem full Mar 5 18:06:48 mercat1 kernel: pid 20940 (fragments), uid 2007 inumber 5622 on /mnt: filesystem full Mar 5 18:06:49 mercat1 kernel: pid 20937 (fragments), uid 2007 inumber 5628 on /mnt: filesystem full Mar 5 18:06:50 mercat1 kernel: pid 20940 (fragments), uid 2007 inumber 5602 on /mnt: filesystem full Mar 5 18:06:51 mercat1 kernel: pid 20940 (fragments), uid 2007 inumber 5664 on /mnt: filesystem full Mar 5 18:06:52 mercat1 kernel: pid 20941 (fragments), uid 2007 inumber 5608 on /mnt: filesystem full Mar 5 18:06:53 mercat1 kernel: pid 20936 (fragments), uid 2007 inumber 5662 on /mnt: filesystem full Mar 5 18:06:54 mercat1 kernel: pid 20936 (fragments), uid 2007 inumber 5623 on /mnt: filesystem full Mar 5 18:06:55 mercat1 kernel: pid 22189 (fragments), uid 2007 inumber 5622 on /mnt: filesystem full Mar 5 18:06:56 mercat1 kernel: pid 22187 (fragments), uid 2007 inumber 5655 on /mnt: filesystem full Mar 5 18:06:57 mercat1 kernel: pid 22190 (fragments), uid 2007 inumber 5684 on /mnt: filesystem full Mar 5 18:06:58 mercat1 kernel: pid 22186 (fragments), uid 2007 inumber 5596 on /mnt: filesystem full Mar 5 18:06:59 mercat1 kernel: pid 22190 (fragments), uid 2007 inumber 5608 on /mnt: filesystem full Mar 5 18:07:00 mercat1 kernel: pid 22187 (fragments), uid 2007 inumber 5628 on /mnt: filesystem full Mar 5 18:07:01 mercat1 kernel: pid 22186 (fragments), uid 2007 inumber 5687 on /mnt: filesystem full Mar 5 18:07:02 mercat1 kernel: pid 22192 (fragments), uid 2007 inumber 5638 on /mnt: filesystem full Mar 5 18:07:03 mercat1 kernel: pid 22191 (fragments), uid 2007 inumber 5639 on /mnt: filesystem full Mar 5 18:07:04 mercat1 kernel: pid 22192 (fragments), uid 2007 inumber 5636 on /mnt: filesystem full Mar 5 18:07:05 mercat1 kernel: pid 22192 (fragments), uid 2007 inumber 5576 on /mnt: filesystem full Mar 5 18:07:07 mercat1 kernel: pid 22187 (fragments), uid 2007 inumber 5581 on /mnt: filesystem full Mar 5 18:07:07 mercat1 kernel: pid 22191 (fragments), uid 2007 inumber 5586 on /mnt: filesystem full Mar 5 18:07:08 mercat1 kernel: pid 22192 (fragments), uid 2007 inumber 5587 on /mnt: filesystem full Mar 5 18:07:10 mercat1 kernel: pid 24679 (fragments), uid 2007 inumber 5657 on /mnt: filesystem full Mar 5 18:07:10 mercat1 kernel: pid 24677 (fragments), uid 2007 inumber 5659 on /mnt: filesystem full Mar 5 18:07:12 mercat1 kernel: pid 24681 (fragments), uid 2007 inumber 5619 on /mnt: filesystem full Mar 5 18:07:12 mercat1 kernel: pid 24682 (fragments), uid 2007 inumber 5636 on /mnt: filesystem full Mar 5 18:07:13 mercat1 kernel: pid 24676 (fragments), uid 2007 inumber 5629 on /mnt: filesystem full Mar 5 18:07:14 mercat1 kernel: pid 24678 (fragments), uid 2007 inumber 5621 on /mnt: filesystem full Mar 5 18:07:16 mercat1 kernel: pid 24678 (fragments), uid 2007 inumber 5586 on /mnt: filesystem full Mar 5 18:07:17 mercat1 kernel: pid 24682 (fragments), uid 2007 inumber 5624 on /mnt: filesystem full Mar 5 18:07:18 mercat1 kernel: pid 24677 (fragments), uid 2007 inumber 5582 on /mnt: filesystem full Mar 5 18:07:18 mercat1 kernel: pid 24677 (fragments), uid 2007 inumber 5643 on /mnt: filesystem full Mar 5 18:07:19 mercat1 kernel: pid 24679 (fragments), uid 2007 inumber 5633 on /mnt: filesystem full Mar 5 18:07:21 mercat1 kernel: pid 24678 (fragments), uid 2007 inumber 5577 on /mnt: filesystem full Mar 5 18:07:22 mercat1 kernel: pid 24682 (fragments), uid 2007 inumber 5607 on /mnt: filesystem full Mar 5 18:07:23 mercat1 kernel: pid 24678 (fragments), uid 2007 inumber 5618 on /mnt: filesystem full Mar 5 18:07:24 mercat1 kernel: pid 25928 (fragments), uid 2007 inumber 5653 on /mnt: filesystem full Mar 5 18:07:25 mercat1 kernel: pid 25930 (fragments), uid 2007 inumber 5710 on /mnt: filesystem full Mar 5 18:07:26 mercat1 kernel: pid 25930 (fragments), uid 2007 inumber 5673 on /mnt: filesystem full Mar 5 18:07:27 mercat1 kernel: pid 25926 (fragments), uid 2007 inumber 5648 on /mnt: filesystem full Mar 5 18:07:28 mercat1 kernel: pid 25931 (fragments), uid 2007 inumber 5671 on /mnt: filesystem full Mar 5 18:07:29 mercat1 kernel: pid 25930 (fragments), uid 2007 inumber 5633 on /mnt: filesystem full Mar 5 18:07:30 mercat1 kernel: pid 25931 (fragments), uid 2007 inumber 5603 on /mnt: filesystem full Mar 5 18:07:31 mercat1 kernel: pid 25926 (fragments), uid 2007 inumber 5615 on /mnt: filesystem full Mar 5 18:07:32 mercat1 kernel: pid 25931 (fragments), uid 2007 inumber 5574 on /mnt: filesystem full Mar 5 18:07:33 mercat1 kernel: pid 25930 (fragments), uid 2007 inumber 5640 on /mnt: filesystem full Mar 5 18:07:34 mercat1 kernel: pid 25926 (fragments), uid 2007 inumber 5579 on /mnt: filesystem full Mar 5 18:07:35 mercat1 kernel: pid 25925 (fragments), uid 2007 inumber 5610 on /mnt: filesystem full Mar 5 18:07:36 mercat1 kernel: pid 25929 (fragments), uid 2007 inumber 5597 on /mnt: filesystem full Mar 5 18:07:37 mercat1 kernel: pid 25931 (fragments), uid 2007 inumber 5592 on /mnt: filesystem full Mar 5 18:07:38 mercat1 kernel: pid 27178 (fragments), uid 2007 inumber 5636 on /mnt: filesystem full Mar 5 18:07:39 mercat1 kernel: pid 27182 (fragments), uid 2007 inumber 5713 on /mnt: filesystem full Mar 5 18:07:40 mercat1 kernel: pid 27179 (fragments), uid 2007 inumber 5656 on /mnt: filesystem full Mar 5 18:07:41 mercat1 kernel: pid 27175 (fragments), uid 2007 inumber 5612 on /mnt: filesystem full Mar 5 18:07:42 mercat1 kernel: pid 27180 (fragments), uid 2007 inumber 5618 on /mnt: filesystem full Mar 5 18:07:43 mercat1 kernel: pid 27178 (fragments), uid 2007 inumber 5622 on /mnt: filesystem full Mar 5 18:07:44 mercat1 kernel: pid 27180 (fragments), uid 2007 inumber 5581 on /mnt: filesystem full Mar 5 18:07:45 mercat1 kernel: pid 27182 (fragments), uid 2007 inumber 5647 on /mnt: filesystem full Mar 5 18:07:46 mercat1 kernel: pid 27177 (fragments), uid 2007 inumber 5597 on /mnt: filesystem full Mar 5 18:07:47 mercat1 kernel: pid 27180 (fragments), uid 2007 inumber 5618 on /mnt: filesystem full Mar 5 18:07:48 mercat1 kernel: pid 27177 (fragments), uid 2007 inumber 5651 on /mnt: filesystem full Mar 5 18:07:49 mercat1 kernel: pid 27178 (fragments), uid 2007 inumber 5611 on /mnt: filesystem full Mar 5 18:07:50 mercat1 kernel: pid 27175 (fragments), uid 2007 inumber 5609 on /mnt: filesystem full Mar 5 18:07:51 mercat1 kernel: pid 27177 (fragments), uid 2007 inumber 5651 on /mnt: filesystem full Mar 5 18:07:52 mercat1 kernel: pid 29669 (fragments), uid 2007 inumber 5626 on /mnt: filesystem full Mar 5 18:07:53 mercat1 kernel: pid 29666 (fragments), uid 2007 inumber 5719 on /mnt: filesystem full Mar 5 18:07:54 mercat1 kernel: pid 29667 (fragments), uid 2007 inumber 5793 on /mnt: filesystem full Mar 5 18:07:55 mercat1 kernel: pid 29665 (fragments), uid 2007 inumber 5667 on /mnt: filesystem full Mar 5 18:07:56 mercat1 kernel: pid 29667 (fragments), uid 2007 inumber 5577 on /mnt: filesystem full Mar 5 18:07:57 mercat1 kernel: pid 29670 (fragments), uid 2007 inumber 5596 on /mnt: filesystem full Mar 5 18:07:58 mercat1 kernel: pid 29671 (fragments), uid 2007 inumber 5616 on /mnt: filesystem full Mar 5 18:07:59 mercat1 kernel: pid 29667 (fragments), uid 2007 inumber 5612 on /mnt: filesystem full Mar 5 18:08:00 mercat1 kernel: pid 29668 (fragments), uid 2007 inumber 5590 on /mnt: filesystem full Mar 5 18:08:01 mercat1 kernel: pid 29668 (fragments), uid 2007 inumber 5602 on /mnt: filesystem full Mar 5 18:08:02 mercat1 kernel: pid 29668 (fragments), uid 2007 inumber 5589 on /mnt: filesystem full Mar 5 18:08:03 mercat1 kernel: pid 29668 (fragments), uid 2007 inumber 5622 on /mnt: filesystem full Mar 5 18:08:04 mercat1 kernel: pid 29668 (fragments), uid 2007 inumber 5624 on /mnt: filesystem full Mar 5 18:08:05 mercat1 kernel: pid 29668 (fragments), uid 2007 inumber 5613 on /mnt: filesystem full Mar 5 18:08:06 mercat1 kernel: pid 30914 (fragments), uid 2007 inumber 5639 on /mnt: filesystem full Mar 5 18:08:07 mercat1 kernel: pid 30919 (fragments), uid 2007 inumber 5714 on /mnt: filesystem full Mar 5 18:08:08 mercat1 kernel: pid 30920 (fragments), uid 2007 inumber 5599 on /mnt: filesystem full Mar 5 18:08:09 mercat1 kernel: pid 30920 (fragments), uid 2007 inumber 5628 on /mnt: filesystem full Mar 5 18:08:10 mercat1 kernel: pid 30918 (fragments), uid 2007 inumber 5650 on /mnt: filesystem full Mar 5 18:08:11 mercat1 kernel: pid 30917 (fragments), uid 2007 inumber 5628 on /mnt: filesystem full Mar 5 18:08:12 mercat1 kernel: pid 30915 (fragments), uid 2007 inumber 5622 on /mnt: filesystem full Mar 5 18:08:13 mercat1 kernel: pid 30918 (fragments), uid 2007 inumber 5606 on /mnt: filesystem full Mar 5 18:08:14 mercat1 kernel: pid 30918 (fragments), uid 2007 inumber 5679 on /mnt: filesystem full Mar 5 18:08:15 mercat1 kernel: pid 30918 (fragments), uid 2007 inumber 5642 on /mnt: filesystem full Mar 5 18:08:16 mercat1 kernel: pid 30920 (fragments), uid 2007 inumber 5679 on /mnt: filesystem full Mar 5 18:08:17 mercat1 kernel: pid 30921 (fragments), uid 2007 inumber 5675 on /mnt: filesystem full Mar 5 18:08:18 mercat1 kernel: pid 30914 (fragments), uid 2007 inumber 5652 on /mnt: filesystem full Mar 5 18:08:19 mercat1 kernel: pid 30916 (fragments), uid 2007 inumber 5601 on /mnt: filesystem full Mar 5 18:08:20 mercat1 kernel: pid 30916 (fragments), uid 2007 inumber 5602 on /mnt: filesystem full Mar 5 18:08:21 mercat1 kernel: pid 30916 (fragments), uid 2007 inumber 5596 on /mnt: filesystem full Mar 5 18:08:22 mercat1 kernel: pid 30916 (fragments), uid 2007 inumber 5594 on /mnt: filesystem full Mar 5 18:08:23 mercat1 kernel: pid 33404 (fragments), uid 2007 inumber 5616 on /mnt: filesystem full Mar 5 18:08:24 mercat1 kernel: pid 33407 (fragments), uid 2007 inumber 5670 on /mnt: filesystem full Mar 5 18:08:25 mercat1 kernel: pid 33410 (fragments), uid 2007 inumber 5612 on /mnt: filesystem full Mar 5 18:08:26 mercat1 kernel: pid 33410 (fragments), uid 2007 inumber 5622 on /mnt: filesystem full Mar 5 18:08:27 mercat1 kernel: pid 33411 (fragments), uid 2007 inumber 5588 on /mnt: filesystem full Mar 5 18:08:28 mercat1 kernel: pid 33410 (fragments), uid 2007 inumber 5653 on /mnt: filesystem full Mar 5 18:08:29 mercat1 kernel: pid 33407 (fragments), uid 2007 inumber 5623 on /mnt: filesystem full Mar 5 18:08:30 mercat1 kernel: pid 33410 (fragments), uid 2007 inumber 5583 on /mnt: filesystem full Mar 5 18:08:31 mercat1 kernel: pid 33406 (fragments), uid 2007 inumber 5642 on /mnt: filesystem full Mar 5 18:08:33 mercat1 kernel: pid 33411 (fragments), uid 2007 inumber 5652 on /mnt: filesystem full Mar 5 18:08:34 mercat1 kernel: pid 33411 (fragments), uid 2007 inumber 5647 on /mnt: filesystem full Mar 5 18:08:34 mercat1 kernel: pid 33408 (fragments), uid 2007 inumber 5669 on /mnt: filesystem full Mar 5 18:08:35 mercat1 kernel: pid 33407 (fragments), uid 2007 inumber 5583 on /mnt: filesystem full Mar 5 18:08:37 mercat1 kernel: pid 33411 (fragments), uid 2007 inumber 5611 on /mnt: filesystem full Mar 5 18:08:38 mercat1 kernel: pid 33411 (fragments), uid 2007 inumber 5580 on /mnt: filesystem full Mar 5 18:08:39 mercat1 kernel: pid 33411 (fragments), uid 2007 inumber 5656 on /mnt: filesystem full Mar 5 18:08:40 mercat1 kernel: pid 34661 (fragments), uid 2007 inumber 5683 on /mnt: filesystem full Mar 5 18:08:41 mercat1 kernel: pid 34659 (fragments), uid 2007 inumber 5621 on /mnt: filesystem full Mar 5 18:08:42 mercat1 kernel: pid 34659 (fragments), uid 2007 inumber 5755 on /mnt: filesystem full Mar 5 18:08:43 mercat1 kernel: pid 34655 (fragments), uid 2007 inumber 5626 on /mnt: filesystem full Mar 5 18:08:44 mercat1 kernel: pid 34658 (fragments), uid 2007 inumber 5596 on /mnt: filesystem full Mar 5 18:08:45 mercat1 kernel: pid 34658 (fragments), uid 2007 inumber 5731 on /mnt: filesystem full Mar 5 18:08:46 mercat1 kernel: pid 34657 (fragments), uid 2007 inumber 5683 on /mnt: filesystem full Mar 5 18:08:47 mercat1 kernel: pid 34658 (fragments), uid 2007 inumber 5621 on /mnt: filesystem full Mar 5 18:08:48 mercat1 kernel: pid 34661 (fragments), uid 2007 inumber 5602 on /mnt: filesystem full Mar 5 18:08:49 mercat1 kernel: pid 34660 (fragments), uid 2007 inumber 5664 on /mnt: filesystem full Mar 5 18:08:50 mercat1 kernel: pid 34660 (fragments), uid 2007 inumber 5595 on /mnt: filesystem full Mar 5 18:08:51 mercat1 kernel: pid 34655 (fragments), uid 2007 inumber 5673 on /mnt: filesystem full Mar 5 18:08:52 mercat1 kernel: pid 35910 (fragments), uid 2007 inumber 5603 on /mnt: filesystem full Mar 5 18:08:53 mercat1 kernel: pid 35906 (fragments), uid 2007 inumber 5586 on /mnt: filesystem full Mar 5 18:08:54 mercat1 kernel: pid 35909 (fragments), uid 2007 inumber 5603 on /mnt: filesystem full Mar 5 18:08:55 mercat1 kernel: pid 35910 (fragments), uid 2007 inumber 5628 on /mnt: filesystem full Mar 5 18:08:56 mercat1 kernel: pid 35906 (fragments), uid 2007 inumber 5629 on /mnt: filesystem full Mar 5 18:08:57 mercat1 kernel: pid 35911 (fragments), uid 2007 inumber 5585 on /mnt: filesystem full Mar 5 18:08:58 mercat1 kernel: pid 35909 (fragments), uid 2007 inumber 5607 on /mnt: filesystem full Mar 5 18:08:59 mercat1 kernel: pid 35904 (fragments), uid 2007 inumber 5585 on /mnt: filesystem full Mar 5 18:09:00 mercat1 kernel: pid 35908 (fragments), uid 2007 inumber 5613 on /mnt: filesystem full Mar 5 18:09:01 mercat1 kernel: pid 35908 (fragments), uid 2007 inumber 5630 on /mnt: filesystem full Mar 5 18:09:02 mercat1 kernel: pid 35909 (fragments), uid 2007 inumber 5678 on /mnt: filesystem full Mar 5 18:09:03 mercat1 kernel: pid 35910 (fragments), uid 2007 inumber 5640 on /mnt: filesystem full Mar 5 18:09:04 mercat1 kernel: pid 35910 (fragments), uid 2007 inumber 5588 on /mnt: filesystem full Mar 5 18:09:05 mercat1 kernel: pid 35909 (fragments), uid 2007 inumber 5585 on /mnt: filesystem full 20220305 18:09:06 all (56/197): chain.sh swap_pager: out of swap space swp_pager_getswapspace(3): failed Mar 5 18:16:01 mercat1 kernel: pid 38560 (chain), jid 0, uid 0, was killed: failed to reclaim memory 20220305 18:16:09 all (57/197): mmap40.sh Mar 5 18:16:51 mercat1 kernel: pid 42485 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page Mar 5 18:17:31 mercat1 kernel: pid 42512 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page Mar 5 18:18:05 mercat1 kernel: pid 42509 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20220305 18:24:47 all (58/197): mincore.sh 20220305 18:31:44 all (59/197): sem_post.sh Mar 5 18:32:28 mercat1 kernel: pid 25597 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page Mar 5 18:33:37 mercat1 kernel: pid 25592 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page Mar 5 18:34:20 mercat1 kernel: pid 25596 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20220305 18:39:31 all (60/197): crossmp4.sh interrupt total irq3: uart1 6507 irq4: uart0 5 irq9: acpi0 4 irq18: ehci0 ehci1+ 56435 irq19: xhci0 34884 cpu0:timer 26125605 cpu1:timer 20912140 cpu2:timer 20799496 cpu3:timer 21208481 cpu4:timer 20931990 cpu5:timer 20684685 cpu6:timer 20934963 cpu7:timer 21087640 cpu8:timer 20973083 cpu9:timer 20896511 cpu10:timer 21748710 cpu11:timer 20946186 irq56: ahci0 11519207 irq57: igb0:rxq0 16993 irq58: igb0:rxq1 365 irq59: igb0:rxq2 3801 irq60: igb0:rxq3 122 irq61: igb0:rxq4 17 irq62: igb0:rxq5 213 irq63: igb0:aq 2 irq73: mlx5_core0 147 irq74: mlx5_core0 1 irq88: mlx5_core1 147 irq89: mlx5_core1 1 Total 268888366 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe01cdb89380 hardclock() at hardclock+0x19d/frame 0xfffffe01cdb893c0 handleevents() at handleevents+0xb4/frame 0xfffffe01cdb89400 timercb() at timercb+0x196/frame 0xfffffe01cdb89450 lapic_handle_timer() at lapic_handle_timer+0xb6/frame 0xfffffe01cdb89470 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe01cdb89470 --- interrupt, rip = 0xffffffff80c5e142, rsp = 0xfffffe01cdb89540, rbp = 0xfffffe01cdb89550 --- lock_delay() at lock_delay+0x22/frame 0xfffffe01cdb89550 __mtx_lock_sleep() at __mtx_lock_sleep+0xf8/frame 0xfffffe01cdb895e0 __mtx_lock_flags() at __mtx_lock_flags+0xe5/frame 0xfffffe01cdb89630 vnlru_free_impl() at vnlru_free_impl+0xae/frame 0xfffffe01cdb896b0 vn_alloc_hard() at vn_alloc_hard+0xf9/frame 0xfffffe01cdb896e0 getnewvnode() at getnewvnode+0x2ae/frame 0xfffffe01cdb89720 ffs_vgetf() at ffs_vgetf+0x11b/frame 0xfffffe01cdb897a0 ufs_lookup_ino() at ufs_lookup_ino+0xbe7/frame 0xfffffe01cdb898b0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x5a/frame 0xfffffe01cdb898d0 vfs_cache_lookup() at vfs_cache_lookup+0xa6/frame 0xfffffe01cdb89920 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe01cdb89940 cache_fplookup_noentry() at cache_fplookup_noentry+0x23d/frame 0xfffffe01cdb899a0 cache_fplookup() at cache_fplookup+0x5d5/frame 0xfffffe01cdb89a90 namei() at namei+0x203/frame 0xfffffe01cdb89b50 vn_open_cred() at vn_open_cred+0x4b0/frame 0xfffffe01cdb89cb0 kern_openat() at kern_openat+0x286/frame 0xfffffe01cdb89e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01cdb89f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01cdb89f30 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x11a911c4b78a, rsp = 0x11a910af4f28, rbp = 0x11a910af5460 --- KDB: enter: watchdog timeout [ thread pid 99290 tid 714424 ] Stopped at kdb_enter+0x37: movq $0,0x127c7ce(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 4590 out of 32626 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 99290 tid 714424 td 0xfffffe014446a720 kdb_enter() at kdb_enter+0x37/frame 0xfffffe01cdb89380 hardclock() at hardclock+0x1b0/frame 0xfffffe01cdb893c0 handleevents() at handleevents+0xb4/frame 0xfffffe01cdb89400 timercb() at timercb+0x196/frame 0xfffffe01cdb89450 lapic_handle_timer() at lapic_handle_timer+0xb6/frame 0xfffffe01cdb89470 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe01cdb89470 --- interrupt, rip = 0xffffffff80c5e142, rsp = 0xfffffe01cdb89540, rbp = 0xfffffe01cdb89550 --- lock_delay() at lock_delay+0x22/frame 0xfffffe01cdb89550 __mtx_lock_sleep() at __mtx_lock_sleep+0xf8/frame 0xfffffe01cdb895e0 __mtx_lock_flags() at __mtx_lock_flags+0xe5/frame 0xfffffe01cdb89630 vnlru_free_impl() at vnlru_free_impl+0xae/frame 0xfffffe01cdb896b0 vn_alloc_hard() at vn_alloc_hard+0xf9/frame 0xfffffe01cdb896e0 getnewvnode() at getnewvnode+0x2ae/frame 0xfffffe01cdb89720 ffs_vgetf() at ffs_vgetf+0x11b/frame 0xfffffe01cdb897a0 ufs_lookup_ino() at ufs_lookup_ino+0xbe7/frame 0xfffffe01cdb898b0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x5a/frame 0xfffffe01cdb898d0 vfs_cache_lookup() at vfs_cache_lookup+0xa6/frame 0xfffffe01cdb89920 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe01cdb89940 cache_fplookup_noentry() at cache_fplookup_noentry+0x23d/frame 0xfffffe01cdb899a0 cache_fplookup() at cache_fplookup+0x5d5/frame 0xfffffe01cdb89a90 namei() at namei+0x203/frame 0xfffffe01cdb89b50 vn_open_cred() at vn_open_cred+0x4b0/frame 0xfffffe01cdb89cb0 kern_openat() at kern_openat+0x286/frame 0xfffffe01cdb89e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01cdb89f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01cdb89f30 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x11a911c4b78a, rsp = 0x11a910af4f28, rbp = 0x11a910af5460 --- db:1:pho1> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x7c9540 curthread = 0xfffffe017288e560: pid 16 tid 826450 critnest 0 "/mnt worker" curpcb = 0xfffffe017288ea70 fpcurthread = none idlethread = 0xfffffe00e4c603a0: tid 100003 "idle: cpu0" self = 0xffffffff82410000 curpmap = 0xffffffff81e8d3f8 tssp = 0xffffffff82410384 rsp0 = 0xfffffe0166242000 kcr3 = 0x800000000236c002 ucr3 = 0xffffffffffffffff scr3 = 0x46c7fc33 gs32p = 0xffffffff82410404 ldt = 0xffffffff82410444 tss = 0xffffffff82410434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bb286540 curthread = 0xfffffe01628bc900: pid 98923 tid 751446 critnest 0 "umount" curpcb = 0xfffffe01628bce10 fpcurthread = 0xfffffe01628bc900: pid 98923 "umount" idlethread = 0xfffffe00e4c5fc80: tid 100004 "idle: cpu1" self = 0xffffffff82411000 curpmap = 0xfffffe01769d2128 tssp = 0xffffffff82411384 rsp0 = 0xfffffe018c45e000 kcr3 = 0x8000000638440013 ucr3 = 0x8000000278eb0813 scr3 = 0x278eb0c7c gs32p = 0xffffffff82411404 ldt = 0xffffffff82411444 tss = 0xffffffff82411434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bb293540 curthread = 0xfffffe014446a720: pid 99290 tid 714424 critnest 1 "sed" curpcb = 0xfffffe014446ac30 fpcurthread = 0xfffffe014446a720: pid 99290 "sed" idlethread = 0xfffffe00e4c5f560: tid 100005 "idle: cpu2" self = 0xffffffff82412000 curpmap = 0xfffffe015aaaab20 tssp = 0xffffffff82412384 rsp0 = 0xfffffe01cdb8a000 kcr3 = 0x8000000385ac33e2 ucr3 = 0x800000071c471be2 scr3 = 0x380d42f8d gs32p = 0xffffffff82412404 ldt = 0xffffffff82412444 tss = 0xffffffff82412434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bb2a0540 curthread = 0xfffffe00e4c5ee40: pid 11 tid 100006 critnest 1 "idle: cpu3" curpcb = 0xfffffe00e4c5f350 fpcurthread = none idlethread = 0xfffffe00e4c5ee40: tid 100006 "idle: cpu3" self = 0xffffffff82413000 curpmap = 0xffffffff81e8d3f8 tssp = 0xffffffff82413384 rsp0 = 0xfffffe00377f6000 kcr3 = 0x800000000236c003 ucr3 = 0xffffffffffffffff scr3 = 0x45aeca14 gs32p = 0xffffffff82413404 ldt = 0xffffffff82413444 tss = 0xffffffff82413434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bb2ad540 curthread = 0xfffffe00e4c5e720: pid 11 tid 100007 critnest 1 "idle: cpu4" curpcb = 0xfffffe00e4c5ec30 fpcurthread = none idlethread = 0xfffffe00e4c5e720: tid 100007 "idle: cpu4" self = 0xffffffff82414000 curpmap = 0xffffffff81e8d3f8 tssp = 0xffffffff82414384 rsp0 = 0xfffffe00e4831000 kcr3 = 0x800000000236c008 ucr3 = 0xffffffffffffffff scr3 = 0x5cde519f7 gs32p = 0xffffffff82414404 ldt = 0xffffffff82414444 tss = 0xffffffff82414434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bb2ba540 curthread = 0xfffffe00e4c5e000: pid 11 tid 100008 critnest 1 "idle: cpu5" curpcb = 0xfffffe00e4c5e510 fpcurthread = none idlethread = 0xfffffe00e4c5e000: tid 100008 "idle: cpu5" self = 0xffffffff82415000 curpmap = 0xffffffff81e8d3f8 tssp = 0xffffffff82415384 rsp0 = 0xfffffe0037800000 kcr3 = 0x800000000236c003 ucr3 = 0xffffffffffffffff scr3 = 0x46c7f882 gs32p = 0xffffffff82415404 ldt = 0xffffffff82415444 tss = 0xffffffff82415434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bb2c7540 curthread = 0xfffffe0171c44e40: pid 99289 tid 734351 critnest 0 "sed" curpcb = 0xfffffe0171c45350 fpcurthread = 0xfffffe0171c44e40: pid 99289 "sed" idlethread = 0xfffffe00e4c66c80: tid 100009 "idle: cpu6" self = 0xffffffff82416000 curpmap = 0xfffffe015b020128 tssp = 0xffffffff82416384 rsp0 = 0xfffffe0172445000 kcr3 = 0x80000004cd1aa511 ucr3 = 0x800000027e892d11 scr3 = 0x2c8ec495c gs32p = 0xffffffff82416404 ldt = 0xffffffff82416444 tss = 0xffffffff82416434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bb2d4540 curthread = 0xfffffe0144026e40: pid 2754 tid 100288 critnest 0 "cron" curpcb = 0xfffffe0144027350 fpcurthread = 0xfffffe0144026e40: pid 2754 "cron" idlethread = 0xfffffe00e4c66560: tid 100010 "idle: cpu7" self = 0xffffffff82417000 curpmap = 0xfffffe010e64ab20 tssp = 0xffffffff82417384 rsp0 = 0xfffffe01438d9000 kcr3 = 0x80000005cdf7b3c3 ucr3 = 0x80000006210fabc3 scr3 = 0x65ef9780b gs32p = 0xffffffff82417404 ldt = 0xffffffff82417444 tss = 0xffffffff82417434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bb2e1540 curthread = 0xfffffe016fad5900: pid 99294 tid 735079 critnest 0 "dhclient" curpcb = 0xfffffe016fad5e10 fpcurthread = 0xfffffe016fad5900: pid 99294 "dhclient" idlethread = 0xfffffe00e4c65e40: tid 100011 "idle: cpu8" self = 0xffffffff82418000 curpmap = 0xfffffe01699f4518 tssp = 0xffffffff82418384 rsp0 = 0xfffffe0159f6d000 kcr3 = 0x80000004fe52907c ucr3 = 0x80000006aa12387c scr3 = 0x5cde51ccb gs32p = 0xffffffff82418404 ldt = 0xffffffff82418444 tss = 0xffffffff82418434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bb2ee540 curthread = 0xfffffe010e7fc020: pid 2705 tid 100228 critnest 0 "ntpd" curpcb = 0xfffffe010e7fc530 fpcurthread = 0xfffffe010e7fc020: pid 2705 "ntpd" idlethread = 0xfffffe00e4c65720: tid 100012 "idle: cpu9" self = 0xffffffff82419000 curpmap = 0xfffffe01442a2128 tssp = 0xffffffff82419384 rsp0 = 0xfffffe0141790000 kcr3 = 0x80000005cde5417e ucr3 = 0x80000005cde5197e scr3 = 0x5cde51da4 gs32p = 0xffffffff82419404 ldt = 0xffffffff82419444 tss = 0xffffffff82419434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bb2fb540 curthread = 0xfffffe00e4c65000: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffffe00e4c65510 fpcurthread = none idlethread = 0xfffffe00e4c65000: tid 100013 "idle: cpu10" self = 0xffffffff8241a000 curpmap = 0xffffffff81e8d3f8 tssp = 0xffffffff8241a384 rsp0 = 0xfffffe00e484f000 kcr3 = 0x800000000236c018 ucr3 = 0xffffffffffffffff scr3 = 0x6aa123be4 gs32p = 0xffffffff8241a404 ldt = 0xffffffff8241a444 tss = 0xffffffff8241a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bb308540 curthread = 0xfffffe00e4c62740: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffffe00e4c62c50 fpcurthread = none idlethread = 0xfffffe00e4c62740: tid 100014 "idle: cpu11" self = 0xffffffff8241b000 curpmap = 0xffffffff81e8d3f8 tssp = 0xffffffff8241b384 rsp0 = 0xfffffe00e484a000 kcr3 = 0x800000000236c002 ucr3 = 0xffffffffffffffff scr3 = 0x27e892e8e gs32p = 0xffffffff8241b404 ldt = 0xffffffff8241b444 tss = 0xffffffff8241b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 99294 (dhclient) thread 0xfffffe016fad5900 (735079) shared lockmgr ufs (ufs) r = 0 (0xfffffe010e6277e0) locked @ kern/vfs_cache.c:4912 Process 99293 (ls) thread 0xfffffe016f7a33a0 (734969) shared lockmgr ufs (ufs) r = 0 (0xfffffe010e623330) locked @ kern/vfs_lookup.c:900 Process 99290 (sed) thread 0xfffffe014446a720 (714424) shared lockmgr ufs (ufs) r = 0 (0xfffffe01570fdc90) locked @ kern/vfs_cache.c:4912 Process 99289 (sed) thread 0xfffffe0171c44e40 (734351) shared lockmgr ufs (ufs) r = 0 (0xfffffe01570fdc90) locked @ kern/vfs_cache.c:4912 Process 98923 (umount) thread 0xfffffe01628bc900 (751446) exclusive lockmgr ufs (ufs) r = 0 (0xfffffe0144125588) locked @ kern/vfs_mount.c:2122 Process 2754 (cron) thread 0xfffffe0144026e40 (100288) exclusive sleep mutex vdbatch (vdbatch) r = 0 (0xfffffe003ce71640) locked @ kern/vfs_subr.c:3499 exclusive sleep mutex vnode interlock (vnode interlock) r = 0 (0xfffffe01686dc648) locked @ kern/vfs_subr.c:3597 shared lockmgr ufs (ufs) r = 0 (0xfffffe0144355c90) locked @ kern/vfs_cache.c:4912 Process 2705 (ntpd) thread 0xfffffe010e7fc020 (100228) shared lockmgr ufs (ufs) r = 0 (0xfffffe010e7c40d8) locked @ kern/vfs_cache.c:4912 Process 16 (bufdaemon) thread 0xfffffe017288e560 (826450) exclusive sleep mutex vdbatch (vdbatch) r = 0 (0xffffffff82366640) locked @ kern/vfs_subr.c:3499 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffffe010e6232c0: type VDIR usecount 33, writecount 0, refcount 4 seqc users 0 mountedhere 0 hold count flags () flags (VV_ROOT|VMP_LAZYLIST) v_object 0xfffff80004088d68 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80bdd4ef at lockmgr_lock_flags+0x1cf #1 0xffffffff80f5eb2d at ffs_lock+0x9d #2 0xffffffff811c271c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d18c84 at _vn_lock+0x54 #4 0xffffffff80cf0c45 at lookup+0xc5 #5 0xffffffff80cefed8 at namei+0x3f8 #6 0xffffffff80d1108e at kern_statat+0x12e #7 0xffffffff80d1178f at sys_fstatat+0x2f #8 0xffffffff810f6435 at amd64_syscall+0x145 #9 0xffffffff810c6f6b at fast_syscall_common+0xf8 nlink=111, effnlink=111, size=2048, extsize 0 generation=8b36ec76, uid=0, gid=0, flags=0x0 ino 2, on dev gpt/work vnode 0xfffffe010e627770: type VDIR usecount 8, writecount 0, refcount 4 seqc users 0 mountedhere 0 hold count flags () flags () v_object 0xfffff80004088b58 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80bdd4ef at lockmgr_lock_flags+0x1cf #1 0xffffffff80f5eb2d at ffs_lock+0x9d #2 0xffffffff811c271c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d18c84 at _vn_lock+0x54 #4 0xffffffff80ce6314 at cache_fplookup_noentry+0x1e4 #5 0xffffffff80ce23f5 at cache_fplookup+0x5d5 #6 0xffffffff80cefce3 at namei+0x203 #7 0xffffffff80bbd5d0 at kern_execve+0x2c0 #8 0xffffffff80bbcfaa at sys_execve+0x5a #9 0xffffffff810f6435 at amd64_syscall+0x145 #10 0xffffffff810c6f6b at fast_syscall_common+0xf8 nlink=2, effnlink=2, size=3584, extsize 0 generation=9673dd38, uid=0, gid=0, flags=0x0 ino 89806464, on dev gpt/work vnode 0xfffffe010e7c4068: type VDIR usecount 1, writecount 0, refcount 4 seqc users 0 mountedhere 0 hold count flags () flags (VMP_LAZYLIST) v_object 0xfffff80003c8f630 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80bdd4ef at lockmgr_lock_flags+0x1cf #1 0xffffffff80f5eb2d at ffs_lock+0x9d #2 0xffffffff811c271c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d18c84 at _vn_lock+0x54 #4 0xffffffff80ce6314 at cache_fplookup_noentry+0x1e4 #5 0xffffffff80ce23f5 at cache_fplookup+0x5d5 #6 0xffffffff80cefce3 at namei+0x203 #7 0xffffffff80d1108e at kern_statat+0x12e #8 0xffffffff80d1178f at sys_fstatat+0x2f #9 0xffffffff810f6435 at amd64_syscall+0x145 #10 0xffffffff810c6f6b at fast_syscall_common+0xf8 nlink=11, effnlink=11, size=512, extsize 0 generation=6b524888, uid=0, gid=0, flags=0x0 ino 90528798, on dev gpt/work vnode 0xfffffe0144125518: type VDIR usecount 2, writecount 0, refcount 2 seqc users 1 mountedhere 0xfffffe010e0c3000 hold count flags () flags (VIRF_MOUNTPOINT) v_object 0xfffff80046750630 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe01628bc900 (pid 98923, umount, tid 751446) with shared waiters pending #0 0xffffffff80bdd4ef at lockmgr_lock_flags+0x1cf #1 0xffffffff80f5eb2d at ffs_lock+0x9d #2 0xffffffff811c271c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d18c84 at _vn_lock+0x54 #4 0xffffffff80cf5bc9 at dounmount+0x4a9 #5 0xffffffff80cf56d7 at kern_unmount+0x2d7 #6 0xffffffff810f6435 at amd64_syscall+0x145 #7 0xffffffff810c6f6b at fast_syscall_common+0xf8 nlink=2, effnlink=2, size=1024, extsize 0 generation=9ceb0e07, uid=0, gid=0, flags=0x0 ino 21027072, on dev gpt/work vnode 0xfffffe0144355c20: type VDIR usecount 2, writecount 0, refcount 3 seqc users 0 mountedhere 0 hold count flags () flags () v_object 0xfffff8002d58c840 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80bdd4ef at lockmgr_lock_flags+0x1cf #1 0xffffffff80f5eb2d at ffs_lock+0x9d #2 0xffffffff811c271c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d18c84 at _vn_lock+0x54 #4 0xffffffff80ce6314 at cache_fplookup_noentry+0x1e4 #5 0xffffffff80ce23f5 at cache_fplookup+0x5d5 #6 0xffffffff80cefce3 at namei+0x203 #7 0xffffffff80d1108e at kern_statat+0x12e #8 0xffffffff80d1178f at sys_fstatat+0x2f #9 0xffffffff810f6435 at amd64_syscall+0x145 #10 0xffffffff810c6f6b at fast_syscall_common+0xf8 nlink=3, effnlink=3, size=512, extsize 0 generation=2401e3ad, uid=0, gid=0, flags=0x0 ino 90528821, on dev gpt/work vnode 0xfffffe01570fdc20: type VDIR usecount 2, writecount 0, refcount 4 seqc users 0 mountedhere 0 hold count flags () flags () v_object 0xfffff8057b99c210 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 2) #0 0xffffffff80bdd4ef at lockmgr_lock_flags+0x1cf #1 0xffffffff80f5eb2d at ffs_lock+0x9d #2 0xffffffff811c271c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d18c84 at _vn_lock+0x54 #4 0xffffffff80ce6314 at cache_fplookup_noentry+0x1e4 #5 0xffffffff80ce23f5 at cache_fplookup+0x5d5 #6 0xffffffff80cefce3 at namei+0x203 #7 0xffffffff80d183e0 at vn_open_cred+0x4b0 #8 0xffffffff80d0ed96 at kern_openat+0x286 #9 0xffffffff810f6435 at amd64_syscall+0x145 #10 0xffffffff810c6f6b at fast_syscall_common+0xf8 nlink=2, effnlink=2, size=512, extsize 0 generation=af4fa88d, uid=0, gid=0, flags=0x0 ino 19100944, on dev gpt/work db:1:pho1> show mount 0xfffffe010e0c4700 /dev/gpt/work on / (ufs) 0xfffffe010e0c5280 devfs on /dev (devfs) 0xfffffe014357d280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe010e0c3000 /dev/md10a on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 87190 Buf domain 0 freebufs 7944 lofreebufs 219 hifreebufs 329 bufspace 235438080 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7150 (234205184) dirtyq count 0 (0) wakeup 0 lim 25 CPU 4, 1, 6, 1, 1, 1, 3, 5, 4, 2, 7, 4, Locked buffers: 0 space 0 Total buffers: 21864 space 235438080 Buf domain 1 freebufs 13384 lofreebufs 219 hifreebufs 329 bufspace 56483840 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1735 (56135680) dirtyq count 0 (0) wakeup 0 lim 25 CPU 7, 3, 0, 0, 0, 0, 0, 1, 0, 0, 2, 1, Locked buffers: 0 space 0 Total buffers: 5885 space 56483840 Buf domain 2 freebufs 15127 lofreebufs 219 hifreebufs 329 bufspace 40960 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1 (4096) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 1, 0, 0, 0, 1, 1, 0, 0, 0, 1, 0, Locked buffers: 0 space 0 Total buffers: 9652 space 40960 Buf domain 3 freebufs 14471 lofreebufs 219 hifreebufs 329 bufspace 21495808 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 583 (19103744) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 22, 0, 1, 13, 12, 4, 10, 4, 3, 7, 2, Locked buffers: 0 space 0 Total buffers: 19195 space 21495808 Buf domain 4 freebufs 15127 lofreebufs 219 hifreebufs 329 bufspace 45056 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1 (4096) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 0, 1, 1, 0, 0, 0, 1, 0, 1, 1, 0, Locked buffers: 0 space 0 Total buffers: 14243 space 45056 Buf domain 5 freebufs 14681 lofreebufs 219 hifreebufs 329 bufspace 11735040 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 431 (11218944) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 13, 0, 0, 2, 0, 1, 2, 0, 2, 0, 0, Locked buffers: 0 space 0 Total buffers: 13127 space 11735040 Buf domain 6 freebufs 15069 lofreebufs 219 hifreebufs 329 bufspace 1101824 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 32 (274432) dirtyq count 0 (0) wakeup 0 lim 25 CPU 3, 2, 0, 8, 0, 8, 1, 3, 0, 0, 7, 0, Locked buffers: 0 space 0 Total buffers: 21965 space 1101824 db:1:pho1> show lockedbufs db:1:pho1> show page vm_cnt.v_free_count: 256557 vm_cnt.v_inactive_count: 2255674 vm_cnt.v_active_count: 3805038 vm_cnt.v_laundry_count: 803568 vm_cnt.v_wire_count: 1002332 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51265 vm_cnt.v_free_target: 173128 vm_cnt.v_inactive_target: 259692 db:1:pho1> show pageq pq_free 256557 dom 0 page_cnt 8124374 free 256557 pq_act 3805038 pq_inact 2255674 pq_laund 803568 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 002216 | 000000 03 (000032K) | 008946 | 000000 02 (000016K) | 017491 | 000001 01 (000008K) | 016891 | 000024 00 (000004K) | 039455 | 000962 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000004 | 000000 02 (000016K) | 000004 | 000000 01 (000008K) | 000008 | 000000 00 (000004K) | 000028 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree FFS inode 1160 619499 393 113914379 0 24 719074720 0 malloc-384 384 1072850 93110 127338631 0 30 447728640 0 VNODE 600 619521 1099 165197674 0 43 372372000 0 malloc-256 256 1104787 93998 393933639 0 62 306888960 0 VM OBJECT 264 509361 112839 175496235 0 31 164260800 0 FFS2 dinode 256 619492 638 113708029 0 62 158753280 0 swblk 136 212479 850284 7778192 0 62 144535768 0 malloc-4096 4096 34135 0 255616 0 2 139816960 0 malloc-128 128 639330 125254 343189227 0 126 97866752 0 RADIX NODE 144 502007 30494 159619949 0 62 76680144 0 THREAD 1808 27851 4489 16579441 0 8 58470720 0 PROC 1352 68 27598 4971667 0 8 37404432 0 mbuf_cluster 2048 13841 13 144419 0 8 28372992 0 FPU_save_area 832 27853 227 16717797 0 16 23362560 0 BUF TRIE 144 1229 104723 48986449 0 63 15257088 0 vmem btag 56 187279 6101 5225242 0 254 10829280 0 malloc-384 384 27671 89 9765461 0 30 10659840 0 swpctrie 144 18549 52571 536396 0 62 10241280 0 malloc-128 128 65901 1803 9433897 0 126 8666112 0 S VFS Cache 104 6188 56329 83878030 0 126 6501768 0 mbuf 256 16546 4469 110971918 0 254 5379840 0 UMA Slabs 0 112 43908 2274 2100469 0 126 5172384 0 malloc-256 256 1737 17733 72711427 0 62 4984320 0 TURNSTILE 136 32341 419 32341 0 62 4455360 0 malloc-128 128 15152 19289 36800656 0 126 4408448 0 ksiginfo 112 27767 1537 356700 0 126 3282048 0 VMSPACE 2552 46 1160 4892847 0 4 3077712 0 SLEEPQUEUE 88 32341 363 32341 0 126 2877952 0 malloc-64 64 1 41075 1563279790 0 254 2628864 0 malloc-256 256 90 9330 51291175 0 62 2411520 0 malloc-128 128 14470 1526 2177274401 0 126 2047488 0 pbuf 2776 0 703 0 0 0 1951528 0 64 Bucket 512 1811 1933 22364344 0 30 1916928 0 malloc-128 128 13076 161 16135317 0 126 1694336 0 malloc-32768 32768 10 39 145402 0 1 1605632 0 malloc-4096 4096 334 0 579481 0 2 1368064 0 32 Bucket 256 2405 2725 19433873 0 62 1313280 0 malloc-256 256 13 4547 23429930 0 62 1167360 0 128 Bucket 1024 386 729 19942673 0 16 1141760 0 TMPFS node 224 0 5058 690358 0 62 1132992 0 malloc-65536 65536 5 12 4658 0 1 1114112 0 malloc-32768 32768 1 31 87495 0 1 1048576 0 256 Bucket 2048 412 88 20651084 0 8 1024000 0 MAP ENTRY 96 1884 8658 269605631 0 126 1012032 0 malloc-4096 4096 70 146 5118593 0 2 884736 0 malloc-8192 8192 106 0 162 0 1 868352 0 g_bio 408 0 2010 301469403 0 52 820080 0 malloc-64 64 9215 3322 9553732 0 254 802368 0 malloc-64 64 9305 3106 1122515849 0 254 794304 0 Files 80 139 8411 1441052593 0 126 684000 0 malloc-1024 1024 302 194 73442357 0 16 507904 0 UMA Zones 2048 237 7 563 0 8 499712 0 filedesc0 1072 69 330 4971668 0 8 427728 0 malloc-32768 32768 13 0 17 0 1 425984 0 DIRHASH 1024 124 276 2929325 0 16 409600 0 malloc-32768 32768 12 0 118942 0 1 393216 0 mbuf_packet 256 0 1530 19762107 0 254 391680 0 lkpimm 168 4 2324 4 0 62 391104 0 lkpicurr 168 15 2313 15 0 62 391104 0 malloc-1024 1024 148 224 1333401 0 16 380928 0 L VFS Cache 320 532 656 94800 0 30 380160 0 malloc-64 64 4420 494 22597 0 254 314496 0 malloc-32 32 8310 1014 44568 0 254 298368 0 malloc-16384 16384 17 1 1734025 0 1 294912 0 malloc-16 16 16250 1750 140059 0 254 288000 0 ttyoutq 256 637 473 18959155 0 62 284160 0 ttyinq 160 1200 550 35552786 0 62 280000 0 malloc-64 64 409 3434 12204150 0 254 245952 0 malloc-8192 8192 30 0 196935 0 1 245760 0 malloc-512 512 111 353 3382914 0 30 237568 0 malloc-256 256 27 843 109212403 0 62 222720 0 NAMEI 1024 6 210 2516720080 0 16 221184 0 16 Bucket 144 213 1299 19385473 0 62 217728 0 malloc-2048 2048 8 96 11270 0 8 212992 0 malloc-1024 1024 78 130 2411145 0 16 212992 0 pipe 744 10 270 886558 0 16 208320 0 malloc-256 256 48 747 2106355 0 62 203520 0 tcp_inpcb 424 11 466 830 0 30 202248 0 malloc-2048 2048 94 4 21947429 0 8 200704 0 Mountpoints 2944 4 64 5323 0 4 200192 0 malloc-64 64 20 3067 3387176 0 254 197568 0 malloc-65536 65536 3 0 12 0 1 196608 0 rl_entry 40 1881 2866 1901 0 254 189880 0 8 Bucket 80 241 1859 27574334 0 126 168000 0 4 Bucket 48 55 3221 2589269 0 254 157248 0 PWD 32 17 4645 62691013 0 254 149184 0 2 Bucket 32 248 4162 11707100 0 254 141120 0 clpbuf 2776 0 49 2271942 0 2 136024 0 ada_ccb 272 0 490 11529815 0 30 133280 0 malloc-65536 65536 2 0 2 0 1 131072 0 malloc-65536 65536 2 0 7519 0 1 131072 0 malloc-65536 65536 2 0 509717 0 1 131072 0 malloc-256 256 51 459 7656971 0 62 130560 0 socket 960 52 80 8753 0 16 126720 0 malloc-384 384 24 306 40829 0 30 126720 0 PGRP 88 32 1394 423 0 126 125488 0 udp_inpcb 424 22 266 1188 0 30 122112 0 malloc-32 32 555 3099 1415847 0 254 116928 0 malloc-128 128 517 382 123956 0 126 115072 0 malloc-16384 16384 7 0 29 0 1 114688 0 DEVCTL 1024 0 104 606824 0 0 106496 0 tcp_inpcb ports 32 6 3270 531 0 254 104832 0 malloc-32 32 14 3136 9899723 0 254 100800 0 swrbuf 2776 0 36 2309745 0 2 99936 0 malloc-8192 8192 12 0 20897582 0 1 98304 0 malloc-64 64 219 1293 12772767 0 254 96768 0 malloc-4096 4096 23 0 102 0 2 94208 0 malloc-16 16 875 4625 13580557 0 254 88000 0 malloc-32 32 122 2524 65125 0 254 84672 0 malloc-1024 1024 15 65 10659 0 16 81920 0 UMA Kegs 384 207 6 533 0 30 81792 0 udp_inpcb ports 32 10 2258 109 0 254 72576 0 malloc-32 32 705 1563 100456 0 254 72576 0 fakepg 104 0 663 430 0 126 68952 0 swwbuf 2776 0 24 3979582 0 1 66624 0 malloc-65536 65536 1 0 1 0 1 65536 0 malloc-65536 65536 1 0 1 0 1 65536 0 malloc-4096 4096 16 0 146171 0 2 65536 0 malloc-384 384 12 158 16604223 0 30 65280 0 malloc-2048 2048 26 4 200184 0 8 61440 0 malloc-384 384 113 37 53131 0 30 57600 0 malloc-128 128 122 312 29101891 0 126 55552 0 tcpcb 1104 11 38 830 0 8 54096 0 malloc-2048 2048 18 8 45 0 8 53248 0 malloc-32 32 599 1039 331797 0 254 52416 0 malloc-16 16 1 3249 2446758 0 254 52000 0 pcpu-64 64 466 302 494 0 254 49152 0 malloc-384 384 82 38 282 0 30 46080 0 udpcb 32 22 1364 1188 0 254 44352 0 malloc-16 16 527 2223 5552921 0 254 44000 0 malloc-128 128 45 296 313 0 126 43648 0 malloc-8192 8192 5 0 25 0 1 40960 0 pcpu-8 8 3550 1570 6056 0 254 40960 0 malloc-16 16 7 2493 5118725 0 254 40000 0 malloc-16 16 258 2242 664 0 254 40000 0 cpuset 104 27 345 27 0 126 38688 0 malloc-512 512 29 43 698926 0 30 36864 0 malloc-32768 32768 1 0 2 0 1 32768 0 malloc-32768 32768 1 0 1 0 1 32768 0 malloc-16384 16384 2 0 2 0 1 32768 0 malloc-8192 8192 4 0 4913 0 1 32768 0 malloc-8192 8192 4 0 4912 0 1 32768 0 rtentry 176 12 172 16 0 62 32384 0 malloc-64 64 28 476 503646 0 254 32256 0 malloc-32 32 255 753 11159061 0 254 32256 0 malloc-16 16 54 1946 23126596 0 254 32000 0 unpcb 256 16 104 6644 0 62 30720 0 malloc-4096 4096 7 0 12610657 0 2 28672 0 malloc-4096 4096 7 0 7 0 2 28672 0 malloc-1024 1024 14 14 4304 0 16 28672 0 pcpu-16 16 68 1724 68 0 254 28672 0 malloc-32 32 23 859 40 0 254 28224 0 routing nhops 256 9 96 16 0 62 26880 0 ertt 72 11 325 830 0 126 24192 0 malloc-384 384 30 30 559 0 30 23040 0 malloc-256 256 16 74 8702390 0 62 23040 0 malloc-512 512 14 26 80 0 30 20480 0 smrs 8 0 2465 20000001 0 254 19720 0 AIOCB 552 0 35 48 0 16 19320 0 AIOLIO 272 0 70 12 0 30 19040 0 SMR CPU 32 46 497 46 0 254 17376 0 malloc-16384 16384 1 0 1 0 1 16384 0 malloc-16384 16384 1 0 147162 0 1 16384 0 hostcache 64 0 252 4 0 254 16128 0 STS VFS Cache 144 0 112 4 0 62 16128 0 malloc-16 16 23 977 30807 0 254 16000 0 AIO 208 0 76 3 0 62 15808 0 SMR SHARED 24 46 497 46 0 254 13032 0 AIOP 32 4 374 4 0 254 12096 0 malloc-1024 1024 2 6 3491 0 16 8192 0 malloc-512 512 6 10 189 0 30 8192 0 KMAP ENTRY 96 48 33 226 0 0 7776 0 kenv 258 18 12 21836 0 30 7740 0 ripcb 424 1 17 3 0 30 7632 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 malloc-4096 4096 1 0 354 0 2 4096 0 malloc-2048 2048 1 1 5 0 8 4096 0 malloc-2048 2048 2 0 2423010 0 8 4096 0 malloc-2048 2048 2 0 14928789 0 8 4096 0 malloc-1024 1024 1 3 97406 0 16 4096 0 malloc-1024 1024 2 2 5375633 0 16 4096 0 malloc-512 512 1 7 2681 0 30 4096 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 UMA Slabs 1 176 9 13 16 0 62 3872 0 malloc-384 384 1 9 41 0 30 3840 0 mqnode 416 3 6 3 0 30 3744 0 vmem 1856 1 1 1 0 8 3712 0 mqnotifier 216 0 0 0 0 62 0 0 mvdata 64 0 0 0 0 254 0 0 mqueue 248 0 0 0 0 62 0 0 FFS1 dinode 128 0 0 0 0 126 0 0 da_ccb 544 0 0 0 0 16 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 syncache 168 0 0 286 0 62 0 0 tcptw 72 0 0 16 0 126 0 0 ipq 56 0 0 0 0 254 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 30 0 0 tcpreass 48 0 0 0 0 254 0 0 ripcb ports 32 0 0 0 0 254 0 0 udplite_inpcb ports 32 0 0 0 0 254 0 0 udplite_inpcb 424 0 0 0 0 30 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 KNOTE 160 0 0 403819 0 62 0 0 itimer 352 0 0 0 0 30 0 0 NCLNODE 760 0 0 8 0 16 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 cryptop 280 0 0 22525626 0 30 0 0 linux_dma_object 32 0 0 0 0 254 0 0 linux_dma_pctrie 144 0 0 0 0 62 0 0 IOMMU_MAP_ENTRY 120 0 0 0 0 126 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 13579823 0 2 0 0 audit_record 1280 0 0 3 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 2776 0 0 11058 0 4 0 0 mdpbuf 2776 0 0 10505 0 1 0 0 nfspbuf 2776 0 0 0 0 2 0 0 ertt_txseginfo 40 0 0 9973559 0 254 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-8192 8192 0 0 0 0 1 0 0 malloc-8192 8192 0 0 0 0 1 0 0 malloc-2048 2048 0 0 1 0 8 0 0 malloc-512 512 0 0 67321 0 30 0 0 malloc-512 512 0 0 0 0 30 0 0 malloc-512 512 0 0 1 0 30 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 vm pgcache 4096 400482 3190 216022695 31 vm pgcache 4096 5431616 3541 1116392258 64 buf free cache 848 10128 8613 90509030 24 buffer arena-65 65536 0 0 76 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 2215 809 21778924 5 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 -3 0 27414646 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 kstack_cache 16384 27851 0 16579441 1 db:0:pho> acttrace Tracing command idle pid 11 tid 100006 td 0xfffffe00e4c5ee40 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3ae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ae10 trap() at trap+0x56/frame 0xfffffe003ce3af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3af20 --- trap 0x13, rip = 0xffffffff810b03e6, rsp = 0xfffffe00377f5dd0, rbp = 0xfffffe00377f5dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377f5dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377f5e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377f5e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377f5e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377f5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00e4c5e720 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce47e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce47e10 trap() at trap+0x56/frame 0xfffffe003ce47f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce47f20 --- trap 0x13, rip = 0xffffffff810b03e6, rsp = 0xfffffe00e4830dd0, rbp = 0xfffffe00e4830dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4830dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4830e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4830e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4830e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4830ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4830f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4830f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe00e4c5e000 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce54e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce54e10 trap() at trap+0x56/frame 0xfffffe003ce54f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce54f20 --- trap 0x13, rip = 0xffffffff810b03e6, rsp = 0xfffffe00377ffdd0, rbp = 0xfffffe00377ffdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377ffdd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377ffe10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377ffe30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377ffe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00e4c65000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce95e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce95e10 trap() at trap+0x56/frame 0xfffffe003ce95f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce95f20 --- trap 0x13, rip = 0xffffffff810b03e6, rsp = 0xfffffe00e484edd0, rbp = 0xfffffe00e484edd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e484edd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e484ee10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e484ee30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e484ee50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e484eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e484ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e484ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00e4c62740 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea2e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea2e10 trap() at trap+0x56/frame 0xfffffe003cea2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea2f20 --- trap 0x13, rip = 0xffffffff810b03e6, rsp = 0xfffffe00e4849dd0, rbp = 0xfffffe00e4849dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4849dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4849e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4849e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4849e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4849ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4849f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4849f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 826450 td 0xfffffe017288e560 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81feb990 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81feb9a0 trap() at trap+0x56/frame 0xffffffff81febab0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81febab0 --- trap 0x13, rip = 0xffffffff80c5e140, rsp = 0xfffffe0166241a90, rbp = 0xfffffe0166241aa0 --- lock_delay() at lock_delay+0x20/frame 0xfffffe0166241aa0 __mtx_lock_sleep() at __mtx_lock_sleep+0xf8/frame 0xfffffe0166241b30 __mtx_lock_flags() at __mtx_lock_flags+0xe5/frame 0xfffffe0166241b80 vdbatch_process() at vdbatch_process+0x64/frame 0xfffffe0166241bb0 vdropl() at vdropl+0x2ba/frame 0xfffffe0166241bf0 vnlru_free_impl() at vnlru_free_impl+0x92/frame 0xfffffe0166241c70 vn_alloc_hard() at vn_alloc_hard+0xf9/frame 0xfffffe0166241ca0 getnewvnode() at getnewvnode+0x2ae/frame 0xfffffe0166241ce0 ffs_vgetf() at ffs_vgetf+0x11b/frame 0xfffffe0166241d60 handle_workitem_remove() at handle_workitem_remove+0x50/frame 0xfffffe0166241de0 process_worklist_item() at process_worklist_item+0x2bd/frame 0xfffffe0166241e70 softdep_process_worklist() at softdep_process_worklist+0xb7/frame 0xfffffe0166241eb0 softdep_flush() at softdep_flush+0x10f/frame 0xfffffe0166241ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0166241f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0166241f30 --- trap 0xc, rip = 0x8220b576a, rsp = 0x826c4af38, rbp = 0x826c4af60 --- Tracing command umount pid 98923 tid 751446 td 0xfffffe01628bc900 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e10 trap() at trap+0x56/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0xffffffff80bea3a8, rsp = 0xfffffe018c45d6f0, rbp = 0xfffffe018c45d770 --- __mtx_lock_sleep() at __mtx_lock_sleep+0xc8/frame 0xfffffe018c45d770 __mtx_lock_flags() at __mtx_lock_flags+0xe5/frame 0xfffffe018c45d7c0 vnlru_free_impl() at vnlru_free_impl+0xae/frame 0xfffffe018c45d840 vn_alloc_hard() at vn_alloc_hard+0xf9/frame 0xfffffe018c45d870 getnewvnode() at getnewvnode+0x2ae/frame 0xfffffe018c45d8b0 ffs_vgetf() at ffs_vgetf+0x11b/frame 0xfffffe018c45d930 handle_workitem_remove() at handle_workitem_remove+0x50/frame 0xfffffe018c45d9b0 process_worklist_item() at process_worklist_item+0x2bd/frame 0xfffffe018c45da40 softdep_process_worklist() at softdep_process_worklist+0xb7/frame 0xfffffe018c45da80 softdep_flushworklist() at softdep_flushworklist+0x3d/frame 0xfffffe018c45dae0 ffs_sync() at ffs_sync+0x3b7/frame 0xfffffe018c45db80 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe018c45dbd0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe018c45dc00 ffs_unmount() at ffs_unmount+0x398/frame 0xfffffe018c45dc80 dounmount() at dounmount+0x7ea/frame 0xfffffe018c45dcf0 kern_unmount() at kern_unmount+0x2d7/frame 0xfffffe018c45de00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe018c45df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe018c45df30 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0xb192328b7ca, rsp = 0xb192242f238, rbp = 0xb192242f770 --- Tracing command sed pid 99289 tid 734351 td 0xfffffe0171c44e40 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce61e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce61e10 trap() at trap+0x56/frame 0xfffffe003ce61f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce61f20 --- trap 0x13, rip = 0xffffffff80c5e140, rsp = 0xfffffe0172444540, rbp = 0xfffffe0172444550 --- lock_delay() at lock_delay+0x20/frame 0xfffffe0172444550 __mtx_lock_sleep() at __mtx_lock_sleep+0xf8/frame 0xfffffe01724445e0 __mtx_lock_flags() at __mtx_lock_flags+0xe5/frame 0xfffffe0172444630 vnlru_free_impl() at vnlru_free_impl+0xae/frame 0xfffffe01724446b0 vn_alloc_hard() at vn_alloc_hard+0xf9/frame 0xfffffe01724446e0 getnewvnode() at getnewvnode+0x2ae/frame 0xfffffe0172444720 ffs_vgetf() at ffs_vgetf+0x11b/frame 0xfffffe01724447a0 ufs_lookup_ino() at ufs_lookup_ino+0xbe7/frame 0xfffffe01724448b0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x5a/frame 0xfffffe01724448d0 vfs_cache_lookup() at vfs_cache_lookup+0xa6/frame 0xfffffe0172444920 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe0172444940 cache_fplookup_noentry() at cache_fplookup_noentry+0x23d/frame 0xfffffe01724449a0 cache_fplookup() at cache_fplookup+0x5d5/frame 0xfffffe0172444a90 namei() at namei+0x203/frame 0xfffffe0172444b50 vn_open_cred() at vn_open_cred+0x4b0/frame 0xfffffe0172444cb0 kern_openat() at kern_openat+0x286/frame 0xfffffe0172444e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0172444f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0172444f30 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x21f3d7fb378a, rsp = 0x21f3d6918e18, rbp = 0x21f3d6919350 --- Tracing command sed pid 99290 tid 714424 td 0xfffffe014446a720 (CPU 2) kdb_enter() at kdb_enter+0x37/frame 0xfffffe01cdb89380 hardclock() at hardclock+0x1b0/frame 0xfffffe01cdb893c0 handleevents() at handleevents+0xb4/frame 0xfffffe01cdb89400 timercb() at timercb+0x196/frame 0xfffffe01cdb89450 lapic_handle_timer() at lapic_handle_timer+0xb6/frame 0xfffffe01cdb89470 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe01cdb89470 --- interrupt, rip = 0xffffffff80c5e142, rsp = 0xfffffe01cdb89540, rbp = 0xfffffe01cdb89550 --- lock_delay() at lock_delay+0x22/frame 0xfffffe01cdb89550 __mtx_lock_sleep() at __mtx_lock_sleep+0xf8/frame 0xfffffe01cdb895e0 __mtx_lock_flags() at __mtx_lock_flags+0xe5/frame 0xfffffe01cdb89630 vnlru_free_impl() at vnlru_free_impl+0xae/frame 0xfffffe01cdb896b0 vn_alloc_hard() at vn_alloc_hard+0xf9/frame 0xfffffe01cdb896e0 getnewvnode() at getnewvnode+0x2ae/frame 0xfffffe01cdb89720 ffs_vgetf() at ffs_vgetf+0x11b/frame 0xfffffe01cdb897a0 ufs_lookup_ino() at ufs_lookup_ino+0xbe7/frame 0xfffffe01cdb898b0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x5a/frame 0xfffffe01cdb898d0 vfs_cache_lookup() at vfs_cache_lookup+0xa6/frame 0xfffffe01cdb89920 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe01cdb89940 cache_fplookup_noentry() at cache_fplookup_noentry+0x23d/frame 0xfffffe01cdb899a0 cache_fplookup() at cache_fplookup+0x5d5/frame 0xfffffe01cdb89a90 namei() at namei+0x203/frame 0xfffffe01cdb89b50 vn_open_cred() at vn_open_cred+0x4b0/frame 0xfffffe01cdb89cb0 kern_openat() at kern_openat+0x286/frame 0xfffffe01cdb89e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01cdb89f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01cdb89f30 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x11a911c4b78a, rsp = 0x11a910af4f28, rbp = 0x11a910af5460 --- Tracing command dhclient pid 99294 tid 735079 td 0xfffffe016fad5900 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7be00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7be10 trap() at trap+0x56/frame 0xfffffe003ce7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7bf20 --- trap 0x13, rip = 0xffffffff80c5e142, rsp = 0xfffffe0159f6c3f0, rbp = 0xfffffe0159f6c400 --- lock_delay() at lock_delay+0x22/frame 0xfffffe0159f6c400 __mtx_lock_sleep() at __mtx_lock_sleep+0xf8/frame 0xfffffe0159f6c490 __mtx_lock_flags() at __mtx_lock_flags+0xe5/frame 0xfffffe0159f6c4e0 vnlru_free_impl() at vnlru_free_impl+0xae/frame 0xfffffe0159f6c560 vn_alloc_hard() at vn_alloc_hard+0xf9/frame 0xfffffe0159f6c590 getnewvnode() at getnewvnode+0x2ae/frame 0xfffffe0159f6c5d0 ffs_vgetf() at ffs_vgetf+0x11b/frame 0xfffffe0159f6c650 ufs_lookup_ino() at ufs_lookup_ino+0xbe7/frame 0xfffffe0159f6c760 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x5a/frame 0xfffffe0159f6c780 vfs_cache_lookup() at vfs_cache_lookup+0xa6/frame 0xfffffe0159f6c7d0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe0159f6c7f0 cache_fplookup_noentry() at cache_fplookup_noentry+0x23d/frame 0xfffffe0159f6c850 cache_fplookup() at cache_fplookup+0x5d5/frame 0xfffffe0159f6c940 namei() at namei+0x203/frame 0xfffffe0159f6ca00 kern_execve() at kern_execve+0x2c0/frame 0xfffffe0159f6cd80 sys_execve() at sys_execve+0x5a/frame 0xfffffe0159f6ce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0159f6cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0159f6cf30 --- syscall (59, FreeBSD ELF64, sys_execve), rip = 0xa1a457e1b0a, rsp = 0xa1a42f77518, rbp = 0xa1a42f775a0 --- Tracing command ntpd pid 2705 tid 100228 td 0xfffffe010e7fc020 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce88e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce88e10 trap() at trap+0x56/frame 0xfffffe003ce88f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce88f20 --- trap 0x13, rip = 0xffffffff80c5e140, rsp = 0xfffffe014178f5b0, rbp = 0xfffffe014178f5c0 --- lock_delay() at lock_delay+0x20/frame 0xfffffe014178f5c0 __mtx_lock_sleep() at __mtx_lock_sleep+0xf8/frame 0xfffffe014178f650 __mtx_lock_flags() at __mtx_lock_flags+0xe5/frame 0xfffffe014178f6a0 vnlru_free_impl() at vnlru_free_impl+0xae/frame 0xfffffe014178f720 vn_alloc_hard() at vn_alloc_hard+0xf9/frame 0xfffffe014178f750 getnewvnode() at getnewvnode+0x2ae/frame 0xfffffe014178f790 ffs_vgetf() at ffs_vgetf+0x11b/frame 0xfffffe014178f810 ufs_lookup_ino() at ufs_lookup_ino+0xbe7/frame 0xfffffe014178f920 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x5a/frame 0xfffffe014178f940 vfs_cache_lookup() at vfs_cache_lookup+0xa6/frame 0xfffffe014178f990 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe014178f9b0 cache_fplookup_noentry() at cache_fplookup_noentry+0x23d/frame 0xfffffe014178fa10 cache_fplookup() at cache_fplookup+0x5d5/frame 0xfffffe014178fb00 namei() at namei+0x203/frame 0xfffffe014178fbc0 kern_statat() at kern_statat+0x12e/frame 0xfffffe014178fd00 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe014178fe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014178ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014178ff30 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x26fa2384354a, rsp = 0x26fa1f7797a8, rbp = 0x26fa1f7798c0 --- Tracing command cron pid 2754 tid 100288 td 0xfffffe0144026e40 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6ee10 trap() at trap+0x56/frame 0xfffffe003ce6ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6ef20 --- trap 0x13, rip = 0xffffffff80c81548, rsp = 0xfffffe01438d8600, rbp = 0xfffffe01438d8610 --- witness_lock() at witness_lock+0x1c8/frame 0xfffffe01438d8610 __mtx_lock_flags() at __mtx_lock_flags+0xf9/frame 0xfffffe01438d8660 vdropl() at vdropl+0x24e/frame 0xfffffe01438d86a0 vnlru_free_impl() at vnlru_free_impl+0x92/frame 0xfffffe01438d8720 vn_alloc_hard() at vn_alloc_hard+0xf9/frame 0xfffffe01438d8750 getnewvnode() at getnewvnode+0x2ae/frame 0xfffffe01438d8790 ffs_vgetf() at ffs_vgetf+0x11b/frame 0xfffffe01438d8810 ufs_lookup_ino() at ufs_lookup_ino+0xbe7/frame 0xfffffe01438d8920 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x5a/frame 0xfffffe01438d8940 vfs_cache_lookup() at vfs_cache_lookup+0xa6/frame 0xfffffe01438d8990 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe01438d89b0 cache_fplookup_noentry() at cache_fplookup_noentry+0x23d/frame 0xfffffe01438d8a10 cache_fplookup() at cache_fplookup+0x5d5/frame 0xfffffe01438d8b00 namei() at namei+0x203/frame 0xfffffe01438d8bc0 kern_statat() at kern_statat+0x12e/frame 0xfffffe01438d8d00 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe01438d8e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438d8f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438d8f30 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x13ddc5ce254a, rsp = 0x13ddc281f1f8, rbp = 0x13ddc281fbd0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 99294 2338 2338 0 R CPU 8 dhclient 99293 99292 2614 0 D ufs 0xfffffe0144125588 ls 99292 2614 2614 0 S wait 0xfffff8062ba4ea90 sh 99291 5294 5230 0 S piperd 0xfffff8067c7975d0 sh 99290 5294 5230 0 R CPU 2 sed 99289 5294 5230 0 R CPU 6 sed 98923 59238 4554 0 RL+ CPU 1 umount 59254 0 0 0 DL mdwait 0xfffff8044a9cf000 [md10] 59238 59236 4554 0 S+ wait 0xfffff8077cf0f000 sh 59237 4554 4554 0 S+ piperd 0xfffff805e743e5d0 tee 59236 4554 4554 0 SW+ wait 0xfffff8010e46e548 sh 48912 0 0 0 DL aiordy 0xfffff80045f3f548 [aiod4] 48911 0 0 0 DL aiordy 0xfffff80045d18000 [aiod3] 48910 0 0 0 DL aiordy 0xfffff801b9b1c000 [aiod2] 48909 0 0 0 DL aiordy 0xfffff8057bd94000 [aiod1] 5297 5230 5230 0 S piperd 0xfffff8002deb1000 sh 5295 5230 5230 0 S piperd 0xfffff8004655f2e8 awk 5294 5230 5230 0 S wait 0xfffff8002227ea90 sh 5230 1 5230 0 SWs wait 0xfffff800224bf548 sh 4554 2796 4554 0 SW+ wait 0xfffff8002d8b9548 sh 2796 2794 2796 0 S+ select 0xfffff800047c2bc0 bash 2794 2793 2794 0 SW+ pause 0xfffff8002df740b0 csh 2793 2786 2793 2006 SW+ wait 0xfffff800224bfa90 su 2786 2785 2786 2006 SWs+ wait 0xfffff8002d868548 bash 2785 2782 2782 2006 S select 0xfffff8000603bdc0 sshd 2782 2750 2782 0 Ss select 0xfffff8000603b240 sshd 2777 1 2777 0 Ss+ ttyin 0xfffff8000610c8b0 getty 2776 1 2776 0 Ss+ ttyin 0xfffff8000610ccb0 getty 2775 1 2775 0 Ss+ ttyin 0xfffff800223068b0 getty 2774 1 2774 0 Ss+ ttyin 0xfffff80022306cb0 getty 2773 1 2773 0 Ss+ ttyin 0xfffff800223050b0 getty 2772 1 2772 0 Ss+ ttyin 0xfffff800223054b0 getty 2771 1 2771 0 Ss+ ttyin 0xfffff800223058b0 getty 2770 1 2770 0 Ss+ ttyin 0xfffff80022305cb0 getty 2769 1 2769 0 Ss+ ttyin 0xfffff800223040b0 getty 2768 1 2768 0 Ss+ ttyin 0xfffff800223044b0 getty 2754 1 2754 0 Rs CPU 7 cron 2750 1 2750 0 Ss select 0xfffff800060d20c0 sshd 2731 1 2731 0 Ss select 0xfffff80004372040 inetd 2705 1 2705 123 Rs CPU 9 ntpd 2679 1 2679 0 Ss select 0xfffff800047c2e40 powerd 2674 1 2674 0 Ss rpcsvc 0xfffff8062100d760 NLM: master 2671 1 2671 0 Ss select 0xfffff800043721c0 rpc.statd 2646 1 2646 0 Ss select 0xfffff8000603ad40 rpcbind 2614 1 2614 0 Ss wait 0xfffff801b9dc8000 watchdogd 2606 1 2606 0 Ss select 0xfffff800060d3f40 syslogd 2419 1 2419 0 Ss select 0xfffff8002d13f440 devd 2414 1 2414 65 Ss piperd 0xfffff8004654c160 dhclient 2338 1 2338 0 Ss wait 0xfffff8002d4ada90 dhclient 2335 1 2335 0 Ss select 0xfffff8000603b5c0 dhclient 18 0 0 0 DL vlruwt 0xfffff800224c4a90 [vnlru] 17 0 0 0 DL syncer 0xffffffff81f9d828 [syncer] 16 0 0 0 RL (threaded) [bufdaemon] 100197 D psleep 0xffffffff81f9c860 [bufdaemon] 100198 D - 0xffffffff81a0af40 [bufspacedaemon-0] 100199 D - 0xffffffff81a13200 [bufspacedaemon-1] 100200 D - 0xffffffff81a1b4c0 [bufspacedaemon-2] 100201 D - 0xffffffff81a23780 [bufspacedaemon-3] 100202 D - 0xffffffff81a2ba40 [bufspacedaemon-4] 100203 D - 0xffffffff81a33d00 [bufspacedaemon-5] 100204 D - 0xffffffff81a3bfc0 [bufspacedaemon-6] 100221 D sdflush 0xfffff8002d4e6ce8 [/ worker] 100227 D sdflush 0xfffff8002d8e7ce8 [/tmp worker] 826450 Run CPU 0 [/mnt worker] 9 0 0 0 DL psleep 0xffffffff81fc29d0 [vmdaemon] 8 0 0 0 DL (threaded) [pagedaemon] 100195 D psleep 0xffffffff81fb6e38 [dom0] 100205 D launds 0xffffffff81fb6e44 [laundry: dom0] 100206 D umarcl 0xffffffff80f809d0 [uma] 7 0 0 0 DL idle 0xfffff800041aa000 [enc_daemon1] 6 0 0 0 DL idle 0xfffff800041aa548 [enc_daemon0] 5 0 0 0 DL - 0xffffffff81ce02f8 [rand_harvestq] 15 0 0 0 DL (threaded) [usb] 100128 D - 0xfffffe010a1a2440 [usbus0] 100129 D - 0xfffffe010a1a2498 [usbus0] 100130 D - 0xfffffe010a1a24f0 [usbus0] 100131 D - 0xfffffe010a1a2548 [usbus0] 100132 D - 0xfffffe010a1a25a0 [usbus0] 100134 D - 0xfffffe00e4d76cf0 [usbus1] 100135 D - 0xfffffe00e4d76d48 [usbus1] 100136 D - 0xfffffe00e4d76da0 [usbus1] 100137 D - 0xfffffe00e4d76df8 [usbus1] 100138 D - 0xfffffe00e4d76e50 [usbus1] 100139 D - 0xfffffe010a564cf0 [usbus2] 100140 D - 0xfffffe010a564d48 [usbus2] 100141 D - 0xfffffe010a564da0 [usbus2] 100142 D - 0xfffffe010a564df8 [usbus2] 100143 D - 0xfffffe010a564e50 [usbus2] 4 0 0 0 DL (threaded) [cam] 100121 D - 0xffffffff81bca0c0 [doneq0] 100122 D - 0xffffffff81bca140 [doneq1] 100123 D - 0xffffffff81bca1c0 [doneq2] 100124 D - 0xffffffff81bca040 [async] 100152 D - 0xffffffff81bc9f10 [scanner] 14 0 0 0 DL seqstat 0xfffff800044d5088 [sequencer 00] 3 0 0 0 DL (threaded) [crypto] 100107 D crypto_ 0xffffffff81fb4330 [crypto] 100108 D crypto_ 0xfffff80004438830 [crypto returns 0] 100109 D crypto_ 0xfffff80004438880 [crypto returns 1] 100110 D crypto_ 0xfffff800044388d0 [crypto returns 2] 100111 D crypto_ 0xfffff80004438920 [crypto returns 3] 100112 D crypto_ 0xfffff80004438970 [crypto returns 4] 100113 D crypto_ 0xfffff800044389c0 [crypto returns 5] 100114 D crypto_ 0xfffff80004438a10 [crypto returns 6] 100115 D crypto_ 0xfffff80004438a60 [crypto returns 7] 100116 D crypto_ 0xfffff80004438ab0 [crypto returns 8] 100117 D crypto_ 0xfffff80004438b00 [crypto returns 9] 100118 D crypto_ 0xfffff80004438b50 [crypto returns 10] 100119 D crypto_ 0xfffff80004438ba0 [crypto returns 11] 13 0 0 0 DL (threaded) [geom] 100092 D - 0xffffffff81e8c0d0 [g_event] 100093 D - 0xffffffff81e8c0d8 [g_up] 100094 D - 0xffffffff81e8c0e0 [g_down] 2 0 0 0 WL (threaded) [clock] 100078 I [clock (0)] 100079 I [clock (1)] 100080 I [clock (2)] 100081 I [clock (3)] 100082 I [clock (4)] 100083 I [clock (5)] 100084 I [clock (6)] 100085 I [clock (7)] 100086 I [clock (8)] 100087 I [clock (9)] 100088 I [clock (10)] 100089 I [clock (11)] 12 0 0 0 WL (threaded) [intr] 100044 I [swi6: task queue] 100045 I [swi6: Giant taskq] 100050 I [swi5: fast taskq] 100077 I [swi1: netisr 0] 100090 I [swi3: busdma] 100125 I [swi4: apei] 100126 I [irq56: ahci0] 100127 I [irq19: xhci0] 100133 I [irq18: ehci0 ehci1+] 100144 I [irq71: ahci1] 100145 I [swi0: uart uart] 100159 I [irq73: mlx5_core0] 100160 I [irq74: mlx5_core0] 100161 I [irq72: mlx5_core0] 100162 I [irq75: mlx5_core0] 100163 I [irq76: mlx5_core0] 100164 I [irq77: mlx5_core0] 100165 I [irq78: mlx5_core0] 100166 I [irq79: mlx5_core0] 100167 I [irq80: mlx5_core0] 100168 I [irq81: mlx5_core0] 100169 I [irq82: mlx5_core0] 100170 I [irq83: mlx5_core0] 100171 I [irq84: mlx5_core0] 100172 I [irq85: mlx5_core0] 100173 I [irq86: mlx5_core0] 100179 I [irq88: mlx5_core1] 100180 I [irq89: mlx5_core1] 100181 I [irq87: mlx5_core1] 100182 I [irq90: mlx5_core1] 100183 I [irq91: mlx5_core1] 100184 I [irq92: mlx5_core1] 100185 I [irq93: mlx5_core1] 100186 I [irq94: mlx5_core1] 100187 I [irq95: mlx5_core1] 100188 I [irq96: mlx5_core1] 100189 I [irq97: mlx5_core1] 100190 I [irq98: mlx5_core1] 100191 I [irq99: mlx5_core1] 100192 I [irq100: mlx5_core1] 100193 I [irq101: mlx5_core1] 100250 I [irq102: ioat0] 100251 I [irq103: ioat1] 100252 I [irq104: ioat2] 100253 I [irq105: ioat3] 100254 I [irq106: ioat4] 100255 I [irq107: ioat5] 100256 I [irq108: ioat6] 100257 I [irq109: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff80003b8a000 [init] 10 0 0 0 DL audit_w 0xffffffff81fb4850 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81e8c650 [swapper] 100015 D - 0xfffff80003c23100 [if_io_tqg_0] 100016 D - 0xfffff80003c23000 [if_io_tqg_1] 100017 D - 0xfffff80003c24e00 [if_io_tqg_2] 100018 D - 0xfffff80003c24d00 [if_io_tqg_3] 100019 D - 0xfffff80003c24c00 [if_io_tqg_4] 100020 D - 0xfffff80003c24b00 [if_io_tqg_5] 100021 D - 0xfffff80003c24a00 [if_io_tqg_6] 100022 D - 0xfffff80003c24900 [if_io_tqg_7] 100023 D - 0xfffff80003c24800 [if_io_tqg_8] 100024 D - 0xfffff80003c24700 [if_io_tqg_9] 100025 D - 0xfffff80003c24600 [if_io_tqg_10] 100026 D - 0xfffff80003c24500 [if_io_tqg_11] 100027 D - 0xfffff80003c24400 [if_config_tqg_0] 100028 D - 0xfffff80003c24300 [softirq_0] 100029 D - 0xfffff80003c24200 [softirq_1] 100030 D - 0xfffff80003c24100 [softirq_2] 100031 D - 0xfffff80003c24000 [softirq_3] 100032 D - 0xfffff80003c25e00 [softirq_4] 100033 D - 0xfffff80003c25d00 [softirq_5] 100034 D - 0xfffff80003c25c00 [softirq_6] 100035 D - 0xfffff80003c25b00 [softirq_7] 100036 D - 0xfffff80003c25a00 [softirq_8] 100037 D - 0xfffff80003c25900 [softirq_9] 100038 D - 0xfffff80003c25800 [softirq_10] 100039 D - 0xfffff80003c25700 [softirq_11] 100040 D - 0xfffff80003a1d500 [pci_hp taskq] 100041 D - 0xfffff80003a1d300 [kqueue_ctx taskq] 100042 D - 0xfffff80003a1d100 [linuxkpi_irq_wq] 100043 D - 0xfffff80003a1ce00 [in6m_free taskq] 100046 D - 0xfffff80003a1c800 [aiod_kick taskq] 100047 D - 0xfffff80003a1c600 [inm_free taskq] 100048 D - 0xfffff80003a1c400 [deferred_unmount ta] 100049 D - 0xfffff80003a1c200 [thread taskq] 100051 D - 0xfffff80003bff200 [linuxkpi_short_wq_0] 100052 D - 0xfffff80003bff200 [linuxkpi_short_wq_1] 100053 D - 0xfffff80003bff200 [linuxkpi_short_wq_2] 100054 D - 0xfffff80003bff200 [linuxkpi_short_wq_3] 100055 D - 0xfffff80003bff200 [linuxkpi_short_wq_4] 100056 D - 0xfffff80003bff200 [linuxkpi_short_wq_5] 100057 D - 0xfffff80003bff200 [linuxkpi_short_wq_6] 100058 D - 0xfffff80003bff200 [linuxkpi_short_wq_7] 100059 D - 0xfffff80003bff200 [linuxkpi_short_wq_8] 100060 D - 0xfffff80003bff200 [linuxkpi_short_wq_9] 100061 D - 0xfffff80003bff200 [linuxkpi_short_wq_1] 100062 D - 0xfffff80003bff200 [linuxkpi_short_wq_1] 100063 D - 0xfffff80003bff200 [linuxkpi_short_wq_1] 100064 D - 0xfffff80003c00300 [linuxkpi_long_wq_0] 100065 D - 0xfffff80003c00300 [linuxkpi_long_wq_1] 100066 D - 0xfffff80003c00300 [linuxkpi_long_wq_2] 100067 D - 0xfffff80003c00300 [linuxkpi_long_wq_3] 100068 D - 0xfffff80003c00300 [linuxkpi_long_wq_4] 100069 D - 0xfffff80003c00300 [linuxkpi_long_wq_5] 100070 D - 0xfffff80003c00300 [linuxkpi_long_wq_6] 100071 D - 0xfffff80003c00300 [linuxkpi_long_wq_7] 100072 D - 0xfffff80003c00300 [linuxkpi_long_wq_8] 100073 D - 0xfffff80003c00300 [linuxkpi_long_wq_9] 100074 D - 0xfffff80003c00300 [linuxkpi_long_wq_10] 100075 D - 0xfffff80003c00300 [linuxkpi_long_wq_11] 100076 D - 0xfffff80003c00300 [linuxkpi_long_wq_12] 100091 D - 0xfffff80004194700 [firmware taskq] 100095 D - 0xfffff80004194200 [crypto_0] 100096 D - 0xfffff80004194200 [crypto_1] 100097 D - 0xfffff80004194200 [crypto_2] 100098 D - 0xfffff80004194200 [crypto_3] 100099 D - 0xfffff80004194200 [crypto_4] 100100 D - 0xfffff80004194200 [crypto_5] 100101 D - 0xfffff80004194200 [crypto_6] 100102 D - 0xfffff80004194200 [crypto_7] 100103 D - 0xfffff80004194200 [crypto_8] 100104 D - 0xfffff80004194200 [crypto_9] 100105 D - 0xfffff80004194200 [crypto_10] 100106 D - 0xfffff80004194200 [crypto_11] 100146 D - 0xfffff80022421b00 [acpi_task_0] 100147 D - 0xfffff80022421b00 [acpi_task_1] 100148 D - 0xfffff80022421b00 [acpi_task_2] 100150 D - 0xfffff80003a20100 [mca taskq] 100151 D - 0xfffff80004196500 [CAM taskq] 100155 D - 0xfffff80022421300 [mlx5_core0-rec] 100156 D - 0xfffff80022421100 [mlx5_core0-wdg] 100157 D - 0xfffff80022422e00 [mlx5_core0-cmd] 100158 D - 0xfffff80022422c00 [mlx5_page_allocator] 100174 D - 0xfffff80028a58300 [mlx5_esw_wq] 100175 D - 0xfffff80028a58100 [mlx5_core1-rec] 100176 D - 0xfffff80028a59e00 [mlx5_core1-wdg] 100177 D - 0xfffff80028a59c00 [mlx5_core1-cmd] 100178 D - 0xfffff80028a59a00 [mlx5_page_allocator] 100194 D - 0xfffff80003d5f500 [mlx5_esw_wq] 766870 D - 0xfffff802b4374500 [unionfs_rele taskq] db:0:pho> allt Tracing command kernel pid 0 tid 100000 td 0xffffffff81e8cba0 sched_switch() at sched_switch+0x559/frame 0xffffffff82364e00 mi_switch() at mi_switch+0x157/frame 0xffffffff82364e20 sleepq_switch() at sleepq_switch+0x107/frame 0xffffffff82364e60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82364ea0 _sleep() at _sleep+0x2ce/frame 0xffffffff82364f40 swapper() at swapper+0x75/frame 0xffffffff82364fa0 mi_startup() at mi_startup+0x32a/frame 0xffffffff82364ff0 btext() at btext+0x22 Tracing command kernel pid 0 tid 100015 td 0xfffffe00e4c62020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4858de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4858e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4858e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4858ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4858ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4858f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4858f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe00e4c61900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4853de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4853e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4853e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4853ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4853ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4853f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4853f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffffe00e4ce6720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4862de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4862e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4862e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4862ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4862ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4862f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4862f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe00e4ce6000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e485dde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e485de00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e485de40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e485dec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e485def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e485df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e485df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe00e4c69740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e486cde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e486ce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e486ce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e486cec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e486cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e486cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e486cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe00e4c69020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4867de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4867e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4867e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4867ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4867ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4867f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4867f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe00e4c68900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4876de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4876e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4876e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4876ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4876ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4876f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4876f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe00e4c681e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4871de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4871e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4871e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4871ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4871ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4871f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4871f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe00e4c67ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4880de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4880e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4880e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4880ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4880ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4880f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4880f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe00e4c673a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e487bde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e487be00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e487be40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e487bec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e487bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e487bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e487bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe00e4cea020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e488ade0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e488ae00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e488ae40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e488aec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e488aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe00e4ce9900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4885de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4885e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4885e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4885ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4885ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4885f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4885f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe00e4ce91e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4894de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4894e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4894e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4894ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4894ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4894f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4894f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe00e4ce8ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e488fde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e488fe00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e488fe40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e488fec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e488fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe00e4ce83a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e489ede0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e489ee00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e489ee40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e489eec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e489eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e489ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e489ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe00e4ce7c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4899de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4899e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4899e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4899ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4899ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4899f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4899f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe00e4ce7560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48a8de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48a8e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48a8e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48a8ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48a8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe00e4ce6e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48a3de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48a3e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48a3e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48a3ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48a3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe00e4cf5ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48b2de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48b2e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48b2e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48b2ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48b2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe00e4cf53a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48adde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48ade00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48ade40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48adec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48adef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48adf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48adf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe00e4cf4c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48bcde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48bce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48bce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48bcec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48bcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48bcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48bcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe00e4cf4560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48b7de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48b7e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48b7e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48b7ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48b7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe00e4cf3e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48c6de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48c6e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48c6e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48c6ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48c6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe00e4cf3720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48c1de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48c1e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48c1e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48c1ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48c1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe00e4cf3000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48d0de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48d0e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48d0e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48d0ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48d0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe00e4cea740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48cbdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48cbde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48cbe20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48cbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48cbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48cbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48cbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffffe00e4cf9560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48dadc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48dade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48dae20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48daec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48daef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48daf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48daf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffffe00e4cf8e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48d5de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48d5e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48d5e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48d5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e48d5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffffe00e4cf8720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48e4dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48e4de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48e4e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48e4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48e4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48e4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffffe00e4cf7020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48e9dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48e9de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48e9e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48e9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48e9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48e9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100047 td 0xfffffe00e4cf6900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48f8dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48f8de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48f8e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48f8ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48f8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48f8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100048 td 0xfffffe00e4cf61e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48f3dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48f3de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48f3e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48f3ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48f3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48f3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100049 td 0xfffffe00e4d01000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4902dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4902de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4902e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4902ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4902ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4902f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4902f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100051 td 0xfffffe00e4cfc020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e490cdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e490cde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e490ce20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e490cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e490cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e490cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e490cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100052 td 0xfffffe00e4cfb900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4907dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4907de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4907e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4907ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4907ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4907f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4907f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffffe00e4cfb1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4916dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4916de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4916e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4916ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4916ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4916f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4916f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100054 td 0xfffffe00e4cfaac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4911dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4911de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4911e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4911ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4911ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4911f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4911f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100055 td 0xfffffe00e4cfa3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4920dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4920de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4920e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4920ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4920ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4920f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4920f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffffe00e4cf9c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e491bdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e491bde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e491be20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e491bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e491bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e491bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e491bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100057 td 0xfffffe00e4d04900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e492adc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e492ade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e492ae20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e492aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e492aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e492af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffffe00e4d041e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4925dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4925de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4925e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4925ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4925ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4925f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4925f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffffe00e4d03ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4934dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4934de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4934e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4934ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4934ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4934f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4934f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffffe00e4d033a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e492fdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e492fde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e492fe20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e492fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e492fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e492ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe00e4d02c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e493edc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e493ede0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e493ee20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e493eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e493eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e493ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e493ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffffe00e4d02560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4939dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4939de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4939e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4939ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4939ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4939f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4939f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffffe00e4d01e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4948dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4948de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4948e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4948ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4948ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4948f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4948f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffffe00e4d01720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4943dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4943de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4943e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4943ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4943ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4943f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4943f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffffe00e4d0a3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4952dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4952de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4952e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4952ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4952ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4952f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4952f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe00e4d09c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e494ddc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e494dde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e494de20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e494dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e494def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e494df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e494df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe00e4d09560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e495cdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e495cde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e495ce20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e495cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e495cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e495cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e495cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe00e4d08e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4957dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4957de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4957e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4957ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4957ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4957f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4957f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe00e4d08720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4966dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4966de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4966e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4966ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4966ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4966f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4966f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe00e4d08000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4961dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4961de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4961e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4961ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4961ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4961f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4961f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe00e4d05740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4970dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4970de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4970e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4970ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4970ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4970f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4970f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe00e4d05020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e496bdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e496bde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e496be20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e496bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e496bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e496bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e496bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe00e4d0de40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e497adc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e497ade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e497ae20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e497aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e497aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe00e4d0d720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4975dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4975de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4975e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4975ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4975ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4975f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4975f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe00e4d0d000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4984dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4984de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4984e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4984ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4984ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4984f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4984f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe00e4d0c740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e497fdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e497fde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e497fe20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e497fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e497fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffffe00e4d17e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49ffdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49ffde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e49ffe20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e49ffec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e49ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100095 td 0xfffffe00e4d2d560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e43dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e43de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e43e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e43ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e43ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e43f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffffe00e4d2ce40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e52dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e52de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e52e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e52ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e52ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e52f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e52f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100097 td 0xfffffe00e4d2c720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e4ddc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e4dde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e4de20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e4dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e4def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e4df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e4df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffffe00e4d2c000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e5cdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e5cde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e5ce20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e5cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e5cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e5cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100099 td 0xfffffe00e4d1b740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e57dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e57de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e57e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e57ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e57ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e57f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffffe00e4d1b020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e66dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e66de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e66e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e66ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e66ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e66f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100101 td 0xfffffe00e4d1a900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e61dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e61de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e61e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e61ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e61ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e61f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffffe00e4d36720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e70dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e70de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e70e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e70ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e70ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e70f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e70f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100103 td 0xfffffe00e4d36000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e6bdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e6bde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e6be20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e6bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e6bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e6bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e6bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffffe00e4d30740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e7adc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e7ade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e7ae20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e7aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e7aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100105 td 0xfffffe00e4d30020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e75dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e75de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e75e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e75ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e75ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e75f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e75f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffffe00e4d2f900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e84dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e84de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e84e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e84ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e84ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e84f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e84f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100146 td 0xfffffe010d9eb3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4fffde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4fffe00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4fffe40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4fffec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4fffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ffff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ffff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100147 td 0xfffffe010d9eac80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ffade0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ffae00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ffae40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4ffaec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4ffaef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ffaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ffaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100148 td 0xfffffe010d9ea560 sched_switch() at sched_switch+0x559/frame 0xfffffe010da39de0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da39e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da39e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da39ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da39ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da39f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100150 td 0xfffffe010d9e9720 sched_switch() at sched_switch+0x559/frame 0xfffffe010da43de0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da43e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da43e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da43ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da43ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da43f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100151 td 0xfffffe010d9e9000 sched_switch() at sched_switch+0x559/frame 0xfffffe010da3edc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da3ede0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da3ee20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da3eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da3eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100155 td 0xfffffe010a32d020 sched_switch() at sched_switch+0x559/frame 0xfffffe010da48dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da48de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da48e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da48ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da48ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da48f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100156 td 0xfffffe010ddbc740 sched_switch() at sched_switch+0x559/frame 0xfffffe010da61dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da61de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da61e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da61ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da61ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da61f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100157 td 0xfffffe010ddbc020 sched_switch() at sched_switch+0x559/frame 0xfffffe010da5cdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da5cde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da5ce20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da5cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da5cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da5cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100158 td 0xfffffe010ddbb900 sched_switch() at sched_switch+0x559/frame 0xfffffe010da6bdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da6bde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da6be20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da6bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da6bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da6bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da6bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100174 td 0xfffffe010e1a3e40 sched_switch() at sched_switch+0x559/frame 0xfffffe010dabbdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dabbde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dabbe20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dabbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dabbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dabbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dabbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100175 td 0xfffffe010e1a3720 sched_switch() at sched_switch+0x559/frame 0xfffffe010dab6dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dab6de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dab6e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dab6ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dab6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dab6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dab6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100176 td 0xfffffe010e1a3000 sched_switch() at sched_switch+0x559/frame 0xfffffe010dac5dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dac5de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dac5e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dac5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dac5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dac5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100177 td 0xfffffe010e1a2740 sched_switch() at sched_switch+0x559/frame 0xfffffe010dac0dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dac0de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dac0e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dac0ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dac0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dac0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100178 td 0xfffffe010e1a2020 sched_switch() at sched_switch+0x559/frame 0xfffffe010dacfdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dacfde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dacfe20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dacfec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dacfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dacff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dacff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100194 td 0xfffffe010e1b7560 sched_switch() at sched_switch+0x559/frame 0xfffffe010db1fdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010db1fde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db1fe20 _sleep() at _sleep+0x2e7/frame 0xfffffe010db1fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010db1fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db1ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db1ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 766870 td 0xfffffe016cc8c3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe01438e7dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe01438e7de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438e7e20 _sleep() at _sleep+0x2e7/frame 0xfffffe01438e7ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe01438e7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01438e7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01438e7f30 --- trap 0xa5a5a5a5, rip = 0xa5a5a5a5a5a5a5a5, rsp = 0xa5a5a5a5a5a5a5a5, rbp = 0xa5a5a5a5a5a5a5a5 --- Tracing command init pid 1 tid 100002 td 0xfffffe00e4c60ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00377e1a10 mi_switch() at mi_switch+0x157/frame 0xfffffe00377e1a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00377e1a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00377e1ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00377e1ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe00377e1b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe00377e1c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00377e1e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe00377e1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00377e1f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x28f06a, rsp = 0x820e1f888, rbp = 0x820e1f8f0 --- Tracing command clock pid 2 tid 100078 td 0xfffffe00e4d11740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49c8ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49c8ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49c8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100079 td 0xfffffe00e4d11020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49c3ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49c3ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49c3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100080 td 0xfffffe00e4d10900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49d2ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49d2ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49d2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49d2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49d2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100081 td 0xfffffe00e4d101e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49cdea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49cdec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49cdef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49cdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49cdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100082 td 0xfffffe00e4d0fac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49dcea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49dcec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49dcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49dcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49dcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100083 td 0xfffffe00e4d0f3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49d7ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49d7ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49d7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49d7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49d7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100084 td 0xfffffe00e4d0ec80 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100085 td 0xfffffe00e4d0e560 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100086 td 0xfffffe00e4d1a1e0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100087 td 0xfffffe00e4d19ac0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100088 td 0xfffffe00e4d193a0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100089 td 0xfffffe00e4d18c80 fork_trampoline() at fork_trampoline Tracing command crypto pid 3 tid 100107 td 0xfffffe00e4d2f1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e7fdb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e7fdd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e7fe10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e7feb0 crypto_dispatch_thread() at crypto_dispatch_thread+0xbf/frame 0xfffffe00e4e7fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100108 td 0xfffffe00e4d2eac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e8edb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e8edd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e8ee10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e8eeb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e8eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e8ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e8ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100109 td 0xfffffe00e4d2e3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e89db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e89dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e89e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e89eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e89ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e89f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e89f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100110 td 0xfffffe00e4d3a020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e98db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e98dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e98e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e98eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e98ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e98f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e98f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100111 td 0xfffffe00e4d39900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e93db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e93dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e93e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e93eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e93ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e93f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e93f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100112 td 0xfffffe00e4d391e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ea2db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ea2dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ea2e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ea2eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ea2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100113 td 0xfffffe00e4d38ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e9ddb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e9ddd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e9de10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e9deb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e9def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e9df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e9df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100114 td 0xfffffe00e4d383a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4eacdb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eacdd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eace10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4eaceb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eacef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eacf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eacf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100115 td 0xfffffe00e4d37c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ea7db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ea7dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ea7e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ea7eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ea7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100116 td 0xfffffe00e4d37560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4eb6db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eb6dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eb6e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4eb6eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eb6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100117 td 0xfffffe00e4d36e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4eb1db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eb1dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eb1e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4eb1eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eb1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100118 td 0xfffffe00e4d3dac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ec0db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ec0dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ec0e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ec0eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ec0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100119 td 0xfffffe00e4d3d3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ebbdb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ebbdd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ebbe10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ebbeb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ebbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ebbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ebbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100121 td 0xfffffe00e4d3c560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ec5da0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ec5dc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ec5e00 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ec5ea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ec5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100122 td 0xfffffe00e4d3be40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ed4da0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ed4dc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ed4e00 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ed4ea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ed4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100123 td 0xfffffe00e4d3b720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ecfda0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ecfdc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ecfe00 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ecfea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ecfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ecff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100124 td 0xfffffe00e4d3b000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ededa0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ededc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4edee00 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4edeea0 xpt_async_td() at xpt_async_td+0x74/frame 0xfffffe00e4edeef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4edef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4edef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100152 td 0xfffffe010a32d740 sched_switch() at sched_switch+0x559/frame 0xfffffe010da4ddc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da4dde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da4de20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da4dec0 xpt_scanner_thread() at xpt_scanner_thread+0x154/frame 0xfffffe010da4def0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da4df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da4df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 5 tid 100149 td 0xfffffe010d9e9e40 sched_switch() at sched_switch+0x559/frame 0xfffffe010da34d20 mi_switch() at mi_switch+0x157/frame 0xfffffe010da34d40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da34d80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010da34dc0 _sleep() at _sleep+0x2ce/frame 0xfffffe010da34e60 random_kthread() at random_kthread+0xa7/frame 0xfffffe010da34ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da34f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da34f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 6 tid 100153 td 0xfffffe00e4d3a740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ed9d80 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ed9da0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ed9de0 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ed9e80 enc_daemon() at enc_daemon+0xeb/frame 0xfffffe00e4ed9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 7 tid 100154 td 0xfffffe010ddb8e40 sched_switch() at sched_switch+0x559/frame 0xfffffe010da57d80 mi_switch() at mi_switch+0x157/frame 0xfffffe010da57da0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da57de0 _sleep() at _sleep+0x2e7/frame 0xfffffe010da57e80 enc_daemon() at enc_daemon+0xeb/frame 0xfffffe010da57ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da57f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 8 tid 100195 td 0xfffffe010e387ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe010db41ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe010db41ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db41b10 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db41b50 _sleep() at _sleep+0x2ce/frame 0xfffffe010db41bf0 vm_pageout_worker() at vm_pageout_worker+0x28c/frame 0xfffffe010db41eb0 vm_pageout() at vm_pageout+0x1d7/frame 0xfffffe010db41ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db41f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db41f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 8 tid 100205 td 0xfffffe010a329720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f53b70 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f53b90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f53bd0 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4f53c70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xb33/frame 0xfffffe00e4f53ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f53f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f53f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 8 tid 100206 td 0xfffffe010e414000 sched_switch() at sched_switch+0x559/frame 0xfffffe01185b5d80 mi_switch() at mi_switch+0x157/frame 0xfffffe01185b5da0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01185b5de0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01185b5e20 _sleep() at _sleep+0x2ce/frame 0xfffffe01185b5ec0 uma_reclaim_worker() at uma_reclaim_worker+0xc8/frame 0xfffffe01185b5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01185b5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01185b5f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command vmdaemon pid 9 tid 100196 td 0xfffffe010e3873a0 sched_switch() at sched_switch+0x559/frame 0xfffffe010db30d80 mi_switch() at mi_switch+0x157/frame 0xfffffe010db30da0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db30de0 _sleep() at _sleep+0x2e7/frame 0xfffffe010db30e80 vm_daemon() at vm_daemon+0x92/frame 0xfffffe010db30ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db30f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db30f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe00e4c611e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00377e6dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00377e6df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00377e6e30 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00377e6e90 audit_worker() at audit_worker+0x9f/frame 0xfffffe00377e6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe00e4c603a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00377f0e30 mi_switch() at mi_switch+0x157/frame 0xfffffe00377f0e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe00e4c5fc80 sched_switch() at sched_switch+0x559/frame 0xfffffe00377ebe30 mi_switch() at mi_switch+0x157/frame 0xfffffe00377ebe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377ebef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ebf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe00e4c5f560 sched_switch() at sched_switch+0x559/frame 0xfffffe00377fae30 mi_switch() at mi_switch+0x157/frame 0xfffffe00377fae50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377faef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe00e4c5ee40 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3ae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ae10 trap() at trap+0x56/frame 0xfffffe003ce3af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3af20 --- trap 0x13, rip = 0xffffffff810b03e6, rsp = 0xfffffe00377f5dd0, rbp = 0xfffffe00377f5dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377f5dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377f5e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377f5e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377f5e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377f5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00e4c5e720 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce47e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce47e10 trap() at trap+0x56/frame 0xfffffe003ce47f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce47f20 --- trap 0x13, rip = 0xffffffff810b03e6, rsp = 0xfffffe00e4830dd0, rbp = 0xfffffe00e4830dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4830dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4830e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4830e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4830e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4830ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4830f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4830f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe00e4c5e000 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce54e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce54e10 trap() at trap+0x56/frame 0xfffffe003ce54f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce54f20 --- trap 0x13, rip = 0xffffffff810b03e6, rsp = 0xfffffe00377ffdd0, rbp = 0xfffffe00377ffdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377ffdd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377ffe10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377ffe30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377ffe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe00e4c66c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e483ae30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e483ae50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e483aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe00e4c66560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4835e30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4835e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4835ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4835f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4835f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe00e4c65e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4844e30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4844e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4844ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4844f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4844f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe00e4c65720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e483fe30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e483fe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e483fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00e4c65000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce95e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce95e10 trap() at trap+0x56/frame 0xfffffe003ce95f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce95f20 --- trap 0x13, rip = 0xffffffff810b03e6, rsp = 0xfffffe00e484edd0, rbp = 0xfffffe00e484edd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e484edd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e484ee10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e484ee30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e484ee50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e484eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e484ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e484ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00e4c62740 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea2e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea2e10 trap() at trap+0x56/frame 0xfffffe003cea2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea2f20 --- trap 0x13, rip = 0xffffffff810b03e6, rsp = 0xfffffe00e4849dd0, rbp = 0xfffffe00e4849dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4849dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4849e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4849e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4849e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4849ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4849f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4849f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100044 td 0xfffffe00e4cf8000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48dfe40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48dfe60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e48dfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48dff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48dff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100045 td 0xfffffe00e4cf7740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48eee40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48eee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e48eeef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48eef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48eef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffffe00e4cfc740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100077 td 0xfffffe00e4d0c020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49bee40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49bee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49beef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49bef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49bef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100090 td 0xfffffe00e4d18560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100125 td 0xfffffe00e4d89560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100126 td 0xfffffe00e4d88e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ee3e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ee3e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ee3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ee3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100127 td 0xfffffe00e4d88720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ef2e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ef2e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ef2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100133 td 0xfffffe010a329000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f10e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f10e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f10ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f10f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f10f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100144 td 0xfffffe010a32a560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100145 td 0xfffffe010a329e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f58e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f58e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f58ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f58f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f58f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100159 td 0xfffffe010ddbb1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe010da66e40 mi_switch() at mi_switch+0x157/frame 0xfffffe010da66e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010da66ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da66f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100160 td 0xfffffe010ddbaac0 sched_switch() at sched_switch+0x559/frame 0xfffffe010da75e40 mi_switch() at mi_switch+0x157/frame 0xfffffe010da75e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010da75ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da75f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da75f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100161 td 0xfffffe010ddba3a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100162 td 0xfffffe010ddb9c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100163 td 0xfffffe010ddb9560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100164 td 0xfffffe010e1a11e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100165 td 0xfffffe010e1a0ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100166 td 0xfffffe010e1a03a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100167 td 0xfffffe010e19fc80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100168 td 0xfffffe010e19f560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100169 td 0xfffffe010e19ee40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100170 td 0xfffffe010e19e720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100171 td 0xfffffe010e19e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100172 td 0xfffffe010e1a4c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100173 td 0xfffffe010e1a4560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe010e1a1900 sched_switch() at sched_switch+0x559/frame 0xfffffe010dacae40 mi_switch() at mi_switch+0x157/frame 0xfffffe010dacae60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010dacaef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dacaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dacaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100180 td 0xfffffe010e1b6720 sched_switch() at sched_switch+0x559/frame 0xfffffe010dad9e40 mi_switch() at mi_switch+0x157/frame 0xfffffe010dad9e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010dad9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dad9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dad9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100181 td 0xfffffe010e1b6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffffe010e1a7740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffffe010e1a7020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffffe010e1a6900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffffe010e1a61e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffffe010e1a5ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffffe010e1a53a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffffe010e1ba020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffffe010e1b9900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffffe010e1b91e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100191 td 0xfffffe010e1b8ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100192 td 0xfffffe010e1b83a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100193 td 0xfffffe010e1b7c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100250 td 0xfffffe010e415c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100251 td 0xfffffe010e415560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100252 td 0xfffffe010e414e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100253 td 0xfffffe010e414720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100254 td 0xfffffe0143643020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100255 td 0xfffffe0143642900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100256 td 0xfffffe01436421e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100257 td 0xfffffe0143641ac0 fork_trampoline() at fork_trampoline Tracing command geom pid 13 tid 100092 td 0xfffffe00e4d17720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e3edc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e3ede0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e3ee20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e3eec0 g_run_events() at g_run_events+0x444/frame 0xfffffe00e4e3eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100093 td 0xfffffe00e4d17000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e39db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e39dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e39e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e39eb0 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe00e4e39ee0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00e4e39ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e39f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100094 td 0xfffffe00e4d2dc80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e48db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e48dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e48e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e48eb0 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe00e4e48ee0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe00e4e48ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e48f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100120 td 0xfffffe00e4d3cc80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ecadb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ecadd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ecae10 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ecae70 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe00e4ecaef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ecaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100128 td 0xfffffe00e4d88000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4eede00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eede20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eede60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4eedec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eedef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eedf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eedf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100129 td 0xfffffe00e4d3f740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4efce00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4efce20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4efce60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4efcec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4efcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4efcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4efcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100130 td 0xfffffe00e4d3f020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ef7e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ef7e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ef7e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ef7ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100131 td 0xfffffe00e4d3e900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f06e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f06e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f06e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f06ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f06ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f06f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f06f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100132 td 0xfffffe00e4d3e1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f01e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f01e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f01e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f01ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f01ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f01f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f01f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100134 td 0xfffffe00e4d8c740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f0be00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f0be20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f0be60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f0bec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f0bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f0bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f0bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100135 td 0xfffffe00e4d8c020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f1ae00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f1ae20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f1ae60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f1aec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f1aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f1af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f1af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100136 td 0xfffffe00e4d8b900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f15e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f15e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f15e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f15ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f15ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f15f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f15f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100137 td 0xfffffe00e4d8b1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f24e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f24e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f24e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f24ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f24ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f24f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f24f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100138 td 0xfffffe00e4d8aac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f1fe00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f1fe20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f1fe60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f1fec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f1fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f1ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f1ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100139 td 0xfffffe010a32c900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f3ae00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f3ae20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f3ae60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f3aec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f3aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f3af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f3af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100140 td 0xfffffe010a32c1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f35e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f35e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f35e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f35ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f35ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f35f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f35f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100141 td 0xfffffe010a32bac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f44e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f44e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f44e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f44ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f44ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f44f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f44f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100142 td 0xfffffe010a32b3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f3fe00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f3fe20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f3fe60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f3fec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f3fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f3ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f3ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100143 td 0xfffffe010a32ac80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f4ee00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f4ee20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f4ee60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f4eec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f4eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f4ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f4ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100197 td 0xfffffe010e386c80 sched_switch() at sched_switch+0x559/frame 0xfffffe010db4bd60 mi_switch() at mi_switch+0x157/frame 0xfffffe010db4bd80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db4bdc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db4be00 _sleep() at _sleep+0x2ce/frame 0xfffffe010db4bea0 buf_daemon() at buf_daemon+0x121/frame 0xfffffe010db4bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db4bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db4bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100198 td 0xfffffe010e39f560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49b9d40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49b9d60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e49b9da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e49b9de0 _sleep() at _sleep+0x2ce/frame 0xfffffe00e49b9e80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe00e49b9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49b9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49b9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100199 td 0xfffffe010e39ee40 sched_switch() at sched_switch+0x559/frame 0xfffffe0111132d40 mi_switch() at mi_switch+0x157/frame 0xfffffe0111132d60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0111132da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0111132de0 _sleep() at _sleep+0x2ce/frame 0xfffffe0111132e80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe0111132ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0111132f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0111132f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100200 td 0xfffffe010e39e720 sched_switch() at sched_switch+0x559/frame 0xfffffe0110f2bd40 mi_switch() at mi_switch+0x157/frame 0xfffffe0110f2bd60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0110f2bda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0110f2bde0 _sleep() at _sleep+0x2ce/frame 0xfffffe0110f2be80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe0110f2bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0110f2bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0110f2bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100201 td 0xfffffe010e39e000 sched_switch() at sched_switch+0x559/frame 0xfffffe010db50d40 mi_switch() at mi_switch+0x157/frame 0xfffffe010db50d60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db50da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db50de0 _sleep() at _sleep+0x2ce/frame 0xfffffe010db50e80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010db50ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db50f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db50f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100202 td 0xfffffe010e389740 sched_switch() at sched_switch+0x559/frame 0xfffffe011153bd40 mi_switch() at mi_switch+0x157/frame 0xfffffe011153bd60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe011153bda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe011153bde0 _sleep() at _sleep+0x2ce/frame 0xfffffe011153be80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe011153bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe011153bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe011153bf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command bufdaemon pid 16 tid 100203 td 0xfffffe010e389020 sched_switch() at sched_switch+0x559/frame 0xfffffe0111d48d40 mi_switch() at mi_switch+0x157/frame 0xfffffe0111d48d60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0111d48da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0111d48de0 _sleep() at _sleep+0x2ce/frame 0xfffffe0111d48e80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe0111d48ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0111d48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0111d48f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command bufdaemon pid 16 tid 100204 td 0xfffffe010e388900 sched_switch() at sched_switch+0x559/frame 0xfffffe010db55d40 mi_switch() at mi_switch+0x157/frame 0xfffffe010db55d60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db55da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db55de0 _sleep() at _sleep+0x2ce/frame 0xfffffe010db55e80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010db55ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db55f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db55f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100221 td 0xfffffe00e4d0b1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe014175dd70 mi_switch() at mi_switch+0x157/frame 0xfffffe014175dd90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014175ddd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe014175de10 _sleep() at _sleep+0x2ce/frame 0xfffffe014175deb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe014175def0 fork_exit() at fork_exit+0x80/frame 0xfffffe014175df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014175df30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command bufdaemon pid 16 tid 100227 td 0xfffffe010e385000 sched_switch() at sched_switch+0x559/frame 0xfffffe01417d4d70 mi_switch() at mi_switch+0x157/frame 0xfffffe01417d4d90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01417d4dd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01417d4e10 _sleep() at _sleep+0x2ce/frame 0xfffffe01417d4eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe01417d4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01417d4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01417d4f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command bufdaemon pid 16 tid 826450 td 0xfffffe017288e560 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81feb990 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81feb9a0 trap() at trap+0x56/frame 0xffffffff81febab0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81febab0 --- trap 0x13, rip = 0xffffffff80c5e140, rsp = 0xfffffe0166241a90, rbp = 0xfffffe0166241aa0 --- lock_delay() at lock_delay+0x20/frame 0xfffffe0166241aa0 __mtx_lock_sleep() at __mtx_lock_sleep+0xf8/frame 0xfffffe0166241b30 __mtx_lock_flags() at __mtx_lock_flags+0xe5/frame 0xfffffe0166241b80 vdbatch_process() at vdbatch_process+0x64/frame 0xfffffe0166241bb0 vdropl() at vdropl+0x2ba/frame 0xfffffe0166241bf0 vnlru_free_impl() at vnlru_free_impl+0x92/frame 0xfffffe0166241c70 vn_alloc_hard() at vn_alloc_hard+0xf9/frame 0xfffffe0166241ca0 getnewvnode() at getnewvnode+0x2ae/frame 0xfffffe0166241ce0 ffs_vgetf() at ffs_vgetf+0x11b/frame 0xfffffe0166241d60 handle_workitem_remove() at handle_workitem_remove+0x50/frame 0xfffffe0166241de0 process_worklist_item() at process_worklist_item+0x2bd/frame 0xfffffe0166241e70 softdep_process_worklist() at softdep_process_worklist+0xb7/frame 0xfffffe0166241eb0 softdep_flush() at softdep_flush+0x10f/frame 0xfffffe0166241ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0166241f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0166241f30 --- trap 0xc, rip = 0x8220b576a, rsp = 0x826c4af38, rbp = 0x826c4af60 --- Tracing command syncer pid 17 tid 100207 td 0xfffffe010e386560 sched_switch() at sched_switch+0x559/frame 0xfffffe010db46d40 mi_switch() at mi_switch+0x157/frame 0xfffffe010db46d60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db46da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db46de0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x19a/frame 0xfffffe010db46e60 sched_sync() at sched_sync+0x63d/frame 0xfffffe010db46ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db46f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db46f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 18 tid 100208 td 0xfffffe010e385e40 sched_switch() at sched_switch+0x559/frame 0xfffffe014174ed10 mi_switch() at mi_switch+0x157/frame 0xfffffe014174ed30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014174ed70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe014174edb0 _sleep() at _sleep+0x2ce/frame 0xfffffe014174ee50 vnlru_proc() at vnlru_proc+0x9fc/frame 0xfffffe014174eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe014174ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014174ef30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command umount pid 98923 tid 751446 td 0xfffffe01628bc900 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e10 trap() at trap+0x56/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0xffffffff80bea3a8, rsp = 0xfffffe018c45d6f0, rbp = 0xfffffe018c45d770 --- __mtx_lock_sleep() at __mtx_lock_sleep+0xc8/frame 0xfffffe018c45d770 __mtx_lock_flags() at __mtx_lock_flags+0xe5/frame 0xfffffe018c45d7c0 vnlru_free_impl() at vnlru_free_impl+0xae/frame 0xfffffe018c45d840 vn_alloc_hard() at vn_alloc_hard+0xf9/frame 0xfffffe018c45d870 getnewvnode() at getnewvnode+0x2ae/frame 0xfffffe018c45d8b0 ffs_vgetf() at ffs_vgetf+0x11b/frame 0xfffffe018c45d930 handle_workitem_remove() at handle_workitem_remove+0x50/frame 0xfffffe018c45d9b0 process_worklist_item() at process_worklist_item+0x2bd/frame 0xfffffe018c45da40 softdep_process_worklist() at softdep_process_worklist+0xb7/frame 0xfffffe018c45da80 softdep_flushworklist() at softdep_flushworklist+0x3d/frame 0xfffffe018c45dae0 ffs_sync() at ffs_sync+0x3b7/frame 0xfffffe018c45db80 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe018c45dbd0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe018c45dc00 ffs_unmount() at ffs_unmount+0x398/frame 0xfffffe018c45dc80 dounmount() at dounmount+0x7ea/frame 0xfffffe018c45dcf0 kern_unmount() at kern_unmount+0x2d7/frame 0xfffffe018c45de00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe018c45df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe018c45df30 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0xb192328b7ca, rsp = 0xb192242f238, rbp = 0xb192242f770 --- Tracing command sed pid 99289 tid 734351 td 0xfffffe0171c44e40 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce61e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce61e10 trap() at trap+0x56/frame 0xfffffe003ce61f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce61f20 --- trap 0x13, rip = 0xffffffff80c5e140, rsp = 0xfffffe0172444540, rbp = 0xfffffe0172444550 --- lock_delay() at lock_delay+0x20/frame 0xfffffe0172444550 __mtx_lock_sleep() at __mtx_lock_sleep+0xf8/frame 0xfffffe01724445e0 __mtx_lock_flags() at __mtx_lock_flags+0xe5/frame 0xfffffe0172444630 vnlru_free_impl() at vnlru_free_impl+0xae/frame 0xfffffe01724446b0 vn_alloc_hard() at vn_alloc_hard+0xf9/frame 0xfffffe01724446e0 getnewvnode() at getnewvnode+0x2ae/frame 0xfffffe0172444720 ffs_vgetf() at ffs_vgetf+0x11b/frame 0xfffffe01724447a0 ufs_lookup_ino() at ufs_lookup_ino+0xbe7/frame 0xfffffe01724448b0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x5a/frame 0xfffffe01724448d0 vfs_cache_lookup() at vfs_cache_lookup+0xa6/frame 0xfffffe0172444920 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe0172444940 cache_fplookup_noentry() at cache_fplookup_noentry+0x23d/frame 0xfffffe01724449a0 cache_fplookup() at cache_fplookup+0x5d5/frame 0xfffffe0172444a90 namei() at namei+0x203/frame 0xfffffe0172444b50 vn_open_cred() at vn_open_cred+0x4b0/frame 0xfffffe0172444cb0 kern_openat() at kern_openat+0x286/frame 0xfffffe0172444e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0172444f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0172444f30 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x21f3d7fb378a, rsp = 0x21f3d6918e18, rbp = 0x21f3d6919350 --- Tracing command sed pid 99290 tid 714424 td 0xfffffe014446a720 (CPU 2) kdb_enter() at kdb_enter+0x37/frame 0xfffffe01cdb89380 hardclock() at hardclock+0x1b0/frame 0xfffffe01cdb893c0 handleevents() at handleevents+0xb4/frame 0xfffffe01cdb89400 timercb() at timercb+0x196/frame 0xfffffe01cdb89450 lapic_handle_timer() at lapic_handle_timer+0xb6/frame 0xfffffe01cdb89470 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe01cdb89470 --- interrupt, rip = 0xffffffff80c5e142, rsp = 0xfffffe01cdb89540, rbp = 0xfffffe01cdb89550 --- lock_delay() at lock_delay+0x22/frame 0xfffffe01cdb89550 __mtx_lock_sleep() at __mtx_lock_sleep+0xf8/frame 0xfffffe01cdb895e0 __mtx_lock_flags() at __mtx_lock_flags+0xe5/frame 0xfffffe01cdb89630 vnlru_free_impl() at vnlru_free_impl+0xae/frame 0xfffffe01cdb896b0 vn_alloc_hard() at vn_alloc_hard+0xf9/frame 0xfffffe01cdb896e0 getnewvnode() at getnewvnode+0x2ae/frame 0xfffffe01cdb89720 ffs_vgetf() at ffs_vgetf+0x11b/frame 0xfffffe01cdb897a0 ufs_lookup_ino() at ufs_lookup_ino+0xbe7/frame 0xfffffe01cdb898b0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x5a/frame 0xfffffe01cdb898d0 vfs_cache_lookup() at vfs_cache_lookup+0xa6/frame 0xfffffe01cdb89920 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe01cdb89940 cache_fplookup_noentry() at cache_fplookup_noentry+0x23d/frame 0xfffffe01cdb899a0 cache_fplookup() at cache_fplookup+0x5d5/frame 0xfffffe01cdb89a90 namei() at namei+0x203/frame 0xfffffe01cdb89b50 vn_open_cred() at vn_open_cred+0x4b0/frame 0xfffffe01cdb89cb0 kern_openat() at kern_openat+0x286/frame 0xfffffe01cdb89e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01cdb89f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01cdb89f30 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x11a911c4b78a, rsp = 0x11a910af4f28, rbp = 0x11a910af5460 --- Tracing command sh pid 99291 tid 760813 td 0xfffffe015731be40 sched_switch() at sched_switch+0x559/frame 0xfffffe0197b50b80 mi_switch() at mi_switch+0x157/frame 0xfffffe0197b50ba0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0197b50be0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0197b50c30 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0197b50c40 _sleep() at _sleep+0x2dd/frame 0xfffffe0197b50ce0 pipe_read() at pipe_read+0x4b6/frame 0xfffffe0197b50d40 dofileread() at dofileread+0x81/frame 0xfffffe0197b50d90 sys_read() at sys_read+0xc0/frame 0xfffffe0197b50e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0197b50f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0197b50f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x22cfd68c86a, rsp = 0x22cfa909058, rbp = 0x22cfa909580 --- Tracing command sh pid 99292 tid 735260 td 0xfffffe016e5dbc80 sched_switch() at sched_switch+0x559/frame 0xfffffe0178831a10 mi_switch() at mi_switch+0x157/frame 0xfffffe0178831a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0178831a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0178831ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0178831ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe0178831b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe0178831c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0178831e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0178831f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0178831f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2c53ca60aa4a, rsp = 0x2c53c7995fd8, rbp = 0x2c53c7996090 --- Tracing command ls pid 99293 tid 734969 td 0xfffffe016f7a33a0 sched_switch() at sched_switch+0x559/frame 0xfffffe01662be740 mi_switch() at mi_switch+0x157/frame 0xfffffe01662be760 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01662be7a0 sleeplk() at sleeplk+0x107/frame 0xfffffe01662be800 lockmgr_slock_hard() at lockmgr_slock_hard+0x3df/frame 0xfffffe01662be8a0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01662be8e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01662be900 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01662be960 vget_finish() at vget_finish+0x7a/frame 0xfffffe01662be990 cache_lookup() at cache_lookup+0x314/frame 0xfffffe01662be9f0 vfs_cache_lookup() at vfs_cache_lookup+0x7b/frame 0xfffffe01662bea40 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe01662bea60 lookup() at lookup+0x4c1/frame 0xfffffe01662beb00 namei() at namei+0x3f8/frame 0xfffffe01662bebc0 kern_statat() at kern_statat+0x12e/frame 0xfffffe01662bed00 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe01662bee00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01662bef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01662bef30 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x3fdc79b5b54a, rsp = 0x3fdc762c3108, rbp = 0x3fdc762c3220 --- Tracing command dhclient pid 99294 tid 735079 td 0xfffffe016fad5900 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7be00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7be10 trap() at trap+0x56/frame 0xfffffe003ce7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7bf20 --- trap 0x13, rip = 0xffffffff80c5e142, rsp = 0xfffffe0159f6c3f0, rbp = 0xfffffe0159f6c400 --- lock_delay() at lock_delay+0x22/frame 0xfffffe0159f6c400 __mtx_lock_sleep() at __mtx_lock_sleep+0xf8/frame 0xfffffe0159f6c490 __mtx_lock_flags() at __mtx_lock_flags+0xe5/frame 0xfffffe0159f6c4e0 vnlru_free_impl() at vnlru_free_impl+0xae/frame 0xfffffe0159f6c560 vn_alloc_hard() at vn_alloc_hard+0xf9/frame 0xfffffe0159f6c590 getnewvnode() at getnewvnode+0x2ae/frame 0xfffffe0159f6c5d0 ffs_vgetf() at ffs_vgetf+0x11b/frame 0xfffffe0159f6c650 ufs_lookup_ino() at ufs_lookup_ino+0xbe7/frame 0xfffffe0159f6c760 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x5a/frame 0xfffffe0159f6c780 vfs_cache_lookup() at vfs_cache_lookup+0xa6/frame 0xfffffe0159f6c7d0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe0159f6c7f0 cache_fplookup_noentry() at cache_fplookup_noentry+0x23d/frame 0xfffffe0159f6c850 cache_fplookup() at cache_fplookup+0x5d5/frame 0xfffffe0159f6c940 namei() at namei+0x203/frame 0xfffffe0159f6ca00 kern_execve() at kern_execve+0x2c0/frame 0xfffffe0159f6cd80 sys_execve() at sys_execve+0x5a/frame 0xfffffe0159f6ce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0159f6cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0159f6cf30 --- syscall (59, FreeBSD ELF64, sys_execve), rip = 0xa1a457e1b0a, rsp = 0xa1a42f77518, rbp = 0xa1a42f775a0 --- Tracing command sh pid 59236 tid 735521 td 0xfffffe0166b7d3a0 --- swapped out Tracing command tee pid 59237 tid 735348 td 0xfffffe016faca1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe01789f3b80 mi_switch() at mi_switch+0x157/frame 0xfffffe01789f3ba0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01789f3be0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01789f3c30 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01789f3c40 _sleep() at _sleep+0x2dd/frame 0xfffffe01789f3ce0 pipe_read() at pipe_read+0x4b6/frame 0xfffffe01789f3d40 dofileread() at dofileread+0x81/frame 0xfffffe01789f3d90 sys_read() at sys_read+0xc0/frame 0xfffffe01789f3e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01789f3f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01789f3f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x3df49a71086a, rsp = 0x3df498e97ff8, rbp = 0x3df498e98050 --- Tracing command sh pid 59238 tid 759350 td 0xfffffe0175f3b1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe0195ebda10 mi_switch() at mi_switch+0x157/frame 0xfffffe0195ebda30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0195ebda70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0195ebdac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0195ebdad0 _sleep() at _sleep+0x2dd/frame 0xfffffe0195ebdb70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe0195ebdc00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0195ebde00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0195ebdf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0195ebdf30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x3321730e5a4a, rsp = 0x332170fdfba8, rbp = 0x332170fdfc60 --- Tracing command md10 pid 59254 tid 760134 td 0xfffffe0161dbbe40 sched_switch() at sched_switch+0x559/frame 0xfffffe0196e0dda0 mi_switch() at mi_switch+0x157/frame 0xfffffe0196e0ddc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0196e0de00 _sleep() at _sleep+0x2e7/frame 0xfffffe0196e0dea0 md_kthread() at md_kthread+0xd5/frame 0xfffffe0196e0def0 fork_exit() at fork_exit+0x80/frame 0xfffffe0196e0df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0196e0df30 --- trap 0xc, rip = 0x27c4c261648a, rsp = 0x27c4be724148, rbp = 0x27c4be724160 --- Tracing command dhclient pid 2335 tid 100266 td 0xfffffe010e418740 sched_switch() at sched_switch+0x559/frame 0xfffffe0143897ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe0143897ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143897b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143897b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143897b70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0143897bd0 kern_select() at kern_select+0xa15/frame 0xfffffe0143897dc0 sys_select() at sys_select+0x56/frame 0xfffffe0143897e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143897f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143897f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0xa1a457e48ea, rsp = 0xa1a42f78468, rbp = 0xa1a42f78520 --- Tracing command dhclient pid 2338 tid 100248 td 0xfffffe01428a8c80 sched_switch() at sched_switch+0x559/frame 0xfffffe010db98a10 mi_switch() at mi_switch+0x157/frame 0xfffffe010db98a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db98a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db98ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db98ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe010db98b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe010db98c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe010db98e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db98f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db98f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0xa1a457e4a4a, rsp = 0xa1a42f77518, rbp = 0xa1a42f775a0 --- Tracing command dhclient pid 2414 tid 100281 td 0xfffffe01428a7e40 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbd4b80 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbd4ba0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbd4be0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbd4c30 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbd4c40 _sleep() at _sleep+0x2dd/frame 0xfffffe010dbd4ce0 pipe_read() at pipe_read+0x4b6/frame 0xfffffe010dbd4d40 dofileread() at dofileread+0x81/frame 0xfffffe010dbd4d90 sys_read() at sys_read+0xc0/frame 0xfffffe010dbd4e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbd4f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbd4f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0xa1a457e486a, rsp = 0xa1a42f76498, rbp = 0xa1a42f764c0 --- Tracing command devd pid 2419 tid 100242 td 0xfffffe014363f000 sched_switch() at sched_switch+0x559/frame 0xfffffe010db8ea60 mi_switch() at mi_switch+0x157/frame 0xfffffe010db8ea80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db8eac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db8eb10 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010db8eb50 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe010db8ebd0 kern_select() at kern_select+0x9ef/frame 0xfffffe010db8edc0 sys_select() at sys_select+0x56/frame 0xfffffe010db8ee00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db8ef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db8ef30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x28b42a, rsp = 0x820668878, rbp = 0x82066aa10 --- Tracing command syslogd pid 2606 tid 100211 td 0xfffffe00e4d8a3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe014176cab0 mi_switch() at mi_switch+0x157/frame 0xfffffe014176cad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014176cb10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014176cb60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014176cb70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014176cbd0 kern_select() at kern_select+0xa15/frame 0xfffffe014176cdc0 sys_select() at sys_select+0x56/frame 0xfffffe014176ce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014176cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014176cf30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x49b315f48ea, rsp = 0x49b2e779ba8, rbp = 0x49b2e77a130 --- Tracing command watchdogd pid 2614 tid 100273 td 0xfffffe014409c560 sched_switch() at sched_switch+0x559/frame 0xfffffe01438b5a10 mi_switch() at mi_switch+0x157/frame 0xfffffe01438b5a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438b5a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438b5ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01438b5ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe01438b5b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01438b5c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01438b5e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438b5f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438b5f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8a53cd5a4a, rsp = 0x8a51e19268, rbp = 0x8a51e19330 --- Tracing command rpcbind pid 2646 tid 100278 td 0xfffffe014409f020 sched_switch() at sched_switch+0x559/frame 0xfffffe01438d3a90 mi_switch() at mi_switch+0x157/frame 0xfffffe01438d3ab0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438d3af0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438d3b40 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01438d3b80 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe01438d3c00 kern_poll_kfds() at kern_poll_kfds+0x487/frame 0xfffffe01438d3c90 kern_poll() at kern_poll+0x9f/frame 0xfffffe01438d3de0 sys_poll() at sys_poll+0x50/frame 0xfffffe01438d3e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438d3f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438d3f30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x3c4c24c717ea, rsp = 0x3c4c21858238, rbp = 0x3c4c2185a460 --- Tracing command rpc.statd pid 2671 tid 100263 td 0xfffffe0144028ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe010db84a60 mi_switch() at mi_switch+0x157/frame 0xfffffe010db84a80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db84ac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db84b10 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010db84b50 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe010db84bd0 kern_select() at kern_select+0x9ef/frame 0xfffffe010db84dc0 sys_select() at sys_select+0x56/frame 0xfffffe010db84e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db84f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db84f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x3f325a4248ea, rsp = 0x3f3258266a68, rbp = 0x3f3258266bb0 --- Tracing command rpc.lockd pid 2674 tid 100279 td 0xfffffe0144027c80 sched_switch() at sched_switch+0x559/frame 0xfffffe01438c4990 mi_switch() at mi_switch+0x157/frame 0xfffffe01438c49b0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438c49f0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438c4a40 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01438c4a80 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe01438c4b00 svc_run_internal() at svc_run_internal+0xada/frame 0xfffffe01438c4c30 svc_run() at svc_run+0x230/frame 0xfffffe01438c4c90 sys_nlm_syscall() at sys_nlm_syscall+0x6fa/frame 0xfffffe01438c4e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438c4f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438c4f30 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x18236fb0d02a, rsp = 0x18236d3bcfe8, rbp = 0x18236d3bd0b0 --- Tracing command powerd pid 2679 tid 100217 td 0xfffffe010e7f8e40 sched_switch() at sched_switch+0x559/frame 0xfffffe0141780a60 mi_switch() at mi_switch+0x157/frame 0xfffffe0141780a80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141780ac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141780b10 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0141780b50 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe0141780bd0 kern_select() at kern_select+0x9ef/frame 0xfffffe0141780dc0 sys_select() at sys_select+0x56/frame 0xfffffe0141780e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141780f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141780f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x3ef4383d8ea, rsp = 0x3ef41b2aba8, rbp = 0x3ef41b2ace0 --- Tracing command ntpd pid 2705 tid 100228 td 0xfffffe010e7fc020 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce88e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce88e10 trap() at trap+0x56/frame 0xfffffe003ce88f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce88f20 --- trap 0x13, rip = 0xffffffff80c5e140, rsp = 0xfffffe014178f5b0, rbp = 0xfffffe014178f5c0 --- lock_delay() at lock_delay+0x20/frame 0xfffffe014178f5c0 __mtx_lock_sleep() at __mtx_lock_sleep+0xf8/frame 0xfffffe014178f650 __mtx_lock_flags() at __mtx_lock_flags+0xe5/frame 0xfffffe014178f6a0 vnlru_free_impl() at vnlru_free_impl+0xae/frame 0xfffffe014178f720 vn_alloc_hard() at vn_alloc_hard+0xf9/frame 0xfffffe014178f750 getnewvnode() at getnewvnode+0x2ae/frame 0xfffffe014178f790 ffs_vgetf() at ffs_vgetf+0x11b/frame 0xfffffe014178f810 ufs_lookup_ino() at ufs_lookup_ino+0xbe7/frame 0xfffffe014178f920 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x5a/frame 0xfffffe014178f940 vfs_cache_lookup() at vfs_cache_lookup+0xa6/frame 0xfffffe014178f990 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe014178f9b0 cache_fplookup_noentry() at cache_fplookup_noentry+0x23d/frame 0xfffffe014178fa10 cache_fplookup() at cache_fplookup+0x5d5/frame 0xfffffe014178fb00 namei() at namei+0x203/frame 0xfffffe014178fbc0 kern_statat() at kern_statat+0x12e/frame 0xfffffe014178fd00 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe014178fe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014178ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014178ff30 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x26fa2384354a, rsp = 0x26fa1f7797a8, rbp = 0x26fa1f7798c0 --- Tracing command inetd pid 2731 tid 100265 td 0xfffffe0143625900 sched_switch() at sched_switch+0x559/frame 0xfffffe014388dab0 mi_switch() at mi_switch+0x157/frame 0xfffffe014388dad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014388db10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014388db60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014388db70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014388dbd0 kern_select() at kern_select+0xa15/frame 0xfffffe014388ddc0 sys_select() at sys_select+0x56/frame 0xfffffe014388de00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014388df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014388df30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x1a941bcb68ea, rsp = 0x1a9418842e08, rbp = 0x1a9418843ca0 --- Tracing command sshd pid 2750 tid 100238 td 0xfffffe014363f720 sched_switch() at sched_switch+0x559/frame 0xfffffe010db93a70 mi_switch() at mi_switch+0x157/frame 0xfffffe010db93a90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db93ad0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db93b20 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db93b30 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010db93b90 kern_select() at kern_select+0xa15/frame 0xfffffe010db93d80 sys_pselect() at sys_pselect+0x127/frame 0xfffffe010db93e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db93f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db93f30 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x28570016c82a, rsp = 0x2856f94515d8, rbp = 0x2856f9451620 --- Tracing command cron pid 2754 tid 100288 td 0xfffffe0144026e40 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6ee10 trap() at trap+0x56/frame 0xfffffe003ce6ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6ef20 --- trap 0x13, rip = 0xffffffff80c81548, rsp = 0xfffffe01438d8600, rbp = 0xfffffe01438d8610 --- witness_lock() at witness_lock+0x1c8/frame 0xfffffe01438d8610 __mtx_lock_flags() at __mtx_lock_flags+0xf9/frame 0xfffffe01438d8660 vdropl() at vdropl+0x24e/frame 0xfffffe01438d86a0 vnlru_free_impl() at vnlru_free_impl+0x92/frame 0xfffffe01438d8720 vn_alloc_hard() at vn_alloc_hard+0xf9/frame 0xfffffe01438d8750 getnewvnode() at getnewvnode+0x2ae/frame 0xfffffe01438d8790 ffs_vgetf() at ffs_vgetf+0x11b/frame 0xfffffe01438d8810 ufs_lookup_ino() at ufs_lookup_ino+0xbe7/frame 0xfffffe01438d8920 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x5a/frame 0xfffffe01438d8940 vfs_cache_lookup() at vfs_cache_lookup+0xa6/frame 0xfffffe01438d8990 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe01438d89b0 cache_fplookup_noentry() at cache_fplookup_noentry+0x23d/frame 0xfffffe01438d8a10 cache_fplookup() at cache_fplookup+0x5d5/frame 0xfffffe01438d8b00 namei() at namei+0x203/frame 0xfffffe01438d8bc0 kern_statat() at kern_statat+0x12e/frame 0xfffffe01438d8d00 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe01438d8e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438d8f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438d8f30 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x13ddc5ce254a, rsp = 0x13ddc281f1f8, rbp = 0x13ddc281fbd0 --- Tracing command getty pid 2768 tid 100209 td 0xfffffe010e417900 sched_switch() at sched_switch+0x559/frame 0xfffffe0141758af0 mi_switch() at mi_switch+0x157/frame 0xfffffe0141758b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141758b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141758ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141758bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141758c10 tty_wait() at tty_wait+0x42/frame 0xfffffe0141758c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe0141758cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0141758ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0141758d40 dofileread() at dofileread+0x81/frame 0xfffffe0141758d90 sys_read() at sys_read+0xc0/frame 0xfffffe0141758e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141758f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141758f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x3011e654186a, rsp = 0x3011e4c2c028, rbp = 0x3011e4c2c070 --- Tracing command getty pid 2769 tid 100290 td 0xfffffe014409e1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe0143911af0 mi_switch() at mi_switch+0x157/frame 0xfffffe0143911b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143911b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143911ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143911bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0143911c10 tty_wait() at tty_wait+0x42/frame 0xfffffe0143911c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe0143911cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0143911ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0143911d40 dofileread() at dofileread+0x81/frame 0xfffffe0143911d90 sys_read() at sys_read+0xc0/frame 0xfffffe0143911e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143911f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143911f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x15b4d631686a, rsp = 0x15b4d4588ec8, rbp = 0x15b4d4588f10 --- Tracing command getty pid 2770 tid 100289 td 0xfffffe014409e900 sched_switch() at sched_switch+0x559/frame 0xfffffe01438ceaf0 mi_switch() at mi_switch+0x157/frame 0xfffffe01438ceb10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438ceb50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438ceba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01438cebb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01438cec10 tty_wait() at tty_wait+0x42/frame 0xfffffe01438cec40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe01438cecb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01438cece0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01438ced40 dofileread() at dofileread+0x81/frame 0xfffffe01438ced90 sys_read() at sys_read+0xc0/frame 0xfffffe01438cee00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438cef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438cef30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x281fe64aa86a, rsp = 0x281fe553f078, rbp = 0x281fe553f0c0 --- Tracing command getty pid 2771 tid 100291 td 0xfffffe014409dac0 sched_switch() at sched_switch+0x559/frame 0xfffffe014390caf0 mi_switch() at mi_switch+0x157/frame 0xfffffe014390cb10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014390cb50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014390cba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014390cbb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014390cc10 tty_wait() at tty_wait+0x42/frame 0xfffffe014390cc40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe014390ccb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe014390cce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe014390cd40 dofileread() at dofileread+0x81/frame 0xfffffe014390cd90 sys_read() at sys_read+0xc0/frame 0xfffffe014390ce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014390cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014390cf30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x2d7586a0286a, rsp = 0x2d758589c388, rbp = 0x2d758589c3d0 --- Tracing command getty pid 2772 tid 100292 td 0xfffffe014409d3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe014391baf0 mi_switch() at mi_switch+0x157/frame 0xfffffe014391bb10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014391bb50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014391bba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014391bbb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014391bc10 tty_wait() at tty_wait+0x42/frame 0xfffffe014391bc40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe014391bcb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe014391bce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe014391bd40 dofileread() at dofileread+0x81/frame 0xfffffe014391bd90 sys_read() at sys_read+0xc0/frame 0xfffffe014391be00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014391bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014391bf30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x7197721586a, rsp = 0x71974c997c8, rbp = 0x71974c99810 --- Tracing command getty pid 2773 tid 100293 td 0xfffffe014409cc80 sched_switch() at sched_switch+0x559/frame 0xfffffe0143916af0 mi_switch() at mi_switch+0x157/frame 0xfffffe0143916b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143916b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143916ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143916bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0143916c10 tty_wait() at tty_wait+0x42/frame 0xfffffe0143916c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe0143916cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0143916ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0143916d40 dofileread() at dofileread+0x81/frame 0xfffffe0143916d90 sys_read() at sys_read+0xc0/frame 0xfffffe0143916e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143916f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143916f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x38886be4f86a, rsp = 0x388869577148, rbp = 0x388869577190 --- Tracing command getty pid 2774 tid 100294 td 0xfffffe0144110900 sched_switch() at sched_switch+0x559/frame 0xfffffe0143925af0 mi_switch() at mi_switch+0x157/frame 0xfffffe0143925b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143925b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143925ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143925bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0143925c10 tty_wait() at tty_wait+0x42/frame 0xfffffe0143925c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe0143925cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0143925ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0143925d40 dofileread() at dofileread+0x81/frame 0xfffffe0143925d90 sys_read() at sys_read+0xc0/frame 0xfffffe0143925e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143925f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143925f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x37ec2a0c286a, rsp = 0x37ec27a8a2f8, rbp = 0x37ec27a8a340 --- Tracing command getty pid 2775 tid 100235 td 0xfffffe010e3a1900 sched_switch() at sched_switch+0x559/frame 0xfffffe010db70af0 mi_switch() at mi_switch+0x157/frame 0xfffffe010db70b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db70b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db70ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db70bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010db70c10 tty_wait() at tty_wait+0x42/frame 0xfffffe010db70c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe010db70cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010db70ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010db70d40 dofileread() at dofileread+0x81/frame 0xfffffe010db70d90 sys_read() at sys_read+0xc0/frame 0xfffffe010db70e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db70f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db70f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x4948e6d986a, rsp = 0x4948ce26bf8, rbp = 0x4948ce26c40 --- Tracing command getty pid 2776 tid 100229 td 0xfffffe010e1ba740 sched_switch() at sched_switch+0x559/frame 0xfffffe01417cfaf0 mi_switch() at mi_switch+0x157/frame 0xfffffe01417cfb10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01417cfb50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417cfba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417cfbb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417cfc10 tty_wait() at tty_wait+0x42/frame 0xfffffe01417cfc40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe01417cfcb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417cfce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417cfd40 dofileread() at dofileread+0x81/frame 0xfffffe01417cfd90 sys_read() at sys_read+0xc0/frame 0xfffffe01417cfe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01417cff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417cff30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x3ba841da986a, rsp = 0x3ba83fb977f8, rbp = 0x3ba83fb97840 --- Tracing command getty pid 2777 tid 100215 td 0xfffffe010e7e53a0 sched_switch() at sched_switch+0x559/frame 0xfffffe0141776af0 mi_switch() at mi_switch+0x157/frame 0xfffffe0141776b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141776b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141776ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141776bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141776c10 tty_wait() at tty_wait+0x42/frame 0xfffffe0141776c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe0141776cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0141776ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0141776d40 dofileread() at dofileread+0x81/frame 0xfffffe0141776d90 sys_read() at sys_read+0xc0/frame 0xfffffe0141776e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141776f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141776f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x1e248989f86a, rsp = 0x1e24881156e8, rbp = 0x1e2488115730 --- Tracing command sshd pid 2782 tid 100218 td 0xfffffe010e3881e0 sched_switch() at sched_switch+0x559/frame 0xfffffe014178aae0 mi_switch() at mi_switch+0x157/frame 0xfffffe014178ab00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014178ab40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014178ab90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014178aba0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014178ac00 kern_poll_kfds() at kern_poll_kfds+0x4bc/frame 0xfffffe014178ac90 kern_poll() at kern_poll+0x9f/frame 0xfffffe014178ade0 sys_poll() at sys_poll+0x50/frame 0xfffffe014178ae00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014178af30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014178af30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x273a35ba37ea, rsp = 0x273a2ea607e8, rbp = 0x273a2ea60820 --- Tracing command sshd pid 2785 tid 100246 td 0xfffffe010e3a11e0 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbc5a70 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbc5a90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbc5ad0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbc5b20 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbc5b30 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010dbc5b90 kern_select() at kern_select+0xa15/frame 0xfffffe010dbc5d80 sys_pselect() at sys_pselect+0x127/frame 0xfffffe010dbc5e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbc5f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbc5f30 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x273a35ba382a, rsp = 0x273a2ea5c768, rbp = 0x273a2ea5c7b0 --- Tracing command bash pid 2786 tid 100283 td 0xfffffe01428a7000 --- swapped out Tracing command su pid 2793 tid 100264 td 0xfffffe010e39fc80 --- swapped out Tracing command csh pid 2794 tid 100245 td 0xfffffe0143626740 --- swapped out Tracing command bash pid 2796 tid 100239 td 0xfffffe01428a93a0 sched_switch() at sched_switch+0x559/frame 0xfffffe010db9da70 mi_switch() at mi_switch+0x157/frame 0xfffffe010db9da90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db9dad0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db9db20 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db9db30 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010db9db90 kern_select() at kern_select+0xa15/frame 0xfffffe010db9dd80 sys_pselect() at sys_pselect+0x127/frame 0xfffffe010db9de00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db9df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db9df30 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x8227fc82a, rsp = 0x8204489c8, rbp = 0x820448a90 --- Tracing command sh pid 4554 tid 100417 td 0xfffffe014ebeac80 --- swapped out Tracing command sh pid 5230 tid 100274 td 0xfffffe014410d000 --- swapped out Tracing command sh pid 5294 tid 100306 td 0xfffffe01444ce900 sched_switch() at sched_switch+0x559/frame 0xfffffe014395ca10 mi_switch() at mi_switch+0x157/frame 0xfffffe014395ca30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014395ca70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014395cac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014395cad0 _sleep() at _sleep+0x2dd/frame 0xfffffe014395cb70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe014395cc00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014395ce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014395cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014395cf30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x22cfd68ca4a, rsp = 0x22cfa909758, rbp = 0x22cfa909810 --- Tracing command awk pid 5295 tid 100303 td 0xfffffe01444bf560 sched_switch() at sched_switch+0x559/frame 0xfffffe0143957b80 mi_switch() at mi_switch+0x157/frame 0xfffffe0143957ba0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143957be0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143957c30 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143957c40 _sleep() at _sleep+0x2dd/frame 0xfffffe0143957ce0 pipe_read() at pipe_read+0x4b6/frame 0xfffffe0143957d40 dofileread() at dofileread+0x81/frame 0xfffffe0143957d90 sys_read() at sys_read+0xc0/frame 0xfffffe0143957e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143957f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143957f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x13efe69a586a, rsp = 0x13efe4e40ec8, rbp = 0x13efe4e40ee0 --- Tracing command sh pid 5297 tid 100728 td 0xfffffe0144552740 sched_switch() at sched_switch+0x559/frame 0xfffffe01439a2b80 mi_switch() at mi_switch+0x157/frame 0xfffffe01439a2ba0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01439a2be0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01439a2c30 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01439a2c40 _sleep() at _sleep+0x2dd/frame 0xfffffe01439a2ce0 pipe_read() at pipe_read+0x4b6/frame 0xfffffe01439a2d40 dofileread() at dofileread+0x81/frame 0xfffffe01439a2d90 sys_read() at sys_read+0xc0/frame 0xfffffe01439a2e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01439a2f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01439a2f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x22cfd68c86a, rsp = 0x22cfa909208, rbp = 0x22cfa909730 --- Tracing command aiod1 pid 48909 tid 101663 td 0xfffffe014ebf03a0 sched_switch() at sched_switch+0x559/frame 0xfffffe0151627d60 mi_switch() at mi_switch+0x157/frame 0xfffffe0151627d80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0151627dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0151627e00 _sleep() at _sleep+0x2ce/frame 0xfffffe0151627ea0 aio_daemon() at aio_daemon+0x305/frame 0xfffffe0151627ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0151627f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0151627f30 --- trap 0xc, rip = 0x30c659d7e48a, rsp = 0x30c656994c18, rbp = 0x30c656994c30 --- Tracing command aiod2 pid 48910 tid 100280 td 0xfffffe0144027560 sched_switch() at sched_switch+0x559/frame 0xfffffe01438ddd60 mi_switch() at mi_switch+0x157/frame 0xfffffe01438ddd80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438dddc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01438dde00 _sleep() at _sleep+0x2ce/frame 0xfffffe01438ddea0 aio_daemon() at aio_daemon+0x305/frame 0xfffffe01438ddef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01438ddf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01438ddf30 --- trap 0xc, rip = 0x18d51724448a, rsp = 0x18d51548e9c8, rbp = 0x18d51548e9e0 --- Tracing command aiod3 pid 48911 tid 101677 td 0xfffffe015759ce40 sched_switch() at sched_switch+0x559/frame 0xfffffe015170cd60 mi_switch() at mi_switch+0x157/frame 0xfffffe015170cd80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe015170cdc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe015170ce00 _sleep() at _sleep+0x2ce/frame 0xfffffe015170cea0 aio_daemon() at aio_daemon+0x305/frame 0xfffffe015170cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe015170cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe015170cf30 --- trap 0xc, rip = 0x29e09253048a, rsp = 0x29e090542eb8, rbp = 0x29e090542ed0 --- Tracing command aiod4 pid 48912 tid 101674 td 0xfffffe0144111740 sched_switch() at sched_switch+0x559/frame 0xfffffe0151647d60 mi_switch() at mi_switch+0x157/frame 0xfffffe0151647d80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0151647dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0151647e00 _sleep() at _sleep+0x2ce/frame 0xfffffe0151647ea0 aio_daemon() at aio_daemon+0x305/frame 0xfffffe0151647ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0151647f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0151647f30 --- trap 0xc, rip = 0x22cfd68c48a, rsp = 0x22cfa9099e8, rbp = 0x22cfa909ae0 --- db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=textdump@entry=0x0) at ../../../kern/kern_shutdown.c:406 #2 0xffffffff804c96da in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #3 0xffffffff804c9592 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x0) at ../../../ddb/db_command.c:482 #4 0xffffffff804c9626 in db_command_script (command=command@entry=0xffffffff81bd4dc0 "dump") at ../../../ddb/db_command.c:553 #5 0xffffffff804ce958 in db_script_exec (scriptname=0xffffffff81bd4730 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #6 0xffffffff804c9592 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x0) at ../../../ddb/db_command.c:482 #7 0xffffffff804c9626 in db_command_script (command=command@entry=0xffffffff81bd4d52 "run pho1") at ../../../ddb/db_command.c:553 #8 0xffffffff804ce958 in db_script_exec (scriptname=0xffffffff81bd4730 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #9 0xffffffff804c9592 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x1) at ../../../ddb/db_command.c:482 #10 0xffffffff804c91ed in db_command_loop () at ../../../ddb/db_command.c:535 #11 0xffffffff804cc826 in db_trap (type=, code=) at ../../../ddb/db_main.c:270 #12 0xffffffff80c5d3bb in kdb_trap (type=type@entry=0x3, code=code@entry=0x0, tf=tf@entry=0xfffffe01cdb892b0) at ../../../kern/subr_kdb.c:733 #13 0xffffffff810f565a in trap (frame=0xfffffe01cdb892b0) at ../../../amd64/amd64/trap.c:609 #14 #15 kdb_enter (why=0xffffffff81205d86 "watchdog", msg=) at ../../../kern/subr_kdb.c:506 #16 0xffffffff80b99dc0 in watchdog_fire () at ../../../kern/kern_clock.c:826 #17 hardclock (cnt=, usermode=, usermode@entry=0x0) at ../../../kern/kern_clock.c:505 #18 0xffffffff80b9ab64 in handleevents (now=now@entry=0x6c8b9c2f02e7, fake=fake@entry=0x0) at ../../../kern/kern_clocksource.c:186 #19 0xffffffff80b9b6d6 in timercb (et=0xffffffff81ff2070 , arg=) at ../../../kern/kern_clocksource.c:358 #20 0xffffffff811baf66 in lapic_handle_timer (frame=) at ../../../x86/x86/local_apic.c:1339 #21 #22 lock_delay (la=la@entry=0xfffffe01cdb89580) at ../../../kern/subr_lock.c:137 #23 0xffffffff80bea3d8 in __mtx_lock_sleep (c=c@entry=0xffffffff81a44498 , v=, opts=, opts@entry=0x0, file=, file@entry=0xffffffff81284247 "../../../kern/vfs_subr.c", line=line@entry=0x522) at ../../../kern/kern_mutex.c:604 #24 0xffffffff80bea265 in __mtx_lock_flags (c=0xffffffff81a44498 , opts=0x1000, file=0xffffffff81284247 "../../../kern/vfs_subr.c", line=0x522) at ../../../kern/kern_mutex.c:284 #25 0xffffffff80cfd72e in vnlru_free_impl (count=count@entry=0x1, mnt_op=mnt_op@entry=0x0, mvp=) at ../../../kern/vfs_subr.c:1314 #26 0xffffffff80d08cd9 in vnlru_free_locked (count=0x1) at ../../../kern/vfs_subr.c:1325 #27 vn_alloc_hard (mp=mp@entry=0xfffffe010e0c4700) at ../../../kern/vfs_subr.c:1699 #28 0xffffffff80cfe15e in vn_alloc (mp=0xfffffe010e0c4700) at /usr/src/sys/amd64/include/atomic.h:408 #29 getnewvnode (tag=0xffffffff811f2630 "ufs", mp=mp@entry=0xfffffe010e0c4700, vops=0xffffffff81b67910 , vpp=vpp@entry=0xfffffe01cdb89770) at ../../../kern/vfs_subr.c:1764 #30 0xffffffff80f5a1bb in ffs_vgetf (mp=, ino=, flags=0x80000, vpp=0xfffffe01cdb89858, ffs_flags=0x0) at ../../../ufs/ffs/ffs_vfsops.c:1884 #31 0xffffffff80f68d57 in ufs_lookup_ino (vdp=, vpp=0xfffffe01cdb89970, cnp=, dd_ino=0x0) at ../../../ufs/ufs/ufs_lookup.c:743 #32 0xffffffff811bf10a in VOP_CACHEDLOOKUP_APV (vop=0xffffffff81b67910 , a=a@entry=0xfffffe01cdb898e0) at vnode_if.c:180 #33 0xffffffff80ce0026 in VOP_CACHEDLOOKUP (dvp=0xfffffe01570fdc20, vpp=0xfffffe01cdb89970, cnp=0xfffffe01cdb89d40) at ./vnode_if.h:103 #34 vfs_cache_lookup (ap=) at ../../../kern/vfs_cache.c:3069 #35 0xffffffff811bef4a in VOP_LOOKUP_APV (vop=0xffffffff81b67910 , a=a@entry=0xfffffe01cdb89950) at vnode_if.c:117 #36 0xffffffff80ce636d in VOP_LOOKUP (dvp=0xfffffe01570fdc20, vpp=0xfffffe01cdb89970, cnp=0xfffffe01cdb89d40) at ./vnode_if.h:69 #37 cache_fplookup_noentry (fpl=fpl@entry=0xfffffe01cdb899f0) at ../../../kern/vfs_cache.c:4927 #38 0xffffffff80ce23f5 in cache_fplookup_next (fpl=0xfffffe01cdb899f0) at ../../../kern/vfs_cache.c:5283 #39 cache_fplookup_impl (dvp=, fpl=0xfffffe01cdb899f0) at ../../../kern/vfs_cache.c:5931 #40 cache_fplookup (ndp=, ndp@entry=0xfffffe01cdb89cc0, status=status@entry=0xfffffe01cdb89b0c, pwdp=pwdp@entry=0xfffffe01cdb89b10) at ../../../kern/vfs_cache.c:6102 #41 0xffffffff80cefce3 in namei (ndp=ndp@entry=0xfffffe01cdb89cc0) at ../../../kern/vfs_lookup.c:612 #42 0xffffffff80d183e0 in vn_open_cred (ndp=ndp@entry=0xfffffe01cdb89cc0, flagp=flagp@entry=0xfffffe01cdb89dd4, cmode=cmode@entry=0x500, vn_open_flags=vn_open_flags@entry=0x0, cred=0xfffff800042d2e00, fp=0xfffff80575ebb7d0) at ../../../kern/vfs_vnops.c:330 #43 0xffffffff80d17f2f in vn_open (ndp=0xfffffe01cdb89580, ndp@entry=0xfffffe01cdb89cc0, flagp=0xfffffe0171c44e40, flagp@entry=0xfffffe01cdb89dd4, cmode=0x1000, cmode@entry=0x500, fp=0xffffffff81284247) at ../../../kern/vfs_vnops.c:195 #44 0xffffffff80d0ed96 in kern_openat (td=0xfffffe014446a720, fd=0xffffff9c, path=0x11a910af5030 , pathseg=UIO_USERSPACE, flags=0x100001, mode=) at ../../../kern/vfs_syscalls.c:1170 #45 0xffffffff810f6435 in syscallenter (td=0xfffffe014446a720) at ../../../amd64/amd64/../../kern/subr_syscall.c:189 #46 amd64_syscall (td=0xfffffe014446a720, traced=0x0) at ../../../amd64/amd64/trap.c:1191 #47 #48 0x000011a911c4b78a in ?? () Backtrace stopped: Cannot access memory at address 0x11a910af4f28 (kgdb) (kgdb) proc 98923 (kgdb) bt #0 cpustop_handler () at ../../../x86/x86/mp_x86.c:1490 #1 0xffffffff810bae19 in ipi_nmi_handler () at ../../../x86/x86/mp_x86.c:1447 #2 0xffffffff810f4e66 in trap (frame=0xfffffe003ce20f30) at ../../../amd64/amd64/trap.c:240 #3 #4 0xffffffff80bea3a8 in atomic_fcmpset_long (dst=0xffffffff81a44498 , src=0xfffffe01628bc900, expect=) at /usr/src/sys/amd64/include/atomic.h:217 #5 __mtx_lock_sleep (c=c@entry=0xffffffff81a44498 , v=0x0, opts=, opts@entry=0x0, file=, file@entry=0xffffffff81284247 "../../../kern/vfs_subr.c", line=line@entry=0x522) at ../../../kern/kern_mutex.c:581 #6 0xffffffff80bea265 in __mtx_lock_flags (c=0xffffffff81a44498 , opts=0x1000, file=0xffffffff81284247 "../../../kern/vfs_subr.c", line=0x522) at ../../../kern/kern_mutex.c:284 #7 0xffffffff80cfd72e in vnlru_free_impl (count=count@entry=0x1, mnt_op=mnt_op@entry=0x0, mvp=) at ../../../kern/vfs_subr.c:1314 #8 0xffffffff80d08cd9 in vnlru_free_locked (count=0x1) at ../../../kern/vfs_subr.c:1325 #9 vn_alloc_hard (mp=mp@entry=0xfffffe010e0c3000) at ../../../kern/vfs_subr.c:1699 #10 0xffffffff80cfe15e in vn_alloc (mp=0xfffffe010e0c3000) at /usr/src/sys/amd64/include/atomic.h:408 #11 getnewvnode (tag=0xffffffff811f2630 "ufs", mp=mp@entry=0xfffffe010e0c3000, vops=0xffffffff81b67910 , vpp=vpp@entry=0xfffffe018c45d900) at ../../../kern/vfs_subr.c:1764 #12 0xffffffff80f5a1bb in ffs_vgetf (mp=mp@entry=0xfffffe010e0c3000, ino=ino@entry=0x23d081, flags=flags@entry=0x80200, vpp=vpp@entry=0xfffffe018c45d978, ffs_flags=ffs_flags@entry=0x9) at ../../../ufs/ffs/ffs_vfsops.c:1884 #13 0xffffffff80f4b560 in handle_workitem_remove (dirrem=dirrem@entry=0xfffff80255671600, flags=0x80200, flags@entry=0x200) at ../../../ufs/ffs/ffs_softdep.c:10223 #14 0xffffffff80f3fdcd in process_worklist_item (mp=mp@entry=0xfffffe010e0c3000, target=target@entry=0xa, flags=flags@entry=0x200) at ../../../ufs/ffs/ffs_softdep.c:2009 #15 0xffffffff80f3a987 in softdep_process_worklist (mp=mp@entry=0xfffffe010e0c3000, full=full@entry=0x1) at ../../../ufs/ffs/ffs_softdep.c:1808 #16 0xffffffff80f3a84d in softdep_flushworklist (oldmnt=0xfffffe010e0c3000, countp=countp@entry=0xfffffe018c45db04, td=td@entry=0xfffffe01628bc900) at ../../../ufs/ffs/ffs_softdep.c:2120 #17 0xffffffff80f5c237 in ffs_sync (mp=0xfffffe010e0c3000, waitfor=0x1) at ../../../ufs/ffs/ffs_vfsops.c:1770 #18 0xffffffff80d1aad5 in vfs_write_suspend (mp=mp@entry=0xfffffe010e0c3000, flags=flags@entry=0x0) at ../../../kern/vfs_vnops.c:2103 #19 0xffffffff80d1ac95 in vfs_write_suspend_umnt (mp=mp@entry=0xfffffe010e0c3000) at ../../../kern/vfs_vnops.c:2157 #20 0xffffffff80f5bbb8 in ffs_unmount (mp=0xfffffe010e0c3000, mntflags=0x8000000) at ../../../ufs/ffs/ffs_vfsops.c:1393 #21 0xffffffff80cf5f0a in dounmount (mp=0xfffffe018c45d710, mp@entry=0xfffffe010e0c3000, flags=, flags@entry=0x8000000, td=td@entry=0xfffffe01628bc900) at ../../../kern/vfs_mount.c:2209 #22 0xffffffff80cf56d7 in kern_unmount (td=, path=, flags=0x8000000) at ../../../kern/vfs_mount.c:1671 #23 0xffffffff810f6435 in syscallenter (td=0xfffffe01628bc900) at ../../../amd64/amd64/../../kern/subr_syscall.c:189 #24 amd64_syscall (td=0xfffffe01628bc900, traced=0x0) at ../../../amd64/amd64/trap.c:1191 #25 #26 0x00000b192328b7ca in ?? () Backtrace stopped: Cannot access memory at address 0xb192242f238 (kgdb) f 7 #7 0xffffffff80cfd72e in vnlru_free_impl (count=count@entry=0x1, mnt_op=mnt_op@entry=0x0, mvp=) at ../../../kern/vfs_subr.c:1314 1314 mtx_lock(&vnode_list_mtx); (kgdb) p vnode_list_mtx $1 = {lock_object = {lo_name = 0xffffffff812842b7 "vnode_list", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd80180}, mtx_lock = 0xfffffe01628bc900} (kgdb) -- Test scenario: misc/crossmp4.sh