panic: snapacct_ufs2: bad block, vmcore.120 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-ALPHA9 r339356 PHO-GENERIC amd64 FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33182367744 (31645 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: unblocking device. ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard Launching APs: 1 8 5 2 6 11 3 10 7 4 9 Timecounter "TSC-low" frequency 1750035910 Hz quality 1000 random: entropy device external interface module_register_init: MOD_LOAD (vesa, 0xffffffff810ebac0, 0) error 19 kbd1 at kbdmux0 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" netmap: loaded module [ath_hal] loaded nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: attach_pre capping queues at 8 igb0: using 1024 tx descriptors and 1024 rx descriptors igb0: msix_init qsets capped at 8 igb0: pxm cpus: 6 queue msgs: 9 admincnt: 1 igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: using 6 rx queues 6 tx queues i** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 90 files, 241824 used, 1023583 free (135 frags, 127931 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib 32-bit compatibility ldconfig path: /usr/lib32 Setting hostnametperf.freebsd.org. ugen0.3: at usbus0 ukbd0 on uhub3 ukbd0: on usbus0 kbd2 at ukbd0 Setting up harvesting: PURE_RDRAND,[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . lo0: link state changed to UP Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 igb0: flags=8843 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:da inet6 fe80::ec4:7aff:fea8:cdda%igb0 prefixlen 64 scopeid 0x1 media: Ethernet autoselect status: no carrier nd6 options=21 igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Starting devd. igb0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff80003fe9800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 15 Oct 10:26:51 ntpdate[2051]: step time server 192.168.5.1 offset -0.529102 sec Starting rpcbind. Starting watchdogd. No core dumps found. NFS access cache time=60 lock order reversal: 1st 0xfffffe00008b1158 bufwait (bufwait) @ kern/vfs_bio.c:3916 2nd 0xfffff8000c908c00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0xffffffff80bf8c83 at witness_debugger+0x73 #1 0xffffffff80bf89d3 at witness_checkorder+0xab3 #2 0xffffffff80b994e8 at _sx_xlock+0x68 #3 0xffffffff80eb031d at ufsdirhash_add+0x4d #4 0xffffffff80eb4e52 at ufs_direnter+0x472 #5 0xffffffff80ebd370 at ufs_mkdir+0x8f0 #6 0xffffffff811f0102 at VOP_MKDIR_APV+0xc2 #7 0xffffffff80c7171e at kern_mkdirat+0x1be #8 0xffffffff810695b7 at amd64_syscall+0x2a7 #9 0xffffffff81044d8d at fast_syscall_common+0x101 Clearing /tmp (X related). Starting statd. Starting lockd. Updating motd:. Mounting late filesystems:. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Mon Oct 15 10:26 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Oct 15 10:29:18 mercat1 login[2307]: ROOT LOGIN (root) ON ttyu1 Last login: Sun Oct 14 09:34:26 on ttyu1 FreeBSD 12.0-ALPHA9 r339356 PHO-GENERIC Welcome to FreeBSD! Release Notes, Errata: https://www.FreeBSD.org/releases/ Security Advisories: https://www.FreeBSD.org/security/ FreeBSD Handbook: https://www.FreeBSD.org/handbook/ FreeBSD FAQ: https://www.FreeBSD.org/faq/ Questions List: https://lists.FreeBSD.org/mailman/listinfo/freebsd-questions/ FreeBSD Forums: https://forums.FreeBSD.org/ Documents installed with the system are in the /usr/local/share/doc/freebsd/ directory, or can be installed later with: pkg install en-freebsd-doc For other languages, replace "en" with a language code like de or fr. Show the version of FreeBSD installed: freebsd-version ; uname -a Please include that output and any error messages when posting questions. Introduction to manual pages: man man FreeBSD directory layout: man hier Edit /etc/motd to change this login announcement. lock order reversal: 1st 0xfffff80304a397d0 ufs (ufs) @ kern/vfs_subr.c:2590 2nd 0xfffffe0000b29618 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:282 3rd 0xfffff80331d747d0 ufs (ufs) @ kern/vfs_subr.c:2590 stack backtrace: #0 0xffffffff80bf8c83 at witness_debugger+0x73 #1 0xffffffff80bf89d3 at witness_checkorder+0xab3 #2 0xffffffff80b6501b at lockmgr_xlock_hard+0x6b #3 0xffffffff80b658ae at __lockmgr_args+0x3ce #4 0xffffffff80eab18c at ffs_lock+0x7c #5 0xffffffff811f0e66 at VOP_LOCK1_APV+0xa6 #6 0xffffffff80c74540 at _vn_lock+0x60 #7 0xffffffff80c62a16 at vget+0x96 #8 0xffffffff80c54cd1 at vfs_hash_get+0xd1 #9 0xffffffff80ea6acf at ffs_vgetf+0x3f #10 0xffffffff80e9c5da at softdep_sync_buf+0x38a #11 0xffffffff80eabf24 at ffs_syncvnode+0x224 #12 0xffffffff80e81e05 at ffs_truncate+0x6e5 #13 0xffffffff80eb501b at ufs_direnter+0x63b #14 0xffffffff80ebd370 at ufs_mkdir+0x8f0 #15 0xffffffff811f0102 at VOP_MKDIR_APV+0xc2 #16 0xffffffff80c7171e at kern_mkdirat+0x1be #17 0xffffffff810695b7 at amd64_syscall+0x2a7 20181015 18:44:18 all (1/587): ptrace7.sh 20181015 18:48:20 all (2/587): suj5.sh 20181015 18:48:39 all (3/587): contigmalloc.sh 20181015 18:48:41 all (4/587): rename11.sh 20181015 18:48:46 all (5/587): crossmp2.sh 20181015 18:48:48 all (6/587): trim7.sh 20181015 18:48:49 all (7/587): nfs13.sh 20181015 18:48:51 all (8/587): vnodes.sh 20181015 18:49:35 all (9/587): mmap.sh 20181015 18:49:37 all (10/587): fullpath.sh 20181015 18:49:39 all (11/587): uma_zalloc_arg.sh 20181015 18:49:40 all (12/587): pathconf2.sh 20181015 18:49:42 all (13/587): nullfs24.sh 20181015 18:54:50 all (14/587): umountf5.sh freework leak: 1/15. 20181015 18:55:25 all (15/587): jumbo.sh 20181015 18:57:51 all (16/587): pthread4.sh 20181015 19:00:17 all (17/587): mmap29.sh 20181015 19:00:44 all (18/587): revoke.sh 20181015 19:00:47 all (19/587): kevent10.sh 20181015 19:00:49 all (20/587): mlockall.sh 20181015 19:01:01 all (21/587): msdos8.sh 20181015 19:01:02 all (22/587): ptrace5.sh 20181015 19:06:04 all (23/587): rename8.sh 20181015 19:06:17 all (24/587): nfs15lockd3.sh 20181015 19:06:18 all (25/587): fpclone2.sh 20181015 19:06:20 all (26/587): rename5.sh 20181015 19:11:23 all (27/587): mount.sh 20181015 19:11:24 all (28/587): watchman.sh 20181015 19:11:26 all (29/587): gnop4.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. freework leak: 7/22. newblk leak: 6/17. 20181015 19:26:29 all (30/587): numa.sh 20181015 19:26:31 all (31/587): mmap26.sh 20181015 19:26:34 all (32/587): dfull.sh Oct 15 19:26:36 mercat1 kernel: pid 92570 (rw), uid 0 inumber 16386 on /mnt: filesystem full Oct 15 19:26:36 mercat1 kernel: pid 92572 (rw), uid 0 inumber 49160 on /mnt: filesystem full Oct 15 19:26:42 mercat1 kernel: pid 92578 (creat), uid 0 inumber 32768 on /mnt: out of inodes Oct 15 19:26:46 mercat1 kernel: pid 92586 (creat), uid 0 inumber 32773 on /mnt: out of inodes Oct 15 19:26:51 mercat1 kernel: pid 92587 (creat), uid 0 inumber 4 on /mnt: out of inodes Oct 15 19:26:55 mercat1 kernel: pid 92577 (creat), uid 0 inumber 49154 on /mnt: out of inodes Oct 15 19:26:59 mercat1 kernel: pid 92583 (creat), uid 0 inumber 32769 on /mnt: out of inodes Oct 15 19:27:03 mercat1 kernel: pid 92586 (creat), uid 0 inumber 32773 on /mnt: out of inodes Oct 15 19:27:09 mercat1 kernel: pid 92571 (creat), uid 0 inumber 16391 on /mnt: out of inodes Oct 15 19:27:12 mercat1 syslogd: last message repeated 1 times Oct 15 19:27:17 mercat1 kernel: pid 92595 (creat), uid 0 inumber 32774 on /mnt: out of inodes Oct 15 19:27:21 mercat1 kernel: pid 92589 (creat), uid 0 inumber 32770 on /mnt: out of inodes Oct 15 19:27:24 mercat1 kernel: pid 92582 (creat), uid 0 inumber 32772 on /mnt: out of inodes Oct 15 19:27:28 mercat1 kernel: pid 92593 (creat), uid 0 inumber 16392 on /mnt: out of inodes Oct 15 19:27:32 mercat1 kernel: pid 92591 (creat), uid 0 inumber 49157 on /mnt: out of inodes Oct 15 19:27:39 mercat1 kernel: pid 99984 (creat), uid 0 inumber 16437 on /mnt: filesystem full Oct 15 19:27:39 mercat1 kernel: pid 99964 (rw), uid 0 inumber 17354 on /mnt: filesystem full Oct 15 19:27:41 mercat1 kernel: pid 99975 (creat), uid 0 inumber 16423 on /mnt: out of inodes Oct 15 19:27:43 mercat1 kernel: pid 99963 (creat), uid 0 inumber 16405 on /mnt: out of inodes Oct 15 19:27:48 mercat1 kernel: pid 99969 (creat), uid 0 inumber 16415 on /mnt: out of inodes Oct 15 19:27:56 mercat1 kernel: pid 99975 (creat), uid 0 inumber 16423 on /mnt: out of inodes Oct 15 19:28:02 mercat1 kernel: pid 99963 (creat), uid 0 inumber 16405 on /mnt: out of inodes Oct 15 19:28:09 mercat1 kernel: pid 99966 (creat), uid 0 inumber 16408 on /mnt: out of inodes Oct 15 19:28:14 mercat1 kernel: pid 99972 (creat), uid 0 inumber 16419 on /mnt: out of inodes Oct 15 19:28:18 mercat1 kernel: pid 99966 (creat), uid 0 inumber 16408 on /mnt: out of inodes Oct 15 19:28:26 mercat1 kernel: pid 99987 (creat), uid 0 inumber 16449 on /mnt: out of inodes Oct 15 19:28:32 mercat1 kernel: pid 99963 (creat), uid 0 inumber 16405 on /mnt: out of inodes Oct 15 19:28:40 mercat1 kernel: pid 8958 (rw), uid 0 inumber 49158 on /mnt: filesystem full Oct 15 19:28:41 mercat1 kernel: pid 8967 (mkdir), uid 0 inumber 16444 on /mnt: out of inodes Oct 15 19:28:45 mercat1 kernel: pid 8969 (mkdir), uid 0 inumber 32710 on /mnt: out of inodes Oct 15 19:28:47 mercat1 kernel: pid 8957 (mkdir), uid 0 inumber 49270 on /mnt: out of inodes Oct 15 19:29:38 mercat1 kernel: pid 16369 (rw), uid 0 inumber 49234 on /mnt: filesystem full Oct 15 19:29:39 mercat1 kernel: pid 16356 (mkdir), uid 0 inumber 16371 on /mnt: out of inodes Oct 15 19:29:46 mercat1 kernel: pid 16350 (mkdir), uid 0 inumber 49125 on /mnt: out of inodes Oct 15 19:29:53 mercat1 kernel: pid 16370 (creat), uid 0 inumber 49216 on /mnt: out of inodes Oct 15 19:29:59 mercat1 kernel: pid 16361 (creat), uid 0 inumber 49200 on /mnt: out of inodes Oct 15 19:30:04 mercat1 kernel: pid 16355 (creat), uid 0 inumber 49198 on /mnt: out of inodes Oct 15 19:30:14 mercat1 kernel: pid 16379 (creat), uid 0 inumber 49211 on /mnt: out of inodes Oct 15 19:30:18 mercat1 kernel: pid 16345 (creat), uid 0 inumber 49187 on /mnt: out of inodes Oct 15 19:30:22 mercat1 kernel: pid 16376 (creat), uid 0 inumber 49209 on /mnt: out of inodes Oct 15 19:30:29 mercat1 kernel: pid 16373 (creat), uid 0 inumber 49210 on /mnt: out of inodes Oct 15 19:30:34 mercat1 syslogd: last message repeated 1 times Oct 15 19:30:38 mercat1 kernel: pid 23757 (rw), uid 0 inumber 49283 on /mnt: filesystem full Oct 15 19:30:40 mercat1 kernel: pid 23780 (creat), uid 0 inumber 49309 on /mnt: out of inodes Oct 15 19:30:47 mercat1 kernel: pid 23759 (creat), uid 0 inumber 49285 on /mnt: out of inodes Oct 15 19:30:52 mercat1 kernel: pid 23774 (creat), uid 0 inumber 49300 on /mnt: out of inodes Oct 15 19:30:58 mercat1 kernel: pid 23778 (creat), uid 0 inumber 49311 on /mnt: out of inodes Oct 15 19:31:06 mercat1 kernel: pid 23771 (creat), uid 0 inumber 49296 on /mnt: out of inodes Oct 15 19:31:09 mercat1 kernel: pid 23778 (creat), uid 0 inumber 49311 on /mnt: out of inodes Oct 15 19:31:16 mercat1 kernel: pid 23756 (creat), uid 0 inumber 49284 on /mnt: out of inodes Oct 15 19:31:21 mercat1 kernel: pid 23786 (creat), uid 0 inumber 49319 on /mnt: out of inodes Oct 15 19:31:25 mercat1 kernel: pid 23756 (creat), uid 0 inumber 49284 on /mnt: out of inodes Oct 15 19:31:30 mercat1 kernel: pid 23778 (creat), uid 0 inumber 49311 on /mnt: out of inodes Oct 15 19:31:41 mercat1 kernel: pid 31162 (mkdir), uid 0 inumber 49123 on /mnt: out of inodes Oct 15 19:31:49 mercat1 kernel: pid 31170 (mkdir), uid 0 inumber 4852 on /mnt: out of inodes Oct 15 19:32:35 mercat1 kernel: pid 31156 (mkdir), uid 0 inumber 16384 on /mnt: out of inodes Oct 15 19:32:37 mercat1 kernel: pid 40008 (rw), uid 0 inumber 32794 on /mnt: filesystem full Oct 15 19:32:40 mercat1 kernel: pid 40025 (creat), uid 0 inumber 32787 on /mnt: out of inodes Oct 15 19:32:42 mercat1 kernel: pid 40020 (creat), uid 0 inumber 32782 on /mnt: out of inodes Oct 15 19:32:48 mercat1 syslogd: last message repeated 2 times Oct 15 19:32:49 mercat1 kernel: pid 40022 (creat), uid 0 inumber 32785 on /mnt: out of inodes Oct 15 19:32:51 mercat1 kernel: pid 40024 (creat), uid 0 inumber 32786 on /mnt: out of inodes Oct 15 19:32:52 mercat1 kernel: pid 40020 (creat), uid 0 inumber 32782 on /mnt: out of inodes Oct 15 19:32:54 mercat1 kernel: pid 40022 (creat), uid 0 inumber 32785 on /mnt: out of inodes Oct 15 19:32:58 mercat1 syslogd: last message repeated 2 times Oct 15 19:33:01 mercat1 kernel: pid 40018 (creat), uid 0 inumber 32780 on /mnt: out of inodes Oct 15 19:33:03 mercat1 kernel: pid 40024 (creat), uid 0 inumber 32786 on /mnt: out of inodes Oct 15 19:33:07 mercat1 syslogd: last message repeated 2 times Oct 15 19:33:09 mercat1 kernel: pid 40018 (creat), uid 0 inumber 32780 on /mnt: out of inodes Oct 15 19:33:11 mercat1 kernel: pid 40020 (creat), uid 0 inumber 32782 on /mnt: out of inodes Oct 15 19:33:16 mercat1 syslogd: last message repeated 1 times Oct 15 19:33:17 mercat1 kernel: pid 40025 (creat), uid 0 inumber 32787 on /mnt: out of inodes Oct 15 19:33:20 mercat1 kernel: pid 40024 (creat), uid 0 inumber 32786 on /mnt: out of inodes Oct 15 19:33:22 mercat1 kernel: pid 40018 (creat), uid 0 inumber 32780 on /mnt: out of inodes Oct 15 19:33:24 mercat1 kernel: pid 40025 (creat), uid 0 inumber 32787 on /mnt: out of inodes Oct 15 19:33:25 mercat1 kernel: pid 40020 (creat), uid 0 inumber 32782 on /mnt: out of inodes Oct 15 19:33:27 mercat1 kernel: pid 40018 (creat), uid 0 inumber 32780 on /mnt: out of inodes Oct 15 19:33:28 mercat1 kernel: pid 40024 (creat), uid 0 inumber 32786 on /mnt: out of inodes Oct 15 19:33:31 mercat1 kernel: pid 40018 (creat), uid 0 inumber 32780 on /mnt: out of inodes Oct 15 19:33:33 mercat1 kernel: pid 40025 (creat), uid 0 inumber 32787 on /mnt: out of inodes Oct 15 19:33:36 mercat1 syslogd: last message repeated 1 times Oct 15 19:33:45 mercat1 kernel: pid 47390 (rw), uid 0 inumber 23441 on /mnt: filesystem full Oct 15 19:33:46 mercat1 kernel: pid 47393 (mkdir), uid 0 inumber 49131 on /mnt: out of inodes Oct 15 19:34:37 mercat1 kernel: pid 54746 (rw), uid 0 inumber 19917 on /mnt: filesystem full Oct 15 19:34:40 mercat1 kernel: pid 54748 (rw), uid 0 inumber 16513 on /mnt: filesystem full Oct 15 19:34:42 mercat1 kernel: pid 54745 (mkdir), uid 0 inumber 65529 on /mnt: out of inodes Oct 15 19:34:44 mercat1 kernel: pid 54755 (mkdir), uid 0 inumber 65249 on /mnt: out of inodes Oct 15 19:34:47 mercat1 kernel: pid 54758 (mkdir), uid 0 inumber 32534 on /mnt: out of inodes Oct 15 19:34:50 mercat1 kernel: pid 54747 (mkdir), uid 0 inumber 65284 on /mnt: out of inodes Oct 15 19:35:38 mercat1 kernel: pid 63591 (rw), uid 0 inumber 19519 on /mnt: filesystem full Oct 15 19:35:38 mercat1 kernel: pid 63599 (creat), uid 0 inumber 19524 on /mnt: filesystem full Oct 15 19:35:41 mercat1 kernel: pid 63616 (mkdir), uid 0 inumber 15779 on /mnt: filesystem full Oct 15 19:35:41 mercat1 kernel: pid 63608 (creat), uid 0 inumber 19528 on /mnt: filesystem full Oct 15 19:35:41 mercat1 kernel: pid 63597 (rw), uid 0 inumber 30940 on /mnt: filesystem full Oct 15 19:35:42 mercat1 kernel: pid 63590 (creat), uid 0 inumber 19513 on /mnt: out of inodes Oct 15 19:35:47 mercat1 kernel: pid 63611 (creat), uid 0 inumber 19536 on /mnt: out of inodes Oct 15 19:35:52 mercat1 kernel: pid 63593 (creat), uid 0 inumber 19517 on /mnt: out of inodes Oct 15 19:35:56 mercat1 kernel: pid 63602 (creat), uid 0 inumber 19526 on /mnt: out of inodes Oct 15 19:36:02 mercat1 kernel: pid 63593 (creat), uid 0 inumber 19517 on /mnt: out of inodes Oct 15 19:36:05 mercat1 syslogd: last message repeated 1 times Oct 15 19:36:10 mercat1 kernel: pid 63605 (creat), uid 0 inumber 19532 on /mnt: out of inodes Oct 15 19:36:14 mercat1 kernel: pid 63593 (creat), uid 0 inumber 19517 on /mnt: out of inodes Oct 15 19:36:19 mercat1 kernel: pid 63596 (creat), uid 0 inumber 19520 on /mnt: out of inodes Oct 15 19:36:28 mercat1 kernel: pid 63608 (creat), uid 0 inumber 19528 on /mnt: out of inodes Oct 15 19:36:35 mercat1 kernel: pid 63593 (creat), uid 0 inumber 19517 on /mnt: out of inodes Oct 15 19:36:39 mercat1 kernel: pid 70977 (rw), uid 0 inumber 16605 on /mnt: filesystem full Oct 15 19:36:41 mercat1 kernel: pid 70992 (mkdir), uid 0 inumber 16242 on /mnt: out of inodes Oct 15 19:36:42 mercat1 kernel: pid 71011 (creat), uid 0 inumber 16638 on /mnt: out of inodes Oct 15 19:36:47 mercat1 kernel: pid 70984 (creat), uid 0 inumber 16612 on /mnt: out of inodes Oct 15 19:36:51 mercat1 kernel: pid 70978 (mkdir), uid 0 inumber 61795 on /mnt: out of inodes Oct 15 19:36:59 mercat1 kernel: pid 71003 (creat), uid 0 inumber 16626 on /mnt: out of inodes Oct 15 19:37:03 mercat1 kernel: pid 71012 (creat), uid 0 inumber 16631 on /mnt: out of inodes Oct 15 19:37:08 mercat1 kernel: pid 71002 (creat), uid 0 inumber 16635 on /mnt: out of inodes Oct 15 19:37:14 mercat1 kernel: pid 70990 (creat), uid 0 inumber 16615 on /mnt: out of inodes Oct 15 19:37:25 mercat1 syslogd: last message repeated 1 times Oct 15 19:37:31 mercat1 kernel: pid 71009 (creat), uid 0 inumber 16628 on /mnt: out of inodes Oct 15 19:37:40 mercat1 kernel: pid 78386 (rw), uid 0 inumber 49563 on /mnt: filesystem full Oct 15 19:37:41 mercat1 kernel: pid 78393 (mkdir), uid 0 inumber 16186 on /mnt: out of inodes Oct 15 19:37:43 mercat1 kernel: pid 78394 (mkdir), uid 0 inumber 49182 on /mnt: out of inodes Oct 15 19:37:46 mercat1 kernel: pid 78388 (creat), uid 0 inumber 49158 on /mnt: out of inodes Oct 15 19:37:47 mercat1 kernel: pid 78389 (mkdir), uid 0 inumber 15949 on /mnt: out of inodes Oct 15 19:37:48 mercat1 kernel: pid 78385 (creat), uid 0 inumber 49157 on /mnt: out of inodes Oct 15 19:37:49 mercat1 kernel: pid 78382 (creat), uid 0 inumber 49153 on /mnt: out of inodes Oct 15 19:37:51 mercat1 kernel: pid 78385 (creat), uid 0 inumber 49157 on /mnt: out of inodes Oct 15 19:37:52 mercat1 kernel: pid 78388 (creat), uid 0 inumber 49158 on /mnt: out of inodes Oct 15 19:37:53 mercat1 syslogd: last message repeated 1 times Oct 15 19:37:55 mercat1 kernel: pid 78385 (creat), uid 0 inumber 49157 on /mnt: out of inodes Oct 15 19:37:56 mercat1 kernel: pid 78382 (creat), uid 0 inumber 49153 on /mnt: out of inodes Oct 15 19:37:57 mercat1 kernel: pid 78385 (creat), uid 0 inumber 49157 on /mnt: out of inodes Oct 15 19:38:12 mercat1 syslogd: last message repeated 2 times Oct 15 19:38:18 mercat1 kernel: pid 78388 (creat), uid 0 inumber 49158 on /mnt: out of inodes Oct 15 19:38:25 mercat1 syslogd: last message repeated 1 times Oct 15 19:38:27 mercat1 kernel: pid 78385 (creat), uid 0 inumber 49157 on /mnt: out of inodes Oct 15 19:38:28 mercat1 kernel: pid 78388 (creat), uid 0 inumber 49158 on /mnt: out of inodes Oct 15 19:38:29 mercat1 kernel: pid 78382 (creat), uid 0 inumber 49153 on /mnt: out of inodes Oct 15 19:38:31 mercat1 kernel: pid 78385 (creat), uid 0 inumber 49157 on /mnt: out of inodes Oct 15 19:38:32 mercat1 kernel: pid 78388 (creat), uid 0 inumber 49158 on /mnt: out of inodes Oct 15 19:38:38 mercat1 kernel: pid 87214 (rw), uid 0 inumber 16550 on /mnt: filesystem full Oct 15 19:38:39 mercat1 kernel: pid 87216 (rw), uid 0 inumber 16650 on /mnt: filesystem full Oct 15 19:38:41 mercat1 kernel: pid 87247 (mkdir), uid 0 inumber 65395 on /mnt: out of inodes Oct 15 19:38:44 mercat1 kernel: pid 87238 (creat), uid 0 inumber 16869 on /mnt: out of inodes Oct 15 19:38:50 mercat1 kernel: pid 87246 (creat), uid 0 inumber 16933 on /mnt: out of inodes Oct 15 19:38:54 mercat1 kernel: pid 87220 (mkdir), uid 0 inumber 16231 on /mnt: out of inodes Oct 15 19:39:01 mercat1 kernel: pid 87234 (creat), uid 0 inumber 16824 on /mnt: out of inodes Oct 15 19:39:08 mercat1 kernel: pid 87226 (creat), uid 0 inumber 16746 on /mnt: out of inodes Oct 15 19:39:15 mercat1 kernel: pid 87236 (creat), uid 0 inumber 16836 on /mnt: out of inodes Oct 15 19:39:21 mercat1 kernel: pid 87230 (creat), uid 0 inumber 16790 on /mnt: out of inodes Oct 15 19:39:28 mercat1 kernel: pid 87234 (creat), uid 0 inumber 16824 on /mnt: out of inodes Oct 15 19:39:35 mercat1 kernel: pid 87218 (creat), uid 0 inumber 16667 on /mnt: out of inodes Oct 15 19:39:40 mercat1 kernel: pid 94622 (rw), uid 0 inumber 16716 on /mnt: filesystem full Oct 15 19:39:43 mercat1 kernel: pid 94621 (creat), uid 0 inumber 16721 on /mnt: out of inodes Oct 15 19:39:45 mercat1 syslogd: last message repeated 1 times Oct 15 19:39:46 mercat1 kernel: pid 94629 (creat), uid 0 inumber 16760 on /mnt: out of inodes Oct 15 19:39:51 mercat1 kernel: pid 94621 (creat), uid 0 inumber 16721 on /mnt: out of inodes Oct 15 19:39:57 mercat1 kernel: pid 94623 (creat), uid 0 inumber 16723 on /mnt: out of inodes Oct 15 19:40:01 mercat1 kernel: pid 94613 (creat), uid 0 inumber 16672 on /mnt: out of inodes Oct 15 19:40:06 mercat1 kernel: pid 94629 (creat), uid 0 inumber 16760 on /mnt: out of inodes Oct 15 19:40:10 mercat1 kernel: pid 94611 (creat), uid 0 inumber 16656 on /mnt: out of inodes Oct 15 19:40:15 mercat1 kernel: pid 94621 (creat), uid 0 inumber 16721 on /mnt: out of inodes Oct 15 19:40:20 mercat1 kernel: pid 94627 (creat), uid 0 inumber 16734 on /mnt: out of inodes Oct 15 19:40:24 mercat1 kernel: pid 94608 (creat), uid 0 inumber 16649 on /mnt: out of inodes Oct 15 19:40:29 mercat1 kernel: pid 94629 (creat), uid 0 inumber 16760 on /mnt: out of inodes Oct 15 19:40:37 mercat1 kernel: pid 94627 (creat), uid 0 inumber 16734 on /mnt: out of inodes Oct 15 19:40:40 mercat1 kernel: pid 2109 (rw), uid 0 inumber 16643 on /mnt: filesystem full Oct 15 19:40:42 mercat1 kernel: pid 2121 (rw), uid 0 inumber 16767 on /mnt: filesystem full Oct 15 19:40:46 mercat1 kernel: pid 2110 (creat), uid 0 inumber 19465 on /mnt: out of inodes Oct 15 19:40:47 mercat1 kernel: pid 2116 (creat), uid 0 inumber 19470 on /mnt: out of inodes Oct 15 19:40:50 mercat1 kernel: pid 2110 (creat), uid 0 inumber 19465 on /mnt: out of inodes Oct 15 19:40:54 mercat1 kernel: pid 2116 (creat), uid 0 inumber 19470 on /mnt: out of inodes Oct 15 19:40:55 mercat1 kernel: pid 2110 (creat), uid 0 inumber 19465 on /mnt: out of inodes Oct 15 19:40:56 mercat1 syslogd: last message repeated 1 times Oct 15 19:40:57 mercat1 kernel: pid 2112 (creat), uid 0 inumber 16640 on /mnt: out of inodes Oct 15 19:40:58 mercat1 syslogd: last message repeated 1 times Oct 15 19:41:07 mercat1 kernel: pid 2116 (creat), uid 0 inumber 19470 on /mnt: out of inodes Oct 15 19:41:09 mercat1 syslogd: last message repeated 2 times Oct 15 19:41:17 mercat1 kernel: pid 2114 (creat), uid 0 inumber 19468 on /mnt: out of inodes Oct 15 19:41:18 mercat1 kernel: pid 2110 (creat), uid 0 inumber 19465 on /mnt: out of inodes Oct 15 19:41:25 mercat1 syslogd: last message repeated 2 times Oct 15 19:41:32 mercat1 kernel: pid 2112 (creat), uid 0 inumber 16640 on /mnt: out of inodes Oct 15 19:41:33 mercat1 kernel: pid 2110 (creat), uid 0 inumber 19465 on /mnt: out of inodes Oct 15 19:41:34 mercat1 kernel: pid 2116 (creat), uid 0 inumber 19470 on /mnt: out of inodes Oct 15 19:41:36 mercat1 syslogd: last message repeated 1 times Oct 15 19:41:41 mercat1 kernel: pid 10347 (mkdir), uid 0 inumber 16304 on /mnt: out of inodes Oct 15 19:41:42 mercat1 kernel: pid 10344 (rw), uid 0 inumber 52138 on /mnt: filesystem full Oct 15 19:41:44 mercat1 kernel: pid 10353 (mkdir), uid 0 inumber 32584 on /mnt: out of inodes Oct 15 19:41:45 mercat1 kernel: pid 10349 (mkdir), uid 0 inumber 16195 on /mnt: out of inodes Oct 15 19:41:46 mercat1 kernel: pid 10358 (mkdir), uid 0 inumber 32577 on /mnt: out of inodes Oct 15 19:41:49 mercat1 kernel: pid 10359 (mkdir), uid 0 inumber 16384 on /mnt: out of inodes Oct 15 19:42:40 mercat1 kernel: pid 18350 (rw), uid 0 inumber 16890 on /mnt: filesystem full Oct 15 19:42:47 mercat1 kernel: pid 18354 (rw), uid 0 inumber 38405 on /mnt: filesystem full Oct 15 19:42:50 mercat1 kernel: pid 18366 (creat), uid 0 inumber 38496 on /mnt: out of inodes Oct 15 19:42:54 mercat1 kernel: pid 18360 (creat), uid 0 inumber 53632 on /mnt: out of inodes Oct 15 19:42:57 mercat1 syslogd: last message repeated 1 times Oct 15 19:43:03 mercat1 kernel: pid 18362 (creat), uid 0 inumber 53633 on /mnt: out of inodes Oct 15 19:43:10 mercat1 kernel: pid 18360 (creat), uid 0 inumber 53632 on /mnt: out of inodes Oct 15 19:43:16 mercat1 syslogd: last message repeated 1 times Oct 15 19:43:22 mercat1 kernel: pid 18358 (creat), uid 0 inumber 53631 on /mnt: out of inodes Oct 15 19:43:29 mercat1 kernel: pid 18364 (creat), uid 0 inumber 22596 on /mnt: out of inodes Oct 15 19:43:35 mercat1 kernel: pid 18353 (creat), uid 0 inumber 53630 on /mnt: out of inodes Oct 15 19:43:39 mercat1 kernel: pid 25723 (rw), uid 0 inumber 32897 on /mnt: filesystem full Oct 15 19:43:43 mercat1 kernel: pid 25726 (mkdir), uid 0 inumber 32580 on /mnt: out of inodes Oct 15 19:43:48 mercat1 kernel: pid 25734 (mkdir), uid 0 inumber 32510 on /mnt: out of inodes Oct 15 19:43:50 mercat1 kernel: pid 25729 (rw), uid 0 inumber 32973 on /mnt: filesystem full Oct 15 19:44:38 mercat1 kernel: pid 33546 (rw), uid 0 inumber 51009 on /mnt: filesystem full Oct 15 19:44:44 mercat1 kernel: pid 33537 (creat), uid 0 inumber 37469 on /mnt: out of inodes Oct 15 19:44:47 mercat1 kernel: pid 33566 (creat), uid 0 inumber 4862 on /mnt: out of inodes Oct 15 19:44:51 mercat1 kernel: pid 33551 (creat), uid 0 inumber 22607 on /mnt: out of inodes Oct 15 19:44:54 mercat1 kernel: pid 33569 (creat), uid 0 inumber 51018 on /mnt: out of inodes Oct 15 19:44:58 mercat1 kernel: pid 33563 (creat), uid 0 inumber 22610 on /mnt: out of inodes Oct 15 19:45:01 mercat1 kernel: pid 33537 (creat), uid 0 inumber 37469 on /mnt: out of inodes Oct 15 19:45:04 mercat1 kernel: pid 33575 (creat), uid 0 inumber 51017 on /mnt: out of inodes Oct 15 19:45:07 mercat1 kernel: pid 33554 (creat), uid 0 inumber 4858 on /mnt: out of inodes Oct 15 19:45:11 mercat1 kernel: pid 33560 (creat), uid 0 inumber 37475 on /mnt: out of inodes Oct 15 19:45:14 mercat1 kernel: pid 33566 (creat), uid 0 inumber 4862 on /mnt: out of inodes Oct 15 19:45:18 mercat1 kernel: pid 33540 (creat), uid 0 inumber 37470 on /mnt: out of inodes Oct 15 19:45:21 mercat1 kernel: pid 33551 (creat), uid 0 inumber 22607 on /mnt: out of inodes Oct 15 19:45:26 mercat1 kernel: pid 33557 (creat), uid 0 inumber 51014 on /mnt: out of inodes Oct 15 19:45:28 mercat1 kernel: pid 33575 (creat), uid 0 inumber 51017 on /mnt: out of inodes Oct 15 19:45:31 mercat1 kernel: pid 33551 (creat), uid 0 inumber 22607 on /mnt: out of inodes Oct 15 19:45:35 mercat1 syslogd: last message repeated 1 times Oct 15 19:45:37 mercat1 kernel: pid 33566 (creat), uid 0 inumber 4862 on /mnt: out of inodes Oct 15 19:45:42 mercat1 kernel: pid 41976 (rw), uid 0 inumber 32799 on /mnt: filesystem full Oct 15 19:45:45 mercat1 kernel: pid 41981 (rw), uid 0 inumber 39573 on /mnt: filesystem full Oct 15 19:45:53 mercat1 kernel: pid 42024 (creat), uid 0 inumber 16534 on /mnt: out of inodes Oct 15 19:45:59 mercat1 kernel: pid 42006 (creat), uid 0 inumber 16524 on /mnt: out of inodes Oct 15 19:46:05 mercat1 kernel: pid 42001 (creat), uid 0 inumber 16521 on /mnt: out of inodes Oct 15 19:46:14 mercat1 kernel: pid 41995 (creat), uid 0 inumber 16518 on /mnt: out of inodes Oct 15 19:46:21 mercat1 kernel: pid 42015 (creat), uid 0 inumber 16529 on /mnt: out of inodes Oct 15 19:46:26 mercat1 kernel: pid 42013 (creat), uid 0 inumber 16528 on /mnt: out of inodes Oct 15 19:46:31 mercat1 kernel: pid 42024 (creat), uid 0 inumber 16534 on /mnt: out of inodes Oct 15 19:46:40 mercat1 kernel: pid 49404 (rw), uid 0 inumber 49305 on /mnt: filesystem full Oct 15 19:46:42 mercat1 kernel: pid 49390 (rw), uid 0 inumber 50761 on /mnt: filesystem full Oct 15 19:46:45 mercat1 kernel: pid 49403 (creat), uid 0 inumber 49286 on /mnt: out of inodes Oct 15 19:46:48 mercat1 kernel: pid 49405 (creat), uid 0 inumber 49291 on /mnt: out of inodes Oct 15 19:46:51 mercat1 kernel: pid 49399 (creat), uid 0 inumber 49257 on /mnt: out of inodes Oct 15 19:46:55 mercat1 kernel: pid 49395 (creat), uid 0 inumber 49229 on /mnt: out of inodes Oct 15 19:46:57 mercat1 kernel: pid 49397 (creat), uid 0 inumber 49245 on /mnt: out of inodes Oct 15 19:47:00 mercat1 kernel: pid 49406 (creat), uid 0 inumber 49295 on /mnt: out of inodes Oct 15 19:47:03 mercat1 kernel: pid 49401 (creat), uid 0 inumber 49280 on /mnt: out of inodes Oct 15 19:47:08 mercat1 kernel: pid 49403 (creat), uid 0 inumber 49286 on /mnt: out of inodes Oct 15 19:47:14 mercat1 kernel: pid 49401 (creat), uid 0 inumber 49280 on /mnt: out of inodes Oct 15 19:47:17 mercat1 kernel: pid 49397 (creat), uid 0 inumber 49245 on /mnt: out of inodes Oct 15 19:47:19 mercat1 kernel: pid 49393 (creat), uid 0 inumber 49153 on /mnt: out of inodes Oct 15 19:47:22 mercat1 kernel: pid 49391 (creat), uid 0 inumber 49192 on /mnt: out of inodes Oct 15 19:47:24 mercat1 kernel: pid 49399 (creat), uid 0 inumber 49257 on /mnt: out of inodes Oct 15 19:47:28 mercat1 kernel: pid 49406 (creat), uid 0 inumber 49295 on /mnt: out of inodes Oct 15 19:47:33 mercat1 kernel: pid 49397 (creat), uid 0 inumber 49245 on /mnt: out of inodes Oct 15 19:47:35 mercat1 kernel: pid 49393 (creat), uid 0 inumber 49153 on /mnt: out of inodes Oct 15 19:47:41 mercat1 kernel: pid 56801 (creat), uid 0 inumber 20399 on /mnt: out of inodes Oct 15 19:47:42 mercat1 kernel: pid 56773 (rw), uid 0 inumber 18293 on /mnt: filesystem full Oct 15 19:47:55 mercat1 kernel: pid 56799 (creat), uid 0 inumber 20378 on /mnt: out of inodes Oct 15 19:47:59 mercat1 kernel: pid 56792 (creat), uid 0 inumber 19979 on /mnt: out of inodes Oct 15 19:48:05 mercat1 kernel: pid 56798 (creat), uid 0 inumber 20372 on /mnt: out of inodes Oct 15 19:48:12 mercat1 kernel: pid 56796 (creat), uid 0 inumber 20238 on /mnt: out of inodes Oct 15 19:48:17 mercat1 kernel: pid 56782 (creat), uid 0 inumber 19974 on /mnt: out of inodes Oct 15 19:48:23 mercat1 kernel: pid 56796 (creat), uid 0 inumber 20238 on /mnt: out of inodes Oct 15 19:48:31 mercat1 kernel: pid 56780 (creat), uid 0 inumber 19973 on /mnt: out of inodes Oct 15 19:48:38 mercat1 kernel: pid 56798 (creat), uid 0 inumber 20372 on /mnt: out of inodes Oct 15 19:48:40 mercat1 kernel: pid 64147 (rw), uid 0 inumber 16513 on /mnt: filesystem full Oct 15 19:48:44 mercat1 kernel: pid 64157 (mkdir), uid 0 inumber 64953 on /mnt: out of inodes Oct 15 19:48:46 mercat1 kernel: pid 64158 (mkdir), uid 0 inumber 16384 on /mnt: out of inodes Oct 15 19:48:49 mercat1 kernel: pid 64151 (mkdir), uid 0 inumber 32465 on /mnt: out of inodes Oct 15 19:48:50 mercat1 kernel: pid 64162 (mkdir), uid 0 inumber 16248 on /mnt: out of inodes Oct 15 19:49:00 mercat1 kernel: pid 64148 (rw), uid 0 inumber 24478 on /mnt: filesystem full Oct 15 19:49:44 mercat1 kernel: pid 73002 (rw), uid 0 inumber 28291 on /mnt: filesystem full Oct 15 19:49:44 mercat1 kernel: pid 72988 (rw), uid 0 inumber 5 on /mnt: filesystem full Oct 15 19:49:45 mercat1 kernel: pid 73005 (mkdir), uid 0 inumber 31466 on /mnt: out of inodes Oct 15 19:49:47 mercat1 kernel: pid 72990 (mkdir), uid 0 inumber 28241 on /mnt: out of inodes Oct 15 19:49:49 mercat1 kernel: pid 73000 (mkdir), uid 0 inumber 28281 on /mnt: out of inodes Oct 15 19:49:51 mercat1 kernel: pid 73009 (mkdir), uid 0 inumber 64517 on /mnt: out of inodes Oct 15 19:49:53 mercat1 kernel: pid 73011 (mkdir), uid 0 inumber 31231 on /mnt: out of inodes Oct 15 19:50:41 mercat1 kernel: pid 80389 (rw), uid 0 inumber 16520 on /mnt: filesystem full Oct 15 19:50:43 mercat1 kernel: pid 80414 (creat), uid 0 inumber 16557 on /mnt: out of inodes Oct 15 19:50:47 mercat1 kernel: pid 80407 (mkdir), uid 0 inumber 16587 on /mnt: out of inodes Oct 15 19:50:51 mercat1 kernel: pid 80405 (creat), uid 0 inumber 16547 on /mnt: out of inodes Oct 15 19:50:57 mercat1 kernel: pid 80411 (creat), uid 0 inumber 16558 on /mnt: out of inodes Oct 15 19:51:01 mercat1 kernel: pid 80420 (creat), uid 0 inumber 16560 on /mnt: out of inodes Oct 15 19:51:06 mercat1 kernel: pid 80411 (creat), uid 0 inumber 16558 on /mnt: out of inodes Oct 15 19:51:11 mercat1 kernel: pid 80423 (creat), uid 0 inumber 16563 on /mnt: out of inodes Oct 15 19:51:18 mercat1 kernel: pid 80420 (creat), uid 0 inumber 16560 on /mnt: out of inodes Oct 15 19:51:23 mercat1 kernel: pid 80417 (creat), uid 0 inumber 16553 on /mnt: out of inodes Oct 15 19:51:27 mercat1 kernel: pid 80396 (creat), uid 0 inumber 16539 on /mnt: out of inodes Oct 15 19:51:32 mercat1 kernel: pid 80420 (creat), uid 0 inumber 16560 on /mnt: out of inodes Oct 15 19:51:35 mercat1 kernel: pid 80408 (creat), uid 0 inumber 16551 on /mnt: out of inodes Oct 15 19:51:40 mercat1 kernel: pid 80420 (creat), uid 0 inumber 16560 on /mnt: out of inodes Oct 15 19:51:44 mercat1 kernel: pid 87821 (rw), uid 0 inumber 19050 on /mnt: filesystem full Oct 15 19:51:45 mercat1 kernel: pid 87817 (rw), uid 0 inumber 46820 on /mnt: filesystem full Oct 15 19:51:48 mercat1 kernel: pid 87826 (creat), uid 0 inumber 16611 on /mnt: out of inodes Oct 15 19:51:50 mercat1 kernel: pid 87822 (creat), uid 0 inumber 16623 on /mnt: out of inodes Oct 15 19:51:55 mercat1 syslogd: last message repeated 1 times Oct 15 19:51:59 mercat1 kernel: pid 87814 (creat), uid 0 inumber 16571 on /mnt: out of inodes Oct 15 19:52:04 mercat1 kernel: pid 87808 (creat), uid 0 inumber 16544 on /mnt: out of inodes Oct 15 19:52:09 mercat1 kernel: pid 87818 (creat), uid 0 inumber 16593 on /mnt: out of inodes Oct 15 19:52:16 mercat1 kernel: pid 87822 (creat), uid 0 inumber 16623 on /mnt: out of inodes Oct 15 19:52:22 mercat1 kernel: pid 87810 (creat), uid 0 inumber 16556 on /mnt: out of inodes Oct 15 19:52:24 mercat1 kernel: pid 87827 (creat), uid 0 inumber 16624 on /mnt: out of inodes Oct 15 19:52:28 mercat1 kernel: pid 87814 (creat), uid 0 inumber 16571 on /mnt: out of inodes Oct 15 19:52:32 mercat1 kernel: pid 87816 (creat), uid 0 inumber 16588 on /mnt: out of inodes Oct 15 19:52:36 mercat1 kernel: pid 87820 (creat), uid 0 inumber 16597 on /mnt: out of inodes Oct 15 19:52:42 mercat1 kernel: pid 96702 (rw), uid 0 inumber 49309 on /mnt: filesystem full Oct 15 19:52:45 mercat1 kernel: pid 96689 (mkdir), uid 0 inumber 48696 on /mnt: out of inodes Oct 15 19:52:47 mercat1 kernel: pid 96679 (creat), uid 0 inumber 49229 on /mnt: out of inodes Oct 15 19:52:52 mercat1 kernel: pid 96691 (creat), uid 0 inumber 49285 on /mnt: out of inodes Oct 15 19:52:55 mercat1 kernel: pid 96672 (rw), uid 0 inumber 7274 on /mnt: filesystem full Oct 15 19:52:58 mercat1 kernel: pid 96674 (creat), uid 0 inumber 49158 on /mnt: out of inodes Oct 15 19:53:01 mercat1 kernel: pid 96685 (creat), uid 0 inumber 49266 on /mnt: out of inodes Oct 15 19:53:06 mercat1 kernel: pid 96679 (creat), uid 0 inumber 49229 on /mnt: out of inodes Oct 15 19:53:10 mercat1 kernel: pid 96691 (creat), uid 0 inumber 49285 on /mnt: out of inodes Oct 15 19:53:12 mercat1 kernel: pid 96700 (creat), uid 0 inumber 49314 on /mnt: out of inodes Oct 15 19:53:16 mercat1 kernel: pid 96676 (creat), uid 0 inumber 49174 on /mnt: out of inodes Oct 15 19:53:18 mercat1 kernel: pid 96671 (creat), uid 0 inumber 49172 on /mnt: out of inodes Oct 15 19:53:25 mercat1 kernel: pid 96691 (creat), uid 0 inumber 49285 on /mnt: out of inodes Oct 15 19:53:28 mercat1 kernel: pid 96676 (creat), uid 0 inumber 49174 on /mnt: out of inodes Oct 15 19:53:31 mercat1 kernel: pid 96694 (creat), uid 0 inumber 49301 on /mnt: out of inodes Oct 15 19:53:35 mercat1 kernel: pid 96691 (creat), uid 0 inumber 49285 on /mnt: out of inodes Oct 15 19:53:39 mercat1 kernel: pid 96679 (creat), uid 0 inumber 49229 on /mnt: out of inodes Oct 15 19:53:42 mercat1 kernel: pid 4227 (rw), uid 0 inumber 32816 on /mnt: filesystem full Oct 15 19:53:45 mercat1 kernel: pid 4203 (creat), uid 0 inumber 32773 on /mnt: out of inodes Oct 15 19:53:51 mercat1 kernel: pid 4218 (creat), uid 0 inumber 32790 on /mnt: out of inodes Oct 15 19:53:58 mercat1 kernel: pid 4211 (mkdir), uid 0 inumber 15648 on /mnt: out of inodes Oct 15 19:54:05 mercat1 kernel: pid 4238 (creat), uid 0 inumber 32802 on /mnt: out of inodes Oct 15 19:54:12 mercat1 kernel: pid 4203 (creat), uid 0 inumber 32773 on /mnt: out of inodes Oct 15 19:54:17 mercat1 syslogd: last message repeated 1 times Oct 15 19:54:31 mercat1 kernel: pid 4212 (creat), uid 0 inumber 32781 on /mnt: out of inodes Oct 15 19:54:37 mercat1 kernel: pid 4234 (creat), uid 0 inumber 32804 on /mnt: out of inodes Oct 15 19:54:46 mercat1 kernel: pid 11609 (rw), uid 0 inumber 58897 on /mnt: filesystem full Oct 15 19:54:50 mercat1 kernel: pid 11624 (creat), uid 0 inumber 52991 on /mnt: out of inodes Oct 15 19:54:56 mercat1 kernel: pid 11608 (creat), uid 0 inumber 50708 on /mnt: out of inodes Oct 15 19:55:01 mercat1 kernel: pid 11622 (creat), uid 0 inumber 52972 on /mnt: out of inodes Oct 15 19:55:05 mercat1 kernel: pid 11606 (creat), uid 0 inumber 50441 on /mnt: out of inodes Oct 15 19:55:11 mercat1 kernel: pid 11614 (creat), uid 0 inumber 50775 on /mnt: out of inodes Oct 15 19:55:16 mercat1 kernel: pid 11616 (creat), uid 0 inumber 50800 on /mnt: out of inodes Oct 15 19:55:20 mercat1 kernel: pid 11608 (creat), uid 0 inumber 50708 on /mnt: out of inodes Oct 15 19:55:28 mercat1 kernel: pid 11624 (creat), uid 0 inumber 52991 on /mnt: out of inodes Oct 15 19:55:33 mercat1 kernel: pid 11622 (creat), uid 0 inumber 52972 on /mnt: out of inodes Oct 15 19:55:38 mercat1 kernel: pid 11608 (creat), uid 0 inumber 50708 on /mnt: out of inodes Oct 15 19:55:43 mercat1 kernel: pid 19054 (rw), uid 0 inumber 32819 on /mnt: filesystem full Oct 15 19:55:51 mercat1 kernel: pid 19036 (creat), uid 0 inumber 32793 on /mnt: out of inodes Oct 15 19:55:57 mercat1 kernel: pid 19024 (creat), uid 0 inumber 32781 on /mnt: out of inodes Oct 15 19:56:09 mercat1 kernel: pid 19053 (creat), uid 0 inumber 32800 on /mnt: out of inodes Oct 15 19:56:18 mercat1 kernel: pid 19013 (creat), uid 0 inumber 32769 on /mnt: out of inodes Oct 15 19:56:24 mercat1 kernel: pid 19045 (creat), uid 0 inumber 32799 on /mnt: out of inodes Oct 15 19:56:40 mercat1 kernel: pid 19016 (creat), uid 0 inumber 32771 on /mnt: out of inodes 20181015 19:56:42 all (33/587): umountf10.sh newblk leak: 2106/2123. 20181015 20:01:49 all (34/587): linger.sh 20181015 20:11:48 all (35/587): mlockall2.sh 20181015 20:22:30 all (36/587): temp.sh 20181015 20:22:32 all (37/587): rename10.sh 20181015 20:23:40 all (38/587): pipe.sh 20181015 20:28:44 all (39/587): truss.sh 20181015 20:35:03 all (40/587): lookup_shared.sh freework leak: 42/64. newblk leak: 30664/32787. 20181015 20:46:00 all (41/587): mlockall5.sh 20181015 20:46:01 all (42/587): kevent6.sh lock order reversal: 1st 0xfffff8005be53040 filedesc structure (filedesc structure) @ kern/kern_descrip.c:1239 2nd 0xfffff806eba237d0 ufs (ufs) @ kern/vfs_subr.c:5045 stack backtrace: #0 0xffffffff80bf8c83 at witness_debugger+0x73 #1 0xffffffff80bf89d3 at witness_checkorder+0xab3 #2 0xffffffff80b6501b at lockmgr_xlock_hard+0x6b #3 0xffffffff80b658ae at __lockmgr_args+0x3ce #4 0xffffffff80eab18c at ffs_lock+0x7c #5 0xffffffff811f0e66 at VOP_LOCK1_APV+0xa6 #6 0xffffffff80c74540 at _vn_lock+0x60 #7 0xffffffff80b459ea at knlist_remove_kq+0x8a #8 0xffffffff80c6a027 at filt_vfsdetach+0x27 #9 0xffffffff80b46431 at knote_fdclose+0x151 #10 0xffffffff80b39696 at closefp+0x66 #11 0xffffffff810695b7 at amd64_syscall+0x2a7 #12 0xffffffff81044d8d at fast_syscall_common+0x101 20181015 20:46:27 all (43/587): tmpfs12.sh 20181015 20:49:00 all (44/587): churn.sh 20181015 20:59:04 all (45/587): crossmp11.sh Oct 15 20:59:06 mercat1 kernel: pid 31234 (rw), uid 2007 inumber 24581 on /mnt10: filesystem full Oct 15 20:59:07 mercat1 kernel: pid 31200 (rw), uid 2007 inumber 49154 on /mnt10: filesystem full Oct 15 20:59:07 mercat1 kernel: pid 31260 (rw), uid 2007 inumber 24594 on /mnt12: filesystem full Oct 15 20:59:09 mercat1 kernel: pid 31194 (mkdir), uid 2007 inumber 73735 on /mnt13: filesystem full Oct 15 20:59:13 mercat1 kernel: pid 31237 (creat), uid 2007 inumber 24603 on /mnt11: out of inodes Oct 15 20:59:14 mercat1 kernel: pid 31262 (creat), uid 2007 inumber 24588 on /mnt12: out of inodes Oct 15 20:59:17 mercat1 kernel: pid 31196 (creat), uid 2007 inumber 24581 on /mnt11: out of inodes Oct 15 20:59:20 mercat1 kernel: pid 31225 (creat), uid 2007 inumber 24577 on /mnt12: out of inodes Oct 15 20:59:22 mercat1 kernel: pid 31235 (creat), uid 2007 inumber 24602 on /mnt11: out of inodes Oct 15 20:59:24 mercat1 kernel: pid 31262 (creat), uid 2007 inumber 24588 on /mnt12: out of inodes Oct 15 20:59:27 mercat1 kernel: pid 31211 (rw), uid 2007 inumber 73731 on /mnt10: filesystem full Oct 15 20:59:28 mercat1 kernel: pid 31257 (creat), uid 2007 inumber 24585 on /mnt12: out of inodes Oct 15 20:59:29 mercat1 kernel: pid 31209 (creat), uid 2007 inumber 24588 on /mnt11: out of inodes Oct 15 20:59:31 mercat1 kernel: pid 31270 (creat), uid 2007 inumber 49157 on /mnt10: out of inodes Oct 15 20:59:33 mercat1 kernel: pid 31237 (creat), uid 2007 inumber 24603 on /mnt11: out of inodes Oct 15 20:59:35 mercat1 kernel: pid 31253 (creat), uid 2007 inumber 24582 on /mnt12: out of inodes Oct 15 20:59:37 mercat1 kernel: pid 31203 (creat), uid 2007 inumber 24590 on /mnt11: out of inodes Oct 15 20:59:40 mercat1 kernel: pid 31216 (creat), uid 2007 inumber 24583 on /mnt11: out of inodes Oct 15 20:59:42 mercat1 kernel: pid 31253 (creat), uid 2007 inumber 24582 on /mnt12: out of inodes Oct 15 20:59:44 mercat1 kernel: pid 31229 (creat), uid 2007 inumber 24578 on /mnt11: out of inodes Oct 15 20:59:46 mercat1 kernel: pid 31262 (creat), uid 2007 inumber 24588 on /mnt12: out of inodes Oct 15 20:59:47 mercat1 kernel: pid 31192 (creat), uid 2007 inumber 24577 on /mnt11: out of inodes Oct 15 20:59:49 mercat1 kernel: pid 31262 (creat), uid 2007 inumber 24588 on /mnt12: out of inodes Oct 15 20:59:50 mercat1 kernel: pid 31237 (creat), uid 2007 inumber 24603 on /mnt11: out of inodes Oct 15 20:59:53 mercat1 kernel: pid 31270 (creat), uid 2007 inumber 49157 on /mnt10: out of inodes Oct 15 20:59:56 mercat1 kernel: pid 31243 (creat), uid 2007 inumber 24598 on /mnt12: out of inodes Oct 15 20:59:57 mercat1 kernel: pid 31235 (creat), uid 2007 inumber 24602 on /mnt11: out of inodes Oct 15 20:59:59 mercat1 kernel: pid 31272 (creat), uid 2007 inumber 24600 on /mnt12: out of inodes Oct 15 21:00:02 mercat1 kernel: pid 31253 (creat), uid 2007 inumber 24582 on /mnt12: out of inodes Oct 15 21:00:04 mercat1 kernel: pid 31216 (creat), uid 2007 inumber 24583 on /mnt11: out of inodes Oct 15 21:00:05 mercat1 kernel: pid 31225 (creat), uid 2007 inumber 24577 on /mnt12: out of inodes Oct 15 21:00:08 mercat1 kernel: pid 31235 (creat), uid 2007 inumber 24602 on /mnt11: out of inodes Oct 15 21:00:09 mercat1 kernel: pid 31231 (creat), uid 2007 inumber 24591 on /mnt12: out of inodes Oct 15 21:00:11 mercat1 kernel: pid 31216 (creat), uid 2007 inumber 24583 on /mnt11: out of inodes Oct 15 21:00:14 mercat1 kernel: pid 31237 (creat), uid 2007 inumber 24603 on /mnt11: out of inodes Oct 15 21:00:16 mercat1 kernel: pid 31243 (creat), uid 2007 inumber 24598 on /mnt12: out of inodes Oct 15 21:00:17 mercat1 kernel: pid 31265 (creat), uid 2007 inumber 73730 on /mnt10: out of inodes Oct 15 21:00:19 mercat1 kernel: pid 31231 (creat), uid 2007 inumber 24591 on /mnt12: out of inodes Oct 15 21:00:23 mercat1 kernel: pid 31243 (creat), uid 2007 inumber 24598 on /mnt12: out of inodes Oct 15 21:00:24 mercat1 kernel: pid 31209 (creat), uid 2007 inumber 24588 on /mnt11: out of inodes Oct 15 21:00:26 mercat1 kernel: pid 31272 (creat), uid 2007 inumber 24600 on /mnt12: out of inodes Oct 15 21:00:28 mercat1 kernel: pid 31209 (creat), uid 2007 inumber 24588 on /mnt11: out of inodes Oct 15 21:00:29 mercat1 kernel: pid 31279 (creat), uid 2007 inumber 49158 on /mnt10: out of inodes Oct 15 21:00:31 mercat1 kernel: pid 31203 (creat), uid 2007 inumber 24590 on /mnt11: out of inodes Oct 15 21:00:34 mercat1 kernel: pid 31262 (creat), uid 2007 inumber 24588 on /mnt12: out of inodes Oct 15 21:00:35 mercat1 kernel: pid 31275 (creat), uid 2007 inumber 49159 on /mnt10: out of inodes Oct 15 21:00:37 mercat1 kernel: pid 31243 (creat), uid 2007 inumber 24598 on /mnt12: out of inodes Oct 15 21:00:38 mercat1 kernel: pid 31237 (creat), uid 2007 inumber 24603 on /mnt11: out of inodes Oct 15 21:00:42 mercat1 kernel: pid 31235 (creat), uid 2007 inumber 24602 on /mnt11: out of inodes Oct 15 21:00:47 mercat1 kernel: pid 31267 (creat), uid 2007 inumber 24595 on /mnt12: out of inodes Oct 15 21:00:49 mercat1 kernel: pid 31216 (creat), uid 2007 inumber 24583 on /mnt11: out of inodes Oct 15 21:00:50 mercat1 kernel: pid 31231 (creat), uid 2007 inumber 24591 on /mnt12: out of inodes Oct 15 21:00:52 mercat1 kernel: pid 31192 (creat), uid 2007 inumber 24577 on /mnt11: out of inodes Oct 15 21:00:54 mercat1 kernel: pid 31262 (creat), uid 2007 inumber 24588 on /mnt12: out of inodes Oct 15 21:00:55 mercat1 kernel: pid 31270 (creat), uid 2007 inumber 49157 on /mnt10: out of inodes Oct 15 21:00:57 mercat1 kernel: pid 31257 (creat), uid 2007 inumber 24585 on /mnt12: out of inodes Oct 15 21:01:00 mercat1 syslogd: last message repeated 1 times Oct 15 21:01:01 mercat1 kernel: pid 31261 (creat), uid 2007 inumber 24589 on /mnt10: out of inodes Oct 15 21:01:04 mercat1 kernel: pid 31225 (creat), uid 2007 inumber 24577 on /mnt12: out of inodes Oct 15 21:01:06 mercat1 kernel: pid 45239 (rw), uid 2007 inumber 73738 on /mnt12: filesystem full Oct 15 21:01:06 mercat1 kernel: pid 45227 (rw), uid 2007 inumber 3 on /mnt12: filesystem full Oct 15 21:01:09 mercat1 kernel: pid 45477 (rw), uid 2007 inumber 49184 on /mnt11: filesystem full Oct 15 21:01:09 mercat1 kernel: pid 45453 (mkdir), uid 2007 inumber 49232 on /mnt11: filesystem full Oct 15 21:01:12 mercat1 kernel: pid 45243 (mkdir), uid 2007 inumber 74620 on /mnt12: out of inodes Oct 15 21:01:13 mercat1 kernel: pid 45339 (creat), uid 2007 inumber 24583 on /mnt13: out of inodes Oct 15 21:01:15 mercat1 kernel: pid 45240 (creat), uid 2007 inumber 73731 on /mnt12: out of inodes Oct 15 21:01:16 mercat1 kernel: pid 45472 (mkdir), uid 2007 inumber 24534 on /mnt11: out of inodes Oct 15 21:01:18 mercat1 kernel: pid 45252 (creat), uid 2007 inumber 73744 on /mnt12: out of inodes Oct 15 21:01:20 mercat1 kernel: pid 45331 (creat), uid 2007 inumber 24591 on /mnt13: out of inodes Oct 15 21:01:21 mercat1 kernel: pid 45254 (creat), uid 2007 inumber 73746 on /mnt12: out of inodes Oct 15 21:01:24 mercat1 kernel: pid 45400 (creat), uid 2007 inumber 24637 on /mnt10: out of inodes Oct 15 21:01:27 mercat1 kernel: pid 45311 (creat), uid 2007 inumber 24586 on /mnt13: out of inodes Oct 15 21:01:28 mercat1 kernel: pid 45376 (creat), uid 2007 inumber 24584 on /mnt10: out of inodes Oct 15 21:01:28 mercat1 kernel: pid 45471 (rw), uid 2007 inumber 49183 on /mnt11: filesystem full Oct 15 21:01:29 mercat1 kernel: pid 45237 (creat), uid 2007 inumber 73735 on /mnt12: out of inodes Oct 15 21:01:32 mercat1 kernel: pid 45309 (creat), uid 2007 inumber 24601 on /mnt13: out of inodes Oct 15 21:01:39 mercat1 kernel: pid 45228 (creat), uid 2007 inumber 24582 on /mnt12: out of inodes Oct 15 21:01:41 mercat1 kernel: pid 45336 (mkdir), uid 2007 inumber 98285 on /mnt13: out of inodes Oct 15 21:01:43 mercat1 kernel: pid 45462 (creat), uid 2007 inumber 49174 on /mnt11: out of inodes Oct 15 21:01:44 mercat1 kernel: pid 45240 (creat), uid 2007 inumber 73731 on /mnt12: out of inodes Oct 15 21:01:47 mercat1 kernel: pid 45326 (creat), uid 2007 inumber 24587 on /mnt13: out of inodes Oct 15 21:01:52 mercat1 kernel: pid 45448 (creat), uid 2007 inumber 49166 on /mnt11: out of inodes Oct 15 21:01:53 mercat1 kernel: pid 45385 (rw), uid 2007 inumber 3551 on /mnt10: filesystem full Oct 15 21:01:58 mercat1 kernel: pid 45400 (creat), uid 2007 inumber 24637 on /mnt10: out of inodes Oct 15 21:01:59 mercat1 kernel: pid 45475 (rw), uid 2007 inumber 27641 on /mnt11: filesystem full Oct 15 21:01:59 mercat1 kernel: pid 45334 (creat), uid 2007 inumber 24589 on /mnt13: out of inodes Oct 15 21:02:02 mercat1 kernel: pid 45401 (creat), uid 2007 inumber 24632 on /mnt10: out of inodes Oct 15 21:02:05 mercat1 kernel: pid 45311 (creat), uid 2007 inumber 24586 on /mnt13: out of inodes Oct 15 21:02:10 mercat1 kernel: pid 45326 (creat), uid 2007 inumber 24587 on /mnt13: out of inodes Oct 15 21:02:12 mercat1 kernel: pid 45234 (creat), uid 2007 inumber 73753 on /mnt12: out of inodes Oct 15 21:02:15 mercat1 kernel: pid 45401 (creat), uid 2007 inumber 24632 on /mnt10: out of inodes Oct 15 21:02:16 mercat1 kernel: pid 45234 (creat), uid 2007 inumber 73753 on /mnt12: out of inodes Oct 15 21:02:18 mercat1 kernel: pid 45337 (creat), uid 2007 inumber 24582 on /mnt13: out of inodes Oct 15 21:02:19 mercat1 kernel: pid 45371 (creat), uid 2007 inumber 24583 on /mnt10: out of inodes Oct 15 21:02:23 mercat1 kernel: pid 45317 (creat), uid 2007 inumber 49153 on /mnt13: out of inodes Oct 15 21:02:25 mercat1 kernel: pid 45260 (creat), uid 2007 inumber 73737 on /mnt12: out of inodes Oct 15 21:02:27 mercat1 kernel: pid 45396 (creat), uid 2007 inumber 24620 on /mnt10: out of inodes Oct 15 21:02:29 mercat1 kernel: pid 45328 (creat), uid 2007 inumber 24580 on /mnt13: out of inodes Oct 15 21:02:33 mercat1 kernel: pid 45456 (creat), uid 2007 inumber 49179 on /mnt11: out of inodes Oct 15 21:02:34 mercat1 kernel: pid 45323 (creat), uid 2007 inumber 49155 on /mnt13: out of inodes Oct 15 21:02:41 mercat1 kernel: pid 45228 (creat), uid 2007 inumber 24582 on /mnt12: out of inodes Oct 15 21:02:43 mercat1 kernel: pid 45373 (creat), uid 2007 inumber 49154 on /mnt10: out of inodes Oct 15 21:02:45 mercat1 kernel: pid 45228 (creat), uid 2007 inumber 24582 on /mnt12: out of inodes Oct 15 21:02:47 mercat1 kernel: pid 45394 (creat), uid 2007 inumber 24623 on /mnt10: out of inodes Oct 15 21:02:48 mercat1 kernel: pid 45454 (creat), uid 2007 inumber 49170 on /mnt11: out of inodes Oct 15 21:02:49 mercat1 kernel: pid 45254 (creat), uid 2007 inumber 73746 on /mnt12: out of inodes Oct 15 21:02:50 mercat1 kernel: pid 45403 (creat), uid 2007 inumber 24630 on /mnt10: out of inodes Oct 15 21:02:52 mercat1 kernel: pid 45228 (creat), uid 2007 inumber 24582 on /mnt12: out of inodes Oct 15 21:02:53 mercat1 kernel: pid 45373 (creat), uid 2007 inumber 49154 on /mnt10: out of inodes Oct 15 21:02:56 mercat1 kernel: pid 45231 (creat), uid 2007 inumber 73730 on /mnt12: out of inodes Oct 15 21:02:57 mercat1 kernel: pid 45384 (creat), uid 2007 inumber 24593 on /mnt10: out of inodes Oct 15 21:02:59 mercat1 kernel: pid 45246 (creat), uid 2007 inumber 73750 on /mnt12: out of inodes Oct 15 21:03:00 mercat1 kernel: pid 45378 (creat), uid 2007 inumber 24588 on /mnt10: out of inodes Oct 15 21:03:03 mercat1 kernel: pid 45454 (creat), uid 2007 inumber 49170 on /mnt11: out of inodes Oct 15 21:03:04 mercat1 kernel: pid 45317 (creat), uid 2007 inumber 49153 on /mnt13: out of inodes Oct 15 21:03:07 mercat1 kernel: pid 56271 (rw), uid 2007 inumber 73746 on /mnt12: filesystem full Oct 15 21:03:14 mercat1 kernel: pid 56418 (creat), uid 2007 inumber 24595 on /mnt13: out of inodes Oct 15 21:03:15 mercat1 kernel: pid 56282 (mkdir), uid 2007 inumber 24517 on /mnt12: out of inodes Oct 15 21:03:16 mercat1 kernel: pid 56516 (mkdir), uid 2007 inumber 49135 on /mnt11: out of inodes Oct 15 21:03:17 mercat1 kernel: pid 56428 (creat), uid 2007 inumber 24606 on /mnt13: out of inodes Oct 15 21:03:18 mercat1 kernel: pid 56533 (mkdir), uid 2007 inumber 49218 on /mnt11: out of inodes Oct 15 21:03:21 mercat1 kernel: pid 56326 (creat), uid 2007 inumber 24576 on /mnt10: out of inodes Oct 15 21:03:27 mercat1 kernel: pid 56412 (creat), uid 2007 inumber 24596 on /mnt13: out of inodes Oct 15 21:03:28 mercat1 kernel: pid 56321 (rw), uid 2007 inumber 89535 on /mnt10: filesystem full Oct 15 21:03:28 mercat1 kernel: pid 56326 (creat), uid 2007 inumber 24576 on /mnt10: filesystem full Oct 15 21:03:28 mercat1 kernel: pid 56333 (mkdir), uid 2007 inumber 89486 on /mnt10: filesystem full Oct 15 21:03:29 mercat1 kernel: pid 56511 (creat), uid 2007 inumber 49202 on /mnt11: out of inodes Oct 15 21:03:32 mercat1 kernel: pid 56421 (mkdir), uid 2007 inumber 96984 on /mnt13: out of inodes Oct 15 21:03:35 mercat1 kernel: pid 56323 (creat), uid 2007 inumber 7 on /mnt10: out of inodes Oct 15 21:03:38 mercat1 kernel: pid 56412 (creat), uid 2007 inumber 24596 on /mnt13: out of inodes Oct 15 21:03:40 mercat1 kernel: pid 56320 (creat), uid 2007 inumber 15 on /mnt10: out of inodes Oct 15 21:03:43 mercat1 kernel: pid 56416 (creat), uid 2007 inumber 24597 on /mnt13: out of inodes Oct 15 21:03:45 mercat1 kernel: pid 56418 (creat), uid 2007 inumber 24595 on /mnt13: out of inodes Oct 15 21:03:46 mercat1 kernel: pid 56280 (mkdir), uid 2007 inumber 93989 on /mnt12: filesystem full Oct 15 21:03:48 mercat1 kernel: pid 56418 (creat), uid 2007 inumber 24595 on /mnt13: out of inodes Oct 15 21:03:51 mercat1 kernel: pid 56508 (creat), uid 2007 inumber 49201 on /mnt11: out of inodes Oct 15 21:03:53 mercat1 kernel: pid 56414 (creat), uid 2007 inumber 24599 on /mnt13: out of inodes Oct 15 21:03:55 mercat1 kernel: pid 56326 (creat), uid 2007 inumber 24576 on /mnt10: out of inodes Oct 15 21:03:56 mercat1 kernel: pid 56400 (creat), uid 2007 inumber 24607 on /mnt13: out of inodes Oct 15 21:03:58 mercat1 kernel: pid 56425 (creat), uid 2007 inumber 24601 on /mnt13: out of inodes Oct 15 21:04:01 mercat1 kernel: pid 56416 (creat), uid 2007 inumber 24597 on /mnt13: out of inodes Oct 15 21:04:04 mercat1 kernel: pid 56320 (creat), uid 2007 inumber 15 on /mnt10: out of inodes Oct 15 21:04:07 mercat1 kernel: pid 56326 (creat), uid 2007 inumber 24576 on /mnt10: out of inodes Oct 15 21:04:09 mercat1 kernel: pid 56398 (creat), uid 2007 inumber 24579 on /mnt13: out of inodes Oct 15 21:04:12 mercat1 kernel: pid 56420 (creat), uid 2007 inumber 24603 on /mnt13: out of inodes Oct 15 21:04:14 mercat1 kernel: pid 56390 (creat), uid 2007 inumber 24592 on /mnt13: out of inodes Oct 15 21:04:16 mercat1 kernel: pid 56320 (creat), uid 2007 inumber 15 on /mnt10: out of inodes Oct 15 21:04:19 mercat1 kernel: pid 56396 (creat), uid 2007 inumber 24585 on /mnt13: out of inodes Oct 15 21:04:21 mercat1 kernel: pid 56416 (creat), uid 2007 inumber 24597 on /mnt13: out of inodes Oct 15 21:04:24 mercat1 kernel: pid 56426 (creat), uid 2007 inumber 24602 on /mnt13: out of inodes Oct 15 21:04:27 mercat1 kernel: pid 56420 (creat), uid 2007 inumber 24603 on /mnt13: out of inodes Oct 15 21:04:29 mercat1 kernel: pid 56326 (creat), uid 2007 inumber 24576 on /mnt10: out of inodes Oct 15 21:04:32 mercat1 kernel: pid 56390 (creat), uid 2007 inumber 24592 on /mnt13: out of inodes Oct 15 21:04:33 mercat1 kernel: pid 56329 (creat), uid 2007 inumber 9 on /mnt10: out of inodes Oct 15 21:04:34 mercat1 kernel: pid 56394 (creat), uid 2007 inumber 24584 on /mnt13: out of inodes Oct 15 21:04:37 mercat1 kernel: pid 56428 (creat), uid 2007 inumber 24606 on /mnt13: out of inodes Oct 15 21:04:40 mercat1 kernel: pid 56416 (creat), uid 2007 inumber 24597 on /mnt13: out of inodes Oct 15 21:04:42 mercat1 kernel: pid 56396 (creat), uid 2007 inumber 24585 on /mnt13: out of inodes Oct 15 21:04:45 mercat1 syslogd: last message repeated 1 times Oct 15 21:04:47 mercat1 kernel: pid 56326 (creat), uid 2007 inumber 24576 on /mnt10: out of inodes Oct 15 21:04:50 mercat1 kernel: pid 56420 (creat), uid 2007 inumber 24603 on /mnt13: out of inodes Oct 15 21:04:52 mercat1 kernel: pid 56320 (creat), uid 2007 inumber 15 on /mnt10: out of inodes Oct 15 21:04:55 mercat1 kernel: pid 56396 (creat), uid 2007 inumber 24585 on /mnt13: out of inodes Oct 15 21:04:56 mercat1 kernel: pid 56326 (creat), uid 2007 inumber 24576 on /mnt10: out of inodes Oct 15 21:04:57 mercat1 kernel: pid 56511 (creat), uid 2007 inumber 49202 on /mnt11: out of inodes Oct 15 21:05:01 mercat1 kernel: pid 56396 (creat), uid 2007 inumber 24585 on /mnt13: out of inodes Oct 15 21:05:04 mercat1 kernel: pid 56405 (creat), uid 2007 inumber 24594 on /mnt13: out of inodes Oct 15 21:05:06 mercat1 kernel: pid 56422 (creat), uid 2007 inumber 24600 on /mnt13: out of inodes 20181015 21:05:08 all (46/587): inversion.sh 20181015 21:15:10 all (47/587): newfs.sh lock order reversal: 1st 0xfffff804973d4c38 ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:118 2nd 0xfffff80778fc3a48 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1682 stack backtrace: #0 0xffffffff80bf8c83 at witness_debugger+0x73 #1 0xffffffff80bf89d3 at witness_checkorder+0xab3 #2 0xffffffff80b6501b at lockmgr_xlock_hard+0x6b #3 0xffffffff80b658ae at __lockmgr_args+0x3ce #4 0xffffffff80ea6bc9 at ffs_vgetf+0x139 #5 0xffffffff80eb94d8 at ufs_root+0x48 #6 0xffffffff80eb16f9 at ufs_extattr_autostart+0x79 #7 0xffffffff80ea8e44 at ffs_mount+0x1ba4 #8 0xffffffff80c59b2f at vfs_domount+0x74f #9 0xffffffff80c58df8 at vfs_donmount+0x7b8 #10 0xffffffff80c58612 at sys_nmount+0x72 #11 0xffffffff810695b7 at amd64_syscall+0x2a7 #12 0xffffffff81044d8d at fast_syscall_common+0x101 Oct 15 21:23:39 mercat1 kernel: pid 35197 (rw), uid 2007 inumber 211254 on /mnt: filesystem full Oct 15 21:23:39 mercat1 kernel: pid 35216 (mkdir), uid 2007 inumber 449053 on /mnt: filesystem full Oct 15 21:23:52 mercat1 kernel: pid 36756 (rw), uid 2007 inumber 66834 on /mnt: filesystem full Oct 15 21:25:03 mercat1 kernel: pid 44467 (creat), uid 2007 inumber 12753 on /mnt: filesystem full Oct 15 21:25:03 mercat1 kernel: pid 44462 (rw), uid 2007 inumber 23958 on /mnt: filesystem full Oct 15 21:25:14 mercat1 kernel: pid 47477 (mkdir), uid 2007 inumber 123978 on /mnt: filesystem full Oct 15 21:25:14 mercat1 kernel: pid 47456 (rw), uid 2007 inumber 199090 on /mnt: filesystem full Oct 15 21:25:26 mercat1 kernel: pid 48997 (rw), uid 2007 inumber 109322 on /mnt: filesystem full Oct 15 21:25:26 mercat1 kernel: pid 49011 (mkdir), uid 2007 inumber 12095 on /mnt: filesystem full Oct 15 21:25:26 mercat1 kernel: pid 49019 (creat), uid 2007 inumber 98338 on /mnt: filesystem full Oct 15 21:25:28 mercat1 kernel: pid 49004 (creat), uid 2007 inumber 98441 on /mnt: out of inodes Oct 15 21:25:43 mercat1 kernel: pid 50559 (mkdir), uid 2007 inumber 32766 on /mnt: out of inodes Oct 15 21:25:44 mercat1 kernel: pid 50549 (rw), uid 2007 inumber 18803 on /mnt: filesystem full Oct 15 21:25:46 mercat1 kernel: pid 50568 (mkdir), uid 2007 inumber 16330 on /mnt: out of inodes Oct 15 21:25:55 mercat1 kernel: pid 52085 (creat), uid 2007 inumber 16417 on /mnt: out of inodes Oct 15 21:26:33 mercat1 kernel: pid 57383 (rw), uid 2007 inumber 26036 on /mnt: filesystem full Oct 15 21:26:33 mercat1 kernel: pid 57394 (mkdir), uid 2007 inumber 24600 on /mnt: filesystem full Oct 15 21:26:34 mercat1 kernel: pid 57407 (mkdir), uid 2007 inumber 24569 on /mnt: out of inodes Oct 15 21:26:36 mercat1 kernel: pid 57413 (mkdir), uid 2007 inumber 8257 on /mnt: out of inodes Oct 15 21:26:37 mercat1 kernel: pid 57398 (creat), uid 2007 inumber 24585 on /mnt: out of inodes Oct 15 21:26:39 mercat1 kernel: pid 57404 (creat), uid 2007 inumber 5 on /mnt: out of inodes Oct 15 21:26:52 mercat1 kernel: pid 59753 (creat), uid 2007 inumber 12327 on /mnt: out of inodes Oct 15 21:27:02 mercat1 kernel: pid 61288 (rw), uid 2007 inumber 8637 on /mnt: filesystem full Oct 15 21:27:03 mercat1 kernel: pid 61291 (creat), uid 2007 inumber 16398 on /mnt: out of inodes Oct 15 21:27:16 mercat1 kernel: pid 62861 (mkdir), uid 2007 inumber 8146 on /mnt: out of inodes Oct 15 21:27:20 mercat1 kernel: pid 62844 (rw), uid 2007 inumber 8381 on /mnt: filesystem full Oct 15 21:27:20 mercat1 kernel: pid 62857 (mkdir), uid 2007 inumber 7245 on /mnt: filesystem full Oct 15 21:27:31 mercat1 kernel: pid 64398 (creat), uid 2007 inumber 8198 on /mnt: out of inodes Oct 15 21:27:33 mercat1 kernel: pid 64407 (creat), uid 2007 inumber 8205 on /mnt: out of inodes Oct 15 21:27:40 mercat1 kernel: pid 65954 (mkdir), uid 2007 inumber 2145 on /mnt: out of inodes Oct 15 21:27:41 mercat1 kernel: pid 65956 (creat), uid 2007 inumber 4112 on /mnt: out of inodes Oct 15 21:27:42 mercat1 kernel: pid 65940 (creat), uid 2007 inumber 4106 on /mnt: out of inodes Oct 15 21:27:43 mercat1 kernel: pid 65953 (creat), uid 2007 inumber 4107 on /mnt: out of inodes Oct 15 21:27:46 mercat1 kernel: pid 65942 (creat), uid 2007 inumber 4102 on /mnt: out of inodes Oct 15 21:29:59 mercat1 kernel: pid 84444 (mkdir), uid 2007 inumber 23068 on /mnt: out of inodes Oct 15 21:31:30 mercat1 kernel: pid 96628 (creat), uid 2007 inumber 4112 on /mnt: out of inodes 20181015 21:31:34 all (48/587): nullfs20.sh 20181015 21:42:15 all (49/587): select.sh 20181015 21:52:20 all (50/587): ptrace8.sh 20181015 21:52:23 all (51/587): quota1.sh Oct 15 21:52:34 mercat1 kernel: pid 1360 (rw), uid 0 inumber 6157 on /mnt: filesystem full Oct 15 21:52:34 mercat1 kernel: pid 1359 (rw), uid 0 inumber 6872 on /mnt: filesystem full Oct 15 21:52:35 mercat1 kernel: pid 1383 (creat), uid 0 inumber 4130 on /mnt: out of inodes Oct 15 21:52:40 mercat1 kernel: pid 1355 (rw), uid 0 inumber 4204 on /mnt: filesystem full Oct 15 21:52:40 mercat1 kernel: pid 1350 (rw), uid 0 inumber 7307 on /mnt: filesystem full Oct 15 21:52:43 mercat1 kernel: pid 1373 (mkdir), uid 0 inumber 4046 on /mnt: out of inodes Oct 15 21:52:45 mercat1 kernel: pid 1385 (creat), uid 0 inumber 4134 on /mnt: out of inodes Oct 15 21:52:47 mercat1 kernel: pid 1381 (creat), uid 0 inumber 4131 on /mnt: out of inodes Oct 15 21:52:49 mercat1 kernel: pid 1383 (creat), uid 0 inumber 4130 on /mnt: out of inodes Oct 15 21:52:51 mercat1 kernel: pid 1372 (mkdir), uid 0 inumber 16198 on /mnt: out of inodes Oct 15 21:52:52 mercat1 kernel: pid 1379 (creat), uid 0 inumber 4225 on /mnt: out of inodes Oct 15 21:52:53 mercat1 kernel: pid 1377 (creat), uid 0 inumber 4129 on /mnt: out of inodes Oct 15 21:52:54 mercat1 kernel: pid 1387 (creat), uid 0 inumber 4132 on /mnt: out of inodes Oct 15 21:52:56 mercat1 kernel: pid 1379 (creat), uid 0 inumber 4225 on /mnt: out of inodes Oct 15 21:52:59 mercat1 syslogd: last message repeated 2 times Oct 15 21:53:00 mercat1 kernel: pid 1381 (creat), uid 0 inumber 4131 on /mnt: out of inodes Oct 15 21:53:01 mercat1 syslogd: last message repeated 1 times Oct 15 21:53:03 mercat1 kernel: pid 1389 (creat), uid 0 inumber 4133 on /mnt: out of inodes Oct 15 21:53:05 mercat1 kernel: pid 1379 (creat), uid 0 inumber 4225 on /mnt: out of inodes Oct 15 21:53:06 mercat1 syslogd: last message repeated 1 times Oct 15 21:53:08 mercat1 kernel: pid 1381 (creat), uid 0 inumber 4131 on /mnt: out of inodes Oct 15 21:53:13 mercat1 kernel: pid 1379 (creat), uid 0 inumber 4225 on /mnt: out of inodes Oct 15 21:53:14 mercat1 kernel: pid 1389 (creat), uid 0 inumber 4133 on /mnt: out of inodes Oct 15 21:53:15 mercat1 kernel: pid 1379 (creat), uid 0 inumber 4225 on /mnt: out of inodes Oct 15 21:53:18 mercat1 kernel: pid 1389 (creat), uid 0 inumber 4133 on /mnt: out of inodes Oct 15 21:53:19 mercat1 kernel: pid 1379 (creat), uid 0 inumber 4225 on /mnt: out of inodes Oct 15 21:53:21 mercat1 kernel: pid 1385 (creat), uid 0 inumber 4134 on /mnt: out of inodes Oct 15 21:53:24 mercat1 kernel: pid 1379 (creat), uid 0 inumber 4225 on /mnt: out of inodes Oct 15 21:53:25 mercat1 kernel: pid 1381 (creat), uid 0 inumber 4131 on /mnt: out of inodes Oct 15 21:53:27 mercat1 kernel: pid 1379 (creat), uid 0 inumber 4225 on /mnt: out of inodes Oct 15 21:53:30 mercat1 kernel: pid 1377 (creat), uid 0 inumber 4129 on /mnt: out of inodes Oct 15 21:53:38 mercat1 kernel: pid 1381 (creat), uid 0 inumber 4131 on /mnt: out of inodes Oct 15 21:53:40 mercat1 kernel: pid 1385 (creat), uid 0 inumber 4134 on /mnt: out of inodes Oct 15 21:53:42 mercat1 kernel: pid 1379 (creat), uid 0 inumber 4225 on /mnt: out of inodes Oct 15 21:53:44 mercat1 syslogd: last message repeated 1 times Oct 15 21:53:46 mercat1 kernel: pid 1389 (creat), uid 0 inumber 4133 on /mnt: out of inodes Oct 15 21:53:47 mercat1 kernel: pid 1379 (creat), uid 0 inumber 4225 on /mnt: out of inodes Oct 15 21:53:48 mercat1 kernel: pid 1377 (creat), uid 0 inumber 4129 on /mnt: out of inodes Oct 15 21:53:50 mercat1 kernel: pid 1385 (creat), uid 0 inumber 4134 on /mnt: out of inodes Oct 15 21:53:51 mercat1 kernel: pid 1379 (creat), uid 0 inumber 4225 on /mnt: out of inodes Oct 15 21:53:56 mercat1 syslogd: last message repeated 3 times Oct 15 21:53:57 mercat1 kernel: pid 1381 (creat), uid 0 inumber 4131 on /mnt: out of inodes Oct 15 21:53:58 mercat1 kernel: pid 1383 (creat), uid 0 inumber 4130 on /mnt: out of inodes Oct 15 21:54:00 mercat1 kernel: pid 1379 (creat), uid 0 inumber 4225 on /mnt: out of inodes Oct 15 21:54:01 mercat1 kernel: pid 1389 (creat), uid 0 inumber 4133 on /mnt: out of inodes Oct 15 21:54:03 mercat1 kernel: pid 1383 (creat), uid 0 inumber 4130 on /mnt: out of inodes Oct 15 21:54:04 mercat1 kernel: pid 1385 (creat), uid 0 inumber 4134 on /mnt: out of inodes Oct 15 21:54:06 mercat1 syslogd: last message repeated 1 times Oct 15 21:54:07 mercat1 kernel: pid 1379 (creat), uid 0 inumber 4225 on /mnt: out of inodes Oct 15 21:54:08 mercat1 kernel: pid 1387 (creat), uid 0 inumber 4132 on /mnt: out of inodes Oct 15 21:54:10 mercat1 kernel: pid 1381 (creat), uid 0 inumber 4131 on /mnt: out of inodes Oct 15 21:54:11 mercat1 kernel: pid 1379 (creat), uid 0 inumber 4225 on /mnt: out of inodes Oct 15 21:54:15 mercat1 syslogd: last message repeated 1 times Oct 15 21:54:16 mercat1 kernel: pid 1385 (creat), uid 0 inumber 4134 on /mnt: out of inodes Oct 15 21:54:21 mercat1 kernel: pid 1387 (creat), uid 0 inumber 4132 on /mnt: out of inodes Oct 15 21:54:23 mercat1 kernel: pid 1385 (creat), uid 0 inumber 4134 on /mnt: out of inodes Oct 15 21:54:24 mercat1 kernel: pid 1387 (creat), uid 0 inumber 4132 on /mnt: out of inodes Oct 15 21:54:25 mercat1 kernel: pid 1379 (creat), uid 0 inumber 4225 on /mnt: out of inodes Oct 15 21:54:30 mercat1 kernel: pid 17593 (mkdir), uid 0 inumber 4077 on /mnt: out of inodes Oct 15 21:54:31 mercat1 kernel: pid 17588 (mkdir), uid 0 inumber 16353 on /mnt: out of inodes Oct 15 21:54:42 mercat1 kernel: pid 17591 (mkdir), uid 0 inumber 4017 on /mnt: out of inodes Oct 15 21:54:44 mercat1 kernel: pid 17596 (mkdir), uid 0 inumber 4082 on /mnt: out of inodes Oct 15 21:54:47 mercat1 kernel: pid 17590 (mkdir), uid 0 inumber 16381 on /mnt: out of inodes Oct 15 21:54:50 mercat1 kernel: pid 17589 (mkdir), uid 0 inumber 16312 on /mnt: out of inodes Oct 15 21:56:36 mercat1 kernel: pid 32302 (rw), uid 0 inumber 4140 on /mnt: filesystem full Oct 15 21:56:42 mercat1 kernel: pid 32295 (rw), uid 0 inumber 4108 on /mnt: filesystem full Oct 15 21:57:58 mercat1 kernel: pid 32297 (rw), uid 0 inumber 8195 on /mnt: filesystem full Oct 15 22:00:28 mercat1 kernel: pid 64688 (rw), uid 0 inumber 7602 on /mnt: filesystem full Oct 15 22:00:28 mercat1 kernel: pid 64694 (rw), uid 0 inumber 4173 on /mnt: filesystem full Oct 15 22:00:28 mercat1 kernel: pid 64700 (creat), uid 0 inumber 4115 on /mnt: out of inodes Oct 15 22:00:31 mercat1 kernel: pid 64693 (creat), uid 0 inumber 4109 on /mnt: out of inodes Oct 15 22:00:33 mercat1 kernel: pid 64717 (creat), uid 0 inumber 4131 on /mnt: out of inodes Oct 15 22:00:34 mercat1 kernel: pid 64721 (creat), uid 0 inumber 4138 on /mnt: out of inodes Oct 15 22:00:35 mercat1 kernel: pid 64719 (creat), uid 0 inumber 4133 on /mnt: out of inodes Oct 15 22:00:36 mercat1 kernel: pid 64717 (creat), uid 0 inumber 4131 on /mnt: out of inodes Oct 15 22:00:38 mercat1 kernel: pid 64697 (mkdir), uid 0 inumber 15466 on /mnt: out of inodes Oct 15 22:00:39 mercat1 kernel: pid 64717 (creat), uid 0 inumber 4131 on /mnt: out of inodes Oct 15 22:00:42 mercat1 kernel: pid 64720 (creat), uid 0 inumber 4134 on /mnt: out of inodes Oct 15 22:00:45 mercat1 kernel: pid 64719 (creat), uid 0 inumber 4133 on /mnt: out of inodes Oct 15 22:00:46 mercat1 kernel: pid 64721 (creat), uid 0 inumber 4138 on /mnt: out of inodes Oct 15 22:00:47 mercat1 kernel: pid 64718 (creat), uid 0 inumber 4132 on /mnt: out of inodes Oct 15 22:00:48 mercat1 kernel: pid 64707 (creat), uid 0 inumber 4122 on /mnt: out of inodes Oct 15 22:00:49 mercat1 kernel: pid 64709 (creat), uid 0 inumber 4123 on /mnt: out of inodes Oct 15 22:00:50 mercat1 kernel: pid 64715 (creat), uid 0 inumber 4129 on /mnt: out of inodes Oct 15 22:00:51 mercat1 kernel: pid 64696 (creat), uid 0 inumber 4111 on /mnt: out of inodes Oct 15 22:00:52 mercat1 kernel: pid 64709 (creat), uid 0 inumber 4123 on /mnt: out of inodes Oct 15 22:00:54 mercat1 kernel: pid 64711 (creat), uid 0 inumber 4127 on /mnt: out of inodes Oct 15 22:00:56 mercat1 kernel: pid 64722 (creat), uid 0 inumber 4140 on /mnt: out of inodes Oct 15 22:00:57 mercat1 kernel: pid 64711 (creat), uid 0 inumber 4127 on /mnt: out of inodes Oct 15 22:00:58 mercat1 kernel: pid 64721 (creat), uid 0 inumber 4138 on /mnt: out of inodes Oct 15 22:00:59 mercat1 kernel: pid 64722 (creat), uid 0 inumber 4140 on /mnt: out of inodes Oct 15 22:01:01 mercat1 kernel: pid 64716 (creat), uid 0 inumber 4130 on /mnt: out of inodes Oct 15 22:01:03 mercat1 kernel: pid 64718 (creat), uid 0 inumber 4132 on /mnt: out of inodes Oct 15 22:01:04 mercat1 kernel: pid 64693 (creat), uid 0 inumber 4109 on /mnt: out of inodes Oct 15 22:01:06 mercat1 kernel: pid 64709 (creat), uid 0 inumber 4123 on /mnt: out of inodes Oct 15 22:01:08 mercat1 kernel: pid 64696 (creat), uid 0 inumber 4111 on /mnt: out of inodes Oct 15 22:01:10 mercat1 kernel: pid 64706 (creat), uid 0 inumber 4121 on /mnt: out of inodes Oct 15 22:01:11 mercat1 kernel: pid 64702 (creat), uid 0 inumber 4119 on /mnt: out of inodes Oct 15 22:01:13 mercat1 kernel: pid 64716 (creat), uid 0 inumber 4130 on /mnt: out of inodes Oct 15 22:01:14 mercat1 kernel: pid 64713 (creat), uid 0 inumber 4128 on /mnt: out of inodes Oct 15 22:01:16 mercat1 kernel: pid 64704 (creat), uid 0 inumber 4120 on /mnt: out of inodes Oct 15 22:01:17 mercat1 kernel: pid 64713 (creat), uid 0 inumber 4128 on /mnt: out of inodes Oct 15 22:01:19 mercat1 kernel: pid 64715 (creat), uid 0 inumber 4129 on /mnt: out of inodes Oct 15 22:01:21 mercat1 kernel: pid 64704 (creat), uid 0 inumber 4120 on /mnt: out of inodes Oct 15 22:01:22 mercat1 kernel: pid 64690 (creat), uid 0 inumber 4107 on /mnt: out of inodes Oct 15 22:01:23 mercat1 kernel: pid 64717 (creat), uid 0 inumber 4131 on /mnt: out of inodes Oct 15 22:01:24 mercat1 kernel: pid 64720 (creat), uid 0 inumber 4134 on /mnt: out of inodes Oct 15 22:01:25 mercat1 syslogd: last message repeated 1 times Oct 15 22:01:26 mercat1 kernel: pid 64690 (creat), uid 0 inumber 4107 on /mnt: out of inodes Oct 15 22:01:27 mercat1 kernel: pid 64718 (creat), uid 0 inumber 4132 on /mnt: out of inodes Oct 15 22:01:29 mercat1 kernel: pid 64720 (creat), uid 0 inumber 4134 on /mnt: out of inodes Oct 15 22:01:30 mercat1 kernel: pid 64707 (creat), uid 0 inumber 4122 on /mnt: out of inodes Oct 15 22:01:31 mercat1 kernel: pid 64704 (creat), uid 0 inumber 4120 on /mnt: out of inodes Oct 15 22:01:32 mercat1 kernel: pid 64706 (creat), uid 0 inumber 4121 on /mnt: out of inodes Oct 15 22:01:34 mercat1 kernel: pid 64719 (creat), uid 0 inumber 4133 on /mnt: out of inodes Oct 15 22:01:36 mercat1 syslogd: last message repeated 1 times Oct 15 22:01:37 mercat1 kernel: pid 64690 (creat), uid 0 inumber 4107 on /mnt: out of inodes Oct 15 22:01:40 mercat1 kernel: pid 64704 (creat), uid 0 inumber 4120 on /mnt: out of inodes Oct 15 22:01:41 mercat1 kernel: pid 64702 (creat), uid 0 inumber 4119 on /mnt: out of inodes Oct 15 22:01:42 mercat1 kernel: pid 64713 (creat), uid 0 inumber 4128 on /mnt: out of inodes Oct 15 22:01:44 mercat1 kernel: pid 64718 (creat), uid 0 inumber 4132 on /mnt: out of inodes Oct 15 22:01:45 mercat1 kernel: pid 64717 (creat), uid 0 inumber 4131 on /mnt: out of inodes Oct 15 22:01:46 mercat1 kernel: pid 64711 (creat), uid 0 inumber 4127 on /mnt: out of inodes Oct 15 22:01:48 mercat1 syslogd: last message repeated 1 times Oct 15 22:01:50 mercat1 kernel: pid 64693 (creat), uid 0 inumber 4109 on /mnt: out of inodes Oct 15 22:01:52 mercat1 kernel: pid 64698 (creat), uid 0 inumber 4113 on /mnt: out of inodes Oct 15 22:01:54 mercat1 kernel: pid 64696 (creat), uid 0 inumber 4111 on /mnt: out of inodes Oct 15 22:01:56 mercat1 kernel: pid 64716 (creat), uid 0 inumber 4130 on /mnt: out of inodes Oct 15 22:01:57 mercat1 kernel: pid 64690 (creat), uid 0 inumber 4107 on /mnt: out of inodes Oct 15 22:01:59 mercat1 kernel: pid 64700 (creat), uid 0 inumber 4115 on /mnt: out of inodes Oct 15 22:02:00 mercat1 kernel: pid 64706 (creat), uid 0 inumber 4121 on /mnt: out of inodes Oct 15 22:02:01 mercat1 kernel: pid 64698 (creat), uid 0 inumber 4113 on /mnt: out of inodes Oct 15 22:02:04 mercat1 kernel: pid 64707 (creat), uid 0 inumber 4122 on /mnt: out of inodes Oct 15 22:02:06 mercat1 kernel: pid 64717 (creat), uid 0 inumber 4131 on /mnt: out of inodes Oct 15 22:02:07 mercat1 kernel: pid 64715 (creat), uid 0 inumber 4129 on /mnt: out of inodes Oct 15 22:02:08 mercat1 kernel: pid 64709 (creat), uid 0 inumber 4123 on /mnt: out of inodes Oct 15 22:02:09 mercat1 kernel: pid 64713 (creat), uid 0 inumber 4128 on /mnt: out of inodes Oct 15 22:02:10 mercat1 kernel: pid 64700 (creat), uid 0 inumber 4115 on /mnt: out of inodes Oct 15 22:02:11 mercat1 kernel: pid 64718 (creat), uid 0 inumber 4132 on /mnt: out of inodes Oct 15 22:02:13 mercat1 kernel: pid 64713 (creat), uid 0 inumber 4128 on /mnt: out of inodes Oct 15 22:02:14 mercat1 kernel: pid 64709 (creat), uid 0 inumber 4123 on /mnt: out of inodes Oct 15 22:02:15 mercat1 kernel: pid 64715 (creat), uid 0 inumber 4129 on /mnt: out of inodes Oct 15 22:02:16 mercat1 kernel: pid 64702 (creat), uid 0 inumber 4119 on /mnt: out of inodes Oct 15 22:02:19 mercat1 syslogd: last message repeated 1 times Oct 15 22:02:20 mercat1 kernel: pid 64718 (creat), uid 0 inumber 4132 on /mnt: out of inodes Oct 15 22:02:21 mercat1 kernel: pid 64707 (creat), uid 0 inumber 4122 on /mnt: out of inodes Oct 15 22:02:22 mercat1 kernel: pid 64696 (creat), uid 0 inumber 4111 on /mnt: out of inodes Oct 15 22:02:23 mercat1 syslogd: last message repeated 1 times Oct 15 22:02:24 mercat1 kernel: pid 64707 (creat), uid 0 inumber 4122 on /mnt: out of inodes 20181015 22:02:26 all (52/587): newfs5.sh 20181015 22:02:29 all (53/587): datagram3.sh 20181015 22:02:31 all (54/587): zfs2.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Expensive timeout(9) function: 0xffffffff80ec9ff0(0) 0.009365174 s Warning: memory type solaris leaked memory on destroy (13 allocations, 13376 bytes leaked). 20181015 22:15:21 all (55/587): kevent.sh 20181015 22:17:24 all (56/587): mountro3.sh 20181015 22:17:26 all (57/587): trim3.sh Oct 15 22:26:26 mercat1 kernel: pid 61138 (creat), uid 2007 inumber 32834 on /mnt: out of inodes Oct 15 22:26:44 mercat1 kernel: pid 61188 (mkdir), uid 2007 inumber 32668 on /mnt: out of inodes Oct 15 22:26:57 mercat1 kernel: pid 61205 (mkdir), uid 2007 inumber 131061 on /mnt: out of inodes Oct 15 22:27:06 mercat1 kernel: pid 61157 (openat), uid 2007 inumber 32836 on /mnt: out of inodes Oct 15 22:27:15 mercat1 kernel: pid 61156 (creat), uid 2007 inumber 32819 on /mnt: out of inodes Oct 15 22:27:27 mercat1 syslogd: last message repeated 1 times Oct 15 22:27:48 mercat1 kernel: pid 61110 (creat), uid 2007 inumber 32832 on /mnt: out of inodes Oct 15 22:28:00 mercat1 kernel: pid 61119 (creat), uid 2007 inumber 32816 on /mnt: out of inodes Oct 15 22:28:21 mercat1 kernel: pid 63124 (creat), uid 2007 inumber 32831 on /mnt: out of inodes Oct 15 22:28:24 mercat1 kernel: pid 63129 (creat), uid 2007 inumber 32840 on /mnt: out of inodes Oct 15 22:30:19 mercat1 kernel: pid 66353 (mkdir), uid 2007 inumber 32570 on /mnt: out of inodes Oct 15 22:30:22 mercat1 kernel: pid 66341 (mkfifo), uid 2007 inumber 32768 on /mnt: out of inodes Oct 15 22:30:29 mercat1 kernel: pid 66371 (mkdir), uid 2007 inumber 32768 on /mnt: out of inodes Oct 15 22:30:34 mercat1 kernel: pid 66367 (mkdir), uid 2007 inumber 32603 on /mnt: out of inodes Oct 15 22:30:39 mercat1 kernel: pid 66361 (mkdir), uid 2007 inumber 32798 on /mnt: out of inodes Oct 15 22:30:50 mercat1 kernel: pid 66364 (mkdir), uid 2007 inumber 32831 on /mnt: out of inodes Oct 15 22:31:10 mercat1 kernel: pid 66324 (mkdir), uid 2007 inumber 32460 on /mnt: out of inodes 20181015 22:42:49 all (58/587): burnin.sh 20181015 23:03:38 all (59/587): gnop3.sh 20181015 23:03:39 all (60/587): parallelmount.sh GEOM leak: 1476/1549 20181015 23:13:41 all (61/587): sendfile.sh 20181015 23:13:43 all (62/587): pipe2.sh 20181015 23:13:57 all (63/587): snap5-1.sh panic: snapacct_ufs2: bad block cpuid = 2 time = 1539638038 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d4916ee0 vpanic() at vpanic+0x1a3/frame 0xfffffe00d4916f40 panic() at panic+0x43/frame 0xfffffe00d4916fa0 snapacct_ufs2() at snapacct_ufs2+0x135/frame 0xfffffe00d4917000 fullacct_ufs2() at fullacct_ufs2+0x29/frame 0xfffffe00d4917060 indiracct_ufs2() at indiracct_ufs2+0x20b/frame 0xfffffe00d4917130 expunge_ufs2() at expunge_ufs2+0x46c/frame 0xfffffe00d49171e0 ffs_snapshot() at ffs_snapshot+0x1b1d/frame 0xfffffe00d49174e0 ffs_mount() at ffs_mount+0xb20/frame 0xfffffe00d4917680 vfs_domount() at vfs_domount+0x81d/frame 0xfffffe00d49178a0 vfs_donmount() at vfs_donmount+0x7b8/frame 0xfffffe00d4917940 sys_nmount() at sys_nmount+0x72/frame 0xfffffe00d4917980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00d4917ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00d4917ab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x8002d3a6a, rsp = 0x7fffffffce98, rbp = 0x7fffffffe6f0 --- KDB: enter: panic [ thread pid 54889 tid 104216 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 54889 tid 104216 td 0xfffff806dd82f000 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00d4916ee0 vpanic() at vpanic+0x1c0/frame 0xfffffe00d4916f40 panic() at panic+0x43/frame 0xfffffe00d4916fa0 snapacct_ufs2() at snapacct_ufs2+0x135/frame 0xfffffe00d4917000 fullacct_ufs2() at fullacct_ufs2+0x29/frame 0xfffffe00d4917060 indiracct_ufs2() at indiracct_ufs2+0x20b/frame 0xfffffe00d4917130 expunge_ufs2() at expunge_ufs2+0x46c/frame 0xfffffe00d49171e0 ffs_snapshot() at ffs_snapshot+0x1b1d/frame 0xfffffe00d49174e0 ffs_mount() at ffs_mount+0xb20/frame 0xfffffe00d4917680 vfs_domount() at vfs_domount+0x81d/frame 0xfffffe00d49178a0 vfs_donmount() at vfs_donmount+0x7b8/frame 0xfffffe00d4917940 sys_nmount() at sys_nmount+0x72/frame 0xfffffe00d4917980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00d4917ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00d4917ab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x8002d3a6a, rsp = 0x7fffffffce98, rbp = 0x7fffffffe6f0 --- db:1:pho1> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0xd45c40 curthread = 0xfffff800036b6000: pid 11 tid 100003 "idle: cpu0" curpcb = 0xfffffe007875ab80 fpcurthread = none idlethread = 0xfffff800036b6000: tid 100003 "idle: cpu0" curpmap = 0xffffffff8208e768 tssp = 0xffffffff821b9aa0 commontssp = 0xffffffff821b9aa0 rsp0 = 0xfffffe007875ab80 gs32p = 0xffffffff821c06d8 ldt = 0xffffffff821c0718 tss = 0xffffffff821c0708 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe008501ac40 curthread = 0xfffff800036b5580: pid 11 tid 100004 "idle: cpu1" curpcb = 0xfffffe007875fb80 fpcurthread = none idlethread = 0xfffff800036b5580: tid 100004 "idle: cpu1" curpmap = 0xffffffff8208e768 tssp = 0xffffffff821b9b08 commontssp = 0xffffffff821b9b08 rsp0 = 0xfffffe007875fb80 gs32p = 0xffffffff821c0740 ldt = 0xffffffff821c0780 tss = 0xffffffff821c0770 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe0085026c40 curthread = 0xfffff806dd82f000: pid 54889 tid 104216 "mksnap_ffs" curpcb = 0xfffffe00d4917b80 fpcurthread = 0xfffff806dd82f000: pid 54889 "mksnap_ffs" idlethread = 0xfffff800036b5000: tid 100005 "idle: cpu2" curpmap = 0xfffff80739a71130 tssp = 0xffffffff821b9b70 commontssp = 0xffffffff821b9b70 rsp0 = 0xfffffe00d4917b80 gs32p = 0xffffffff821c07a8 ldt = 0xffffffff821c07e8 tss = 0xffffffff821c07d8 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe0085032c40 curthread = 0xfffff800036b4580: pid 11 tid 100006 "idle: cpu3" curpcb = 0xfffffe0078769b80 fpcurthread = none idlethread = 0xfffff800036b4580: tid 100006 "idle: cpu3" curpmap = 0xffffffff8208e768 tssp = 0xffffffff821b9bd8 commontssp = 0xffffffff821b9bd8 rsp0 = 0xfffffe0078769b80 gs32p = 0xffffffff821c0810 ldt = 0xffffffff821c0850 tss = 0xffffffff821c0840 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe008503ec40 curthread = 0xfffff800036eb580: pid 0 tid 100020 "thread taskq" curpcb = 0xfffffe00787afb80 fpcurthread = none idlethread = 0xfffff800036b4000: tid 100007 "idle: cpu4" curpmap = 0xffffffff8208e768 tssp = 0xffffffff821b9c40 commontssp = 0xffffffff821b9c40 rsp0 = 0xfffffe00787afb80 gs32p = 0xffffffff821c0878 ldt = 0xffffffff821c08b8 tss = 0xffffffff821c08a8 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe008504ac40 curthread = 0xfffff800036b3580: pid 11 tid 100008 "idle: cpu5" curpcb = 0xfffffe0078773b80 fpcurthread = none idlethread = 0xfffff800036b3580: tid 100008 "idle: cpu5" curpmap = 0xffffffff8208e768 tssp = 0xffffffff821b9ca8 commontssp = 0xffffffff821b9ca8 rsp0 = 0xfffffe0078773b80 gs32p = 0xffffffff821c08e0 ldt = 0xffffffff821c0920 tss = 0xffffffff821c0910 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe0085056c40 curthread = 0xfffff800036b3000: pid 11 tid 100009 "idle: cpu6" curpcb = 0xfffffe0078778b80 fpcurthread = none idlethread = 0xfffff800036b3000: tid 100009 "idle: cpu6" curpmap = 0xffffffff8208e768 tssp = 0xffffffff821b9d10 commontssp = 0xffffffff821b9d10 rsp0 = 0xfffffe0078778b80 gs32p = 0xffffffff821c0948 ldt = 0xffffffff821c0988 tss = 0xffffffff821c0978 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe0085062c40 curthread = 0xfffff800036c7580: pid 11 tid 100010 "idle: cpu7" curpcb = 0xfffffe007877db80 fpcurthread = none idlethread = 0xfffff800036c7580: tid 100010 "idle: cpu7" curpmap = 0xffffffff8208e768 tssp = 0xffffffff821b9d78 commontssp = 0xffffffff821b9d78 rsp0 = 0xfffffe007877db80 gs32p = 0xffffffff821c09b0 ldt = 0xffffffff821c09f0 tss = 0xffffffff821c09e0 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe007e6dec40 curthread = 0xfffff800036c7000: pid 11 tid 100011 "idle: cpu8" curpcb = 0xfffffe0078782b80 fpcurthread = none idlethread = 0xfffff800036c7000: tid 100011 "idle: cpu8" curpmap = 0xffffffff8208e768 tssp = 0xffffffff821b9de0 commontssp = 0xffffffff821b9de0 rsp0 = 0xfffffe0078782b80 gs32p = 0xffffffff821c0a18 ldt = 0xffffffff821c0a58 tss = 0xffffffff821c0a48 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe007e6eac40 curthread = 0xfffff800036c6580: pid 11 tid 100012 "idle: cpu9" curpcb = 0xfffffe0078787b80 fpcurthread = none idlethread = 0xfffff800036c6580: tid 100012 "idle: cpu9" curpmap = 0xffffffff8208e768 tssp = 0xffffffff821b9e48 commontssp = 0xffffffff821b9e48 rsp0 = 0xfffffe0078787b80 gs32p = 0xffffffff821c0a80 ldt = 0xffffffff821c0ac0 tss = 0xffffffff821c0ab0 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe007e6f6c40 curthread = 0xfffff800036c6000: pid 11 tid 100013 "idle: cpu10" curpcb = 0xfffffe007878cb80 fpcurthread = none idlethread = 0xfffff800036c6000: tid 100013 "idle: cpu10" curpmap = 0xffffffff8208e768 tssp = 0xffffffff821b9eb0 commontssp = 0xffffffff821b9eb0 rsp0 = 0xfffffe007878cb80 gs32p = 0xffffffff821c0ae8 ldt = 0xffffffff821c0b28 tss = 0xffffffff821c0b18 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe007e702c40 curthread = 0xfffff800036c5580: pid 11 tid 100014 "idle: cpu11" curpcb = 0xfffffe0078791b80 fpcurthread = none idlethread = 0xfffff800036c5580: tid 100014 "idle: cpu11" curpmap = 0xffffffff8208e768 tssp = 0xffffffff821b9f18 commontssp = 0xffffffff821b9f18 rsp0 = 0xfffffe0078791b80 gs32p = 0xffffffff821c0b50 ldt = 0xffffffff821c0b90 tss = 0xffffffff821c0b80 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 54889 (mksnap_ffs) thread 0xfffff806dd82f000 (104216) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe000218f4b8) locked @ kern/vfs_bio.c:3916 exclusive lockmgr ufs (ufs) r = 0 (0xfffff803657ed2e0) locked @ ufs/ffs/ffs_snapshot.c:548 exclusive lockmgr ufs (ufs) r = 0 (0xfffff800746a5cc0) locked @ ufs/ffs/ffs_snapshot.c:438 Process 0 (kernel) thread 0xfffff800036eb580 (100020) exclusive sleep mutex buffer arena (buffer arena) r = 0 (0xffffffff81f96640) locked @ kern/subr_vmem.c:763 exclusive sleep mutex vmem list lock (vmem list lock) r = 0 (0xffffffff81a02200) locked @ kern/subr_vmem.c:758 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff803657ed278: tag ufs, type VREG usecount 68, writecount 0, refcount 7249 flags (VV_NOSYNC|VI_ACTIVE) v_object 0xfffff80365704000 ref 0 pages 71168 cleanbuf 7179 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff806dd82f000 (pid 54889, mksnap_ffs, tid 104216) #0 0xffffffff80b6536a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b658ae at __lockmgr_args+0x3ce #2 0xffffffff80eab18c at ffs_lock+0x7c #3 0xffffffff811f0e66 at VOP_LOCK1_APV+0xa6 #4 0xffffffff80c74540 at _vn_lock+0x60 #5 0xffffffff80e84adc at ffs_snapshot+0x17ac #6 0xffffffff80ea7dc0 at ffs_mount+0xb20 #7 0xffffffff80c59bfd at vfs_domount+0x81d #8 0xffffffff80c58df8 at vfs_donmount+0x7b8 #9 0xffffffff80c58612 at sys_nmount+0x72 #10 0xffffffff810695b7 at amd64_syscall+0x2a7 #11 0xffffffff81044d8d at fast_syscall_common+0x101 ino 37, on dev gpt/tmp vnode 0xfffff800746a5c58: tag ufs, type VREG usecount 1, writecount 0, refcount 55 flags (VV_SYSTEM|VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff806dd82f000 (pid 54889, mksnap_ffs, tid 104216) #0 0xffffffff80b6536a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b658ae at __lockmgr_args+0x3ce #2 0xffffffff80eab18c at ffs_lock+0x7c #3 0xffffffff811f0e66 at VOP_LOCK1_APV+0xa6 #4 0xffffffff80c74540 at _vn_lock+0x60 #5 0xffffffff80e8414b at ffs_snapshot+0xe1b #6 0xffffffff80ea7dc0 at ffs_mount+0xb20 #7 0xffffffff80c59bfd at vfs_domount+0x81d #8 0xffffffff80c58df8 at vfs_donmount+0x7b8 #9 0xffffffff80c58612 at sys_nmount+0x72 #10 0xffffffff810695b7 at amd64_syscall+0x2a7 #11 0xffffffff81044d8d at fast_syscall_common+0x101 ino 19, on dev gpt/tmp db:1:pho1> show allchains chain 1: thread 104605 (pid 54872, sh) sleeping on 0xfffff805b72a6528 "wait" chain 2: thread 102003 (pid 54871, tee) sleeping on 0xfffff80041d6b8e8 "piperd" chain 3: thread 100262 (pid 54870, sh) sleeping on 0xfffff80304efea50 "wait" chain 4: thread 100224 (pid 54143, sleep) sleeping on 0xffffffff81e96ab9 "nanslp" chain 5: thread 100147 (pid 50209, sh) sleeping on 0xfffff8033131fbe0 "piperd" chain 6: thread 100270 (pid 50206, awk) sleeping on 0xfffff803f06a0000 "piperd" chain 7: thread 100265 (pid 50205, sh) sleeping on 0xfffff8000c87d000 "wait" chain 8: thread 100220 (pid 50195, sh) sleeping on 0xfffff80263d82000 "wait" chain 9: thread 100219 (pid 48120, sh) sleeping on 0xfffff80304a08a50 "wait" chain 10: thread 100215 (pid 2324, bash) sleeping on 0xfffff8000c208dc0 "select" chain 11: thread 100173 (pid 2322, csh) sleeping on 0xfffff8000c7be0a8 "pause" chain 12: thread 100161 (pid 2321, su) sleeping on 0xfffff8000c8b7528 "wait" chain 13: thread 100155 (pid 2320, bash) sleeping on 0xfffff8000c1b6528 "wait" chain 14: thread 100151 (pid 2319, sshd) sleeping on 0xfffff8000601bec0 "select" chain 15: thread 100202 (pid 2316, sshd) sleeping on 0xfffff80003fbe2c0 "select" chain 16: thread 100199 (pid 2312, csh) sleeping on 0xfffff800060f9cb0 "ttyin" chain 17: thread 100213 (pid 2307, login) sleeping on 0xfffff80263e6c528 "wait" chain 18: thread 100212 (pid 2306, getty) sleeping on 0xfffff800060fa0b0 "ttyin" chain 19: thread 100148 (pid 2305, getty) sleeping on 0xfffff8000c357cb0 "ttyin" chain 20: thread 100211 (pid 2304, getty) sleeping on 0xfffff8000c3580b0 "ttyin" chain 21: thread 100210 (pid 2303, getty) sleeping on 0xfffff8000c3584b0 "ttyin" chain 22: thread 100209 (pid 2302, getty) sleeping on 0xfffff8000c3588b0 "ttyin" chain 23: thread 100208 (pid 2301, getty) sleeping on 0xfffff8000c358cb0 "ttyin" chain 24: thread 100195 (pid 2300, getty) sleeping on 0xfffff8000c3590b0 "ttyin" chain 25: thread 100198 (pid 2299, getty) sleeping on 0xfffff8000c3594b0 "ttyin" chain 26: thread 100142 (pid 2298, getty) sleeping on 0xfffff8000c3598b0 "ttyin" chain 27: thread 100201 (pid 2252, cron) sleeping on 0xffffffff81e96ab0 "nanslp" chain 28: thread 100156 (pid 2248, sshd) sleeping on 0xfffff8000375fdc0 "select" chain 29: thread 100190 (pid 2183, NLM: master) sleeping on 0xfffff8000c9b3260 "rpcsvc" chain 30: thread 100154 (pid 2180, rpc.statd) sleeping on 0xfffff8000600d240 "select" chain 31: thread 100171 (pid 2130, watchdogd) sleeping on 0xffffffff81e96ab4 "nanslp" chain 32: thread 100189 (pid 2054, rpcbind) sleeping on 0xfffff8000600d440 "select" chain 33: thread 100193 (pid 2044, syslogd) sleeping on 0xfffff8000601d040 "select" chain 34: thread 100149 (pid 1973, devd) sleeping on 0xfffff8000c3f91c0 "select" chain 35: thread 100172 (pid 1968, dhclient) sleeping on 0xfffff80006002c40 "select" chain 36: thread 100174 (pid 1924, dhclient) sleeping on 0xfffff8000c1c7e40 "select" chain 37: thread 100180 (pid 1921, dhclient) sleeping on 0xfffff80006002cc0 "select" chain 38: thread 100134 (pid 34, vnlru) sleeping on 0xfffff8000c1b6a50 "vlruwt" chain 39: thread 100132 (pid 33, syncer) sleeping on 0xffffffff82038f00 "syncer" chain 40: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff820383a0 "qsleep" chain 41: thread 100133 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff81a0a580 "-" chain 42: thread 100135 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81a12840 "-" chain 43: thread 100136 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff81a1ab00 "-" chain 44: thread 100137 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81a22dc0 "-" chain 45: thread 100138 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff81a2b080 "-" chain 46: thread 100140 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81a33340 "-" chain 47: thread 100141 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff81a3b600 "-" chain 48: thread 100152 (pid 32, / worker) sleeping on 0xfffff8000c2298e8 "sdflush" chain 49: thread 100158 (pid 32, /tmp worker) sleeping on 0xfffff80003fd34e8 "sdflush" chain 50: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff82055208 "psleep" chain 51: thread 100128 (pid 30, dom0) sleeping on 0xffffffff820b2bd8 "psleep" chain 52: thread 100131 (pid 30, laundry: dom0) sleeping on 0xffffffff81e95848 "laundp" chain 53: thread 100139 (pid 30, uma) sleeping on 0xffffffff80ec8f00 "umarcl" chain 54: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff8000c0b2000 "idle" chain 55: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff8000c0b2528 "idle" chain 56: thread 100120 (pid 27, rand_harvestq) sleeping on 0xffffffff81cf6288 "-" chain 57: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff820b12c0 "waiting_for_work" chain 58: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff82037d9c "-" chain 59: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff82037d9c "-" chain 60: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff82037d9c "-" chain 61: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff82037d9c "-" chain 62: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe009c1fc460 "-" chain 63: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe009c1fc4b8 "-" chain 64: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe009c1fc510 "-" chain 65: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe009c1fc568 "-" chain 66: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe009c1fc5c0 "-" chain 67: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe009a016d10 "-" chain 68: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe009a016d68 "-" chain 69: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe009a016dc0 "-" chain 70: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe009a016e18 "-" chain 71: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe009a016e70 "-" chain 72: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe009c667d10 "-" chain 73: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe009c667d68 "-" chain 74: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe009c667dc0 "-" chain 75: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe009c667e18 "-" chain 76: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe009c667e70 "-" chain 77: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff81bd1540 "-" chain 78: thread 100092 (pid 20, doneq1) sleeping on 0xffffffff81bd15c0 "-" chain 79: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff81bd1640 "-" chain 80: thread 100125 (pid 20, scanner) sleeping on 0xffffffff81bd1408 "-" chain 81: thread 100090 (pid 19, sequencer 00) sleeping on 0xfffff80003882c88 "seqstate" chain 82: thread 100089 (pid 18, crypto returns 11) sleeping on 0xfffff800038ef450 "crypto_ret_wait" chain 83: thread 100088 (pid 17, crypto returns 10) sleeping on 0xfffff800038ef3f0 "crypto_ret_wait" chain 84: thread 100087 (pid 16, crypto returns 9) sleeping on 0xfffff800038ef390 "crypto_ret_wait" chain 85: thread 100086 (pid 15, crypto returns 8) sleeping on 0xfffff800038ef330 "crypto_ret_wait" chain 86: thread 100085 (pid 14, crypto returns 7) sleeping on 0xfffff800038ef2d0 "crypto_ret_wait" chain 87: thread 100084 (pid 9, crypto returns 6) sleeping on 0xfffff800038ef270 "crypto_ret_wait" chain 88: thread 100083 (pid 8, crypto returns 5) sleeping on 0xfffff800038ef210 "crypto_ret_wait" chain 89: thread 100082 (pid 7, crypto returns 4) sleeping on 0xfffff800038ef1b0 "crypto_ret_wait" chain 90: thread 100081 (pid 6, crypto returns 3) sleeping on 0xfffff800038ef150 "crypto_ret_wait" chain 91: thread 100080 (pid 5, crypto returns 2) sleeping on 0xfffff800038ef0f0 "crypto_ret_wait" chain 92: thread 100079 (pid 4, crypto returns 1) sleeping on 0xfffff800038ef090 "crypto_ret_wait" chain 93: thread 100078 (pid 3, crypto returns 0) sleeping on 0xfffff800038ef030 "crypto_ret_wait" chain 94: thread 100077 (pid 2, crypto) sleeping on 0xffffffff8204f820 "crypto_wait" chain 95: thread 100061 (pid 13, g_event) sleeping on 0xffffffff8208db10 "-" chain 96: thread 100062 (pid 13, g_up) sleeping on 0xffffffff8208db20 "-" chain 97: thread 100063 (pid 13, g_down) sleeping on 0xffffffff8208db08 "-" chain 98: thread 100002 (pid 1, init) sleeping on 0xfffff800036b2528 "wait" chain 99: thread 100001 (pid 10, audit) sleeping on 0xffffffff820b1fe0 "audit_worker_cv" chain 100: thread 100000 (pid 0, swapper) sleeping on 0xffffffff8208db50 "swapin" chain 101: thread 100015 (pid 0, config_0) sleeping on 0xfffff80003121a00 "-" chain 102: thread 100016 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff800036e6000 "-" chain 103: thread 100017 (pid 0, aiod_kick taskq) sleeping on 0xfffff800036e5e00 "-" chain 104: thread 100022 (pid 0, if_io_tqg_0) sleeping on 0xfffff80003121600 "-" chain 105: thread 100023 (pid 0, if_io_tqg_1) sleeping on 0xfffff80003121500 "-" chain 106: thread 100024 (pid 0, if_io_tqg_2) sleeping on 0xfffff80003121400 "-" chain 107: thread 100025 (pid 0, if_io_tqg_3) sleeping on 0xfffff80003121300 "-" chain 108: thread 100026 (pid 0, if_io_tqg_4) sleeping on 0xfffff80003121200 "-" chain 109: thread 100027 (pid 0, if_io_tqg_5) sleeping on 0xfffff80003121100 "-" chain 110: thread 100028 (pid 0, if_io_tqg_6) sleeping on 0xfffff80003121000 "-" chain 111: thread 100029 (pid 0, if_io_tqg_7) sleeping on 0xfffff80003726100 "-" chain 112: thread 100030 (pid 0, if_io_tqg_8) sleeping on 0xfffff80003726000 "-" chain 113: thread 100031 (pid 0, if_io_tqg_9) sleeping on 0xfffff80003725e00 "-" chain 114: thread 100032 (pid 0, if_io_tqg_10) sleeping on 0xfffff80003725d00 "-" chain 115: thread 100033 (pid 0, if_io_tqg_11) sleeping on 0xfffff80003725c00 "-" chain 116: thread 100034 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003725b00 "-" chain 117: thread 100035 (pid 0, softirq_0) sleeping on 0xfffff80003725a00 "-" chain 118: thread 100036 (pid 0, softirq_1) sleeping on 0xfffff80003725900 "-" chain 119: thread 100037 (pid 0, softirq_2) sleeping on 0xfffff80003725800 "-" chain 120: thread 100038 (pid 0, softirq_3) sleeping on 0xfffff800037c9200 "-" chain 121: thread 100039 (pid 0, softirq_4) sleeping on 0xfffff800037c9100 "-" chain 122: thread 100040 (pid 0, softirq_5) sleeping on 0xfffff800037c9000 "-" chain 123: thread 100041 (pid 0, softirq_6) sleeping on 0xfffff800037c8e00 "-" chain 124: thread 100042 (pid 0, softirq_7) sleeping on 0xfffff800037c8d00 "-" chain 125: thread 100043 (pid 0, softirq_8) sleeping on 0xfffff800037c8c00 "-" chain 126: thread 100044 (pid 0, softirq_9) sleeping on 0xfffff800037c8b00 "-" chain 127: thread 100045 (pid 0, softirq_10) sleeping on 0xfffff800037c8a00 "-" chain 128: thread 100046 (pid 0, softirq_11) sleeping on 0xfffff800037c8900 "-" chain 129: thread 100064 (pid 0, firmware taskq) sleeping on 0xfffff800038a4700 "-" chain 130: thread 100065 (pid 0, crypto_0) sleeping on 0xfffff800038a4500 "-" chain 131: thread 100066 (pid 0, crypto_1) sleeping on 0xfffff800038a4500 "-" chain 132: thread 100067 (pid 0, crypto_2) sleeping on 0xfffff800038a4500 "-" chain 133: thread 100068 (pid 0, crypto_3) sleeping on 0xfffff800038a4500 "-" chain 134: thread 100069 (pid 0, crypto_4) sleeping on 0xfffff800038a4500 "-" chain 135: thread 100070 (pid 0, crypto_5) sleeping on 0xfffff800038a4500 "-" chain 136: thread 100071 (pid 0, crypto_6) sleeping on 0xfffff800038a4500 "-" chain 137: thread 100072 (pid 0, crypto_7) sleeping on 0xfffff800038a4500 "-" chain 138: thread 100073 (pid 0, crypto_8) sleeping on 0xfffff800038a4500 "-" chain 139: thread 100074 (pid 0, crypto_9) sleeping on 0xfffff800038a4500 "-" chain 140: thread 100075 (pid 0, crypto_10) sleeping on 0xfffff800038a4500 "-" chain 141: thread 100076 (pid 0, crypto_11) sleeping on 0xfffff800038a4500 "-" chain 142: thread 100114 (pid 0, mca taskq) blocked on lockmgr (null)EXCL KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d49165f0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00d4916600 trap() at trap+0x5c/frame 0xfffffe00d4916710 calltrap() at calltrap+0x8/frame 0xfffffe00d4916710 --- trap 0xc, rip = 0xffffffff80bf0a6a, rsp = 0xfffffe00d49167e0, rbp = 0xfffffe00d4916800 --- print_lockchain() at print_lockchain+0x3a/frame 0xfffffe00d4916800 db_show_allchains() at db_show_allchains+0x80/frame 0xfffffe00d4916830 db_command() at db_command+0x279/frame 0xfffffe00d4916900 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00d49169a0 db_command() at db_command+0x279/frame 0xfffffe00d4916a70 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00d4916b10 db_command() at db_command+0x279/frame 0xfffffe00d4916be0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00d4916bf0 db_trap() at db_trap+0xef/frame 0xfffffe00d4916c80 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00d4916cf0 trap() at trap+0x806/frame 0xfffffe00d4916e00 calltrap() at calltrap+0x8/frame 0xfffffe00d4916e00 --- trap 0x3, rip = 0xffffffff80bd821b, rsp = 0xfffffe00d4916ed0, rbp = 0xfffffe00d4916ee0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00d4916ee0 vpanic() at vpanic+0x1c0/frame 0xfffffe00d4916f40 panic() at panic+0x43/frame 0xfffffe00d4916fa0 snapacct_ufs2() at snapacct_ufs2+0x135/frame 0xfffffe00d4917000 fullacct_ufs2() at fullacct_ufs2+0x29/frame 0xfffffe00d4917060 indiracct_ufs2() at indiracct_ufs2+0x20b/frame 0xfffffe00d4917130 expunge_ufs2() at expunge_ufs2+0x46c/frame 0xfffffe00d49171e0 ffs_snapshot() at ffs_snapshot+0x1b1d/frame 0xfffffe00d49174e0 ffs_mount() at ffs_mount+0xb20/frame 0xfffffe00d4917680 vfs_domount() at vfs_domount+0x81d/frame 0xfffffe00d49178a0 vfs_donmount() at vfs_donmount+0x7b8/frame 0xfffffe00d4917940 sys_nmount() at sys_nmount+0x72/frame 0xfffffe00d4917980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00d4917ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00d4917ab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x8002d3a6a, rsp = 0x7fffffffce98, rbp = 0x7fffffffe6f0 --- Script command 'show allchains' returned error db:1:pho1> show mount 0xfffff8000c490000 /dev/gpt/work on / (ufs) 0xfffff8000c491000 devfs on /dev (devfs) 0xfffff8000c9b9000 /dev/gpt/tmp on /tmp (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 23095 Buf domain 0 freebufs 7938 lofreebufs 219 hifreebufs 329 bufspace 235364352 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7095 (232255488) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 16, 2, 22, 1, 17, 8, 5, 0, 6, 4, 18, Locked buffers: 0 space 0 Total buffers: 37230 space 235364352 Buf domain 1 freebufs 14961 lofreebufs 219 hifreebufs 329 bufspace 4825088 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 13 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 121 (3457024) dirtyq count 13 (425984) wakeup 0 lim 25 CPU 1, 0, 5, 0, 4, 4, 0, 2, 0, 8, 4, 10, Locked buffers: 0 space 0 Total buffers: 7059 space 4825088 Buf domain 2 freebufs 14999 lofreebufs 219 hifreebufs 329 bufspace 3760128 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 100 (2998272) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 5, 3, 2, 2, 4, 0, 9, 3, 1, 1, 3, Locked buffers: 0 space 0 Total buffers: 11408 space 3760128 Buf domain 3 freebufs 15071 lofreebufs 219 hifreebufs 329 bufspace 1208320 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 33 (827392) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 1, 1, 0, 4, 3, 2, 2, 1, 1, 2, 11, Locked buffers: 0 space 0 Total buffers: 14662 space 1208320 Buf domain 4 freebufs 15081 lofreebufs 219 hifreebufs 329 bufspace 823296 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 24 (389120) dirtyq count 0 (0) wakeup 0 lim 25 CPU 2, 1, 1, 0, 1, 4, 0, 6, 1, 2, 5, 5, Locked buffers: 0 space 0 Total buffers: 14079 space 823296 Buf domain 5 freebufs 13615 lofreebufs 219 hifreebufs 329 bufspace 49070080 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1455 (47304704) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 2, 15, 1, 4, 13, 1, 22, 0, 0, 2, 3, Locked buffers: 0 space 0 Total buffers: 15195 space 49070080 Buf domain 6 freebufs 14999 lofreebufs 219 hifreebufs 329 bufspace 3608576 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 10 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 86 (2420736) dirtyq count 10 (327680) wakeup 0 lim 25 CPU 2, 1, 12, 2, 2, 1, 0, 10, 0, 3, 0, 5, Locked buffers: 1 space 32768 Total buffers: 6298 space 3608576 db:1:pho1> show page vm_cnt.v_free_count: 7729501 vm_cnt.v_inactive_count: 14508 vm_cnt.v_active_count: 1078 vm_cnt.v_laundry_count: 62 vm_cnt.v_wire_count: 379483 vm_cnt.v_free_reserved: 10649 vm_cnt.v_free_min: 51289 vm_cnt.v_free_target: 173209 vm_cnt.v_inactive_target: 259813 db:1:pho1> show pageq pq_free 7729501 dom 0 page_cnt 8128423 free 7729501 pq_act 1078 pq_inact 14508 pq_laund 62 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000088 | 000000 11 (008192K) | 000560 | 000000 10 (004096K) | 001285 | 000000 09 (002048K) | 002539 | 000001 08 (001024K) | 004867 | 000076 07 (000512K) | 007226 | 000005 06 (000256K) | 008339 | 000012 05 (000128K) | 009982 | 000022 04 (000064K) | 012946 | 000060 03 (000032K) | 017452 | 000146 02 (000016K) | 025173 | 000456 01 (000008K) | 038092 | 000460 00 (000004K) | 003881 | 000433 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000002 | 000000 04 (000064K) | 000003 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000002 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000004 | 000000 db:0:pho> acttrace Tracing command mksnap_ffs pid 54889 tid 104216 td 0xfffff806dd82f000 (CPU 2) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00d4916ee0 vpanic() at vpanic+0x1c0/frame 0xfffffe00d4916f40 panic() at panic+0x43/frame 0xfffffe00d4916fa0 snapacct_ufs2() at snapacct_ufs2+0x135/frame 0xfffffe00d4917000 fullacct_ufs2() at fullacct_ufs2+0x29/frame 0xfffffe00d4917060 indiracct_ufs2() at indiracct_ufs2+0x20b/frame 0xfffffe00d4917130 expunge_ufs2() at expunge_ufs2+0x46c/frame 0xfffffe00d49171e0 ffs_snapshot() at ffs_snapshot+0x1b1d/frame 0xfffffe00d49174e0 ffs_mount() at ffs_mount+0xb20/frame 0xfffffe00d4917680 vfs_domount() at vfs_domount+0x81d/frame 0xfffffe00d49178a0 vfs_donmount() at vfs_donmount+0x7b8/frame 0xfffffe00d4917940 sys_nmount() at sys_nmount+0x72/frame 0xfffffe00d4917980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00d4917ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00d4917ab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x8002d3a6a, rsp = 0x7fffffffce98, rbp = 0x7fffffffe6f0 --- Tracing command idle pid 11 tid 100003 td 0xfffff800036b6000 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff82059570 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xffffffff82059590 trap() at trap+0x49/frame 0xffffffff820596a0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff820596a0 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe007875a910, rbp = 0xfffffe007875a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007875a910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe007875a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007875a980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007875a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007875aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007875aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007875aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800036b5580 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bb0df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bb0e10 trap() at trap+0x49/frame 0xfffffe0006bb0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bb0f20 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe007875f910, rbp = 0xfffffe007875f910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007875f910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe007875f960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007875f980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007875f9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007875fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007875fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007875fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800036b4580 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bc8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bc8e10 trap() at trap+0x49/frame 0xfffffe0006bc8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc8f20 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe0078769910, rbp = 0xfffffe0078769910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078769910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078769960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078769980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787699a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078769a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078769ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078769ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800036b3580 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006be0df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006be0e10 trap() at trap+0x49/frame 0xfffffe0006be0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006be0f20 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe0078773910, rbp = 0xfffffe0078773910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078773910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078773960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078773980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787739a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078773a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078773ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078773ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800036b3000 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006becdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bece10 trap() at trap+0x49/frame 0xfffffe0006becf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006becf20 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe0078778910, rbp = 0xfffffe0078778910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078778910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078778960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078778980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787789a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078778a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078778ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078778ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800036c7580 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bf8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bf8e10 trap() at trap+0x49/frame 0xfffffe0006bf8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bf8f20 --- trap 0x13, rip = 0xffffffff811d41f6, rsp = 0xfffffe007877d990, rbp = 0xfffffe007877d9a0 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe007877d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007877da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007877dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007877dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800036c7000 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000274df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000274e10 trap() at trap+0x49/frame 0xfffffe0000274f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000274f20 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe0078782910, rbp = 0xfffffe0078782910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078782910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078782960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078782980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787829a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078782a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078782ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078782ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800036c6580 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000280df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000280e10 trap() at trap+0x49/frame 0xfffffe0000280f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000280f20 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe0078787910, rbp = 0xfffffe0078787910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078787910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078787960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078787980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787879a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078787a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078787ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078787ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800036c6000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe000028cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe000028ce10 trap() at trap+0x49/frame 0xfffffe000028cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe000028cf20 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe007878c910, rbp = 0xfffffe007878c910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007878c910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe007878c960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007878c980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007878c9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007878ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007878cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007878cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800036c5580 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000298df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000298e10 trap() at trap+0x49/frame 0xfffffe0000298f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000298f20 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe0078791910, rbp = 0xfffffe0078791910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078791910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078791960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078791980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787919a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078791a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078791ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078791ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff800036eb580 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bd4df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bd4e10 trap() at trap+0x49/frame 0xfffffe0006bd4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd4f20 --- trap 0x13, rip = 0xffffffff80bf5fc1, rsp = 0xfffffe00787af9a0, rbp = 0xfffffe00787af9e0 --- vmem_periodic() at vmem_periodic+0xf1/frame 0xfffffe00787af9e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00787afa40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00787afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 54889 54872 48120 0 R+ CPU 2 mksnap_ffs 54872 54870 48120 0 S+ wait 0xfffff805b72a6528 sh 54871 48120 48120 0 S+ piperd 0xfffff80041d6b8e8 tee 54870 48120 48120 0 S+ wait 0xfffff80304efea50 sh 54143 50205 50195 0 S nanslp 0xffffffff81e96ab9 sleep 50209 50195 50195 0 S piperd 0xfffff8033131fbe0 sh 50206 50195 50195 0 S piperd 0xfffff803f06a0000 awk 50205 50195 50195 0 S wait 0xfffff8000c87d000 sh 50195 1 50195 0 SWs wait 0xfffff80263d82000 sh 48120 2324 48120 0 S+ wait 0xfffff80304a08a50 sh 2324 2322 2324 0 S+ select 0xfffff8000c208dc0 bash 2322 2321 2322 0 SW+ pause 0xfffff8000c7be0a8 csh 2321 2320 2321 2006 SW+ wait 0xfffff8000c8b7528 su 2320 2319 2320 2006 SWs+ wait 0xfffff8000c1b6528 bash 2319 2316 2316 2006 S select 0xfffff8000601bec0 sshd 2316 2248 2316 0 Ss select 0xfffff80003fbe2c0 sshd 2312 2307 2312 0 S+ ttyin 0xfffff800060f9cb0 csh 2307 1 2307 0 SWs+ wait 0xfffff80263e6c528 login 2306 1 2306 0 Ss+ ttyin 0xfffff800060fa0b0 getty 2305 1 2305 0 Ss+ ttyin 0xfffff8000c357cb0 getty 2304 1 2304 0 Ss+ ttyin 0xfffff8000c3580b0 getty 2303 1 2303 0 Ss+ ttyin 0xfffff8000c3584b0 getty 2302 1 2302 0 Ss+ ttyin 0xfffff8000c3588b0 getty 2301 1 2301 0 Ss+ ttyin 0xfffff8000c358cb0 getty 2300 1 2300 0 Ss+ ttyin 0xfffff8000c3590b0 getty 2299 1 2299 0 Ss+ ttyin 0xfffff8000c3594b0 getty 2298 1 2298 0 Ss+ ttyin 0xfffff8000c3598b0 getty 2252 1 2252 0 Ss nanslp 0xffffffff81e96ab0 cron 2248 1 2248 0 Ss select 0xfffff8000375fdc0 sshd 2183 1 2183 0 Ss rpcsvc 0xfffff8000c9b3260 NLM: master 2180 1 2180 0 Ss select 0xfffff8000600d240 rpc.statd 2130 1 2130 0 Ss nanslp 0xffffffff81e96ab4 watchdogd 2054 1 2054 0 Ss select 0xfffff8000600d440 rpcbind 2044 1 2044 0 Ss select 0xfffff8000601d040 syslogd 1973 1 1973 0 Ss select 0xfffff8000c3f91c0 devd 1968 1 1968 65 Ss select 0xfffff80006002c40 dhclient 1924 1 1924 0 Ss select 0xfffff8000c1c7e40 dhclient 1921 1 1921 0 Ss select 0xfffff80006002cc0 dhclient 34 0 0 0 DL vlruwt 0xfffff8000c1b6a50 [vnlru] 33 0 0 0 DL syncer 0xffffffff82038f00 [syncer] 32 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff820383a0 [bufdaemon] 100133 D - 0xffffffff81a0a580 [bufspacedaemon-0] 100135 D - 0xffffffff81a12840 [bufspacedaemon-1] 100136 D - 0xffffffff81a1ab00 [bufspacedaemon-2] 100137 D - 0xffffffff81a22dc0 [bufspacedaemon-3] 100138 D - 0xffffffff81a2b080 [bufspacedaemon-4] 100140 D - 0xffffffff81a33340 [bufspacedaemon-5] 100141 D - 0xffffffff81a3b600 [bufspacedaemon-6] 100152 D sdflush 0xfffff8000c2298e8 [/ worker] 100158 D sdflush 0xfffff80003fd34e8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff82055208 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff820b2bd8 [dom0] 100131 D laundp 0xffffffff81e95848 [laundry: dom0] 100139 D umarcl 0xffffffff80ec8f00 [uma] 29 0 0 0 DL idle 0xfffff8000c0b2000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff8000c0b2528 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81cf6288 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff820b12c0 [sctp_iterator] 25 0 0 0 DL - 0xffffffff82037d9c [soaiod4] 24 0 0 0 DL - 0xffffffff82037d9c [soaiod3] 23 0 0 0 DL - 0xffffffff82037d9c [soaiod2] 22 0 0 0 DL - 0xffffffff82037d9c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe009c1fc460 [usbus0] 100097 D - 0xfffffe009c1fc4b8 [usbus0] 100098 D - 0xfffffe009c1fc510 [usbus0] 100099 D - 0xfffffe009c1fc568 [usbus0] 100100 D - 0xfffffe009c1fc5c0 [usbus0] 100102 D - 0xfffffe009a016d10 [usbus1] 100103 D - 0xfffffe009a016d68 [usbus1] 100104 D - 0xfffffe009a016dc0 [usbus1] 100105 D - 0xfffffe009a016e18 [usbus1] 100106 D - 0xfffffe009a016e70 [usbus1] 100107 D - 0xfffffe009c667d10 [usbus2] 100108 D - 0xfffffe009c667d68 [usbus2] 100109 D - 0xfffffe009c667dc0 [usbus2] 100110 D - 0xfffffe009c667e18 [usbus2] 100111 D - 0xfffffe009c667e70 [usbus2] 20 0 0 0 DL (threaded) [cam] 100091 D - 0xffffffff81bd1540 [doneq0] 100092 D - 0xffffffff81bd15c0 [doneq1] 100093 D - 0xffffffff81bd1640 [doneq2] 100125 D - 0xffffffff81bd1408 [scanner] 19 0 0 0 DL seqstat 0xfffff80003882c88 [sequencer 00] 18 0 0 0 DL crypto_ 0xfffff800038ef450 [crypto returns 11] 17 0 0 0 DL crypto_ 0xfffff800038ef3f0 [crypto returns 10] 16 0 0 0 DL crypto_ 0xfffff800038ef390 [crypto returns 9] 15 0 0 0 DL crypto_ 0xfffff800038ef330 [crypto returns 8] 14 0 0 0 DL crypto_ 0xfffff800038ef2d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff800038ef270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff800038ef210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff800038ef1b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff800038ef150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff800038ef0f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff800038ef090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff800038ef030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff8204f820 [crypto] 13 0 0 0 DL (threaded) [geom] 100061 D - 0xffffffff8208db10 [g_event] 100062 D - 0xffffffff8208db20 [g_up] 100063 D - 0xffffffff8208db08 [g_down] 12 0 0 0 WL (threaded) [intr] 100018 I [swi6: task queue] 100019 I [swi6: Giant taskq] 100021 I [swi5: fast taskq] 100047 I [swi1: netisr 0] 100048 I [swi4: clock (0)] 100049 I [swi4: clock (1)] 100050 I [swi4: clock (2)] 100051 I [swi4: clock (3)] 100052 I [swi4: clock (4)] 100053 I [swi4: clock (5)] 100054 I [swi4: clock (6)] 100055 I [swi4: clock (7)] 100056 I [swi4: clock (8)] 100057 I [swi4: clock (9)] 100058 I [swi4: clock (10)] 100059 I [swi4: clock (11)] 100060 I [swi3: vm] 100094 I [irq264: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq279: ahci1] 100113 I [swi0: uart uart] 100181 I [irq280: ioat0] 100182 I [irq281: ioat1] 100183 I [irq282: ioat2] 100184 I [irq283: ioat3] 100185 I [irq284: ioat4] 100186 I [irq285: ioat5] 100187 I [irq286: ioat6] 100188 I [irq287: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800036b2528 [init] 10 0 0 0 DL audit_w 0xffffffff820b1fe0 [audit] 0 0 0 0 RLs (threaded) [kernel] 100000 D swapin 0xffffffff8208db50 [swapper] 100015 D - 0xfffff80003121a00 [config_0] 100016 D - 0xfffff800036e6000 [kqueue_ctx taskq] 100017 D - 0xfffff800036e5e00 [aiod_kick taskq] 100020 Run CPU 4 [thread taskq] 100022 D - 0xfffff80003121600 [if_io_tqg_0] 100023 D - 0xfffff80003121500 [if_io_tqg_1] 100024 D - 0xfffff80003121400 [if_io_tqg_2] 100025 D - 0xfffff80003121300 [if_io_tqg_3] 100026 D - 0xfffff80003121200 [if_io_tqg_4] 100027 D - 0xfffff80003121100 [if_io_tqg_5] 100028 D - 0xfffff80003121000 [if_io_tqg_6] 100029 D - 0xfffff80003726100 [if_io_tqg_7] 100030 D - 0xfffff80003726000 [if_io_tqg_8] 100031 D - 0xfffff80003725e00 [if_io_tqg_9] 100032 D - 0xfffff80003725d00 [if_io_tqg_10] 100033 D - 0xfffff80003725c00 [if_io_tqg_11] 100034 D - 0xfffff80003725b00 [if_config_tqg_0] 100035 D - 0xfffff80003725a00 [softirq_0] 100036 D - 0xfffff80003725900 [softirq_1] 100037 D - 0xfffff80003725800 [softirq_2] 100038 D - 0xfffff800037c9200 [softirq_3] 100039 D - 0xfffff800037c9100 [softirq_4] 100040 D - 0xfffff800037c9000 [softirq_5] 100041 D - 0xfffff800037c8e00 [softirq_6] 100042 D - 0xfffff800037c8d00 [softirq_7] 100043 D - 0xfffff800037c8c00 [softirq_8] 100044 D - 0xfffff800037c8b00 [softirq_9] 100045 D - 0xfffff800037c8a00 [softirq_10] 100046 D - 0xfffff800037c8900 [softirq_11] 100064 D - 0xfffff800038a4700 [firmware taskq] 100065 D - 0xfffff800038a4500 [crypto_0] 100066 D - 0xfffff800038a4500 [crypto_1] 100067 D - 0xfffff800038a4500 [crypto_2] 100068 D - 0xfffff800038a4500 [crypto_3] 100069 D - 0xfffff800038a4500 [crypto_4] 100070 D - 0xfffff800038a4500 [crypto_5] 100071 D - 0xfffff800038a4500 [crypto_6] 100072 D - 0xfffff800038a4500 [crypto_7] 100073 D - 0xfffff800038a4500 [crypto_8] 100074 D - 0xfffff800038a4500 [crypto_9] 100075 D - 0xfffff800038a4500 [crypto_10] 100076 D - 0xfffff800038a4500 [crypto_11] 100114 D - 0xfffff8000612f200 [mca taskq] 100121 D - 0xfffff8000c200700 [acpi_task_0] 100122 D - 0xfffff8000c200700 [acpi_task_1] 100123 D - 0xfffff8000c200700 [acpi_task_2] 100124 D - 0xfffff800038a3c00 [CAM taskq] db:0:pho> allt Tracing command mksnap_ffs pid 54889 tid 104216 td 0xfffff806dd82f000 (CPU 2) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00d4916ee0 vpanic() at vpanic+0x1c0/frame 0xfffffe00d4916f40 panic() at panic+0x43/frame 0xfffffe00d4916fa0 snapacct_ufs2() at snapacct_ufs2+0x135/frame 0xfffffe00d4917000 fullacct_ufs2() at fullacct_ufs2+0x29/frame 0xfffffe00d4917060 indiracct_ufs2() at indiracct_ufs2+0x20b/frame 0xfffffe00d4917130 expunge_ufs2() at expunge_ufs2+0x46c/frame 0xfffffe00d49171e0 ffs_snapshot() at ffs_snapshot+0x1b1d/frame 0xfffffe00d49174e0 ffs_mount() at ffs_mount+0xb20/frame 0xfffffe00d4917680 vfs_domount() at vfs_domount+0x81d/frame 0xfffffe00d49178a0 vfs_donmount() at vfs_donmount+0x7b8/frame 0xfffffe00d4917940 sys_nmount() at sys_nmount+0x72/frame 0xfffffe00d4917980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00d4917ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00d4917ab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x8002d3a6a, rsp = 0x7fffffffce98, rbp = 0x7fffffffe6f0 --- Tracing command sh pid 54872 tid 104605 td 0xfffff805b728f000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00d50b8560 mi_switch() at mi_switch+0x16f/frame 0xfffffe00d50b8590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00d50b85d0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00d50b8630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00d50b8660 _sleep() at _sleep+0x34e/frame 0xfffffe00d50b8700 kern_wait6() at kern_wait6+0x4af/frame 0xfffffe00d50b8790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00d50b8980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00d50b8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00d50b8ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040318a, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe270 --- Tracing command tee pid 54871 tid 102003 td 0xfffff8028ae0f580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a81b26b0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a81b26e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a81b2720 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a81b2780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a81b27b0 _sleep() at _sleep+0x34e/frame 0xfffffe00a81b2850 pipe_read() at pipe_read+0x345/frame 0xfffffe00a81b28b0 dofileread() at dofileread+0x95/frame 0xfffffe00a81b28f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a81b2930 sys_read() at sys_read+0x86/frame 0xfffffe00a81b2980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a81b2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a81b2ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800413a7a, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sh pid 54870 tid 100262 td 0xfffff80304adb580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a71f5560 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a71f5590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a71f55d0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a71f5630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a71f5660 _sleep() at _sleep+0x34e/frame 0xfffffe00a71f5700 kern_wait6() at kern_wait6+0x4af/frame 0xfffffe00a71f5790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a71f5980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a71f5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a71f5ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040318a, rsp = 0x7fffffffe288, rbp = 0x7fffffffe340 --- Tracing command sleep pid 54143 tid 100224 td 0xfffff8000c7c7580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a7137700 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a7137730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7137770 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a71377d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a7137810 _sleep() at _sleep+0x2e9/frame 0xfffffe00a71378b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00a7137940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00a7137980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a7137ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7137ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003a230a, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sh pid 50209 tid 100147 td 0xfffff8000c826000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f676b0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f676e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f67720 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f67780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006f677b0 _sleep() at _sleep+0x34e/frame 0xfffffe0006f67850 pipe_read() at pipe_read+0x345/frame 0xfffffe0006f678b0 dofileread() at dofileread+0x95/frame 0xfffffe0006f678f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe0006f67930 sys_read() at sys_read+0x86/frame 0xfffffe0006f67980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006f67ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f67ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800474a7a, rsp = 0x7fffffffe238, rbp = 0x7fffffffe340 --- Tracing command awk pid 50206 tid 100270 td 0xfffff80304d00580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a781d6b0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a781d6e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a781d720 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a781d780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a781d7b0 _sleep() at _sleep+0x34e/frame 0xfffffe00a781d850 pipe_read() at pipe_read+0x345/frame 0xfffffe00a781d8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a781d8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a781d930 sys_read() at sys_read+0x86/frame 0xfffffe00a781d980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a781dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a781dab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800476a7a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe340 --- Tracing command sh pid 50205 tid 100265 td 0xfffff8000c867580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a7804560 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a7804590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a78045d0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a7804630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7804660 _sleep() at _sleep+0x34e/frame 0xfffffe00a7804700 kern_wait6() at kern_wait6+0x4af/frame 0xfffffe00a7804790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a7804980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a7804ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7804ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040318a, rsp = 0x7fffffffe248, rbp = 0x7fffffffe300 --- Tracing command sh pid 50195 tid 100220 td 0xfffff8000c49e580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d4916700 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00d4916710 trap() at trap+0x5c/frame 0xfffffe00d4916820 calltrap() at calltrap+0x8/frame 0xfffffe00d4916820 --- trap 0xc, rip = 0xffffffff81042686, rsp = 0xfffffe00d49168f0, rbp = 0xfffffe00d4916900 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00d4916900 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00d49169a0 db_command() at db_command+0x279/frame 0xfffffe00d4916a70 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00d4916b10 db_command() at db_command+0x279/frame 0xfffffe00d4916be0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00d4916bf0 db_trap() at db_trap+0xef/frame 0xfffffe00d4916c80 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00d4916cf0 trap() at trap+0x806/frame 0xfffffe00d4916e00 calltrap() at calltrap+0x8/frame 0xfffffe00d4916e00 --- trap 0x3, rip = 0xffffffff80bd821b, rsp = 0xfffffe00d4916ed0, rbp = 0xfffffe00d4916ee0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00d4916ee0 vpanic() at vpanic+0x1c0/frame 0xfffffe00d4916f40 panic() at panic+0x43/frame 0xfffffe00d4916fa0 snapacct_ufs2() at snapacct_ufs2+0x135/frame 0xfffffe00d4917000 fullacct_ufs2() at fullacct_ufs2+0x29/frame 0xfffffe00d4917060 indiracct_ufs2() at indiracct_ufs2+0x20b/frame 0xfffffe00d4917130 expunge_ufs2() at expunge_ufs2+0x46c/frame 0xfffffe00d49171e0 ffs_snapshot() at ffs_snapshot+0x1b1d/frame 0xfffffe00d49174e0 ffs_mount() at ffs_mount+0xb20/frame 0xfffffe00d4917680 vfs_domount() at vfs_domount+0x81d/frame 0xfffffe00d49178a0 vfs_donmount() at vfs_donmount+0x7b8/frame 0xfffffe00d4917940 sys_nmount() at sys_nmount+0x72/frame 0xfffffe00d4917980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00d4917ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00d4917ab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x8002d3a6a, rsp = 0x7fffffffce98, rbp = 0x7fffffffe6f0 --- Tracing command sh pid 48120 tid 100219 td 0xfffff8000c7c8000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a711e560 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a711e590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a711e5d0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a711e630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a711e660 _sleep() at _sleep+0x34e/frame 0xfffffe00a711e700 kern_wait6() at kern_wait6+0x4af/frame 0xfffffe00a711e790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a711e980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a711eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a711eab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040318a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe660 --- Tracing command bash pid 2324 tid 100215 td 0xfffff8000c8f0000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a710a580 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a710a5b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a710a5f0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a710a650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a710a680 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a710a6e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a710a720 kern_select() at kern_select+0x8bf/frame 0xfffffe00a710a900 sys_pselect() at sys_pselect+0x127/frame 0xfffffe00a710a980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a710aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a710aab0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x800aff15a, rsp = 0x7fffffffd638, rbp = 0x7fffffffd700 --- Tracing command csh pid 2322 tid 100173 td 0xfffff8000c4aa000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d4916700 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00d4916710 trap() at trap+0x5c/frame 0xfffffe00d4916820 calltrap() at calltrap+0x8/frame 0xfffffe00d4916820 --- trap 0xc, rip = 0xffffffff81042686, rsp = 0xfffffe00d49168f0, rbp = 0xfffffe00d4916900 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00d4916900 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00d49169a0 db_command() at db_command+0x279/frame 0xfffffe00d4916a70 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00d4916b10 db_command() at db_command+0x279/frame 0xfffffe00d4916be0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00d4916bf0 db_trap() at db_trap+0xef/frame 0xfffffe00d4916c80 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00d4916cf0 trap() at trap+0x806/frame 0xfffffe00d4916e00 calltrap() at calltrap+0x8/frame 0xfffffe00d4916e00 --- trap 0x3, rip = 0xffffffff80bd821b, rsp = 0xfffffe00d4916ed0, rbp = 0xfffffe00d4916ee0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00d4916ee0 vpanic() at vpanic+0x1c0/frame 0xfffffe00d4916f40 panic() at panic+0x43/frame 0xfffffe00d4916fa0 snapacct_ufs2() at snapacct_ufs2+0x135/frame 0xfffffe00d4917000 fullacct_ufs2() at fullacct_ufs2+0x29/frame 0xfffffe00d4917060 indiracct_ufs2() at indiracct_ufs2+0x20b/frame 0xfffffe00d4917130 expunge_ufs2() at expunge_ufs2+0x46c/frame 0xfffffe00d49171e0 ffs_snapshot() at ffs_snapshot+0x1b1d/frame 0xfffffe00d49174e0 ffs_mount() at ffs_mount+0xb20/frame 0xfffffe00d4917680 vfs_domount() at vfs_domount+0x81d/frame 0xfffffe00d49178a0 vfs_donmount() at vfs_donmount+0x7b8/frame 0xfffffe00d4917940 sys_nmount() at sys_nmount+0x72/frame 0xfffffe00d4917980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00d4917ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00d4917ab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x8002d3a6a, rsp = 0x7fffffffce98, rbp = 0x7fffffffe6f0 --- Tracing command su pid 2321 tid 100161 td 0xfffff8000c8f0580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d4916700 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00d4916710 trap() at trap+0x5c/frame 0xfffffe00d4916820 calltrap() at calltrap+0x8/frame 0xfffffe00d4916820 --- trap 0xc, rip = 0xffffffff81042686, rsp = 0xfffffe00d49168f0, rbp = 0xfffffe00d4916900 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00d4916900 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00d49169a0 db_command() at db_command+0x279/frame 0xfffffe00d4916a70 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00d4916b10 db_command() at db_command+0x279/frame 0xfffffe00d4916be0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00d4916bf0 db_trap() at db_trap+0xef/frame 0xfffffe00d4916c80 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00d4916cf0 trap() at trap+0x806/frame 0xfffffe00d4916e00 calltrap() at calltrap+0x8/frame 0xfffffe00d4916e00 --- trap 0x3, rip = 0xffffffff80bd821b, rsp = 0xfffffe00d4916ed0, rbp = 0xfffffe00d4916ee0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00d4916ee0 vpanic() at vpanic+0x1c0/frame 0xfffffe00d4916f40 panic() at panic+0x43/frame 0xfffffe00d4916fa0 snapacct_ufs2() at snapacct_ufs2+0x135/frame 0xfffffe00d4917000 fullacct_ufs2() at fullacct_ufs2+0x29/frame 0xfffffe00d4917060 indiracct_ufs2() at indiracct_ufs2+0x20b/frame 0xfffffe00d4917130 expunge_ufs2() at expunge_ufs2+0x46c/frame 0xfffffe00d49171e0 ffs_snapshot() at ffs_snapshot+0x1b1d/frame 0xfffffe00d49174e0 ffs_mount() at ffs_mount+0xb20/frame 0xfffffe00d4917680 vfs_domount() at vfs_domount+0x81d/frame 0xfffffe00d49178a0 vfs_donmount() at vfs_donmount+0x7b8/frame 0xfffffe00d4917940 sys_nmount() at sys_nmount+0x72/frame 0xfffffe00d4917980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00d4917ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00d4917ab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x8002d3a6a, rsp = 0x7fffffffce98, rbp = 0x7fffffffe6f0 --- Tracing command bash pid 2320 tid 100155 td 0xfffff8000c4a4580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d4916700 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00d4916710 trap() at trap+0x5c/frame 0xfffffe00d4916820 calltrap() at calltrap+0x8/frame 0xfffffe00d4916820 --- trap 0xc, rip = 0xffffffff81042686, rsp = 0xfffffe00d49168f0, rbp = 0xfffffe00d4916900 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00d4916900 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00d49169a0 db_command() at db_command+0x279/frame 0xfffffe00d4916a70 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00d4916b10 db_command() at db_command+0x279/frame 0xfffffe00d4916be0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00d4916bf0 db_trap() at db_trap+0xef/frame 0xfffffe00d4916c80 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00d4916cf0 trap() at trap+0x806/frame 0xfffffe00d4916e00 calltrap() at calltrap+0x8/frame 0xfffffe00d4916e00 --- trap 0x3, rip = 0xffffffff80bd821b, rsp = 0xfffffe00d4916ed0, rbp = 0xfffffe00d4916ee0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00d4916ee0 vpanic() at vpanic+0x1c0/frame 0xfffffe00d4916f40 panic() at panic+0x43/frame 0xfffffe00d4916fa0 snapacct_ufs2() at snapacct_ufs2+0x135/frame 0xfffffe00d4917000 fullacct_ufs2() at fullacct_ufs2+0x29/frame 0xfffffe00d4917060 indiracct_ufs2() at indiracct_ufs2+0x20b/frame 0xfffffe00d4917130 expunge_ufs2() at expunge_ufs2+0x46c/frame 0xfffffe00d49171e0 ffs_snapshot() at ffs_snapshot+0x1b1d/frame 0xfffffe00d49174e0 ffs_mount() at ffs_mount+0xb20/frame 0xfffffe00d4917680 vfs_domount() at vfs_domount+0x81d/frame 0xfffffe00d49178a0 vfs_donmount() at vfs_donmount+0x7b8/frame 0xfffffe00d4917940 sys_nmount() at sys_nmount+0x72/frame 0xfffffe00d4917980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00d4917ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00d4917ab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x8002d3a6a, rsp = 0x7fffffffce98, rbp = 0x7fffffffe6f0 --- Tracing command sshd pid 2319 tid 100151 td 0xfffff80006096000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f7b5c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f7b5f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f7b630 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f7b690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006f7b6c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe0006f7b720 seltdwait() at seltdwait+0x8d/frame 0xfffffe0006f7b760 kern_select() at kern_select+0x8bf/frame 0xfffffe0006f7b940 sys_select() at sys_select+0x56/frame 0xfffffe0006f7b980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006f7bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f7bab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80087779a, rsp = 0x7fffffffa598, rbp = 0x7fffffffa5d0 --- Tracing command sshd pid 2316 tid 100202 td 0xfffff80263057000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70c9640 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a70c9670 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a70c96b0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a70c9710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a70c9740 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a70c97a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a70c97e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe00a70c9960 sys_poll() at sys_poll+0x50/frame 0xfffffe00a70c9980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a70c9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a70c9ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800818b5a, rsp = 0x7fffffffe5f8, rbp = 0x7fffffffe630 --- Tracing command csh pid 2312 tid 100199 td 0xfffff8000c7c8580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70ba630 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a70ba660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a70ba6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a70ba700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a70ba730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a70ba790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a70ba7c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe00a70ba820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a70ba850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a70ba8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a70ba8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a70ba930 sys_read() at sys_read+0x86/frame 0xfffffe00a70ba980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a70baab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a70baab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004f87ba, rsp = 0x7fffffffe208, rbp = 0x7fffffffe230 --- Tracing command login pid 2307 tid 100213 td 0xfffff8000c597580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d4916700 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00d4916710 trap() at trap+0x5c/frame 0xfffffe00d4916820 calltrap() at calltrap+0x8/frame 0xfffffe00d4916820 --- trap 0xc, rip = 0xffffffff81042686, rsp = 0xfffffe00d49168f0, rbp = 0xfffffe00d4916900 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00d4916900 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00d49169a0 db_command() at db_command+0x279/frame 0xfffffe00d4916a70 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00d4916b10 db_command() at db_command+0x279/frame 0xfffffe00d4916be0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00d4916bf0 db_trap() at db_trap+0xef/frame 0xfffffe00d4916c80 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00d4916cf0 trap() at trap+0x806/frame 0xfffffe00d4916e00 calltrap() at calltrap+0x8/frame 0xfffffe00d4916e00 --- trap 0x3, rip = 0xffffffff80bd821b, rsp = 0xfffffe00d4916ed0, rbp = 0xfffffe00d4916ee0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00d4916ee0 vpanic() at vpanic+0x1c0/frame 0xfffffe00d4916f40 panic() at panic+0x43/frame 0xfffffe00d4916fa0 snapacct_ufs2() at snapacct_ufs2+0x135/frame 0xfffffe00d4917000 fullacct_ufs2() at fullacct_ufs2+0x29/frame 0xfffffe00d4917060 indiracct_ufs2() at indiracct_ufs2+0x20b/frame 0xfffffe00d4917130 expunge_ufs2() at expunge_ufs2+0x46c/frame 0xfffffe00d49171e0 ffs_snapshot() at ffs_snapshot+0x1b1d/frame 0xfffffe00d49174e0 ffs_mount() at ffs_mount+0xb20/frame 0xfffffe00d4917680 vfs_domount() at vfs_domount+0x81d/frame 0xfffffe00d49178a0 vfs_donmount() at vfs_donmount+0x7b8/frame 0xfffffe00d4917940 sys_nmount() at sys_nmount+0x72/frame 0xfffffe00d4917980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00d4917ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00d4917ab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x8002d3a6a, rsp = 0x7fffffffce98, rbp = 0x7fffffffe6f0 --- Tracing command getty pid 2306 tid 100212 td 0xfffff8000c59e000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70fb630 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a70fb660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a70fb6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a70fb700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a70fb730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a70fb790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a70fb7c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe00a70fb820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a70fb850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a70fb8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a70fb8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a70fb930 sys_read() at sys_read+0x86/frame 0xfffffe00a70fb980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a70fbab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a70fbab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f7ba, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 2305 tid 100148 td 0xfffff8000c822580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f6c630 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f6c660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f6c6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f6c700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006f6c730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe0006f6c790 tty_wait() at tty_wait+0x42/frame 0xfffffe0006f6c7c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe0006f6c820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0006f6c850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe0006f6c8b0 dofileread() at dofileread+0x95/frame 0xfffffe0006f6c8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe0006f6c930 sys_read() at sys_read+0x86/frame 0xfffffe0006f6c980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006f6cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f6cab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f7ba, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 2304 tid 100211 td 0xfffff8000c59e580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70f6630 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a70f6660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a70f66a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a70f6700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a70f6730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a70f6790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a70f67c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe00a70f6820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a70f6850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a70f68b0 dofileread() at dofileread+0x95/frame 0xfffffe00a70f68f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a70f6930 sys_read() at sys_read+0x86/frame 0xfffffe00a70f6980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a70f6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a70f6ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f7ba, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 2303 tid 100210 td 0xfffff8000c59f000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70f1630 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a70f1660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a70f16a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a70f1700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a70f1730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a70f1790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a70f17c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe00a70f1820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a70f1850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a70f18b0 dofileread() at dofileread+0x95/frame 0xfffffe00a70f18f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a70f1930 sys_read() at sys_read+0x86/frame 0xfffffe00a70f1980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a70f1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a70f1ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f7ba, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 2302 tid 100209 td 0xfffff8000c7ff000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70ec630 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a70ec660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a70ec6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a70ec700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a70ec730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a70ec790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a70ec7c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe00a70ec820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a70ec850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a70ec8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a70ec8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a70ec930 sys_read() at sys_read+0x86/frame 0xfffffe00a70ec980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a70ecab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a70ecab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f7ba, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 2301 tid 100208 td 0xfffff8000c7ff580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70e7630 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a70e7660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a70e76a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a70e7700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a70e7730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a70e7790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a70e77c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe00a70e7820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a70e7850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a70e78b0 dofileread() at dofileread+0x95/frame 0xfffffe00a70e78f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a70e7930 sys_read() at sys_read+0x86/frame 0xfffffe00a70e7980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a70e7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a70e7ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f7ba, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 2300 tid 100195 td 0xfffff8000c820580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a709a630 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a709a660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a709a6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a709a700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a709a730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a709a790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a709a7c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe00a709a820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a709a850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a709a8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a709a8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a709a930 sys_read() at sys_read+0x86/frame 0xfffffe00a709a980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a709aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a709aab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f7ba, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 2299 tid 100198 td 0xfffff8000c820000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70b5630 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a70b5660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a70b56a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a70b5700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a70b5730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a70b5790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a70b57c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe00a70b5820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a70b5850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a70b58b0 dofileread() at dofileread+0x95/frame 0xfffffe00a70b58f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a70b5930 sys_read() at sys_read+0x86/frame 0xfffffe00a70b5980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a70b5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a70b5ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f7ba, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 2298 tid 100142 td 0xfffff8000c0b8580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f4e630 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f4e660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f4e6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f4e700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006f4e730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe0006f4e790 tty_wait() at tty_wait+0x42/frame 0xfffffe0006f4e7c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe0006f4e820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0006f4e850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe0006f4e8b0 dofileread() at dofileread+0x95/frame 0xfffffe0006f4e8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe0006f4e930 sys_read() at sys_read+0x86/frame 0xfffffe0006f4e980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006f4eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f4eab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f7ba, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command cron pid 2252 tid 100201 td 0xfffff8000c4a1000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70c4700 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a70c4730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a70c4770 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a70c47d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a70c4810 _sleep() at _sleep+0x2e9/frame 0xfffffe00a70c48b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00a70c4940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00a70c4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a70c4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a70c4ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d11ba, rsp = 0x7fffffffeaf8, rbp = 0x7fffffffece0 --- Tracing command sshd pid 2248 tid 100156 td 0xfffff8000c4a4000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f945c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f945f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f94630 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f94690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006f946c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe0006f94720 seltdwait() at seltdwait+0x8d/frame 0xfffffe0006f94760 kern_select() at kern_select+0x8bf/frame 0xfffffe0006f94940 sys_select() at sys_select+0x56/frame 0xfffffe0006f94980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006f94ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f94ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80087779a, rsp = 0x7fffffffe688, rbp = 0x7fffffffe6c0 --- Tracing command rpc.lockd pid 2183 tid 100190 td 0xfffff8000c5be000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70754e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a7075510 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7075550 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a70755b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a70755f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe00a7075660 svc_run_internal() at svc_run_internal+0xa92/frame 0xfffffe00a70757a0 svc_run() at svc_run+0x1fe/frame 0xfffffe00a7075800 sys_nlm_syscall() at sys_nlm_syscall+0x76b/frame 0xfffffe00a7075980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a7075ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7075ab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002ed5da, rsp = 0x7fffffffec28, rbp = 0x7fffffffece0 --- Tracing command rpc.statd pid 2180 tid 100154 td 0xfffff80003fba000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f8a5a0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f8a5d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f8a610 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f8a670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe0006f8a6b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe0006f8a720 seltdwait() at seltdwait+0x6b/frame 0xfffffe0006f8a760 kern_select() at kern_select+0x8bf/frame 0xfffffe0006f8a940 sys_select() at sys_select+0x56/frame 0xfffffe0006f8a980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006f8aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f8aab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042379a, rsp = 0x7fffffffeab8, rbp = 0x7fffffffec00 --- Tracing command watchdogd pid 2130 tid 100171 td 0xfffff8000c7ca000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006fe6700 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006fe6730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006fe6770 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006fe67d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe0006fe6810 _sleep() at _sleep+0x2e9/frame 0xfffffe0006fe68b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe0006fe6940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe0006fe6980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006fe6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006fe6ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003bb1ba, rsp = 0x7fffffffeab8, rbp = 0x7fffffffeb00 --- Tracing command rpcbind pid 2054 tid 100189 td 0xfffff8000c7c9580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a7070620 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a7070650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7070690 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a70706f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a7070730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe00a70707a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00a70707e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe00a7070960 sys_poll() at sys_poll+0x50/frame 0xfffffe00a7070980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a7070ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7070ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003c9b5a, rsp = 0x7fffffffca58, rbp = 0x7fffffffec70 --- Tracing command syslogd pid 2044 tid 100193 td 0xfffff8000c7c9000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70905c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a70905f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7090630 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a7090690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a70906c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a7090720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a7090760 kern_select() at kern_select+0x8bf/frame 0xfffffe00a7090940 sys_select() at sys_select+0x56/frame 0xfffffe00a7090980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a7090ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7090ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043579a, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffece0 --- Tracing command devd pid 1973 tid 100149 td 0xfffff8000c869580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f715a0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f715d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f71610 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f71670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe0006f716b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe0006f71720 seltdwait() at seltdwait+0x6b/frame 0xfffffe0006f71760 kern_select() at kern_select+0x8bf/frame 0xfffffe0006f71940 sys_select() at sys_select+0x56/frame 0xfffffe0006f71980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006f71ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f71ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2fc24a, rsp = 0x7fffffffcb78, rbp = 0x7fffffffed00 --- Tracing command dhclient pid 1968 tid 100172 td 0xfffff8000cbd9580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006feb620 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006feb650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006feb690 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006feb6f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe0006feb730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe0006feb7a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe0006feb7e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe0006feb960 sys_poll() at sys_poll+0x50/frame 0xfffffe0006feb980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006febab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006febab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003ecb5a, rsp = 0x7fffffffec48, rbp = 0x7fffffffec80 --- Tracing command dhclient pid 1924 tid 100174 td 0xfffff800037cc580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ff5640 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ff5670 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ff56b0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006ff5710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006ff5740 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe0006ff57a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe0006ff57e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe0006ff5960 sys_poll() at sys_poll+0x50/frame 0xfffffe0006ff5980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006ff5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006ff5ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003ecb5a, rsp = 0x7fffffffec58, rbp = 0x7fffffffec80 --- Tracing command dhclient pid 1921 tid 100180 td 0xfffff8000c659580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70135c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a70135f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7013630 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a7013690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a70136c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a7013720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a7013760 kern_select() at kern_select+0x8bf/frame 0xfffffe00a7013940 sys_select() at sys_select+0x56/frame 0xfffffe00a7013980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a7013ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7013ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80044b79a, rsp = 0x7fffffffea08, rbp = 0x7fffffffeac0 --- Tracing command vnlru pid 34 tid 100134 td 0xfffff8000c4a5000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f21880 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f218b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f218f0 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f21930 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f219d0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe0006f21a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f21ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f21ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100132 td 0xfffff8000c4a5580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f178c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f178f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f17930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f17970 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x1f1/frame 0xfffffe0006f179e0 sched_sync() at sched_sync+0x609/frame 0xfffffe0006f17a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f17ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f17ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffff8000c4a7000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f128d0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f12900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f12940 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f12980 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f12a20 buf_daemon() at buf_daemon+0xd8/frame 0xfffffe0006f12a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f12ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f12ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100133 td 0xfffff80003a88580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f1c8c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f1c8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f1c930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f1c970 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f1ca10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006f1ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f1cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f1cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff80003a88000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f268c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f268f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f26930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f26970 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f26a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006f26a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f26ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f26ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff80003a87580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f2b8c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f2b8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f2b930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f2b970 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f2ba10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006f2ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f2bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f2bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffff80003a87000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f358c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f358f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f35930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f35970 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f35a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006f35a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f35ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f35ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffff80003a86580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f3a8c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f3a8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f3a930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f3a970 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f3aa10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006f3aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f3aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f3aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100140 td 0xfffff80003a86000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f448c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f448f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f44930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f44970 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f44a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006f44a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f44ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f44ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100141 td 0xfffff800038f9580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f498c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f498f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f49930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f49970 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f49a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006f49a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f49ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f49ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100152 td 0xfffff8000c8f1000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f808f0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f80920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f80960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f809a0 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f80a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe0006f80a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f80ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f80ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100158 td 0xfffff800037cd580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f998f0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f99920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f99960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f999a0 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f99a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe0006f99a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f99ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f99ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff8000c1bd000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f0d8b0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f0d8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f0d920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f0d950 _sleep() at _sleep+0x358/frame 0xfffffe0006f0d9f0 vm_daemon() at vm_daemon+0xaa6/frame 0xfffffe0006f0da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f0dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f0dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff8000c1bd580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f08560 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f08590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f085d0 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f08610 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f086b0 vm_pageout_worker() at vm_pageout_worker+0x24e/frame 0xfffffe0006f08a40 vm_pageout() at vm_pageout+0x16c/frame 0xfffffe0006f08a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f08ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f08ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100131 td 0xfffff8000c4ae000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f30660 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f30690 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f306d0 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f30710 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f307b0 pause_sbt() at pause_sbt+0x11f/frame 0xfffffe0006f307f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xb22/frame 0xfffffe0006f30a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f30ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f30ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100139 td 0xfffff8000c4ac580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f3f8f0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f3f920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f3f960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f3f9a0 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f3fa40 uma_reclaim_worker() at uma_reclaim_worker+0xda/frame 0xfffffe0006f3fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f3fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f3fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff8000c0c8000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ef78b0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ef78e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ef7920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ef7950 _sleep() at _sleep+0x358/frame 0xfffffe0006ef79f0 enc_daemon() at enc_daemon+0x1df/frame 0xfffffe0006ef7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ef7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ef7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff8000c0c8580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ef28b0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ef28e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ef2920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ef2950 _sleep() at _sleep+0x358/frame 0xfffffe0006ef29f0 enc_daemon() at enc_daemon+0x1df/frame 0xfffffe0006ef2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ef2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ef2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100120 td 0xfffff8000c1cb580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ed48c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ed48f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ed4930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006ed4970 _sleep() at _sleep+0x2fc/frame 0xfffffe0006ed4a10 random_kthread() at random_kthread+0x296/frame 0xfffffe0006ed4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ed4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ed4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff8000c1cc000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ec3910 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ec3940 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ec3980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ec39b0 _sleep() at _sleep+0x358/frame 0xfffffe0006ec3a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0006ec3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff8000c0c9000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006eb28e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006eb2910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006eb2950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006eb2990 _sleep() at _sleep+0x2fc/frame 0xfffffe0006eb2a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006eb2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff8000c0c9580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ead8e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ead910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ead950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006ead990 _sleep() at _sleep+0x2fc/frame 0xfffffe0006eada30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006eada70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eadab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eadab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff8000c0ca000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ea88e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ea8910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ea8950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006ea8990 _sleep() at _sleep+0x2fc/frame 0xfffffe0006ea8a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ea8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff8000c0ca580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ea38e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ea3910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ea3950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006ea3990 _sleep() at _sleep+0x2fc/frame 0xfffffe0006ea3a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ea3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff80003e2d000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e2c930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e2c960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e2c9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e2c9d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e2ca30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e2ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e2cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff80003e2c580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e31930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e31960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e319a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e319d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e31a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e31a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e31ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff80003e2c000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e36930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e36960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e369a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e369d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e36a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e36a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e36ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff80003e2b580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e3b930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e3b960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e3b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e3b9d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e3ba30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e3ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e3bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e3bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff80003e2b000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e40930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e40960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e409a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e409d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e40a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e40a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e40ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e40ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff80003e23000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e4a930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e4a960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e4a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4a9d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e4aa30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e4aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff80003fc0580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e4f930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e4f960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e4f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4f9d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e4fa30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e4fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff80003fc0000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e54930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e54960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e549a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e549d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e54a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e54a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e54ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e54ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff80003fbb580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e59930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e59960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e599a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e599d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e59a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e59a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e59ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e59ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff80003fbb000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e5e930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e5e960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e5e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e5e9d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e5ea30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e5ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e5eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e5eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff800060a1000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e7b930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e7b960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e7b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e7b9d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e7ba30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e7ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e7bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e7bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff800060a0580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e80930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e80960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e809a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e809d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e80a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e80a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e80ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e80ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff800060a0000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e85930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e85960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e859a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e859d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e85a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e85a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e85ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e85ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff8000609f580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e8a930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e8a960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e8a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e8a9d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e8aa30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e8aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e8aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e8aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff8000609f000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e8f930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e8f960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e8f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e8f9d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e8fa30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e8fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e8fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e8fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff800038f5000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e138e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e13910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e13950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e13980 _sleep() at _sleep+0x358/frame 0xfffffe0006e13a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e13a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e13ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff80003a89580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e188e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e18910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e18950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e18980 _sleep() at _sleep+0x358/frame 0xfffffe0006e18a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e18a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e18ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff80003a89000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e1d8e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e1d910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e1d950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e1d980 _sleep() at _sleep+0x358/frame 0xfffffe0006e1da20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e1dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff8000c1c9000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006eed8d0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006eed900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006eed940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eed970 _sleep() at _sleep+0x358/frame 0xfffffe0006eeda10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe0006eeda70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eedab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eedab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 19 tid 100090 td 0xfffff800038f5580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e0e8f0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e0e920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e0e960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e0e990 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e0e9f0 seq_eventthread() at seq_eventthread+0xcc/frame 0xfffffe0006e0ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e0eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 18 tid 100089 td 0xfffff800038f6000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e098c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e098f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e09930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e09960 _sleep() at _sleep+0x358/frame 0xfffffe0006e09a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e09ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 17 tid 100088 td 0xfffff800038f6580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e048c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e048f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e04930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e04960 _sleep() at _sleep+0x358/frame 0xfffffe0006e04a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e04a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e04ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 16 tid 100087 td 0xfffff800038f7000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005fd8c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005fd8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005fd930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005fd960 _sleep() at _sleep+0x358/frame 0xfffffe00005fda00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 15 tid 100086 td 0xfffff800038f7580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005f88c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005f88f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f8930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f8960 _sleep() at _sleep+0x358/frame 0xfffffe00005f8a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 14 tid 100085 td 0xfffff800038f8000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005f38c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005f38f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f3930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f3960 _sleep() at _sleep+0x358/frame 0xfffffe00005f3a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100084 td 0xfffff800038f8580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005ee8c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005ee8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ee930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ee960 _sleep() at _sleep+0x358/frame 0xfffffe00005eea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100083 td 0xfffff800038f9000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005e98c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005e98f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e9930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e9960 _sleep() at _sleep+0x358/frame 0xfffffe00005e9a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100082 td 0xfffff800038e7580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005e48c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005e48f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e4930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e4960 _sleep() at _sleep+0x358/frame 0xfffffe00005e4a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100081 td 0xfffff800038e8000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005df8c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005df8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005df930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005df960 _sleep() at _sleep+0x358/frame 0xfffffe00005dfa00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100080 td 0xfffff800038e8580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005da8c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005da8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005da930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005da960 _sleep() at _sleep+0x358/frame 0xfffffe00005daa00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100079 td 0xfffff800038e9000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005d58c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005d58f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d5930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d5960 _sleep() at _sleep+0x358/frame 0xfffffe00005d5a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100078 td 0xfffff800038e9580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005d08c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005d08f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d0930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d0960 _sleep() at _sleep+0x358/frame 0xfffffe00005d0a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100077 td 0xfffff800038ea000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005cb8f0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005cb920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005cb960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005cb990 _sleep() at _sleep+0x358/frame 0xfffffe00005cba30 crypto_proc() at crypto_proc+0x2c5/frame 0xfffffe00005cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100061 td 0xfffff80003807000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe000057b8f0 mi_switch() at mi_switch+0x16f/frame 0xfffffe000057b920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000057b960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000057b990 _sleep() at _sleep+0x358/frame 0xfffffe000057ba30 g_run_events() at g_run_events+0x4f/frame 0xfffffe000057ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000057bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000057bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff80003806580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005808f0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000580920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000580960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000580990 _sleep() at _sleep+0x358/frame 0xfffffe0000580a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0000580a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe0000580a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000580ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000580ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff80003806000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005858e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000585910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000585950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000585980 _sleep() at _sleep+0x358/frame 0xfffffe0000585a20 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe0000585a60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe0000585a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000585ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000585ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100018 td 0xfffff800036b7580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00787a59e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00787a5a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00787a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787a5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100019 td 0xfffff800036ec000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00787aa9e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00787aaa10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00787aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787aaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100021 td 0xfffff800036eb000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff800037f7000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004d59e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004d5a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00004d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff800037f6580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004da9e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004daa10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00004daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffff800037f6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff800037f5580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff800037f5000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff800037f4580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff800037f4000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff800037e8580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff800037e8000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff80003809580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff80003809000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff80003808580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff80003808000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffff80003807580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffff80003e2e000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e229e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e22a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe0006e22a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e22ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e22ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff80003e2d580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e279e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e27a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe0006e27a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e27ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e27ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff80003e23580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e459e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e45a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe0006e45a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e45ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e45ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff8000609e580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff8000609e000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e999e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e99a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe0006e99a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e99ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e99ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100181 td 0xfffff8000cbd9000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffff8000cbd8580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffff8000cbd8000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffff8000cbcb580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffff8000cbcb000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffff8000c8f1580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffff80263058580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffff80263058000 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff800036b6000 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff82059570 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xffffffff82059590 trap() at trap+0x49/frame 0xffffffff820596a0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff820596a0 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe007875a910, rbp = 0xfffffe007875a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007875a910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe007875a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007875a980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007875a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007875aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007875aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007875aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800036b5580 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bb0df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bb0e10 trap() at trap+0x49/frame 0xfffffe0006bb0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bb0f20 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe007875f910, rbp = 0xfffffe007875f910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007875f910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe007875f960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007875f980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007875f9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007875fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007875fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007875fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800036b5000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0078764950 mi_switch() at mi_switch+0x16f/frame 0xfffffe0078764980 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe00787649a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078764a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078764ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078764ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800036b4580 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bc8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bc8e10 trap() at trap+0x49/frame 0xfffffe0006bc8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc8f20 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe0078769910, rbp = 0xfffffe0078769910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078769910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078769960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078769980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787699a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078769a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078769ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078769ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800036b4000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe007876e950 mi_switch() at mi_switch+0x16f/frame 0xfffffe007876e980 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe007876e9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007876ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007876eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007876eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800036b3580 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006be0df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006be0e10 trap() at trap+0x49/frame 0xfffffe0006be0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006be0f20 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe0078773910, rbp = 0xfffffe0078773910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078773910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078773960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078773980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787739a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078773a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078773ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078773ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800036b3000 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006becdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bece10 trap() at trap+0x49/frame 0xfffffe0006becf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006becf20 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe0078778910, rbp = 0xfffffe0078778910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078778910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078778960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078778980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787789a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078778a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078778ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078778ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800036c7580 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bf8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bf8e10 trap() at trap+0x49/frame 0xfffffe0006bf8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bf8f20 --- trap 0x13, rip = 0xffffffff811d41f6, rsp = 0xfffffe007877d990, rbp = 0xfffffe007877d9a0 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe007877d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007877da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007877dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007877dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800036c7000 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000274df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000274e10 trap() at trap+0x49/frame 0xfffffe0000274f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000274f20 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe0078782910, rbp = 0xfffffe0078782910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078782910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078782960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078782980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787829a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078782a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078782ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078782ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800036c6580 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000280df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000280e10 trap() at trap+0x49/frame 0xfffffe0000280f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000280f20 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe0078787910, rbp = 0xfffffe0078787910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078787910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078787960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078787980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787879a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078787a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078787ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078787ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800036c6000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe000028cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe000028ce10 trap() at trap+0x49/frame 0xfffffe000028cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe000028cf20 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe007878c910, rbp = 0xfffffe007878c910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007878c910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe007878c960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007878c980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007878c9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007878ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007878cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007878cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800036c5580 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000298df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000298e10 trap() at trap+0x49/frame 0xfffffe0000298f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000298f20 --- trap 0x13, rip = 0xffffffff811d3ad6, rsp = 0xfffffe0078791910, rbp = 0xfffffe0078791910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078791910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078791960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078791980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787919a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078791a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078791ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078791ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800036b6580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0078755560 mi_switch() at mi_switch+0x16f/frame 0xfffffe0078755590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787555d0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0078755630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0078755660 _sleep() at _sleep+0x34e/frame 0xfffffe0078755700 kern_wait6() at kern_wait6+0x4af/frame 0xfffffe0078755790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0078755980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0078755ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0078755ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2ae76a, rsp = 0x7fffffffe788, rbp = 0x7fffffffe7f0 --- Tracing command audit pid 10 tid 100001 td 0xfffff800036b7000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0078750910 mi_switch() at mi_switch+0x16f/frame 0xfffffe0078750940 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0078750980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787509b0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0078750a10 audit_worker() at audit_worker+0x93/frame 0xfffffe0078750a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078750ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078750ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff8208e0a0 sched_switch() at sched_switch+0x7ca/frame 0xffffffff828dc9d0 mi_switch() at mi_switch+0x16f/frame 0xffffffff828dca00 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffffff828dca40 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xffffffff828dca80 _sleep() at _sleep+0x2fc/frame 0xffffffff828dcb20 swapper() at swapper+0x77/frame 0xffffffff828dcb70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffff800036c5000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0078796930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0078796960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787969a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787969d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0078796a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0078796a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078796ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078796ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffff800036c4580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe007879b900 mi_switch() at mi_switch+0x16f/frame 0xfffffe007879b930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe007879b970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe007879b9a0 _sleep() at _sleep+0x358/frame 0xfffffe007879ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe007879ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007879bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007879bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff800036c4000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00787a0900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00787a0930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787a0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787a09a0 _sleep() at _sleep+0x358/frame 0xfffffe00787a0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00787a0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787a0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787a0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff800036eb580 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bd4df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bd4e10 trap() at trap+0x49/frame 0xfffffe0006bd4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd4f20 --- trap 0x13, rip = 0xffffffff80bf5fc1, rsp = 0xfffffe00787af9a0, rbp = 0xfffffe00787af9e0 --- vmem_periodic() at vmem_periodic+0xf1/frame 0xfffffe00787af9e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00787afa40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00787afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff800036ea580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00787e9930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00787e9960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787e99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787e99d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00787e9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00787e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff800036ea000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00787ee930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00787ee960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787ee9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787ee9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00787eea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00787eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff800036e9580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00787f3930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00787f3960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787f39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787f39d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00787f3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00787f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff800036e9000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00787f8930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00787f8960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787f89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787f89d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00787f8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00787f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff800036e8580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00787fd930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00787fd960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787fd9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787fd9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00787fda40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00787fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff800036e8000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0000471930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000471960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004719a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004719d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0000471a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000471a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000471ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000471ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff80003722580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0000476930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000476960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004769a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004769d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0000476a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000476a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000476ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000476ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003722000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe000047b930 mi_switch() at mi_switch+0x16f/frame 0xfffffe000047b960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000047b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000047b9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe000047ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000047ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000047bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000047bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff80003721580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0000480930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000480960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004809a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004809d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0000480a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000480a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000480ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000480ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003721000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0000485930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000485960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004859a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004859d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0000485a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000485a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000485ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000485ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff80003720580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe000048a930 mi_switch() at mi_switch+0x16f/frame 0xfffffe000048a960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000048a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048a9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe000048aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80003720000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe000048f930 mi_switch() at mi_switch+0x16f/frame 0xfffffe000048f960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000048f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048f9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe000048fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff8000371f580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0000494930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000494960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004949d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0000494a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000494a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000494ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000494ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff8000371f000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0000499930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000499960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004999d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0000499a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000499a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000499ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000499ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff800036ec580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe000049e930 mi_switch() at mi_switch+0x16f/frame 0xfffffe000049e960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000049e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000049e9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe000049ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000049ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000049eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000049eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff800037b9000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004a3930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004a3960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a39d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004a3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800037b8580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004a8930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004a8960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a89d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004a8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff800037b8000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004ad930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004ad960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004ad9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004ad9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004ada40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800037b7580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004b2930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004b2960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b29d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004b2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff800037b7000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004b7930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004b7960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b79d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004b7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff800037b6580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004bc930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004bc960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004bc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004bc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004bca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff800037b6000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004c1930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004c1960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c19d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004c1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff8000375e580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004c6930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004c6960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c69d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004c6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff8000375e000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004cb930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004cb960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004cb9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004cb9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004cba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff800037ce580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004d0930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004d0960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004d09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d09d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004d0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff800037f7580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe000058a900 mi_switch() at mi_switch+0x16f/frame 0xfffffe000058a930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000058a970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000058a9a0 _sleep() at _sleep+0x358/frame 0xfffffe000058aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000058aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff800038e7000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe000058f900 mi_switch() at mi_switch+0x16f/frame 0xfffffe000058f930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000058f970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000058f9a0 _sleep() at _sleep+0x358/frame 0xfffffe000058fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000058fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff800038e6580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0000594900 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000594930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000594970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005949a0 _sleep() at _sleep+0x358/frame 0xfffffe0000594a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000594a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000594ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000594ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff800038e6000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0000599900 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000599930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000599970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005999a0 _sleep() at _sleep+0x358/frame 0xfffffe0000599a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000599a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000599ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000599ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff800038e5580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe000059e900 mi_switch() at mi_switch+0x16f/frame 0xfffffe000059e930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000059e970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000059e9a0 _sleep() at _sleep+0x358/frame 0xfffffe000059ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000059ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000059eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000059eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff800038e5000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005a3900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005a3930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005a3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a39a0 _sleep() at _sleep+0x358/frame 0xfffffe00005a3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff800038e4580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005a8900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005a8930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005a8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a89a0 _sleep() at _sleep+0x358/frame 0xfffffe00005a8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff800038e4000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005ad900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005ad930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ad970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ad9a0 _sleep() at _sleep+0x358/frame 0xfffffe00005ada40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff800038e3580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005b2900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005b2930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005b2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b29a0 _sleep() at _sleep+0x358/frame 0xfffffe00005b2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff800038e3000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005b7900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005b7930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005b7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b79a0 _sleep() at _sleep+0x358/frame 0xfffffe00005b7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff800038eb580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005bc900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005bc930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005bc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005bc9a0 _sleep() at _sleep+0x358/frame 0xfffffe00005bca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff800038eb000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005c1900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005c1930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c1970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c19a0 _sleep() at _sleep+0x358/frame 0xfffffe00005c1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff800038ea580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005c6900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005c6930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c6970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c69a0 _sleep() at _sleep+0x358/frame 0xfffffe00005c6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff80006096580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e9e930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e9e960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e9e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e9e9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0006e9ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006e9ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e9eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e9eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff8000c1cb000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ed9930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ed9960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ed99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ed99d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0006ed9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ed9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ed9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ed9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff8000c1ca580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ede930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ede960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ede9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ede9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0006edea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006edea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006edeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006edeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffff8000c1ca000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ee3930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ee3960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ee39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ee39d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0006ee3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ee3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ee3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ee3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff8000c1c9580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ee8900 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ee8930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ee8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ee89a0 _sleep() at _sleep+0x358/frame 0xfffffe0006ee8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0006ee8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ee8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ee8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 2109 out of 32621 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2