panic: general protection fault, vmcore.481 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2022 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 14.0-CURRENT #0 ufs-n252521-bac0bd31f7b-dirty: Wed Jan 19 02:57:26 CET 2022 pho@mercat1.netperf.freebsd.org:/var/tmp/deviant3/sys/amd64/compile/PHO amd64 FreeBSD clang version 13.0.0 (git@github.com:llvm/llvm-project.git llvmorg-13.0.0-0-gd7b669b3a303) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.23-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33176580096 (31639 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 7 9 5 6 4 11 2 3 10 8 random: entropy device external interface kbd1 at kbdmux0 vtvga0: smbios0: at iomem 0xf0560-0xf057e smbios0: Version: 2.8, BCD Revision: 2.7 aesni0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 apei0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: EEPROM V1.63-0 eTrack 0x800009fa igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 417 files, 22140 used, 1243267 free (83 frags, 155398 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.00-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc10 /usr/local/lib/gcc8 /usr/local/lib/gcc9 /usr/local/lib/perl5/5.32/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: mercat1.netperf.freebsd.org. Setting up harvesting: PURE_RDRAND,[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . Autoloading module: acpi_wmi.ko Autoloading module: ichsmb.ko Autoloading module: ioat.ko acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 ichsmb0: port 0x580-0x59f mem 0xfb431000-0xfb4310ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 lo0: link state changed to UP Starting Network: lo0 igb0 igb1 mce0 mce1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 igb0: flags=8863 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:da inet6 fe80::ec4:7aff:fea8:cdda%igb0 prefixlen 64 scopeid 0x1 media: Ethernet autoselect status: no carrier nd6 options=21 igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 mce0: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 mce1: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Starting devd. igb0: link state changed to UP Autoloading module: acpi_wmi.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: ichsmb.ko Starting Network: mce0. mce0: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce1. mce1: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko Autoloading module: usbhid.ko ums0 on uhub4 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff80004983800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Recovering vi editor sessions:. Updating motd:. Clearing /tmp (X related). Starting syslogd. Starting watchdogd. No core dumps found. Setting date via ntp. 19 Jan 04:16:02 ntpdate[2595]: step time server 192.168.5.1 offset -0.876182 sec Starting rpcbind. NFS access cache time=60 Starting statd. Starting lockd. Starting powerd. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Mounting late filesystems:. Starting inetd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. sysctl: unknown oid 'debug.fail_point.pmap_allocpte_page_alloc' at line 12 Wed Jan 19 04:16 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Jan 19 04:16:35 mercat1 login[2736]: ROOT LOGIN (root) ON ttyu1 Last login: Thu Jan 6 17:13:52 on ttyu1 FreeBSD 14.0-CURRENT (PHO) #0 ufs-n252521-bac0bd31f7b-dirty: Wed Jan 19 02:57:26 CET 2022 78root@mercat1:~ # cd /usr/src/tools/test/stress2/misc root@mercat1:/usr/src/tools/test/stress2/misc # sh -x ./gjournal3.sh + id -u + [ 0 -ne 0 ] + . ../default.cfg + export 'SHELL=/bin/sh' + hostname + : /tmp/stress2.d/mercat1.netperf.freebsd.org + [ -f /tmp/stress2.d/mercat1.netperf.freebsd.org ] + . /tmp/stress2.d/mercat1.netperf.freebsd.org + testuser=test + export 'RUNDIR=/work/stressX' + export 'diskimage=/work/diskfile' + export 'RUNDIR=/work/stressX' + export 'RUNTIME=2m' + export 'VERBOSE=1' + export 'LOAD=20' + export 'INCARNATIONS=20' + export 'BLASTHOST=192.168.1.1' + export 'runRUNTIME=3d' + export 'runINCARNATIONS=1' + export 'runLOAD=100' + export 'swapINCARNATIONS=40' + export 'swapLOAD=80' + export 'syscallKILL=1' + export 'swapKILL=1' + export 'rwLOAD=70' + export 'mkdirLOAD=80' + export 'creatLOAD=80' + export 'symlinkLOAD=20' + export 'tcpKILL=1' + export 'shmINCARNATIONS=5' + [ -z '' ] + export 'TESTPROGS= testcases/rw/rw testcases/swap/swap testcases/creat/creat testcases/mkdir/mkdir testcases/thr1/thr1 testcases/udp/udp testcases/tcp/tcp ' + export 'diskimage=/work/diskfile' + export 'mntpoint=/mnt' + export 'testuser=test' + export 'mdstart=10' + export 'part=a' + export 'newfs_flags=-U' + pwd + export 'stress2origin=/usr/src/tools/test/stress2/misc' + dirname /usr/src/tools/test/stress2/misc + export 'stress2tools=/usr/src/tools/test/stress2/tools' + CC=cc + pwd + dirname /usr/src/tools/test/stress2/misc + top=/usr/src/tools/test/stress2 + STRESS2BIN=/usr/src/tools/test/stress2/bin + id test + swapinfo + wc -l + [ 2 -eq 1 ] + size=12g + jsize=8g + sysctl -n hw.usermem + [ 31 -le 12 ] + swapinfo -k + tail -1 + awk '{print int($4/1024/1024)}' + [ 64 -lt 12 ] + mount + grep /mnt + grep -q /dev/md + [ -c /dev/mdmd10 ] + mdconfig -a -t swap -s 12g -u 10 + gjournal load + gjournal label -s 8g md10 GEOM_JOURNAL: Journal 210169160: md10 contains data. GEOM_JOURNAL: Journal 210169160: md10 contains journal. GEOM_JOURNAL: Journal md10 clean. + sleep .5 GEOM_JOURNAL: BIO_FLUSH not supported by md10. + newfs -J /dev/md10.journal + mount -o async /dev/md10.journal /mnt + chmod 777 /mnt + export 'runRUNTIME=10m' + export 'RUNDIR=/mnt/stressX' + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + su test -c $'cd ../testcases/rw \t./rw -t 2m -i 10 -l 100 > /dev/null 2>&1' + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 + rm -f /mnt/.snap/snap + kill -0 2790 + mksnap_ffs /mnt /mnt/.snap/snap + sleep .2 Fatal trap 9: general protection fault while in kernel mode cpuid = 3; apic id = 03 instruction pointer = 0x20:0xffffffff80b3d2cf stack pointer = 0x28:0xfffffe00e4e3eeb0 frame pointer = 0x28:0xfffffe00e4e3eeb0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 13 (g_up) trap number = 9 panic: general protection fault cpuid = 3 time = 1642562325 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e4e3ecd0 vpanic() at vpanic+0x17f/frame 0xfffffe00e4e3ed20 panic() at panic+0x43/frame 0xfffffe00e4e3ed80 trap_fatal() at trap_fatal+0x385/frame 0xfffffe00e4e3ede0 calltrap() at calltrap+0x8/frame 0xfffffe00e4e3ede0 --- trap 0x9, rip = 0xffffffff80b3d2cf, rsp = 0xfffffe00e4e3eeb0, rbp = 0xfffffe00e4e3eeb0 --- g_bioq_first() at g_bioq_first+0x2f/frame 0xfffffe00e4e3eeb0 g_io_schedule_up() at g_io_schedule_up+0x62/frame 0xfffffe00e4e3eee0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00e4e3eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: panic [ thread pid 13 tid 100093 ] Stopped at kdb_enter+0x37: movq $0,0x128529e(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 2443 out of 32626 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 13 tid 100093 td 0xfffffe00e4d2dc80 kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e4e3ecd0 vpanic() at vpanic+0x1b0/frame 0xfffffe00e4e3ed20 panic() at panic+0x43/frame 0xfffffe00e4e3ed80 trap_fatal() at trap_fatal+0x385/frame 0xfffffe00e4e3ede0 calltrap() at calltrap+0x8/frame 0xfffffe00e4e3ede0 --- trap 0x9, rip = 0xffffffff80b3d2cf, rsp = 0xfffffe00e4e3eeb0, rbp = 0xfffffe00e4e3eeb0 --- g_bioq_first() at g_bioq_first+0x2f/frame 0xfffffe00e4e3eeb0 g_io_schedule_up() at g_io_schedule_up+0x62/frame 0xfffffe00e4e3eee0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00e4e3eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0x7c5600 curthread = 0xfffffe00e4c603a0: pid 11 tid 100003 critnest 1 "idle: cpu0" curpcb = 0xfffffe00e4c608b0 fpcurthread = none idlethread = 0xfffffe00e4c603a0: tid 100003 "idle: cpu0" self = 0xffffffff82410000 curpmap = 0xffffffff81e8c2d8 tssp = 0xffffffff82410384 rsp0 = 0xfffffe00377f1000 kcr3 = 0x8000000002367002 ucr3 = 0xffffffffffffffff scr3 = 0x44b0fca56 gs32p = 0xffffffff82410404 ldt = 0xffffffff82410444 tss = 0xffffffff82410434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bb287600 curthread = 0xfffffe00e4c5fc80: pid 11 tid 100004 critnest 1 "idle: cpu1" curpcb = 0xfffffe00e4c60190 fpcurthread = none idlethread = 0xfffffe00e4c5fc80: tid 100004 "idle: cpu1" self = 0xffffffff82411000 curpmap = 0xffffffff81e8c2d8 tssp = 0xffffffff82411384 rsp0 = 0xfffffe00377ec000 kcr3 = 0x8000000002367002 ucr3 = 0xffffffffffffffff scr3 = 0x44b5ec8d6 gs32p = 0xffffffff82411404 ldt = 0xffffffff82411444 tss = 0xffffffff82411434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bb294600 curthread = 0xfffffe00e4c5f560: pid 11 tid 100005 critnest 1 "idle: cpu2" curpcb = 0xfffffe00e4c5fa70 fpcurthread = none idlethread = 0xfffffe00e4c5f560: tid 100005 "idle: cpu2" self = 0xffffffff82412000 curpmap = 0xffffffff81e8c2d8 tssp = 0xffffffff82412384 rsp0 = 0xfffffe00377fb000 kcr3 = 0x8000000002367002 ucr3 = 0xffffffffffffffff scr3 = 0x44b58beed gs32p = 0xffffffff82412404 ldt = 0xffffffff82412444 tss = 0xffffffff82412434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bb2a1600 curthread = 0xfffffe00e4d2dc80: pid 13 tid 100093 critnest 1 "g_up" curpcb = 0xfffffe00e4d2e190 fpcurthread = none idlethread = 0xfffffe00e4c5ee40: tid 100006 "idle: cpu3" self = 0xffffffff82413000 curpmap = 0xffffffff81e8c2d8 tssp = 0xffffffff82413384 rsp0 = 0xfffffe00e4e3f000 kcr3 = 0x8000000002367002 ucr3 = 0xffffffffffffffff scr3 = 0x44b199e62 gs32p = 0xffffffff82413404 ldt = 0xffffffff82413444 tss = 0xffffffff82413434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bb2ae600 curthread = 0xfffffe00e4c5e720: pid 11 tid 100007 critnest 1 "idle: cpu4" curpcb = 0xfffffe00e4c5ec30 fpcurthread = none idlethread = 0xfffffe00e4c5e720: tid 100007 "idle: cpu4" self = 0xffffffff82414000 curpmap = 0xffffffff81e8c2d8 tssp = 0xffffffff82414384 rsp0 = 0xfffffe00e4831000 kcr3 = 0x8000000002367002 ucr3 = 0xffffffffffffffff scr3 = 0x44b1f2a1b gs32p = 0xffffffff82414404 ldt = 0xffffffff82414444 tss = 0xffffffff82414434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bb2bb600 curthread = 0xfffffe00e4c5e000: pid 11 tid 100008 critnest 1 "idle: cpu5" curpcb = 0xfffffe00e4c5e510 fpcurthread = none idlethread = 0xfffffe00e4c5e000: tid 100008 "idle: cpu5" self = 0xffffffff82415000 curpmap = 0xffffffff81e8c2d8 tssp = 0xffffffff82415384 rsp0 = 0xfffffe0037800000 kcr3 = 0x8000000002367002 ucr3 = 0xffffffffffffffff scr3 = 0x44b67a91e gs32p = 0xffffffff82415404 ldt = 0xffffffff82415444 tss = 0xffffffff82415434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bb2c8600 curthread = 0xfffffe00e4d0b1e0: pid 2785 tid 100221 critnest 0 "g_journal md10" curpcb = 0xfffffe00e4d0b6f0 fpcurthread = none idlethread = 0xfffffe00e4c66c80: tid 100009 "idle: cpu6" self = 0xffffffff82416000 curpmap = 0xffffffff81e8c2d8 tssp = 0xffffffff82416384 rsp0 = 0xfffffe014179f000 kcr3 = 0x8000000002367002 ucr3 = 0xffffffffffffffff scr3 = 0x44b5ecce7 gs32p = 0xffffffff82416404 ldt = 0xffffffff82416444 tss = 0xffffffff82416434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bb2d5600 curthread = 0xfffffe00e4c66560: pid 11 tid 100010 critnest 1 "idle: cpu7" curpcb = 0xfffffe00e4c66a70 fpcurthread = none idlethread = 0xfffffe00e4c66560: tid 100010 "idle: cpu7" self = 0xffffffff82417000 curpmap = 0xffffffff81e8c2d8 tssp = 0xffffffff82417384 rsp0 = 0xfffffe00e4836000 kcr3 = 0x8000000002367002 ucr3 = 0xffffffffffffffff scr3 = 0x2ede4dec8 gs32p = 0xffffffff82417404 ldt = 0xffffffff82417444 tss = 0xffffffff82417434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bb2e2600 curthread = 0xfffffe00e4c65e40: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffffe00e4c66350 fpcurthread = none idlethread = 0xfffffe00e4c65e40: tid 100011 "idle: cpu8" self = 0xffffffff82418000 curpmap = 0xffffffff81e8c2d8 tssp = 0xffffffff82418384 rsp0 = 0xfffffe00e4845000 kcr3 = 0x8000000002367002 ucr3 = 0xffffffffffffffff scr3 = 0x44b58bc19 gs32p = 0xffffffff82418404 ldt = 0xffffffff82418444 tss = 0xffffffff82418434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bb2ef600 curthread = 0xfffffe00e4c65720: pid 11 tid 100012 critnest 1 "idle: cpu9" curpcb = 0xfffffe00e4c65c30 fpcurthread = none idlethread = 0xfffffe00e4c65720: tid 100012 "idle: cpu9" self = 0xffffffff82419000 curpmap = 0xffffffff81e8c2d8 tssp = 0xffffffff82419384 rsp0 = 0xfffffe00e4840000 kcr3 = 0x8000000002367002 ucr3 = 0xffffffffffffffff scr3 = 0x44b16d867 gs32p = 0xffffffff82419404 ldt = 0xffffffff82419444 tss = 0xffffffff82419434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bb2fc600 curthread = 0xfffffe00e4c65000: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffffe00e4c65510 fpcurthread = none idlethread = 0xfffffe00e4c65000: tid 100013 "idle: cpu10" self = 0xffffffff8241a000 curpmap = 0xffffffff81e8c2d8 tssp = 0xffffffff8241a384 rsp0 = 0xfffffe00e484f000 kcr3 = 0x8000000002367002 ucr3 = 0xffffffffffffffff scr3 = 0x2edc09ad7 gs32p = 0xffffffff8241a404 ldt = 0xffffffff8241a444 tss = 0xffffffff8241a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bb309600 curthread = 0xfffffe00e4c62740: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffffe00e4c62c50 fpcurthread = none idlethread = 0xfffffe00e4c62740: tid 100014 "idle: cpu11" self = 0xffffffff8241b000 curpmap = 0xffffffff81e8c2d8 tssp = 0xffffffff8241b384 rsp0 = 0xfffffe00e484a000 kcr3 = 0x8000000002367002 ucr3 = 0xffffffffffffffff scr3 = 0x44b5d1eb0 gs32p = 0xffffffff8241b404 ldt = 0xffffffff8241b444 tss = 0xffffffff8241b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 2804 (rw) thread 0xfffffe0144397020 (100303) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037972240) locked @ kern/vfs_bio.c:3950 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe0151423c28) locked @ kern/vfs_vnops.c:1164 Process 2803 (rw) thread 0xfffffe0144397740 (100302) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0038532ed0) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00384d4ba0) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0038972760) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037d25840) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003867b120) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00378f0550) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037b8ff10) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037c3ee20) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0038926460) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037f10630) locked @ kern/vfs_bio.c:3950 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe01444ba9d0) locked @ kern/vfs_vnops.c:1164 Process 2802 (rw) thread 0xfffffe0144597000 (100301) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037acbe20) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037da25b0) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00387ff0c0) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00379bf920) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003795fec0) locked @ kern/vfs_bio.c:3950 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe014e5d1a38) locked @ kern/vfs_vnops.c:1164 Process 2801 (rw) thread 0xfffffe0144597720 (100300) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037eed9b0) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037e631a0) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037a2fc80) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037db4290) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00378b5f30) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0038337140) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003829e150) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00383cbef0) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003806da60) locked @ kern/vfs_bio.c:3950 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe016837c070) locked @ kern/vfs_vnops.c:1164 Process 2800 (rw) thread 0xfffffe0144597e40 (100299) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037d537a0) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037b9f430) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037908590) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0038a0ad60) locked @ kern/vfs_bio.c:3950 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe010e394e80) locked @ kern/vfs_vnops.c:1164 Process 2799 (rw) thread 0xfffffe0143619740 (100298) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0038252840) locked @ kern/vfs_bio.c:3950 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe01443ab588) locked @ kern/vfs_subr.c:2993 Process 2798 (rw) thread 0xfffffe0143682000 (100297) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0038977390) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0038605100) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037cc6b20) locked @ kern/vfs_bio.c:3950 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe014e5f37e0) locked @ kern/vfs_vnops.c:1164 Process 2797 (rw) thread 0xfffffe0143682720 (100296) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037ee6c60) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003791fbe0) locked @ kern/vfs_bio.c:3950 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe01444690d8) locked @ kern/vfs_vnops.c:1164 Process 2796 (rw) thread 0xfffffe0143682e40 (100282) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00380cd4c0) locked @ kern/vfs_bio.c:3950 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00386ba6c0) locked @ kern/vfs_bio.c:3950 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe01765fb0d8) locked @ kern/vfs_vnops.c:1164 Process 2795 (rw) thread 0xfffffe01428b43a0 (100279) exclusive lockmgr ufs (ufs) r = 0 (0xfffffe01443fba38) locked @ kern/vfs_vnops.c:1164 Process 2784 (g_journal switcher) thread 0xfffffe014410b900 (100278) exclusive lockmgr snaplk (snaplk) r = 0 (0xfffff80139903830) locked @ ufs/ffs/ffs_snapshot.c:2349 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe01444489d0) locked @ kern/vfs_subr.c:2993 Process 13 (geom) thread 0xfffffe00e4d2dc80 (100093) exclusive sleep mutex bio queue (bio queue) r = 0 (0xffffffff81e8af10) locked @ geom/geom_io.c:96 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffffe0144448960: type VDIR usecount 3, writecount 0, refcount 3 seqc users 0 mountedhere 0 hold count flags () flags (VMP_LAZYLIST) v_object 0xfffff80139c4f420 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe014410b900 (pid 2784, g_journal switcher, tid 100278) #0 0xffffffff80bd415f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3ffbd at ffs_lock+0x9d #2 0xffffffff811a374c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e954 at _vn_lock+0x54 #4 0xffffffff80cf613a at vget_finish+0x7a #5 0xffffffff80f3d463 at ffs_sync+0x193 #6 0xffffffff8255153e at g_journal_switcher+0x44e #7 0xffffffff80bbd3a0 at fork_exit+0x80 #8 0xffffffff810a8aee at fork_trampoline+0xe nlink=2, effnlink=2, size=512, extsize 0 generation=afcb26be, uid=2007, gid=0, flags=0x0 ino 160259, on dev md10.journal vnode 0xfffffe01443ab518: type VREG usecount 0, writecount 0, refcount 3 seqc users 0 hold count flags () flags (VIRF_PGREAD|VV_NOSYNC|VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff801399d2840 ref 0 pages 12 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe0143619740 (pid 2799, rw, tid 100298) #0 0xffffffff80bd415f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3ffbd at ffs_lock+0x9d #2 0xffffffff811a374c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e954 at _vn_lock+0x54 #4 0xffffffff80cf613a at vget_finish+0x7a #5 0xffffffff80ce41fd at vfs_hash_get+0xcd #6 0xffffffff80f3b548 at ffs_vgetf+0x58 #7 0xffffffff80f4a35d at ufs_lookup_ino+0xd6d #8 0xffffffff811a013a at VOP_CACHEDLOOKUP_APV+0x5a #9 0xffffffff80cd58c6 at vfs_cache_lookup+0xa6 #10 0xffffffff8119ff7a at VOP_LOOKUP_APV+0x5a #11 0xffffffff80ce6d01 at lookup+0x4c1 #12 0xffffffff80ce5b98 at namei+0x3f8 #13 0xffffffff80d06215 at kern_funlinkat+0x175 #14 0xffffffff80d06098 at sys_unlink+0x28 #15 0xffffffff810d7455 at amd64_syscall+0x145 #16 0xffffffff810a838b at fast_syscall_common+0xf8 nlink=0, effnlink=0, size=76329984, extsize 0 generation=6c9e1082, uid=2007, gid=0, flags=0x0 ino 160272, on dev md10.journal vnode 0xfffffe010e394e10: type VREG usecount 1, writecount 1, refcount 1858 seqc users 1 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff801399d9e70 ref 0 pages 14848 cleanbuf 1851 dirtybuf 5 lock type ufs: EXCL by thread 0xfffffe0144597e40 (pid 2800, rw, tid 100299) #0 0xffffffff80bd415f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3ffbd at ffs_lock+0x9d #2 0xffffffff811a374c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e954 at _vn_lock+0x54 #4 0xffffffff80d138c8 at vn_write+0x1e8 #5 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #6 0xffffffff80d0f303 at vn_io_fault1+0x163 #7 0xffffffff80d0cc7a at vn_io_fault+0x1aa #8 0xffffffff80c7c591 at dofilewrite+0x81 #9 0xffffffff80c7c0c0 at sys_write+0xc0 #10 0xffffffff810d7455 at amd64_syscall+0x145 #11 0xffffffff810a838b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=60784640, extsize 0 generation=8603ed3c, uid=2007, gid=0, flags=0x0 ino 160265, on dev md10.journal vnode 0xfffffe01443fb9c8: type VREG usecount 1, writecount 1, refcount 1692 seqc users 0 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff80139d13738 ref 0 pages 13520 cleanbuf 1689 dirtybuf 1 lock type ufs: EXCL by thread 0xfffffe01428b43a0 (pid 2795, rw, tid 100279) #0 0xffffffff80bd415f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3ffbd at ffs_lock+0x9d #2 0xffffffff811a374c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e954 at _vn_lock+0x54 #4 0xffffffff80d138c8 at vn_write+0x1e8 #5 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #6 0xffffffff80d0f303 at vn_io_fault1+0x163 #7 0xffffffff80d0cc7a at vn_io_fault+0x1aa #8 0xffffffff80c7c591 at dofilewrite+0x81 #9 0xffffffff80c7c0c0 at sys_write+0xc0 #10 0xffffffff810d7455 at amd64_syscall+0x145 #11 0xffffffff810a838b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=55345152, extsize 0 generation=dfcecd6e, uid=2007, gid=0, flags=0x0 ino 160267, on dev md10.journal vnode 0xfffffe014e5f3770: type VREG usecount 1, writecount 1, refcount 873 seqc users 1 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff801a622f108 ref 0 pages 6968 cleanbuf 867 dirtybuf 4 lock type ufs: EXCL by thread 0xfffffe0143682000 (pid 2798, rw, tid 100297) #0 0xffffffff80bd415f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3ffbd at ffs_lock+0x9d #2 0xffffffff811a374c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e954 at _vn_lock+0x54 #4 0xffffffff80d138c8 at vn_write+0x1e8 #5 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #6 0xffffffff80d0f303 at vn_io_fault1+0x163 #7 0xffffffff80d0cc7a at vn_io_fault+0x1aa #8 0xffffffff80c7c591 at dofilewrite+0x81 #9 0xffffffff80c7c0c0 at sys_write+0xc0 #10 0xffffffff810d7455 at amd64_syscall+0x145 #11 0xffffffff810a838b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=28508160, extsize 0 generation=618f1760, uid=2007, gid=0, flags=0x0 ino 160268, on dev md10.journal vnode 0xfffffe01765fb068: type VREG usecount 1, writecount 1, refcount 2075 seqc users 1 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff801399cf210 ref 0 pages 16584 cleanbuf 2039 dirtybuf 34 lock type ufs: EXCL by thread 0xfffffe0143682e40 (pid 2796, rw, tid 100282) #0 0xffffffff80bd415f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3ffbd at ffs_lock+0x9d #2 0xffffffff811a374c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e954 at _vn_lock+0x54 #4 0xffffffff80d138c8 at vn_write+0x1e8 #5 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #6 0xffffffff80d0f303 at vn_io_fault1+0x163 #7 0xffffffff80d0cc7a at vn_io_fault+0x1aa #8 0xffffffff80c7c591 at dofilewrite+0x81 #9 0xffffffff80c7c0c0 at sys_write+0xc0 #10 0xffffffff810d7455 at amd64_syscall+0x145 #11 0xffffffff810a838b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=67895296, extsize 0 generation=988fcd63, uid=2007, gid=0, flags=0x0 ino 240387, on dev md10.journal vnode 0xfffffe0144469068: type VREG usecount 1, writecount 1, refcount 1924 seqc users 1 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff8000494ba50 ref 0 pages 15376 cleanbuf 1919 dirtybuf 3 lock type ufs: EXCL by thread 0xfffffe0143682720 (pid 2797, rw, tid 100296) #0 0xffffffff80bd415f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3ffbd at ffs_lock+0x9d #2 0xffffffff811a374c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e954 at _vn_lock+0x54 #4 0xffffffff80d138c8 at vn_write+0x1e8 #5 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #6 0xffffffff80d0f303 at vn_io_fault1+0x163 #7 0xffffffff80d0cc7a at vn_io_fault+0x1aa #8 0xffffffff80c7c591 at dofilewrite+0x81 #9 0xffffffff80c7c0c0 at sys_write+0xc0 #10 0xffffffff810d7455 at amd64_syscall+0x145 #11 0xffffffff810a838b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=62947328, extsize 0 generation=ad10e2a4, uid=2007, gid=0, flags=0x0 ino 240386, on dev md10.journal vnode 0xfffffe016837c000: type VREG usecount 1, writecount 1, refcount 609 seqc users 1 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff801a622f000 ref 0 pages 4856 cleanbuf 597 dirtybuf 10 lock type ufs: EXCL by thread 0xfffffe0144597720 (pid 2801, rw, tid 100300) #0 0xffffffff80bd415f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3ffbd at ffs_lock+0x9d #2 0xffffffff811a374c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e954 at _vn_lock+0x54 #4 0xffffffff80d138c8 at vn_write+0x1e8 #5 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #6 0xffffffff80d0f303 at vn_io_fault1+0x163 #7 0xffffffff80d0cc7a at vn_io_fault+0x1aa #8 0xffffffff80c7c591 at dofilewrite+0x81 #9 0xffffffff80c7c0c0 at sys_write+0xc0 #10 0xffffffff810d7455 at amd64_syscall+0x145 #11 0xffffffff810a838b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=19857408, extsize 0 generation=b03ef669, uid=2007, gid=0, flags=0x0 ino 160271, on dev md10.journal vnode 0xfffffe016837c4b0: type VREG usecount 1, writecount 0, refcount 57 seqc users 0 hold count flags () flags (VIRF_PGREAD|VV_SYSTEM|VMP_LAZYLIST) v_object 0xfffff802edfe0000 ref 0 pages 440 cleanbuf 48 dirtybuf 7 lock type snaplk: EXCL by thread 0xfffffe014410b900 (pid 2784, g_journal switcher, tid 100278) with exclusive waiters pending #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80f1ad63 at ffs_copyonwrite+0x1b3 #3 0xffffffff80f3edbf at ffs_geom_strategy+0xcf #4 0xffffffff80f53e83 at ufs_strategy+0x83 #5 0xffffffff811a3bc1 at VOP_STRATEGY_APV+0x61 #6 0xffffffff80cc766e at bufstrategy+0x3e #7 0xffffffff80cc750c at bufwrite+0x24c #8 0xffffffff80f411b3 at ffs_syncvnode+0x133 #9 0xffffffff80f3d4bd at ffs_sync+0x1ed #10 0xffffffff8255153e at g_journal_switcher+0x44e #11 0xffffffff80bbd3a0 at fork_exit+0x80 #12 0xffffffff810a8aee at fork_trampoline+0xe nlink=1, effnlink=1, size=4295000064, extsize 0 generation=674de22c, uid=0, gid=5, flags=0x200000 ino 4, on dev md10.journal vnode 0xfffffe014e5d19c8: type VREG usecount 1, writecount 1, refcount 527 seqc users 1 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff802edfd2000 ref 0 pages 4200 cleanbuf 488 dirtybuf 37 lock type ufs: EXCL by thread 0xfffffe0144597000 (pid 2802, rw, tid 100301) #0 0xffffffff80bd415f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3ffbd at ffs_lock+0x9d #2 0xffffffff811a374c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e954 at _vn_lock+0x54 #4 0xffffffff80d138c8 at vn_write+0x1e8 #5 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #6 0xffffffff80d0f303 at vn_io_fault1+0x163 #7 0xffffffff80d0cc7a at vn_io_fault+0x1aa #8 0xffffffff80c7c591 at dofilewrite+0x81 #9 0xffffffff80c7c0c0 at sys_write+0xc0 #10 0xffffffff810d7455 at amd64_syscall+0x145 #11 0xffffffff810a838b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=17170432, extsize 0 generation=95701272, uid=2007, gid=0, flags=0x0 ino 160270, on dev md10.journal vnode 0xfffffe01444ba960: type VREG usecount 1, writecount 1, refcount 351 seqc users 1 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff80139c77b58 ref 0 pages 2792 cleanbuf 338 dirtybuf 11 lock type ufs: EXCL by thread 0xfffffe0144397740 (pid 2803, rw, tid 100302) #0 0xffffffff80bd415f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3ffbd at ffs_lock+0x9d #2 0xffffffff811a374c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e954 at _vn_lock+0x54 #4 0xffffffff80d138c8 at vn_write+0x1e8 #5 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #6 0xffffffff80d0f303 at vn_io_fault1+0x163 #7 0xffffffff80d0cc7a at vn_io_fault+0x1aa #8 0xffffffff80c7c591 at dofilewrite+0x81 #9 0xffffffff80c7c0c0 at sys_write+0xc0 #10 0xffffffff810d7455 at amd64_syscall+0x145 #11 0xffffffff810a838b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=11403264, extsize 0 generation=3b5cc394, uid=2007, gid=0, flags=0x0 ino 160266, on dev md10.journal vnode 0xfffffe0151423bb8: type VREG usecount 1, writecount 1, refcount 4 seqc users 1 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff801a622f840 ref 0 pages 15 cleanbuf 0 dirtybuf 2 lock type ufs: EXCL by thread 0xfffffe0144397020 (pid 2804, rw, tid 100303) #0 0xffffffff80bd415f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3ffbd at ffs_lock+0x9d #2 0xffffffff811a374c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e954 at _vn_lock+0x54 #4 0xffffffff80d138c8 at vn_write+0x1e8 #5 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #6 0xffffffff80d0f303 at vn_io_fault1+0x163 #7 0xffffffff80d0cc7a at vn_io_fault+0x1aa #8 0xffffffff80c7c591 at dofilewrite+0x81 #9 0xffffffff80c7c0c0 at sys_write+0xc0 #10 0xffffffff810d7455 at amd64_syscall+0x145 #11 0xffffffff810a838b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=61440, extsize 0 generation=2a253123, uid=2007, gid=0, flags=0x0 ino 160269, on dev md10.journal db:1:pho1> show mount 0xfffffe010e392700 /dev/gpt/work on / (ufs) 0xfffffe010e393280 devfs on /dev (devfs) 0xfffffe0143590280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe01445b4280 /dev/md10.journal on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 84075 Buf domain 0 freebufs 12821 lofreebufs 219 hifreebufs 329 bufspace 75616256 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 18 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2135 (69844992) dirtyq count 50 (1609728) wakeup 0 lim 25 CPU 1, 3, 10, 22, 0, 8, 19, 8, 18, 11, 23, 4, Locked buffers: 41 space 1343488 Total buffers: 5269 space 75616256 Buf domain 1 freebufs 13057 lofreebufs 219 hifreebufs 329 bufspace 67993600 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 36 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1875 (61411328) dirtyq count 36 (1175552) wakeup 0 lim 25 CPU 9, 0, 7, 14, 16, 5, 18, 16, 24, 22, 18, 16, Locked buffers: 3 space 94208 Total buffers: 2115 space 67993600 Buf domain 2 freebufs 14207 lofreebufs 219 hifreebufs 329 bufspace 30343168 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 11 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 824 (27000832) dirtyq count 11 (360448) wakeup 0 lim 25 CPU 0, 0, 4, 13, 0, 15, 13, 21, 7, 17, 0, 0, Locked buffers: 4 space 131072 Total buffers: 3372 space 30343168 Buf domain 3 freebufs 15132 lofreebufs 219 hifreebufs 329 bufspace 4096 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 0 (0) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 769 space 4096 Buf domain 4 freebufs 12737 lofreebufs 219 hifreebufs 329 bufspace 78139392 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 42 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2248 (73289728) dirtyq count 42 (1376256) wakeup 0 lim 25 CPU 3, 4, 9, 18, 0, 14, 20, 7, 13, 16, 2, 0, Locked buffers: 9 space 294912 Total buffers: 3744 space 78139392 Buf domain 5 freebufs 12854 lofreebufs 219 hifreebufs 329 bufspace 74481664 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 15 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2102 (68681728) dirtyq count 15 (491520) wakeup 0 lim 25 CPU 9, 22, 3, 20, 23, 16, 19, 13, 24, 4, 6, 3, Locked buffers: 12 space 393216 Total buffers: 2290 space 74481664 Buf domain 6 freebufs 15122 lofreebufs 219 hifreebufs 329 bufspace 237568 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 4 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 5 (69632) dirtyq count 5 (135168) wakeup 0 lim 25 CPU 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, Locked buffers: 2 space 36864 Total buffers: 4297 space 237568 db:1:pho1> show lockedbufs buf at 0xfffffe00378b5eb0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe016837c178), b_data = 0xfffffe00e472c000 , b_blkno = 2961216, b_lblkno = 600, b_vp = 0xfffffe016837c000, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801a622f000, 0x12c0, 0x3c68a7000),(0xfffff801a622f000, 0x12c1, 0x44df86000),(0xfffff801a622f000, 0x12c2, 0x3eeaef000),(0xfffff801a622f000, 0x12c3, 0x237182000),(0xfffff801a622f000, 0x12c4, 0x422da5000),(0xfffff801a622f000, 0x12c5, 0x445d2f000),(0xfffff801a622f000, 0x12c6, 0x284a01000),(0xfffff801a622f000, 0x12c7, 0x44c58e000) lock type bufwait: EXCL by thread 0xfffffe0144597720 (pid 2801, rw, tid 100300) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4075 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00378cc7c0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3881920, b_lblkno = 1659, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x33d8, 0x44cba7000),(0xfffff80139d13738, 0x33d9, 0x3a1685000),(0xfffff80139d13738, 0x33da, 0x261a07000),(0xfffff80139d13738, 0x33db, 0x254bdc000),(0xfffff80139d13738, 0x33dc, 0x304a13000),(0xfffff80139d13738, 0x33dd, 0x3e7289000),(0xfffff80139d13738, 0x33de, 0x3a1f86000),(0xfffff80139d13738, 0x33df, 0x287219000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 3441 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00378ce8e0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3882624, b_lblkno = 1670, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3430, 0x1d0789000),(0xfffff80139d13738, 0x3431, 0x304d44000),(0xfffff80139d13738, 0x3432, 0x2b9c2d000),(0xfffff80139d13738, 0x3433, 0x3ed8c6000),(0xfffff80139d13738, 0x3434, 0x333c03000),(0xfffff80139d13738, 0x3435, 0x3309e0000),(0xfffff80139d13738, 0x3436, 0x449819000),(0xfffff80139d13738, 0x3437, 0x477696000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4527 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00378f04d0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01444baad8), b_data = 0xfffffe00e472c000 , b_blkno = 2882752, b_lblkno = 341, b_vp = 0xfffffe01444ba960, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139c77b58, 0xaa8, 0x2546e8000),(0xfffff80139c77b58, 0xaa9, 0x447983000),(0xfffff80139c77b58, 0xaaa, 0x447982000),(0xfffff80139c77b58, 0xaab, 0x447985000),(0xfffff80139c77b58, 0xaac, 0x447984000),(0xfffff80139c77b58, 0xaad, 0x448b9b000),(0xfffff80139c77b58, 0xaae, 0x448b9a000),(0xfffff80139c77b58, 0xaaf, 0x331789000) lock type bufwait: EXCL by thread 0xfffffe0144397740 (pid 2803, rw, tid 100302) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 44801 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00379063f0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3882752, b_lblkno = 1672, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3440, 0x2dc03a000),(0xfffff80139d13738, 0x3441, 0x3c2477000),(0xfffff80139d13738, 0x3442, 0x254774000),(0xfffff80139d13738, 0x3443, 0x25646f000),(0xfffff80139d13738, 0x3444, 0x423259000),(0xfffff80139d13738, 0x3445, 0x248da0000),(0xfffff80139d13738, 0x3446, 0x44877e000),(0xfffff80139d13738, 0x3447, 0x39f303000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 2145 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0037908510 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe010e394f88), b_data = 0xfffffe00e472c000 , b_blkno = 2948544, b_lblkno = 1851, b_vp = 0xfffffe010e394e10, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801399d9e70, 0x39d8, 0x457047000),(0xfffff801399d9e70, 0x39d9, 0x457046000),(0xfffff801399d9e70, 0x39da, 0x3eeab1000),(0xfffff801399d9e70, 0x39db, 0x3eeab0000),(0xfffff801399d9e70, 0x39dc, 0x3c699b000),(0xfffff801399d9e70, 0x39dd, 0x3c699a000),(0xfffff801399d9e70, 0x39de, 0x257c9d000),(0xfffff801399d9e70, 0x39df, 0x257c9c000) lock type bufwait: EXCL by thread 0xfffffe0144597e40 (pid 2800, rw, tid 100299) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 2652 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe003791fb60 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01444691e0), b_data = 0xfffffe00e472c000 , b_blkno = 4214272, b_lblkno = 1920, b_vp = 0xfffffe0144469068, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff8000494ba50, 0x3c00, 0x1c1170000),(0xfffff8000494ba50, 0x3c01, 0x39b96d000),(0xfffff8000494ba50, 0x3c02, 0x39b96c000),(0xfffff8000494ba50, 0x3c03, 0x33363f000),(0xfffff8000494ba50, 0x3c04, 0x33363e000),(0xfffff8000494ba50, 0x3c05, 0x281943000),(0xfffff8000494ba50, 0x3c06, 0x281942000),(0xfffff8000494ba50, 0x3c07, 0x3de38d000) lock type bufwait: EXCL by thread 0xfffffe0143682720 (pid 2797, rw, tid 100296) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cdddcd at cluster_read+0xed #4 0xffffffff80f13088 at ffs_balloc_ufs2+0x1d38 #5 0xffffffff80f3f9a2 at ffs_write+0x262 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 12966 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: brelse 24: bqrelse 25: bufdone 26: cluster_wbuild 27: brelse 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe0037944c50 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3883776, b_lblkno = 1688, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x34c0, 0x2beca6000),(0xfffff80139d13738, 0x34c1, 0x2bb1ff000),(0xfffff80139d13738, 0x34c2, 0x2b9d25000),(0xfffff80139d13738, 0x34c3, 0x12479e000),(0xfffff80139d13738, 0x34c4, 0x254aab000),(0xfffff80139d13738, 0x34c5, 0x302c88000),(0xfffff80139d13738, 0x34c6, 0x3079ef000),(0xfffff80139d13738, 0x34c7, 0x2bed29000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 2479 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe003795fe40 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e5d1b40), b_data = 0xfffffe00e472c000 , b_blkno = 2961536, b_lblkno = 523, b_vp = 0xfffffe014e5d19c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff802edfd2000, 0x1058, 0x2dc51b000),(0xfffff802edfd2000, 0x1059, 0x2dc51a000),(0xfffff802edfd2000, 0x105a, 0x3e722b000),(0xfffff802edfd2000, 0x105b, 0x3e722a000),(0xfffff802edfd2000, 0x105c, 0x1ba7d1000),(0xfffff802edfd2000, 0x105d, 0x1ba7d0000),(0xfffff802edfd2000, 0x105e, 0x44c13d000),(0xfffff802edfd2000, 0x105f, 0x44c13c000) lock type bufwait: EXCL by thread 0xfffffe0144597000 (pid 2802, rw, tid 100301) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cdddcd at cluster_read+0xed #4 0xffffffff80f13088 at ffs_balloc_ufs2+0x1d38 #5 0xffffffff80f3f9a2 at ffs_write+0x262 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4160 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: brelse 24: bqrelse 25: bufdone 26: cluster_wbuild 27: brelse 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe00379721c0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 28672, b_bcount = 28672, b_resid = 0 b_bufobj = (0xfffffe0151423d30), b_data = 0xfffffe00e472c000 , b_blkno = 2662976, b_lblkno = 1, b_vp = 0xfffffe0151423bb8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 7, pages(OBJ, IDX, PA): (0xfffff801a622f840, 0x8, 0x44d8c3000),(0xfffff801a622f840, 0x9, 0x44d8c2000),(0xfffff801a622f840, 0xa, 0x304991000),(0xfffff801a622f840, 0xb, 0x304990000),(0xfffff801a622f840, 0xc, 0x302d75000),(0xfffff801a622f840, 0xd, 0x302d74000),(0xfffff801a622f840, 0xe, 0x268caf000) lock type bufwait: EXCL by thread 0xfffffe0144397020 (pid 2804, rw, tid 100303) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80f09c59 at ffs_realloccg+0x269 #5 0xffffffff80f11884 at ffs_balloc_ufs2+0x534 #6 0xffffffff80f3f9a2 at ffs_write+0x262 #7 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #8 0xffffffff80d139dc at vn_write+0x2fc #9 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #10 0xffffffff80d0f303 at vn_io_fault1+0x163 #11 0xffffffff80d0cc7a at vn_io_fault+0x1aa #12 0xffffffff80c7c591 at dofilewrite+0x81 #13 0xffffffff80c7c0c0 at sys_write+0xc0 #14 0xffffffff810d7455 at amd64_syscall+0x145 #15 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4150 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: brelse 24: bqrelse 25: bufdone 26: cluster_wbuild 27: brelse 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe00379bf8a0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e5d1b40), b_data = 0xfffffe00e472c000 , b_blkno = 2960768, b_lblkno = 519, b_vp = 0xfffffe014e5d19c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff802edfd2000, 0x1038, 0x2581e1000),(0xfffff802edfd2000, 0x1039, 0x2581e0000),(0xfffff802edfd2000, 0x103a, 0x280c03000),(0xfffff802edfd2000, 0x103b, 0x280c02000),(0xfffff802edfd2000, 0x103c, 0x306ccb000),(0xfffff802edfd2000, 0x103d, 0x306cca000),(0xfffff802edfd2000, 0x103e, 0x39f0df000),(0xfffff802edfd2000, 0x103f, 0x39f0de000) lock type bufwait: EXCL by thread 0xfffffe0144597000 (pid 2802, rw, tid 100301) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 5310 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00379f9180 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3882112, b_lblkno = 1662, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x33f0, 0x477486000),(0xfffff80139d13738, 0x33f1, 0x1b7a88000),(0xfffff80139d13738, 0x33f2, 0x3de31b000),(0xfffff80139d13738, 0x33f3, 0x44daea000),(0xfffff80139d13738, 0x33f4, 0x2656a2000),(0xfffff80139d13738, 0x33f5, 0x307996000),(0xfffff80139d13738, 0x33f6, 0x286dca000),(0xfffff80139d13738, 0x33f7, 0x30781d000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 5568 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe0037a2fc00 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe016837c178), b_data = 0xfffffe00e472c000 , b_blkno = 2961344, b_lblkno = 602, b_vp = 0xfffffe016837c000, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801a622f000, 0x12d0, 0x2371a1000),(0xfffff801a622f000, 0x12d1, 0x2dbb0e000),(0xfffff801a622f000, 0x12d2, 0x2dbb07000),(0xfffff801a622f000, 0x12d3, 0x24e9c8000),(0xfffff801a622f000, 0x12d4, 0x1a561c000),(0xfffff801a622f000, 0x12d5, 0x330911000),(0xfffff801a622f000, 0x12d6, 0x265764000),(0xfffff801a622f000, 0x12d7, 0x25bdea000) lock type bufwait: EXCL by thread 0xfffffe0144597720 (pid 2801, rw, tid 100300) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 5488 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0037acbda0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e5d1b40), b_data = 0xfffffe00e472c000 , b_blkno = 2960960, b_lblkno = 522, b_vp = 0xfffffe014e5d19c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff802edfd2000, 0x1050, 0x422f5b000),(0xfffff802edfd2000, 0x1051, 0x422f5a000),(0xfffff802edfd2000, 0x1052, 0x264335000),(0xfffff802edfd2000, 0x1053, 0x264334000),(0xfffff802edfd2000, 0x1054, 0x1c3d01000),(0xfffff802edfd2000, 0x1055, 0x1c3d00000),(0xfffff802edfd2000, 0x1056, 0x44d697000),(0xfffff802edfd2000, 0x1057, 0x44d696000) lock type bufwait: EXCL by thread 0xfffffe0144597000 (pid 2802, rw, tid 100301) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 19786 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0037b8fe90 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01444baad8), b_data = 0xfffffe00e472c000 , b_blkno = 2882688, b_lblkno = 340, b_vp = 0xfffffe01444ba960, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139c77b58, 0xaa0, 0x39d6ca000),(0xfffff80139c77b58, 0xaa1, 0x257f7f000),(0xfffff80139c77b58, 0xaa2, 0x257f7e000),(0xfffff80139c77b58, 0xaa3, 0x330889000),(0xfffff80139c77b58, 0xaa4, 0x330888000),(0xfffff80139c77b58, 0xaa5, 0x268c8b000),(0xfffff80139c77b58, 0xaa6, 0x268c8a000),(0xfffff80139c77b58, 0xaa7, 0x2546e9000) lock type bufwait: EXCL by thread 0xfffffe0144397740 (pid 2803, rw, tid 100302) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 46528 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0037b9f3b0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe010e394f88), b_data = 0xfffffe00e472c000 , b_blkno = 2948608, b_lblkno = 1852, b_vp = 0xfffffe010e394e10, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801399d9e70, 0x39e0, 0x42ae91000),(0xfffff801399d9e70, 0x39e1, 0x42ae90000),(0xfffff801399d9e70, 0x39e2, 0x261aa4000),(0xfffff801399d9e70, 0x39e3, 0x252c4f000),(0xfffff801399d9e70, 0x39e4, 0x252c4e000),(0xfffff801399d9e70, 0x39e5, 0x252c4d000),(0xfffff801399d9e70, 0x39e6, 0x252c4c000),(0xfffff801399d9e70, 0x39e7, 0x1f6ba7000) lock type bufwait: EXCL by thread 0xfffffe0144597e40 (pid 2800, rw, tid 100299) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 5104 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe0037bd3320 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3883456, b_lblkno = 1683, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3498, 0x2653d7000),(0xfffff80139d13738, 0x3499, 0x25311a000),(0xfffff80139d13738, 0x349a, 0x21f60d000),(0xfffff80139d13738, 0x349b, 0x3a1b85000),(0xfffff80139d13738, 0x349c, 0x4479cf000),(0xfffff80139d13738, 0x349d, 0x3a007e000),(0xfffff80139d13738, 0x349e, 0x445c8b000),(0xfffff80139d13738, 0x349f, 0x39ff4c000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4900 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0037c3eda0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01444baad8), b_data = 0xfffffe00e472c000 , b_blkno = 2882624, b_lblkno = 339, b_vp = 0xfffffe01444ba960, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139c77b58, 0xa98, 0x3a129c000),(0xfffff80139c77b58, 0xa99, 0x1ccecf000),(0xfffff80139c77b58, 0xa9a, 0x1ccece000),(0xfffff80139c77b58, 0xa9b, 0x302d31000),(0xfffff80139c77b58, 0xa9c, 0x302d30000),(0xfffff80139c77b58, 0xa9d, 0x2bb4d7000),(0xfffff80139c77b58, 0xa9e, 0x2bb4d6000),(0xfffff80139c77b58, 0xa9f, 0x39d6cb000) lock type bufwait: EXCL by thread 0xfffffe0144397740 (pid 2803, rw, tid 100302) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4764 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0037c987f0 b_flags = 0xa0000024, b_xflags=0x2 b_vflags=0x1 b_ioflags0x0 b_error = 0, b_bufsize = 4096, b_bcount = 4096, b_resid = 0 b_bufobj = (0xfffffe0144448ad8), b_data = 0xfffffe003d7a8000 , b_blkno = 2601304, b_lblkno = 0, b_vp = 0xfffffe0144448960, b_dep = 0 b_kvabase = 0xfffffe003d7a8000, b_kvasize = 32768 b_npages = 1, pages(OBJ, IDX, PA): (0xfffff80139c4f420, 0x0, 0x44c0f9000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cc74b7 at bufwrite+0x1f7 #2 0xffffffff80f411b3 at ffs_syncvnode+0x133 #3 0xffffffff80f3d4bd at ffs_sync+0x1ed #4 0xffffffff8255153e at g_journal_switcher+0x44e #5 0xffffffff80bbd3a0 at fork_exit+0x80 #6 0xffffffff810a8aee at fork_trampoline+0xe b_io_tracking: b_io_tcnt = 4872 1: bufwrite 2: bqrelse 3: bdwrite 4: getblkx 5: brelse 6: getblkx 7: brelse 8: getblkx 9: bqrelse 10: bufdone 11: biodone 12: g_io_deliver 13: g_io_check 14: g_io_schedule_down 15: g_io_request 16: g_vfs_strategy 17: bufwrite 18: bqrelse 19: bdwrite 20: getblkx 21: brelse 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: getblkx 28: brelse 29: getblkx 30: bqrelse 31: bufdone 32: biodone buf at 0xfffffe0037cc6aa0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e5f38e8), b_data = 0xfffffe00e472c000 , b_blkno = 4214336, b_lblkno = 869, b_vp = 0xfffffe014e5f3770, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801a622f108, 0x1b28, 0x47379a000),(0xfffff801a622f108, 0x1b29, 0x286c87000),(0xfffff801a622f108, 0x1b2a, 0x286c86000),(0xfffff801a622f108, 0x1b2b, 0x284a0f000),(0xfffff801a622f108, 0x1b2c, 0x284a0e000),(0xfffff801a622f108, 0x1b2d, 0x287355000),(0xfffff801a622f108, 0x1b2e, 0x287354000),(0xfffff801a622f108, 0x1b2f, 0x39b9bb000) lock type bufwait: EXCL by thread 0xfffffe0143682000 (pid 2798, rw, tid 100297) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cdddcd at cluster_read+0xed #4 0xffffffff80f13088 at ffs_balloc_ufs2+0x1d38 #5 0xffffffff80f3f9a2 at ffs_write+0x262 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 5384 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: brelse 24: bqrelse 25: bufdone 26: cluster_wbuild 27: brelse 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe0037d23350 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3881984, b_lblkno = 1660, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x33e0, 0x39f2ea000),(0xfffff80139d13738, 0x33e1, 0x28a6e7000),(0xfffff80139d13738, 0x33e2, 0x2bb16c000),(0xfffff80139d13738, 0x33e3, 0x254895000),(0xfffff80139d13738, 0x33e4, 0x42bb2a000),(0xfffff80139d13738, 0x33e5, 0x259666000),(0xfffff80139d13738, 0x33e6, 0x32f33a000),(0xfffff80139d13738, 0x33e7, 0x448075000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4939 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe0037d257c0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01444baad8), b_data = 0xfffffe00e472c000 , b_blkno = 2882880, b_lblkno = 343, b_vp = 0xfffffe01444ba960, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139c77b58, 0xab8, 0x23703e000),(0xfffff80139c77b58, 0xab9, 0x25f96b000),(0xfffff80139c77b58, 0xaba, 0x25f96a000),(0xfffff80139c77b58, 0xabb, 0x33049b000),(0xfffff80139c77b58, 0xabc, 0x33049a000),(0xfffff80139c77b58, 0xabd, 0x280c21000),(0xfffff80139c77b58, 0xabe, 0x280c20000),(0xfffff80139c77b58, 0xabf, 0x302d83000) lock type bufwait: EXCL by thread 0xfffffe0144397740 (pid 2803, rw, tid 100302) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4743 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0037d53720 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe010e394f88), b_data = 0xfffffe00e472c000 , b_blkno = 2948672, b_lblkno = 1853, b_vp = 0xfffffe010e394e10, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801399d9e70, 0x39e8, 0x1f6ba6000),(0xfffff801399d9e70, 0x39e9, 0x33400f000),(0xfffff801399d9e70, 0x39ea, 0x2bb4d5000),(0xfffff801399d9e70, 0x39eb, 0x1ccecd000),(0xfffff801399d9e70, 0x39ec, 0x3079af000),(0xfffff801399d9e70, 0x39ed, 0x1c11fb000),(0xfffff801399d9e70, 0x39ee, 0x3a43c3000),(0xfffff801399d9e70, 0x39ef, 0x44c8f6000) lock type bufwait: EXCL by thread 0xfffffe0144597e40 (pid 2800, rw, tid 100299) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4601 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe0037da2530 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e5d1b40), b_data = 0xfffffe00e472c000 , b_blkno = 2960896, b_lblkno = 521, b_vp = 0xfffffe014e5d19c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff802edfd2000, 0x1048, 0x3a2127000),(0xfffff802edfd2000, 0x1049, 0x3a2126000),(0xfffff802edfd2000, 0x104a, 0x3b9973000),(0xfffff802edfd2000, 0x104b, 0x3b9972000),(0xfffff802edfd2000, 0x104c, 0x1d5f57000),(0xfffff802edfd2000, 0x104d, 0x1d5f56000),(0xfffff802edfd2000, 0x104e, 0x254fc5000),(0xfffff802edfd2000, 0x104f, 0x254fc4000) lock type bufwait: EXCL by thread 0xfffffe0144597000 (pid 2802, rw, tid 100301) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 3915 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0037da5a30 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3882944, b_lblkno = 1675, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3458, 0x3f25b9000),(0xfffff80139d13738, 0x3459, 0x32eda4000),(0xfffff80139d13738, 0x345a, 0x2658d2000),(0xfffff80139d13738, 0x345b, 0x1d7e51000),(0xfffff80139d13738, 0x345c, 0x257ae0000),(0xfffff80139d13738, 0x345d, 0x3afb33000),(0xfffff80139d13738, 0x345e, 0x306b36000),(0xfffff80139d13738, 0x345f, 0x4488e0000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 44067 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0037db4210 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe016837c178), b_data = 0xfffffe00e472c000 , b_blkno = 2961280, b_lblkno = 601, b_vp = 0xfffffe016837c000, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801a622f000, 0x12c8, 0x3343cd000),(0xfffff801a622f000, 0x12c9, 0x248cec000),(0xfffff801a622f000, 0x12ca, 0x303c4f000),(0xfffff801a622f000, 0x12cb, 0x287d14000),(0xfffff801a622f000, 0x12cc, 0x44c79d000),(0xfffff801a622f000, 0x12cd, 0x45c244000),(0xfffff801a622f000, 0x12ce, 0x33045d000),(0xfffff801a622f000, 0x12cf, 0x3e4f00000) lock type bufwait: EXCL by thread 0xfffffe0144597720 (pid 2801, rw, tid 100300) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 5146 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0037de59c0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3883008, b_lblkno = 1676, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3460, 0x44d681000),(0xfffff80139d13738, 0x3461, 0x3b71a2000),(0xfffff80139d13738, 0x3462, 0x2baeb9000),(0xfffff80139d13738, 0x3463, 0x44d40e000),(0xfffff80139d13738, 0x3464, 0x3c374f000),(0xfffff80139d13738, 0x3465, 0x3a2212000),(0xfffff80139d13738, 0x3466, 0x3a1329000),(0xfffff80139d13738, 0x3467, 0x3044b2000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4016 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0037e63120 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe016837c178), b_data = 0xfffffe00e472c000 , b_blkno = 2961408, b_lblkno = 603, b_vp = 0xfffffe016837c000, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801a622f000, 0x12d8, 0x2452d6000),(0xfffff801a622f000, 0x12d9, 0x448a2f000),(0xfffff801a622f000, 0x12da, 0x425537000),(0xfffff801a622f000, 0x12db, 0x1a5616000),(0xfffff801a622f000, 0x12dc, 0x24e9c1000),(0xfffff801a622f000, 0x12dd, 0x33221b000),(0xfffff801a622f000, 0x12de, 0x32dd14000),(0xfffff801a622f000, 0x12df, 0x280de1000) lock type bufwait: EXCL by thread 0xfffffe0144597720 (pid 2801, rw, tid 100300) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4811 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0037ee6be0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01444691e0), b_data = 0xfffffe00e472c000 , b_blkno = 4214016, b_lblkno = 1919, b_vp = 0xfffffe0144469068, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff8000494ba50, 0x3bf8, 0x26643f000),(0xfffff8000494ba50, 0x3bf9, 0x44dfec000),(0xfffff8000494ba50, 0x3bfa, 0x282144000),(0xfffff8000494ba50, 0x3bfb, 0x21ceb4000),(0xfffff8000494ba50, 0x3bfc, 0x304150000),(0xfffff8000494ba50, 0x3bfd, 0x330a23000),(0xfffff8000494ba50, 0x3bfe, 0x1be72c000),(0xfffff8000494ba50, 0x3bff, 0x4486b0000) lock type bufwait: EXCL by thread 0xfffffe0143682720 (pid 2797, rw, tid 100296) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 5011 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0037eed930 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe016837c178), b_data = 0xfffffe00e472c000 , b_blkno = 2961472, b_lblkno = 604, b_vp = 0xfffffe016837c000, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801a622f000, 0x12e0, 0x44c817000),(0xfffff801a622f000, 0x12e1, 0x252451000),(0xfffff801a622f000, 0x12e2, 0x2814c0000),(0xfffff801a622f000, 0x12e3, 0x2529ad000),(0xfffff801a622f000, 0x12e4, 0x2564f4000),(0xfffff801a622f000, 0x12e5, 0x3337f1000),(0xfffff801a622f000, 0x12e6, 0x3e72f8000),(0xfffff801a622f000, 0x12e7, 0x3afa64000) lock type bufwait: EXCL by thread 0xfffffe0144597720 (pid 2801, rw, tid 100300) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4143 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0037f105b0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01444baad8), b_data = 0xfffffe00e472c000 , b_blkno = 2884160, b_lblkno = 347, b_vp = 0xfffffe01444ba960, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139c77b58, 0xad8, 0x32ee38000),(0xfffff80139c77b58, 0xad9, 0x30298b000),(0xfffff80139c77b58, 0xada, 0x30298a000),(0xfffff80139c77b58, 0xadb, 0x331bdb000),(0xfffff80139c77b58, 0xadc, 0x331bda000),(0xfffff80139c77b58, 0xadd, 0x444d53000),(0xfffff80139c77b58, 0xade, 0x444d52000),(0xfffff80139c77b58, 0xadf, 0x302a95000) lock type bufwait: EXCL by thread 0xfffffe0144397740 (pid 2803, rw, tid 100302) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cdddcd at cluster_read+0xed #4 0xffffffff80f13088 at ffs_balloc_ufs2+0x1d38 #5 0xffffffff80f3f9a2 at ffs_write+0x262 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4636 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: brelse 24: bqrelse 25: bufdone 26: cluster_wbuild 27: brelse 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe0037fcbb80 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3882240, b_lblkno = 1664, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3400, 0x304669000),(0xfffff80139d13738, 0x3401, 0x254c53000),(0xfffff80139d13738, 0x3402, 0x4438d5000),(0xfffff80139d13738, 0x3403, 0x252810000),(0xfffff80139d13738, 0x3404, 0x258cbe000),(0xfffff80139d13738, 0x3405, 0x1cce61000),(0xfffff80139d13738, 0x3406, 0x39f39a000),(0xfffff80139d13738, 0x3407, 0x2ba8be000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 9813 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe003801ba20 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3882688, b_lblkno = 1671, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3438, 0x20de1d000),(0xfffff80139d13738, 0x3439, 0x39d2ae000),(0xfffff80139d13738, 0x343a, 0x42ba48000),(0xfffff80139d13738, 0x343b, 0x254d70000),(0xfffff80139d13738, 0x343c, 0x44c9f4000),(0xfffff80139d13738, 0x343d, 0x30410b000),(0xfffff80139d13738, 0x343e, 0x444d06000),(0xfffff80139d13738, 0x343f, 0x332577000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4024 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00380506d0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3883136, b_lblkno = 1678, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3470, 0x3063ba000),(0xfffff80139d13738, 0x3471, 0x44c06d000),(0xfffff80139d13738, 0x3472, 0x197c86000),(0xfffff80139d13738, 0x3473, 0x423e43000),(0xfffff80139d13738, 0x3474, 0x39daa5000),(0xfffff80139d13738, 0x3475, 0x331692000),(0xfffff80139d13738, 0x3476, 0x256451000),(0xfffff80139d13738, 0x3477, 0x2280a2000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4070 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe003806d9e0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe016837c178), b_data = 0xfffffe00e472c000 , b_blkno = 2961600, b_lblkno = 605, b_vp = 0xfffffe016837c000, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801a622f000, 0x12e8, 0x1c1107000),(0xfffff801a622f000, 0x12e9, 0x39fe5d000),(0xfffff801a622f000, 0x12ea, 0x254d9d000),(0xfffff801a622f000, 0x12eb, 0x330a2f000),(0xfffff801a622f000, 0x12ec, 0x1f6b14000),(0xfffff801a622f000, 0x12ed, 0x44d433000),(0xfffff801a622f000, 0x12ee, 0x2443e2000),(0xfffff801a622f000, 0x12ef, 0x3c257d000) lock type bufwait: EXCL by thread 0xfffffe0144597720 (pid 2801, rw, tid 100300) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cdddcd at cluster_read+0xed #4 0xffffffff80f13088 at ffs_balloc_ufs2+0x1d38 #5 0xffffffff80f3f9a2 at ffs_write+0x262 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4974 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: brelse 24: bqrelse 25: bufdone 26: cluster_wbuild 27: brelse 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe00380cd440 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01765fb1e0), b_data = 0xfffffe00e472c000 , b_blkno = 4211712, b_lblkno = 2070, b_vp = 0xfffffe01765fb068, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801399cf210, 0x40b0, 0x3039f0000),(0xfffff801399cf210, 0x40b1, 0x3039f1000),(0xfffff801399cf210, 0x40b2, 0x2529f6000),(0xfffff801399cf210, 0x40b3, 0x2529f7000),(0xfffff801399cf210, 0x40b4, 0x21d3e2000),(0xfffff801399cf210, 0x40b5, 0x21d3e3000),(0xfffff801399cf210, 0x40b6, 0x3a12ea000),(0xfffff801399cf210, 0x40b7, 0x3a12eb000) lock type bufwait: EXCL by thread 0xfffffe0143682e40 (pid 2796, rw, tid 100282) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4452 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe0038158640 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3883200, b_lblkno = 1679, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3478, 0x28905d000),(0xfffff80139d13738, 0x3479, 0x2562b3000),(0xfffff80139d13738, 0x347a, 0x21d32e000),(0xfffff80139d13738, 0x347b, 0x306b38000),(0xfffff80139d13738, 0x347c, 0x1a5613000),(0xfffff80139d13738, 0x347d, 0x237183000),(0xfffff80139d13738, 0x347e, 0x2841a5000),(0xfffff80139d13738, 0x347f, 0x259680000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4342 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0038179840 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3883328, b_lblkno = 1681, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3488, 0x39dd5e000),(0xfffff80139d13738, 0x3489, 0x1a1a63000),(0xfffff80139d13738, 0x348a, 0x202b56000),(0xfffff80139d13738, 0x348b, 0x473429000),(0xfffff80139d13738, 0x348c, 0x39f7e4000),(0xfffff80139d13738, 0x348d, 0x280b7b000),(0xfffff80139d13738, 0x348e, 0x1a5af6000),(0xfffff80139d13738, 0x348f, 0x286095000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 44986 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00382527c0 b_flags = 0xa0020020, b_xflags=0x2 b_vflags=0x1 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443ab690), b_data = 0xfffffe003d530000 , b_blkno = 2654912, b_lblkno = -12, b_vp = 0xfffffe01443ab518, b_dep = 0 b_kvabase = 0xfffffe003d530000, b_kvasize = 32768 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801399d2840, 0xfffffffffffa0, 0x251e99000),(0xfffff801399d2840, 0xfffffffffffa1, 0x251e98000),(0xfffff801399d2840, 0xfffffffffffa2, 0x44cf4d000),(0xfffff801399d2840, 0xfffffffffffa3, 0x44cf4c000),(0xfffff801399d2840, 0xfffffffffffa4, 0x4322bd000),(0xfffff801399d2840, 0xfffffffffffa5, 0x4322bc000),(0xfffff801399d2840, 0xfffffffffffa6, 0x24e887000),(0xfffff801399d2840, 0xfffffffffffa7, 0x24e886000) lock type bufwait: EXCL by thread 0xfffffe0143619740 (pid 2799, rw, tid 100298) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80f3a81a at ffs_breadz+0x5a #5 0xffffffff80f14e7e at ffs_indirtrunc+0x11e #6 0xffffffff80f144d8 at ffs_truncate+0xe68 #7 0xffffffff80f4931a at ufs_inactive+0x1aa #8 0xffffffff811a32d9 at VOP_INACTIVE_APV+0x59 #9 0xffffffff80cf73aa at vinactivef+0xda #10 0xffffffff80cf69fa at vput_final+0x2aa #11 0xffffffff80d06315 at kern_funlinkat+0x275 #12 0xffffffff80d06098 at sys_unlink+0x28 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 44548 1: getblkx 2: bqrelse 3: bufdone 4: biodone 5: g_io_deliver 6: g_io_check 7: g_io_schedule_down 8: g_io_request 9: g_vfs_strategy 10: bufwrite 11: brelse 12: getblkx 13: brelse 14: getblkx 15: brelse 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: brelse 21: getblkx 22: brelse 23: getblkx 24: brelse 25: getblkx 26: brelse 27: getblkx 28: brelse 29: getblkx 30: brelse 31: getblkx 32: brelse buf at 0xfffffe003829e0d0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe016837c178), b_data = 0xfffffe00e472c000 , b_blkno = 2961088, b_lblkno = 598, b_vp = 0xfffffe016837c000, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801a622f000, 0x12b0, 0x1c7ce3000),(0xfffff801a622f000, 0x12b1, 0x25bcd2000),(0xfffff801a622f000, 0x12b2, 0x258573000),(0xfffff801a622f000, 0x12b3, 0x44873d000),(0xfffff801a622f000, 0x12b4, 0x3e729f000),(0xfffff801a622f000, 0x12b5, 0x32f216000),(0xfffff801a622f000, 0x12b6, 0x254402000),(0xfffff801a622f000, 0x12b7, 0x3cbda0000) lock type bufwait: EXCL by thread 0xfffffe0144597720 (pid 2801, rw, tid 100300) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4366 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00382c48f0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3882176, b_lblkno = 1663, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x33f8, 0x248d04000),(0xfffff80139d13738, 0x33f9, 0x4213e7000),(0xfffff80139d13738, 0x33fa, 0x39f3e0000),(0xfffff80139d13738, 0x33fb, 0x3de2ad000),(0xfffff80139d13738, 0x33fc, 0x32eaba000),(0xfffff80139d13738, 0x33fd, 0x3a21bb000),(0xfffff80139d13738, 0x33fe, 0x25cf9f000),(0xfffff80139d13738, 0x33ff, 0x302823000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4646 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe0038314790 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3881856, b_lblkno = 1658, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x33d0, 0x251502000),(0xfffff80139d13738, 0x33d1, 0x26595f000),(0xfffff80139d13738, 0x33d2, 0x45c63d000),(0xfffff80139d13738, 0x33d3, 0x281d38000),(0xfffff80139d13738, 0x33d4, 0x42549d000),(0xfffff80139d13738, 0x33d5, 0x2515e6000),(0xfffff80139d13738, 0x33d6, 0x25f95f000),(0xfffff80139d13738, 0x33d7, 0x3a1297000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 45469 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00383370c0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe016837c178), b_data = 0xfffffe00e472c000 , b_blkno = 2961152, b_lblkno = 599, b_vp = 0xfffffe016837c000, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801a622f000, 0x12b8, 0x264645000),(0xfffff801a622f000, 0x12b9, 0x47367c000),(0xfffff801a622f000, 0x12ba, 0x27e0ad000),(0xfffff801a622f000, 0x12bb, 0x25fb31000),(0xfffff801a622f000, 0x12bc, 0x476dfd000),(0xfffff801a622f000, 0x12bd, 0x1a5b96000),(0xfffff801a622f000, 0x12be, 0x2bab0f000),(0xfffff801a622f000, 0x12bf, 0x3038ec000) lock type bufwait: EXCL by thread 0xfffffe0144597720 (pid 2801, rw, tid 100300) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 5014 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe003838d2c0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3883264, b_lblkno = 1680, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3480, 0x2618d4000),(0xfffff80139d13738, 0x3481, 0x20aa6f000),(0xfffff80139d13738, 0x3482, 0x1d5fc2000),(0xfffff80139d13738, 0x3483, 0x2dd108000),(0xfffff80139d13738, 0x3484, 0x39dd65000),(0xfffff80139d13738, 0x3485, 0x25a10f000),(0xfffff80139d13738, 0x3486, 0x449af3000),(0xfffff80139d13738, 0x3487, 0x39f744000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4950 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0038391ef0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3882880, b_lblkno = 1674, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3450, 0x21e6f1000),(0xfffff80139d13738, 0x3451, 0x284ba2000),(0xfffff80139d13738, 0x3452, 0x44883b000),(0xfffff80139d13738, 0x3453, 0x2873f0000),(0xfffff80139d13738, 0x3454, 0x2560d9000),(0xfffff80139d13738, 0x3455, 0x2dbf21000),(0xfffff80139d13738, 0x3456, 0x287d70000),(0xfffff80139d13738, 0x3457, 0x259c1c000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 85791 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00383c1f70 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3882816, b_lblkno = 1673, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3448, 0x284692000),(0xfffff80139d13738, 0x3449, 0x39d639000),(0xfffff80139d13738, 0x344a, 0x45c720000),(0xfffff80139d13738, 0x344b, 0x1e43b8000),(0xfffff80139d13738, 0x344c, 0x287243000),(0xfffff80139d13738, 0x344d, 0x2546b4000),(0xfffff80139d13738, 0x344e, 0x3b714f000),(0xfffff80139d13738, 0x344f, 0x422b48000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 3458 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00383cbe70 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe016837c178), b_data = 0xfffffe00e472c000 , b_blkno = 2961024, b_lblkno = 597, b_vp = 0xfffffe016837c000, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801a622f000, 0x12a8, 0x2565e6000),(0xfffff801a622f000, 0x12a9, 0x283ded000),(0xfffff801a622f000, 0x12aa, 0x283dec000),(0xfffff801a622f000, 0x12ab, 0x3d09e3000),(0xfffff801a622f000, 0x12ac, 0x3d09e2000),(0xfffff801a622f000, 0x12ad, 0x422e73000),(0xfffff801a622f000, 0x12ae, 0x422e72000),(0xfffff801a622f000, 0x12af, 0x2525dd000) lock type bufwait: EXCL by thread 0xfffffe0144597720 (pid 2801, rw, tid 100300) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 3743 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00384163a0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3882304, b_lblkno = 1665, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3408, 0x43d0be000),(0xfffff80139d13738, 0x3409, 0x19d099000),(0xfffff80139d13738, 0x340a, 0x423b85000),(0xfffff80139d13738, 0x340b, 0x12479d000),(0xfffff80139d13738, 0x340c, 0x345fc000),(0xfffff80139d13738, 0x340d, 0x28119c000),(0xfffff80139d13738, 0x340e, 0x2bb11b000),(0xfffff80139d13738, 0x340f, 0x25fbe4000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4760 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe00384746d0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3881792, b_lblkno = 1657, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x33c8, 0x252cc6000),(0xfffff80139d13738, 0x33c9, 0x2baf75000),(0xfffff80139d13738, 0x33ca, 0x2baf74000),(0xfffff80139d13738, 0x33cb, 0x2560ff000),(0xfffff80139d13738, 0x33cc, 0x2560fe000),(0xfffff80139d13738, 0x33cd, 0x1e42ef000),(0xfffff80139d13738, 0x33ce, 0x1e42ee000),(0xfffff80139d13738, 0x33cf, 0x265b91000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4003 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe003848e4e0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3882048, b_lblkno = 1661, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x33e8, 0x25c3ce000),(0xfffff80139d13738, 0x33e9, 0x287d22000),(0xfffff80139d13738, 0x33ea, 0x35bf6000),(0xfffff80139d13738, 0x33eb, 0x4737fd000),(0xfffff80139d13738, 0x33ec, 0x302b1e000),(0xfffff80139d13738, 0x33ed, 0x2bafa7000),(0xfffff80139d13738, 0x33ee, 0x21ce34000),(0xfffff80139d13738, 0x33ef, 0x263156000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 3687 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe00384d4b20 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01444baad8), b_data = 0xfffffe00e472c000 , b_blkno = 2883008, b_lblkno = 345, b_vp = 0xfffffe01444ba960, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139c77b58, 0xac8, 0x2bedfa000),(0xfffff80139c77b58, 0xac9, 0x32f259000),(0xfffff80139c77b58, 0xaca, 0x32f258000),(0xfffff80139c77b58, 0xacb, 0x28aebf000),(0xfffff80139c77b58, 0xacc, 0x28aebe000),(0xfffff80139c77b58, 0xacd, 0x25286d000),(0xfffff80139c77b58, 0xace, 0x25286c000),(0xfffff80139c77b58, 0xacf, 0x3eea7b000) lock type bufwait: EXCL by thread 0xfffffe0144397740 (pid 2803, rw, tid 100302) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4774 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00384e6ea0 b_flags = 0x20000024, b_xflags=0x6 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe016837c628), b_data = 0xfffffe003d15c000 , b_blkno = 5213568, b_lblkno = 40645, b_vp = 0xfffffe016837c4b0, b_dep = 0 b_kvabase = 0xfffffe003d15c000, b_kvasize = 32768 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff802edfe0000, 0x4f628, 0x466835000),(0xfffff802edfe0000, 0x4f629, 0x466834000),(0xfffff802edfe0000, 0x4f62a, 0x264e23000),(0xfffff802edfe0000, 0x4f62b, 0x264e22000),(0xfffff802edfe0000, 0x4f62c, 0x264e21000),(0xfffff802edfe0000, 0x4f62d, 0x264e20000),(0xfffff802edfe0000, 0x4f62e, 0x449907000),(0xfffff802edfe0000, 0x4f62f, 0x449906000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cc74b7 at bufwrite+0x1f7 #2 0xffffffff80f1b0fe at ffs_copyonwrite+0x54e #3 0xffffffff80f3edbf at ffs_geom_strategy+0xcf #4 0xffffffff80f53e83 at ufs_strategy+0x83 #5 0xffffffff811a3bc1 at VOP_STRATEGY_APV+0x61 #6 0xffffffff80cc766e at bufstrategy+0x3e #7 0xffffffff80cc750c at bufwrite+0x24c #8 0xffffffff80f411b3 at ffs_syncvnode+0x133 #9 0xffffffff80f3d4bd at ffs_sync+0x1ed #10 0xffffffff8255153e at g_journal_switcher+0x44e #11 0xffffffff80bbd3a0 at fork_exit+0x80 #12 0xffffffff810a8aee at fork_trampoline+0xe b_io_tracking: b_io_tcnt = 4254 1: g_io_deliver 2: g_io_check 3: g_io_schedule_down 4: g_io_request 5: g_vfs_strategy 6: bufwrite 7: bufdone 8: biodone 9: g_io_deliver 10: g_io_deliver 11: g_io_check 12: g_io_schedule_down 13: g_io_request 14: g_vfs_strategy 15: getblkx 16: brelse 17: bqrelse 18: bufdone 19: cluster_wbuild 20: brelse 21: getblkx 22: bqrelse 23: bdwrite 24: getblkx 25: bqrelse 26: bdwrite 27: getblkx 28: bqrelse 29: bdwrite 30: getblkx 31: bqrelse 32: bdwrite buf at 0xfffffe0038517c60 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3883712, b_lblkno = 1687, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x34b8, 0x44c43f000),(0xfffff80139d13738, 0x34b9, 0x1b3c0f000),(0xfffff80139d13738, 0x34ba, 0x476c1e000),(0xfffff80139d13738, 0x34bb, 0x302c6f000),(0xfffff80139d13738, 0x34bc, 0x307dce000),(0xfffff80139d13738, 0x34bd, 0x280db5000),(0xfffff80139d13738, 0x34be, 0x3eecae000),(0xfffff80139d13738, 0x34bf, 0x254c2f000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4688 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0038532e50 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01444baad8), b_data = 0xfffffe00e472c000 , b_blkno = 2883072, b_lblkno = 346, b_vp = 0xfffffe01444ba960, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139c77b58, 0xad0, 0x3eea7a000),(0xfffff80139c77b58, 0xad1, 0x28a74f000),(0xfffff80139c77b58, 0xad2, 0x28a74e000),(0xfffff80139c77b58, 0xad3, 0x2bb5eb000),(0xfffff80139c77b58, 0xad4, 0x2bb5ea000),(0xfffff80139c77b58, 0xad5, 0x21e7a9000),(0xfffff80139c77b58, 0xad6, 0x21e7a8000),(0xfffff80139c77b58, 0xad7, 0x32ee39000) lock type bufwait: EXCL by thread 0xfffffe0144397740 (pid 2803, rw, tid 100302) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4773 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00385387c0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3883584, b_lblkno = 1685, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x34a8, 0x3308c5000),(0xfffff80139d13738, 0x34a9, 0x333c38000),(0xfffff80139d13738, 0x34aa, 0x2dc0d9000),(0xfffff80139d13738, 0x34ab, 0x334585000),(0xfffff80139d13738, 0x34ac, 0x412d31000),(0xfffff80139d13738, 0x34ad, 0x280c18000),(0xfffff80139d13738, 0x34ae, 0x1a1ae3000),(0xfffff80139d13738, 0x34af, 0x3062c1000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4531 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00385dcde0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3883648, b_lblkno = 1686, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x34b0, 0x25bd6d000),(0xfffff80139d13738, 0x34b1, 0x32f47c000),(0xfffff80139d13738, 0x34b2, 0x47744c000),(0xfffff80139d13738, 0x34b3, 0x44de7f000),(0xfffff80139d13738, 0x34b4, 0x1a5bde000),(0xfffff80139d13738, 0x34b5, 0x445c3d000),(0xfffff80139d13738, 0x34b6, 0x422c97000),(0xfffff80139d13738, 0x34b7, 0x332566000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4798 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0038605080 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e5f38e8), b_data = 0xfffffe00e472c000 , b_blkno = 4214080, b_lblkno = 867, b_vp = 0xfffffe014e5f3770, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801a622f108, 0x1b18, 0x3c73d4000),(0xfffff801a622f108, 0x1b19, 0x28ae57000),(0xfffff801a622f108, 0x1b1a, 0x28ae56000),(0xfffff801a622f108, 0x1b1b, 0x44c8f5000),(0xfffff801a622f108, 0x1b1c, 0x44c8f4000),(0xfffff801a622f108, 0x1b1d, 0x21cfe5000),(0xfffff801a622f108, 0x1b1e, 0x21cfe4000),(0xfffff801a622f108, 0x1b1f, 0x3a129d000) lock type bufwait: EXCL by thread 0xfffffe0143682000 (pid 2798, rw, tid 100297) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4612 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe003867b0a0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01444baad8), b_data = 0xfffffe00e472c000 , b_blkno = 2882816, b_lblkno = 342, b_vp = 0xfffffe01444ba960, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139c77b58, 0xab0, 0x331788000),(0xfffff80139c77b58, 0xab1, 0x2bf039000),(0xfffff80139c77b58, 0xab2, 0x2bf038000),(0xfffff80139c77b58, 0xab3, 0x19712f000),(0xfffff80139c77b58, 0xab4, 0x19712e000),(0xfffff80139c77b58, 0xab5, 0x280b5d000),(0xfffff80139c77b58, 0xab6, 0x280b5c000),(0xfffff80139c77b58, 0xab7, 0x23703f000) lock type bufwait: EXCL by thread 0xfffffe0144397740 (pid 2803, rw, tid 100302) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4452 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00386ba640 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01765fb1e0), b_data = 0xfffffe00e472c000 , b_blkno = 4214208, b_lblkno = 2071, b_vp = 0xfffffe01765fb068, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801399cf210, 0x40b8, 0x44ca40000),(0xfffff801399cf210, 0x40b9, 0x39f3ed000),(0xfffff801399cf210, 0x40ba, 0x39f3ec000),(0xfffff801399cf210, 0x40bb, 0x1971e1000),(0xfffff801399cf210, 0x40bc, 0x1971e0000),(0xfffff801399cf210, 0x40bd, 0x4216bf000),(0xfffff801399cf210, 0x40be, 0x4216be000),(0xfffff801399cf210, 0x40bf, 0x2657fb000) lock type bufwait: EXCL by thread 0xfffffe0143682e40 (pid 2796, rw, tid 100282) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cdddcd at cluster_read+0xed #4 0xffffffff80f13088 at ffs_balloc_ufs2+0x1d38 #5 0xffffffff80f3f9a2 at ffs_write+0x262 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 3123 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: brelse 24: bqrelse 25: bufdone 26: cluster_wbuild 27: brelse 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe0038703ae0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3882496, b_lblkno = 1668, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3420, 0x448b14000),(0xfffff80139d13738, 0x3421, 0x303c61000),(0xfffff80139d13738, 0x3422, 0x42ba22000),(0xfffff80139d13738, 0x3423, 0x33215b000),(0xfffff80139d13738, 0x3424, 0x3304a4000),(0xfffff80139d13738, 0x3425, 0x2841aa000),(0xfffff80139d13738, 0x3426, 0x39b98f000),(0xfffff80139d13738, 0x3427, 0x3c680a000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 72955 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe0038734f40 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3883392, b_lblkno = 1682, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3490, 0x32e7ee000),(0xfffff80139d13738, 0x3491, 0x32eb45000),(0xfffff80139d13738, 0x3492, 0x330912000),(0xfffff80139d13738, 0x3493, 0x20df4e000),(0xfffff80139d13738, 0x3494, 0x447990000),(0xfffff80139d13738, 0x3495, 0x307e64000),(0xfffff80139d13738, 0x3496, 0x24eac3000),(0xfffff80139d13738, 0x3497, 0x2597c2000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 3440 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0038773450 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3883072, b_lblkno = 1677, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3468, 0x282139000),(0xfffff80139d13738, 0x3469, 0x304d98000),(0xfffff80139d13738, 0x346a, 0x4453c9000),(0xfffff80139d13738, 0x346b, 0x307c31000),(0xfffff80139d13738, 0x346c, 0x307987000),(0xfffff80139d13738, 0x346d, 0x1b7aa5000),(0xfffff80139d13738, 0x346e, 0x39cd8a000),(0xfffff80139d13738, 0x346f, 0x2287d6000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 125893 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00387dbd20 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3883520, b_lblkno = 1684, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x34a0, 0x425559000),(0xfffff80139d13738, 0x34a1, 0x2b9c8e000),(0xfffff80139d13738, 0x34a2, 0x28512b000),(0xfffff80139d13738, 0x34a3, 0x330802000),(0xfffff80139d13738, 0x34a4, 0x25fa3e000),(0xfffff80139d13738, 0x34a5, 0x265243000),(0xfffff80139d13738, 0x34a6, 0x2da388000),(0xfffff80139d13738, 0x34a7, 0x27f189000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4147 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00387ff040 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e5d1b40), b_data = 0xfffffe00e472c000 , b_blkno = 2960832, b_lblkno = 520, b_vp = 0xfffffe014e5d19c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff802edfd2000, 0x1040, 0x302c8d000),(0xfffff802edfd2000, 0x1041, 0x302c8c000),(0xfffff802edfd2000, 0x1042, 0x4438d9000),(0xfffff802edfd2000, 0x1043, 0x4438d8000),(0xfffff802edfd2000, 0x1044, 0x3a1a19000),(0xfffff802edfd2000, 0x1045, 0x3a1a18000),(0xfffff802edfd2000, 0x1046, 0x39cc5f000),(0xfffff802edfd2000, 0x1047, 0x39cc5e000) lock type bufwait: EXCL by thread 0xfffffe0144597000 (pid 2802, rw, tid 100301) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 4055 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0038829df0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3882560, b_lblkno = 1669, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3428, 0x32dc49000),(0xfffff80139d13738, 0x3429, 0x445b40000),(0xfffff80139d13738, 0x342a, 0x45c323000),(0xfffff80139d13738, 0x342b, 0x287df7000),(0xfffff80139d13738, 0x342c, 0x3047e2000),(0xfffff80139d13738, 0x342d, 0x25bd6a000),(0xfffff80139d13738, 0x342e, 0x25f59c000),(0xfffff80139d13738, 0x342f, 0x42afd9000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 3373 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe00389263e0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01444baad8), b_data = 0xfffffe00e472c000 , b_blkno = 2882560, b_lblkno = 338, b_vp = 0xfffffe01444ba960, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139c77b58, 0xa90, 0x21e7b8000),(0xfffff80139c77b58, 0xa91, 0x3078b7000),(0xfffff80139c77b58, 0xa92, 0x3078b6000),(0xfffff80139c77b58, 0xa93, 0x1b074b000),(0xfffff80139c77b58, 0xa94, 0x1b074a000),(0xfffff80139c77b58, 0xa95, 0x2bedbd000),(0xfffff80139c77b58, 0xa96, 0x2bedbc000),(0xfffff80139c77b58, 0xa97, 0x3dc843000) lock type bufwait: EXCL by thread 0xfffffe0144397740 (pid 2803, rw, tid 100302) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 2896 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe00389316c0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3882432, b_lblkno = 1667, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3418, 0x334543000),(0xfffff80139d13738, 0x3419, 0x1a5795000),(0xfffff80139d13738, 0x341a, 0x44875e000),(0xfffff80139d13738, 0x341b, 0x39f227000),(0xfffff80139d13738, 0x341c, 0x2bad6f000),(0xfffff80139d13738, 0x341d, 0x331e67000),(0xfffff80139d13738, 0x341e, 0x25f6f9000),(0xfffff80139d13738, 0x341f, 0x39f281000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 3001 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe00389726e0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01444baad8), b_data = 0xfffffe00e472c000 , b_blkno = 2882944, b_lblkno = 344, b_vp = 0xfffffe01444ba960, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139c77b58, 0xac0, 0x302d82000),(0xfffff80139c77b58, 0xac1, 0x25283b000),(0xfffff80139c77b58, 0xac2, 0x25283a000),(0xfffff80139c77b58, 0xac3, 0x280341000),(0xfffff80139c77b58, 0xac4, 0x280340000),(0xfffff80139c77b58, 0xac5, 0x1927bf000),(0xfffff80139c77b58, 0xac6, 0x1927be000),(0xfffff80139c77b58, 0xac7, 0x2bedfb000) lock type bufwait: EXCL by thread 0xfffffe0144397740 (pid 2803, rw, tid 100302) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 2701 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0038977310 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e5f38e8), b_data = 0xfffffe00e472c000 , b_blkno = 4214144, b_lblkno = 868, b_vp = 0xfffffe014e5f3770, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801a622f108, 0x1b20, 0x3dc842000),(0xfffff801a622f108, 0x1b21, 0x25c773000),(0xfffff801a622f108, 0x1b22, 0x25c772000),(0xfffff801a622f108, 0x1b23, 0x307da3000),(0xfffff801a622f108, 0x1b24, 0x307da2000),(0xfffff801a622f108, 0x1b25, 0x1893d5000),(0xfffff801a622f108, 0x1b26, 0x1893d4000),(0xfffff801a622f108, 0x1b27, 0x47379b000) lock type bufwait: EXCL by thread 0xfffffe0143682000 (pid 2798, rw, tid 100297) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cc8f24 at breadn_flags+0x44 #4 0xffffffff80cdef9a at cluster_write+0x34a #5 0xffffffff80f3fb62 at ffs_write+0x422 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 2195 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0038977d00 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01443fbb40), b_data = 0xfffffe00e472c000 , b_blkno = 3882368, b_lblkno = 1666, b_vp = 0xfffffe01443fb9c8, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80139d13738, 0x3410, 0x21d08d000),(0xfffff80139d13738, 0x3411, 0x24e830000),(0xfffff80139d13738, 0x3412, 0x25f44d000),(0xfffff80139d13738, 0x3413, 0x3ae1e8000),(0xfffff80139d13738, 0x3414, 0x21cf75000),(0xfffff80139d13738, 0x3415, 0x44c823000),(0xfffff80139d13738, 0x3416, 0x33160e000),(0xfffff80139d13738, 0x3417, 0x197c3b000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd6300 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf8f4 at cluster_wbuild+0x5b4 #2 0xffffffff80cded7c at cluster_write+0x12c #3 0xffffffff80f3fb62 at ffs_write+0x422 #4 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #5 0xffffffff80d139dc at vn_write+0x2fc #6 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f303 at vn_io_fault1+0x163 #8 0xffffffff80d0cc7a at vn_io_fault+0x1aa #9 0xffffffff80c7c591 at dofilewrite+0x81 #10 0xffffffff80c7c0c0 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 1912 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe0038a0ace0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe010e394f88), b_data = 0xfffffe00e472c000 , b_blkno = 2954432, b_lblkno = 1854, b_vp = 0xfffffe010e394e10, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff801399d9e70, 0x39f0, 0x257b27000),(0xfffff801399d9e70, 0x39f1, 0x332524000),(0xfffff801399d9e70, 0x39f2, 0x28ae55000),(0xfffff801399d9e70, 0x39f3, 0x3c73d6000),(0xfffff801399d9e70, 0x39f4, 0x42bb92000),(0xfffff801399d9e70, 0x39f5, 0x42bb93000),(0xfffff801399d9e70, 0x39f6, 0x42b1a0000),(0xfffff801399d9e70, 0x39f7, 0x42b1a1000) lock type bufwait: EXCL by thread 0xfffffe0144597e40 (pid 2800, rw, tid 100299) #0 0xffffffff80bd4c5c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd5129 at __lockmgr_args+0x1f9 #2 0xffffffff80cc91ec at getblkx+0xcc #3 0xffffffff80cdddcd at cluster_read+0xed #4 0xffffffff80f13088 at ffs_balloc_ufs2+0x1d38 #5 0xffffffff80f3f9a2 at ffs_write+0x262 #6 0xffffffff811a1b2f at VOP_WRITE_APV+0xcf #7 0xffffffff80d139dc at vn_write+0x2fc #8 0xffffffff80d132e3 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f303 at vn_io_fault1+0x163 #10 0xffffffff80d0cc7a at vn_io_fault+0x1aa #11 0xffffffff80c7c591 at dofilewrite+0x81 #12 0xffffffff80c7c0c0 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a838b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 2015 1: getblkx 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: brelse 24: bqrelse 25: bufdone 26: cluster_wbuild 27: bqrelse 28: bdwrite 29: getblkx 30: bqrelse 31: bdwrite 32: getblkx db:1:pho1> show page vm_cnt.v_free_count: 5211772 vm_cnt.v_inactive_count: 7847 vm_cnt.v_active_count: 2431770 vm_cnt.v_laundry_count: 0 vm_cnt.v_wire_count: 469322 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51265 vm_cnt.v_free_target: 173128 vm_cnt.v_inactive_target: 259692 db:1:pho1> show pageq pq_free 5211772 dom 0 page_cnt 8124374 free 5211772 pq_act 2431770 pq_inact 7847 pq_laund 0 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 001201 | 000000 11 (008192K) | 000006 | 000001 10 (004096K) | 000010 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000006 | 000000 07 (000512K) | 000037 | 000000 06 (000256K) | 000217 | 000001 05 (000128K) | 000520 | 000001 04 (000064K) | 001047 | 000001 03 (000032K) | 002866 | 000000 02 (000016K) | 002186 | 000000 01 (000008K) | 002730 | 000001 00 (000004K) | 004411 | 000001 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000001 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000001 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree malloc-4096 4096 34115 23 130998 0 2 139829248 0 malloc-32768 32768 958 1334 126594 0 1 75104256 0 malloc-65536 65536 591 496 48091 0 1 71237632 0 mbuf_cluster 2048 13932 800 13940 0 254 30171136 0 RADIX NODE 144 191576 9349 5071794 0 67 28933200 0 BUF TRIE 144 717 105235 1072361 0 63 15257088 0 UMA Slabs 0 112 48755 19 48755 0 126 5462688 0 mbuf 256 15527 2258 18257 0 254 4552960 0 malloc-128 128 26062 1156 26389 0 126 3483904 0 socket 960 52 2996 5739 0 254 2926080 0 g_bio 408 4727 1783 472672 0 30 2656080 0 mbuf_jumbo_page 4096 0 508 3 0 254 2080768 0 pbuf 2776 0 744 0 0 0 2065344 0 malloc-128 128 14431 1193 1136909 0 126 1999872 0 malloc-128 128 12866 1022 12914 0 126 1777664 0 tcpcb 1096 11 1515 16 0 254 1672496 0 FFS inode 1160 1288 126 2724 0 8 1640240 0 256 Bucket 2048 654 84 136075 0 10 1511424 0 malloc-65536 65536 0 23 222 0 1 1507328 0 malloc-4096 4096 340 14 638 0 2 1449984 0 vmem btag 56 21128 2332 75274 0 254 1313760 0 VNODE 600 1416 235 3078 0 16 990600 0 malloc-65536 65536 2 11 95 0 1 851968 0 malloc-16384 16384 2 50 3397 0 1 851968 0 malloc-32768 32768 1 24 10952 0 1 819200 0 malloc-64 64 9476 2998 24874 0 254 798336 0 malloc-32768 32768 1 23 224 0 1 786432 0 unpcb 256 16 3044 5536 0 254 783360 0 malloc-8192 8192 93 2 133 0 1 778240 0 malloc-64 64 9286 2432 12090 0 254 749952 0 DEVCTL 1024 0 676 821 0 0 692224 0 malloc-32768 32768 8 12 30 0 1 655360 0 mbuf_packet 256 9 2531 305 0 254 650240 0 128 Bucket 1024 384 247 50215 0 16 646144 0 THREAD 1808 302 50 303 0 8 636416 0 VM OBJECT 264 1789 431 75460 0 30 586080 0 malloc-65536 65536 4 4 3929 0 1 524288 0 malloc-16384 16384 0 31 191 0 1 507904 0 64 Bucket 512 483 485 35631 0 30 495616 0 UMA Zones 2048 232 3 232 0 8 481280 0 malloc-4096 4096 78 38 7521 0 2 475136 0 32 Bucket 256 331 1484 31223 0 62 464640 0 S VFS Cache 104 1894 2396 3353 0 126 446160 0 FFS2 dinode 256 1288 452 2724 0 62 445440 0 malloc-32768 32768 13 0 13 0 1 425984 0 malloc-64 64 4434 2181 7858 0 254 423360 0 lkpicurr 168 9 2439 9 0 62 411264 0 malloc-65536 65536 3 3 7 0 1 393216 0 malloc-32768 32768 12 0 12 0 1 393216 0 lkpimm 168 3 2325 3 0 62 391104 0 malloc-16384 16384 14 9 4844 0 1 376832 0 malloc-1024 1024 255 113 5235 0 16 376832 0 malloc-2048 2048 105 71 1657 0 8 360448 0 FPU_save_area 832 304 119 504 0 16 351936 0 malloc-256 256 944 421 11231 0 62 349440 0 MAP ENTRY 96 1771 1757 212152 0 126 338688 0 malloc-32 32 8308 2150 8682 0 254 334656 0 malloc-8192 8192 26 14 3100 0 1 327680 0 malloc-8192 8192 0 37 898 0 1 303104 0 malloc-16 16 16007 1993 16187 0 254 288000 0 malloc-128 128 882 1288 2553 0 126 277760 0 VMSPACE 2552 44 58 3450 0 4 260304 0 malloc-128 128 543 1348 17315 0 126 242048 0 malloc-128 128 749 1142 4167 0 126 242048 0 malloc-2048 2048 7 105 5822 0 8 229376 0 16 Bucket 144 210 1358 19105143 0 62 225792 0 malloc-256 256 329 541 1556 0 62 222720 0 malloc-256 256 1 869 176590 0 62 222720 0 DIRHASH 1024 134 74 134 0 16 212992 0 NAMEI 1024 0 208 77685 0 16 212992 0 malloc-1024 1024 15 193 1126 0 16 212992 0 malloc-128 128 388 1255 1083 0 126 210304 0 malloc-128 128 3 1640 177566 0 126 210304 0 filedesc0 1072 65 131 3470 0 8 210112 0 malloc-64 64 30 3057 110001252 0 254 197568 0 malloc-64 64 104 2983 9781 0 254 197568 0 malloc-64 64 7 3080 101071 0 254 197568 0 malloc-256 256 14 736 484 0 62 192000 0 malloc-256 256 182 568 1047 0 62 192000 0 malloc-256 256 9 741 565 0 62 192000 0 2 Bucket 32 1502 4420 79151 0 254 189504 0 clpbuf 2776 1 67 116041 0 2 188768 0 PROC 1352 64 74 3469 0 8 186576 0 ksiginfo 112 92 1564 345 0 126 185472 0 malloc-384 384 183 297 10065 0 30 184320 0 malloc-64 64 27 2808 112 0 254 181440 0 malloc-1024 1024 14 162 39 0 16 180224 0 ttyoutq 256 173 517 282 0 62 176640 0 malloc-256 256 13 677 1340 0 62 176640 0 malloc-256 256 148 542 253 0 62 176640 0 malloc-512 512 50 286 1545 0 30 172032 0 malloc-64 64 162 2421 201 0 254 165312 0 malloc-512 512 1 303 6444 0 30 155648 0 malloc-384 384 13 377 5876 0 30 149760 0 4 Bucket 48 32 3076 256 0 254 149184 0 cpuset 104 27 1399 27 0 126 148304 0 udp_inpcb 424 22 311 177 0 30 141192 0 malloc-384 384 139 221 140 0 30 138240 0 SLEEPQUEUE 88 353 1183 353 0 126 135168 0 pipe 744 5 175 1060 0 16 133920 0 ttyinq 160 330 495 540 0 62 132000 0 Files 80 138 1512 38594 0 126 132000 0 malloc-65536 65536 2 0 2 0 1 131072 0 malloc-65536 65536 2 0 2 0 1 131072 0 malloc-2048 2048 0 64 306 0 8 131072 0 malloc-1024 1024 30 98 58 0 16 131072 0 routing nhops 256 9 501 15 0 62 130560 0 PGRP 88 30 1396 56 0 126 125488 0 rl_entry 40 78 3053 78 0 254 125240 0 8 Bucket 80 147 1403 574302 0 126 124000 0 TURNSTILE 136 353 529 353 0 62 119952 0 malloc-32 32 813 2841 26296 0 254 116928 0 malloc-384 384 26 274 85 0 30 115200 0 malloc-384 384 2 298 119 0 30 115200 0 malloc-4096 4096 21 7 38 0 2 114688 0 malloc-1024 1024 1 111 6478 0 16 114688 0 malloc-512 512 6 210 62 0 30 110592 0 malloc-4096 4096 23 3 23 0 2 106496 0 PWD 32 29 3121 442 0 254 100800 0 malloc-32 32 385 2765 734 0 254 100800 0 malloc-16384 16384 4 2 6 0 1 98304 0 malloc-8192 8192 12 0 12 0 1 98304 0 malloc-8192 8192 11 1 12 0 1 98304 0 malloc-4096 4096 1 23 460 0 2 98304 0 malloc-2048 2048 20 28 20 0 8 98304 0 malloc-1024 1024 18 78 18 0 16 98304 0 pcpu-64 64 454 1082 454 0 254 98304 0 kenv 258 18 342 21842 0 30 92880 0 malloc-32 32 117 2781 1342 0 254 92736 0 malloc-32 32 316 2582 19577 0 254 92736 0 malloc-32 32 65 2833 134 0 254 92736 0 malloc-32 32 42 2856 184 0 254 92736 0 ada_ccb 272 0 336 5065 0 30 91392 0 rtentry 176 12 494 15 0 62 89056 0 udpcb 32 22 2624 177 0 254 84672 0 malloc-4096 4096 7 13 18 0 2 81920 0 malloc-2048 2048 2 38 8 0 8 81920 0 malloc-384 384 16 194 198 0 30 80640 0 UMA Kegs 384 202 1 202 0 30 77952 0 malloc-512 512 12 140 17 0 30 77824 0 tcp_inpcb 424 11 169 16 0 30 76320 0 malloc-384 384 10 170 11 0 30 69120 0 malloc-65536 65536 1 0 1 0 1 65536 0 malloc-32768 32768 2 0 2 0 1 65536 0 malloc-16384 16384 2 2 4 0 1 65536 0 malloc-2048 2048 6 26 6 0 8 65536 0 malloc-512 512 3 117 5 0 30 61440 0 malloc-512 512 1 119 4 0 30 61440 0 malloc-384 384 22 128 22 0 30 57600 0 malloc-8192 8192 6 1 8 0 1 57344 0 ertt 72 11 773 16 0 126 56448 0 malloc-16 16 45 3455 8411 0 254 56000 0 malloc-16 16 824 2676 39011 0 254 56000 0 malloc-16 16 507 2993 1094128 0 254 56000 0 ertt_txseginfo 40 0 1313 48 0 254 52520 0 malloc-16 16 49 3201 301 0 254 52000 0 malloc-16384 16384 1 2 4 0 1 49152 0 malloc-16 16 97 2903 230 0 254 48000 0 Mountpoints 2944 4 12 5 0 4 47104 0 pcpu-8 8 3526 2106 3533 0 254 45056 0 syncache 168 0 264 1 0 254 44352 0 tcp_inpcb ports 32 6 1380 6 0 254 44352 0 udp_inpcb ports 32 10 1376 17 0 254 44352 0 malloc-8192 8192 4 1 5 0 1 40960 0 malloc-32768 32768 1 0 1 0 1 32768 0 malloc-4096 4096 1 7 7 0 2 32768 0 malloc-1024 1024 3 29 3 0 16 32768 0 malloc-512 512 2 62 2 0 30 32768 0 malloc-32 32 6 876 9 0 254 28224 0 SMR CPU 32 7 760 7 0 254 24544 0 SMR SHARED 24 7 760 7 0 254 18408 0 epoch_record pcpu 256 4 60 4 0 62 16384 0 malloc-16384 16384 1 0 1 0 1 16384 0 malloc-8192 8192 2 0 2 0 1 16384 0 malloc-2048 2048 2 6 2 0 8 16384 0 pcpu-16 16 16 1008 16 0 254 16384 0 malloc-16 16 55 945 60 0 254 16000 0 ripcb 424 1 35 1 0 30 15264 0 vmem 1856 1 7 1 0 8 14848 0 malloc-16 16 3 747 3 0 254 12000 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 UMA Slabs 1 176 10 12 10 0 62 3872 0 KMAP ENTRY 96 36 3 36 0 0 3744 0 FFS1 dinode 128 0 0 0 0 126 0 0 swblk 136 0 0 0 0 62 0 0 swpctrie 144 0 0 0 0 62 0 0 da_ccb 544 0 0 0 0 16 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 hostcache 64 0 0 0 0 254 0 0 tcptw 72 0 0 0 0 254 0 0 ipq 56 0 0 0 0 254 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 254 0 0 tcpreass 48 0 0 0 0 254 0 0 ripcb ports 32 0 0 0 0 254 0 0 udplite_inpcb ports 32 0 0 0 0 254 0 0 udplite_inpcb 424 0 0 0 0 30 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 KNOTE 160 0 0 0 0 62 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 272 0 0 0 0 30 0 0 AIOCB 552 0 0 0 0 16 0 0 AIOP 32 0 0 0 0 254 0 0 AIO 208 0 0 0 0 62 0 0 TMPFS node 224 0 0 0 0 62 0 0 NCLNODE 760 0 0 0 0 16 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 L VFS Cache 320 0 0 0 0 30 0 0 STS VFS Cache 144 0 0 0 0 62 0 0 cryptop 280 0 0 0 0 30 0 0 linux_dma_object 32 0 0 0 0 254 0 0 linux_dma_pctrie 144 0 0 0 0 62 0 0 IOMMU_MAP_ENTRY 120 0 0 0 0 126 0 0 mbuf_jumbo_16k 16384 0 0 0 0 254 0 0 mbuf_jumbo_9k 9216 0 0 0 0 254 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 2776 0 0 0 0 10 0 0 mdpbuf 2776 0 0 0 0 1 0 0 nfspbuf 2776 0 0 0 0 2 0 0 swwbuf 2776 0 0 0 0 1 0 0 swrbuf 2776 0 0 0 0 2 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-2048 2048 0 0 0 0 8 0 0 malloc-1024 1024 0 0 0 0 16 0 0 malloc-512 512 0 0 0 0 30 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 fakepg 104 0 0 0 0 126 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 vm pgcache 4096 67840 2211 232335 169 vm pgcache 4096 94955 1137 22644863 169 buf free cache 848 10001 11855 2774256 42 buffer arena-65 65536 0 0 0 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 109 307 15989 1 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 3 4 14 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 kstack_cache 16384 302 10 303 2 db:0:pho> acttrace Tracing command idle pid 11 tid 100003 td 0xfffffe00e4c603a0 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81fea310 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81fea320 trap() at trap+0x56/frame 0xffffffff81fea430 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fea430 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00377f0dd0, rbp = 0xfffffe00377f0dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377f0dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377f0e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377f0e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377f0e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe00e4c5fc80 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e10 trap() at trap+0x56/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00377ebdd0, rbp = 0xfffffe00377ebdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377ebdd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377ebe10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377ebe30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377ebe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377ebef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ebf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe00e4c5f560 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce2de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce2de10 trap() at trap+0x56/frame 0xfffffe003ce2df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce2df20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00377fadd0, rbp = 0xfffffe00377fadd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377fadd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377fae10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377fae30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377fae50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377faef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00e4c5e720 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce47e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce47e10 trap() at trap+0x56/frame 0xfffffe003ce47f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce47f20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00e4830dd0, rbp = 0xfffffe00e4830dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4830dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4830e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4830e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4830e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4830ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4830f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4830f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe00e4c5e000 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce54e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce54e10 trap() at trap+0x56/frame 0xfffffe003ce54f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce54f20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00377ffdd0, rbp = 0xfffffe00377ffdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377ffdd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377ffe10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377ffe30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377ffe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe00e4c66560 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6ee10 trap() at trap+0x56/frame 0xfffffe003ce6ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6ef20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00e4835dd0, rbp = 0xfffffe00e4835dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4835dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4835e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4835e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4835e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4835ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4835f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4835f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe00e4c65e40 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7be00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7be10 trap() at trap+0x56/frame 0xfffffe003ce7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7bf20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00e4844dd0, rbp = 0xfffffe00e4844dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4844dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4844e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4844e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4844e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4844ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4844f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4844f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe00e4c65720 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce88e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce88e10 trap() at trap+0x56/frame 0xfffffe003ce88f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce88f20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00e483fdd0, rbp = 0xfffffe00e483fdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e483fdd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e483fe10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e483fe30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e483fe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e483fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00e4c65000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce95e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce95e10 trap() at trap+0x56/frame 0xfffffe003ce95f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce95f20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00e484edd0, rbp = 0xfffffe00e484edd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e484edd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e484ee10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e484ee30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e484ee50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e484eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e484ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e484ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00e4c62740 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea2e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea2e10 trap() at trap+0x56/frame 0xfffffe003cea2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea2f20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00e4849dd0, rbp = 0xfffffe00e4849dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4849dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4849e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4849e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4849e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4849ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4849f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4849f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100093 td 0xfffffe00e4d2dc80 (CPU 3) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e4e3ecd0 vpanic() at vpanic+0x1b0/frame 0xfffffe00e4e3ed20 panic() at panic+0x43/frame 0xfffffe00e4e3ed80 trap_fatal() at trap_fatal+0x385/frame 0xfffffe00e4e3ede0 calltrap() at calltrap+0x8/frame 0xfffffe00e4e3ede0 --- trap 0x9, rip = 0xffffffff80b3d2cf, rsp = 0xfffffe00e4e3eeb0, rbp = 0xfffffe00e4e3eeb0 --- g_bioq_first() at g_bioq_first+0x2f/frame 0xfffffe00e4e3eeb0 g_io_schedule_up() at g_io_schedule_up+0x62/frame 0xfffffe00e4e3eee0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00e4e3eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command g_journal md10 pid 2785 tid 100221 td 0xfffffe00e4d0b1e0 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce61e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce61e10 trap() at trap+0x56/frame 0xfffffe003ce61f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce61f20 --- trap 0x13, rip = 0xffffffff80c54470, rsp = 0xfffffe014179ea80, rbp = 0xfffffe014179ea90 --- lock_delay() at lock_delay+0x20/frame 0xfffffe014179ea90 __mtx_lock_sleep() at __mtx_lock_sleep+0xf8/frame 0xfffffe014179eb20 __mtx_lock_flags() at __mtx_lock_flags+0xe5/frame 0xfffffe014179eb70 g_io_deliver() at g_io_deliver+0x289/frame 0xfffffe014179ebc0 g_journal_add_current() at g_journal_add_current+0x97/frame 0xfffffe014179ebe0 g_journal_worker() at g_journal_worker+0x1227/frame 0xfffffe014179eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe014179ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014179ef30 --- trap 0xc, rip = 0x3397456d931a, rsp = 0x339741da77e8, rbp = 0x339741da7800 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 3469 2763 2763 0 S+ nanslp 0xffffffff81eab825 sleep 2804 2794 2792 2007 D+ snaplk 0xfffff80139903830 rw 2803 2794 2792 2007 D+ snaplk 0xfffff80139903830 rw 2802 2794 2792 2007 D+ snaplk 0xfffff80139903830 rw 2801 2794 2792 2007 D+ snaplk 0xfffff80139903830 rw 2800 2794 2792 2007 D+ snaplk 0xfffff80139903830 rw 2799 2794 2792 2007 D+ snaplk 0xfffff80139903830 rw 2798 2794 2792 2007 D+ snaplk 0xfffff80139903830 rw 2797 2794 2792 2007 D+ snaplk 0xfffff80139903830 rw 2796 2794 2792 2007 D+ snaplk 0xfffff80139903830 rw 2795 2794 2792 2007 D+ snaplk 0xfffff80139903830 rw 2794 2792 2792 2007 S+ wait 0xfffff80139086a90 rw 2792 2790 2792 2007 S+ nanslp 0xffffffff81eab823 rw 2790 2763 2763 0 S+ wait 0xfffff8000e063a90 su 2785 0 0 0 RL CPU 6 [g_journal md10] 2784 0 0 0 DL bo_wwai 0xfffffe016837c6b0 [g_journal switcher] 2781 0 0 0 DL mdwait 0xfffff80139c76000 [md10] 2763 2758 2763 0 S+ wait 0xfffff80043a7e000 sh 2758 2736 2758 0 S+ pause 0xfffff800274810b0 csh 2741 2740 2741 2006 Ss+ select 0xfffff8002740f5c0 bash 2740 2737 2737 2006 S select 0xfffff80003cd0440 sshd 2737 2709 2737 0 Ss select 0xfffff8002740f440 sshd 2736 1 2736 0 Ss+ wait 0xfffff80027439a90 login 2735 1 2735 0 Ss+ ttyin 0xfffff800043758b0 getty 2734 1 2734 0 Ss+ ttyin 0xfffff8002746b8b0 getty 2733 1 2733 0 Ss+ ttyin 0xfffff8002746bcb0 getty 2732 1 2732 0 Ss+ ttyin 0xfffff8002746a0b0 getty 2731 1 2731 0 Ss+ ttyin 0xfffff8002746a4b0 getty 2730 1 2730 0 Ss+ ttyin 0xfffff8002746a8b0 getty 2729 1 2729 0 Ss+ ttyin 0xfffff8002746acb0 getty 2728 1 2728 0 Ss+ ttyin 0xfffff800274690b0 getty 2727 1 2727 0 Ss+ ttyin 0xfffff800274694b0 getty 2713 1 2713 0 Ss nanslp 0xffffffff81eab827 cron 2709 1 2709 0 Ss select 0xfffff8000487a9c0 sshd 2690 1 2690 0 Ss select 0xfffff8002740f4c0 inetd 2664 1 2664 123 Ss select 0xfffff80004217ac0 ntpd 2638 1 2638 0 Ss select 0xfffff8000e10a2c0 powerd 2633 1 2633 0 Ss rpcsvc 0xfffff8000413a760 NLM: master 2630 1 2630 0 Ss select 0xfffff8000487aac0 rpc.statd 2605 1 2605 0 Ss select 0xfffff8000e10a240 rpcbind 2583 1 2583 0 Ss nanslp 0xffffffff81eab825 watchdogd 2575 1 2575 0 Ss select 0xfffff80003a09cc0 syslogd 2388 1 2388 0 Ss select 0xfffff8002740f6c0 devd 2383 1 2383 65 Ss select 0xfffff80004091f40 dhclient 2324 1 2324 0 Ss select 0xfffff80003a09dc0 dhclient 2321 1 2321 0 Ss select 0xfffff8003264b0c0 dhclient 18 0 0 0 DL syncer 0xffffffff81f9c630 [syncer] 17 0 0 0 DL vlruwt 0xfffff800040c6548 [vnlru] 16 0 0 0 DL (threaded) [bufdaemon] 100197 D psleep 0xffffffff81f9b660 [bufdaemon] 100198 D - 0xffffffff81a0af40 [bufspacedaemon-0] 100199 D - 0xffffffff81a13200 [bufspacedaemon-1] 100200 D - 0xffffffff81a1b4c0 [bufspacedaemon-2] 100201 D - 0xffffffff81a23780 [bufspacedaemon-3] 100202 D - 0xffffffff81a2ba40 [bufspacedaemon-4] 100203 D - 0xffffffff81a33d00 [bufspacedaemon-5] 100204 D - 0xffffffff81a3bfc0 [bufspacedaemon-6] 100219 D sdflush 0xfffff8002751a4e8 [/ worker] 100224 D sdflush 0xfffff8002740bce8 [/tmp worker] 9 0 0 0 DL psleep 0xffffffff81fc1390 [vmdaemon] 8 0 0 0 DL (threaded) [pagedaemon] 100195 D psleep 0xffffffff81fb57f8 [dom0] 100205 D launds 0xffffffff81fb5804 [laundry: dom0] 100206 D umarcl 0xffffffff80f61e50 [uma] 7 0 0 0 DL idle 0xfffff800040c2a90 [enc_daemon1] 6 0 0 0 DL idle 0xfffff800040c1000 [enc_daemon0] 5 0 0 0 DL - 0xffffffff81cdf1d8 [rand_harvestq] 15 0 0 0 DL (threaded) [usb] 100128 D - 0xfffffe010a1a2440 [usbus0] 100129 D - 0xfffffe010a1a2498 [usbus0] 100130 D - 0xfffffe010a1a24f0 [usbus0] 100131 D - 0xfffffe010a1a2548 [usbus0] 100132 D - 0xfffffe010a1a25a0 [usbus0] 100134 D - 0xfffffe00e4d76cf0 [usbus1] 100135 D - 0xfffffe00e4d76d48 [usbus1] 100136 D - 0xfffffe00e4d76da0 [usbus1] 100137 D - 0xfffffe00e4d76df8 [usbus1] 100138 D - 0xfffffe00e4d76e50 [usbus1] 100139 D - 0xfffffe00e4d56cf0 [usbus2] 100140 D - 0xfffffe00e4d56d48 [usbus2] 100141 D - 0xfffffe00e4d56da0 [usbus2] 100142 D - 0xfffffe00e4d56df8 [usbus2] 100143 D - 0xfffffe00e4d56e50 [usbus2] 4 0 0 0 DL (threaded) [cam] 100121 D - 0xffffffff81bc8fc0 [doneq0] 100122 D - 0xffffffff81bc9040 [doneq1] 100123 D - 0xffffffff81bc90c0 [doneq2] 100124 D - 0xffffffff81bc8f40 [async] 100152 D - 0xffffffff81bc8e10 [scanner] 14 0 0 0 DL seqstat 0xfffff80004419888 [sequencer 00] 3 0 0 0 DL (threaded) [crypto] 100107 D crypto_ 0xffffffff81fb2d20 [crypto] 100108 D crypto_ 0xfffff8000437c830 [crypto returns 0] 100109 D crypto_ 0xfffff8000437c880 [crypto returns 1] 100110 D crypto_ 0xfffff8000437c8d0 [crypto returns 2] 100111 D crypto_ 0xfffff8000437c920 [crypto returns 3] 100112 D crypto_ 0xfffff8000437c970 [crypto returns 4] 100113 D crypto_ 0xfffff8000437c9c0 [crypto returns 5] 100114 D crypto_ 0xfffff8000437ca10 [crypto returns 6] 100115 D crypto_ 0xfffff8000437ca60 [crypto returns 7] 100116 D crypto_ 0xfffff8000437cab0 [crypto returns 8] 100117 D crypto_ 0xfffff8000437cb00 [crypto returns 9] 100118 D crypto_ 0xfffff8000437cb50 [crypto returns 10] 100119 D crypto_ 0xfffff8000437cba0 [crypto returns 11] 13 0 0 0 RL (threaded) [geom] 100092 D - 0xffffffff81e8af90 [g_event] 100093 Run CPU 3 [g_up] 100094 D - 0xffffffff81e8afa0 [g_down] 2 0 0 0 WL (threaded) [clock] 100078 I [clock (0)] 100079 I [clock (1)] 100080 I [clock (2)] 100081 I [clock (3)] 100082 I [clock (4)] 100083 I [clock (5)] 100084 I [clock (6)] 100085 I [clock (7)] 100086 I [clock (8)] 100087 I [clock (9)] 100088 I [clock (10)] 100089 I [clock (11)] 12 0 0 0 WL (threaded) [intr] 100043 I [swi5: fast taskq] 100048 I [swi6: task queue] 100049 I [swi6: Giant taskq] 100077 I [swi1: netisr 0] 100090 I [swi3: busdma] 100125 I [swi4: apei] 100126 I [irq56: ahci0] 100127 I [irq19: xhci0] 100133 I [irq18: ehci0 ehci1+] 100144 I [irq71: ahci1] 100145 I [swi0: uart uart] 100159 I [irq73: mlx5_core0] 100160 I [irq74: mlx5_core0] 100161 I [irq72: mlx5_core0] 100162 I [irq75: mlx5_core0] 100163 I [irq76: mlx5_core0] 100164 I [irq77: mlx5_core0] 100165 I [irq78: mlx5_core0] 100166 I [irq79: mlx5_core0] 100167 I [irq80: mlx5_core0] 100168 I [irq81: mlx5_core0] 100169 I [irq82: mlx5_core0] 100170 I [irq83: mlx5_core0] 100171 I [irq84: mlx5_core0] 100172 I [irq85: mlx5_core0] 100173 I [irq86: mlx5_core0] 100179 I [irq88: mlx5_core1] 100180 I [irq89: mlx5_core1] 100181 I [irq87: mlx5_core1] 100182 I [irq90: mlx5_core1] 100183 I [irq91: mlx5_core1] 100184 I [irq92: mlx5_core1] 100185 I [irq93: mlx5_core1] 100186 I [irq94: mlx5_core1] 100187 I [irq95: mlx5_core1] 100188 I [irq96: mlx5_core1] 100189 I [irq97: mlx5_core1] 100190 I [irq98: mlx5_core1] 100191 I [irq99: mlx5_core1] 100192 I [irq100: mlx5_core1] 100193 I [irq101: mlx5_core1] 100253 I [irq102: ioat0] 100254 I [irq103: ioat1] 100255 I [irq104: ioat2] 100256 I [irq105: ioat3] 100257 I [irq106: ioat4] 100258 I [irq107: ioat5] 100259 I [irq108: ioat6] 100260 I [irq109: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff80003c25000 [init] 10 0 0 0 DL audit_w 0xffffffff81fb3230 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81e8b530 [swapper] 100015 D - 0xfffff80003a19000 [softirq_0] 100016 D - 0xfffff80003a18e00 [softirq_1] 100017 D - 0xfffff80003a18d00 [softirq_2] 100018 D - 0xfffff80003a18c00 [softirq_3] 100019 D - 0xfffff80003a18b00 [softirq_4] 100020 D - 0xfffff80003a18a00 [softirq_5] 100021 D - 0xfffff80003a18900 [softirq_6] 100022 D - 0xfffff80003a18800 [softirq_7] 100023 D - 0xfffff80003a18700 [softirq_8] 100024 D - 0xfffff80003a18600 [softirq_9] 100025 D - 0xfffff80003a18500 [softirq_10] 100026 D - 0xfffff80003a18400 [softirq_11] 100027 D - 0xfffff80003a18300 [if_io_tqg_0] 100028 D - 0xfffff80003a18200 [if_io_tqg_1] 100029 D - 0xfffff80003a18100 [if_io_tqg_2] 100030 D - 0xfffff80003a18000 [if_io_tqg_3] 100031 D - 0xfffff80003a17e00 [if_io_tqg_4] 100032 D - 0xfffff80003a17d00 [if_io_tqg_5] 100033 D - 0xfffff80003a17c00 [if_io_tqg_6] 100034 D - 0xfffff80003a17b00 [if_io_tqg_7] 100035 D - 0xfffff80003a17a00 [if_io_tqg_8] 100036 D - 0xfffff80003a17900 [if_io_tqg_9] 100037 D - 0xfffff80003a17800 [if_io_tqg_10] 100038 D - 0xfffff80003a17700 [if_io_tqg_11] 100039 D - 0xfffff80003a17600 [if_config_tqg_0] 100040 D - 0xfffff80003a17500 [inm_free taskq] 100041 D - 0xfffff80003a17400 [deferred_unmount ta] 100042 D - 0xfffff80003a17300 [thread taskq] 100044 D - 0xfffff80003a17100 [pci_hp taskq] 100045 D - 0xfffff80003a17000 [linuxkpi_irq_wq] 100046 D - 0xfffff80003a16e00 [kqueue_ctx taskq] 100047 D - 0xfffff80003a16d00 [in6m_free taskq] 100050 D - 0xfffff80003a16a00 [aiod_kick taskq] 100051 D - 0xfffff80003a16900 [linuxkpi_short_wq_0] 100052 D - 0xfffff80003a16900 [linuxkpi_short_wq_1] 100053 D - 0xfffff80003a16900 [linuxkpi_short_wq_2] 100054 D - 0xfffff80003a16900 [linuxkpi_short_wq_3] 100055 D - 0xfffff80003a16900 [linuxkpi_short_wq_4] 100056 D - 0xfffff80003a16900 [linuxkpi_short_wq_5] 100057 D - 0xfffff80003a16900 [linuxkpi_short_wq_6] 100058 D - 0xfffff80003a16900 [linuxkpi_short_wq_7] 100059 D - 0xfffff80003a16900 [linuxkpi_short_wq_8] 100060 D - 0xfffff80003a16900 [linuxkpi_short_wq_9] 100061 D - 0xfffff80003a16900 [linuxkpi_short_wq_1] 100062 D - 0xfffff80003a16900 [linuxkpi_short_wq_1] 100063 D - 0xfffff80003a16900 [linuxkpi_short_wq_1] 100064 D - 0xfffff80003a16800 [linuxkpi_long_wq_0] 100065 D - 0xfffff80003a16800 [linuxkpi_long_wq_1] 100066 D - 0xfffff80003a16800 [linuxkpi_long_wq_2] 100067 D - 0xfffff80003a16800 [linuxkpi_long_wq_3] 100068 D - 0xfffff80003a16800 [linuxkpi_long_wq_4] 100069 D - 0xfffff80003a16800 [linuxkpi_long_wq_5] 100070 D - 0xfffff80003a16800 [linuxkpi_long_wq_6] 100071 D - 0xfffff80003a16800 [linuxkpi_long_wq_7] 100072 D - 0xfffff80003a16800 [linuxkpi_long_wq_8] 100073 D - 0xfffff80003a16800 [linuxkpi_long_wq_9] 100074 D - 0xfffff80003a16800 [linuxkpi_long_wq_10] 100075 D - 0xfffff80003a16800 [linuxkpi_long_wq_11] 100076 D - 0xfffff80003a16800 [linuxkpi_long_wq_12] 100091 D - 0xfffff80003ddd300 [firmware taskq] 100095 D - 0xfffff80003dde700 [crypto_0] 100096 D - 0xfffff80003dde700 [crypto_1] 100097 D - 0xfffff80003dde700 [crypto_2] 100098 D - 0xfffff80003dde700 [crypto_3] 100099 D - 0xfffff80003dde700 [crypto_4] 100100 D - 0xfffff80003dde700 [crypto_5] 100101 D - 0xfffff80003dde700 [crypto_6] 100102 D - 0xfffff80003dde700 [crypto_7] 100103 D - 0xfffff80003dde700 [crypto_8] 100104 D - 0xfffff80003dde700 [crypto_9] 100105 D - 0xfffff80003dde700 [crypto_10] 100106 D - 0xfffff80003dde700 [crypto_11] 100147 D - 0xfffff80027429800 [acpi_task_0] 100148 D - 0xfffff80027429800 [acpi_task_1] 100149 D - 0xfffff80027429800 [acpi_task_2] 100150 D - 0xfffff80003a19100 [mca taskq] 100151 D - 0xfffff80003dde000 [CAM taskq] 100155 D - 0xfffff80027429500 [mlx5_core0-rec] 100156 D - 0xfffff80027429400 [mlx5_core0-wdg] 100157 D - 0xfffff80027429300 [mlx5_core0-cmd] 100158 D - 0xfffff80027429100 [mlx5_page_allocator] 100174 D - 0xfffff8002742be00 [mlx5_esw_wq] 100175 D - 0xfffff8002742bb00 [mlx5_core1-rec] 100176 D - 0xfffff8002742ba00 [mlx5_core1-wdg] 100177 D - 0xfffff8002742b900 [mlx5_core1-cmd] 100178 D - 0xfffff8002742b700 [mlx5_page_allocator] 100194 D - 0xfffff800040a5e00 [mlx5_esw_wq] db:0:pho> allt Tracing command kernel pid 0 tid 100000 td 0xffffffff81e8ba80 sched_switch() at sched_switch+0x559/frame 0xffffffff8235fe00 mi_switch() at mi_switch+0x157/frame 0xffffffff8235fe20 sleepq_switch() at sleepq_switch+0x107/frame 0xffffffff8235fe60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff8235fea0 _sleep() at _sleep+0x2ce/frame 0xffffffff8235ff40 swapper() at swapper+0x75/frame 0xffffffff8235ffa0 mi_startup() at mi_startup+0x2f3/frame 0xffffffff8235fff0 btext() at btext+0x22 Tracing command kernel pid 0 tid 100015 td 0xfffffe00e4c62020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4858de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4858e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4858e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4858ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4858ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4858f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4858f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe00e4c61900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4853de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4853e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4853e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4853ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4853ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4853f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4853f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffffe00e4ce6720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4862de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4862e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4862e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4862ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4862ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4862f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4862f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe00e4ce6000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e485dde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e485de00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e485de40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e485dec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e485def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e485df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e485df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe00e4c69740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e486cde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e486ce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e486ce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e486cec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e486cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e486cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e486cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe00e4c69020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4867de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4867e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4867e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4867ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4867ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4867f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4867f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe00e4c68900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4876de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4876e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4876e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4876ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4876ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4876f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4876f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe00e4c681e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4871de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4871e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4871e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4871ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4871ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4871f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4871f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe00e4c67ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4880de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4880e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4880e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4880ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4880ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4880f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4880f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe00e4c673a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e487bde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e487be00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e487be40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e487bec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e487bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e487bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e487bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe00e4cea020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e488ade0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e488ae00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e488ae40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e488aec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e488aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe00e4ce9900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4885de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4885e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4885e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4885ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4885ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4885f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4885f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe00e4ce91e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4894de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4894e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4894e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4894ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4894ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4894f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4894f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe00e4ce8ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e488fde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e488fe00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e488fe40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e488fec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e488fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe00e4ce83a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e489ede0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e489ee00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e489ee40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e489eec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e489eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e489ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e489ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe00e4ce7c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4899de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4899e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4899e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4899ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4899ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4899f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4899f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe00e4ce7560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48a8de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48a8e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48a8e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48a8ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48a8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe00e4ce6e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48a3de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48a3e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48a3e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48a3ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48a3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe00e4cf3ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48b2de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48b2e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48b2e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48b2ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48b2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe00e4cf33a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48adde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48ade00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48ade40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48adec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48adef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48adf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48adf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe00e4cf2c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48bcde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48bce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48bce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48bcec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48bcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48bcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48bcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe00e4cf2560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48b7de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48b7e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48b7e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48b7ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48b7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe00e4cf1e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48c6de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48c6e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48c6e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48c6ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48c6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe00e4cf1720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48c1de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48c1e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48c1e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48c1ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48c1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe00e4cf1000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48d0de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48d0e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48d0e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48d0ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48d0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe00e4cea740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48cbdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48cbde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48cbe20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48cbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48cbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48cbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48cbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffffe00e4cf9560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48dadc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48dade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48dae20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48daec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48daef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48daf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48daf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffffe00e4cf8e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48d5dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48d5de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48d5e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48d5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48d5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffffe00e4cf8000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48dfdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48dfde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48dfe20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48dfec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48dfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48dff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48dff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffffe00e4cf5740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48eede0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48eee00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48eee40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48eeec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e48eeef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48eef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48eef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffffe00e4cf5020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48e9dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48e9de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48e9e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48e9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48e9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48e9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100047 td 0xfffffe00e4cf4900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48f8dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48f8de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48f8e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48f8ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48f8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48f8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100050 td 0xfffffe00e4cfc740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48fddc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48fdde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48fde20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48fdec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48fdef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48fdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48fdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100051 td 0xfffffe00e4cfc020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e490cdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e490cde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e490ce20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e490cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e490cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e490cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e490cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100052 td 0xfffffe00e4cfb900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4907dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4907de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4907e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4907ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4907ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4907f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4907f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffffe00e4cfb1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4916dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4916de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4916e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4916ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4916ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4916f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4916f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100054 td 0xfffffe00e4cfaac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4911dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4911de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4911e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4911ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4911ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4911f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4911f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100055 td 0xfffffe00e4cfa3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4920dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4920de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4920e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4920ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4920ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4920f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4920f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffffe00e4cf9c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e491bdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e491bde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e491be20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e491bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e491bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e491bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e491bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100057 td 0xfffffe00e4d04900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e492adc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e492ade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e492ae20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e492aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e492aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e492af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffffe00e4d041e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4925dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4925de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4925e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4925ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4925ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4925f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4925f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffffe00e4d03ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4934dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4934de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4934e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4934ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4934ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4934f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4934f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffffe00e4d033a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e492fdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e492fde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e492fe20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e492fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e492fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e492ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe00e4d02c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e493edc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e493ede0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e493ee20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e493eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e493eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e493ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e493ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffffe00e4d02560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4939dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4939de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4939e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4939ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4939ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4939f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4939f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffffe00e4d01e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4948dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4948de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4948e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4948ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4948ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4948f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4948f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffffe00e4d01720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4943dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4943de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4943e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4943ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4943ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4943f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4943f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffffe00e4d0a3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4952dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4952de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4952e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4952ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4952ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4952f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4952f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe00e4d09c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e494ddc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e494dde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e494de20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e494dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e494def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e494df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e494df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe00e4d09560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e495cdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e495cde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e495ce20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e495cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e495cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e495cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e495cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe00e4d08e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4957dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4957de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4957e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4957ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4957ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4957f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4957f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe00e4d08720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4966dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4966de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4966e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4966ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4966ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4966f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4966f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe00e4d08000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4961dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4961de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4961e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4961ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4961ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4961f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4961f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe00e4d05740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4970dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4970de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4970e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4970ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4970ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4970f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4970f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe00e4d05020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e496bdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e496bde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e496be20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e496bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e496bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e496bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e496bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe00e4d0de40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e497adc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e497ade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e497ae20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e497aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e497aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe00e4d0d720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4975dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4975de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4975e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4975ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4975ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4975f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4975f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe00e4d0d000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4984dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4984de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4984e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4984ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4984ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4984f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4984f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe00e4d0c740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e497fdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e497fde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e497fe20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e497fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e497fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffffe00e4d17720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e34dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e34de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e34e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e34ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e34ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e34f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e34f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100095 td 0xfffffe00e4d2ce40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e48dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e48de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e48e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e48ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e48ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e48f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffffe00e4d2c720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e43dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e43de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e43e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e43ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e43ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e43f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100097 td 0xfffffe00e4d2c000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e52dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e52de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e52e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e52ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e52ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e52f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e52f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffffe00e4d1b740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e4ddc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e4dde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e4de20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e4dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e4def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e4df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e4df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100099 td 0xfffffe00e4d1b020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e5cdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e5cde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e5ce20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e5cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e5cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e5cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffffe00e4d1a900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e57dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e57de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e57e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e57ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e57ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e57f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100101 td 0xfffffe00e4d36720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e66dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e66de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e66e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e66ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e66ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e66f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffffe00e4d36000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e61dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e61de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e61e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e61ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e61ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e61f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100103 td 0xfffffe00e4d30740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e70dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e70de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e70e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e70ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e70ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e70f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e70f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffffe00e4d30020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e6bdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e6bde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e6be20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e6bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e6bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e6bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e6bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100105 td 0xfffffe00e4d2f900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e7adc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e7ade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e7ae20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e7aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e7aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffffe00e4d2f1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e75dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e75de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e75e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e75ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e75ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e75f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e75f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100147 td 0xfffffe010d9fcc80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ffcde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ffce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ffce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4ffcec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4ffcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ffcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ffcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100148 td 0xfffffe010d9fc560 sched_switch() at sched_switch+0x559/frame 0xfffffe010da3ede0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da3ee00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da3ee40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da3eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da3eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100149 td 0xfffffe010d9fbe40 sched_switch() at sched_switch+0x559/frame 0xfffffe010da39de0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da39e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da39e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da39ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da39ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da39f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100150 td 0xfffffe010d9fb720 sched_switch() at sched_switch+0x559/frame 0xfffffe010da48de0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da48e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da48e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da48ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da48ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da48f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100151 td 0xfffffe010d9fb000 sched_switch() at sched_switch+0x559/frame 0xfffffe010da43dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da43de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da43e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da43ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da43ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da43f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100155 td 0xfffffe010a32d020 sched_switch() at sched_switch+0x559/frame 0xfffffe010da4ddc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da4dde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da4de20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da4dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da4def0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da4df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da4df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100156 td 0xfffffe010ddc2740 sched_switch() at sched_switch+0x559/frame 0xfffffe010da66dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da66de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da66e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da66ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da66ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da66f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100157 td 0xfffffe010ddc2020 sched_switch() at sched_switch+0x559/frame 0xfffffe010da61dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da61de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da61e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da61ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da61ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da61f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100158 td 0xfffffe010ddc1900 sched_switch() at sched_switch+0x559/frame 0xfffffe010da70dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da70de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da70e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da70ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da70ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da70f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da70f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100174 td 0xfffffe010e0c9e40 sched_switch() at sched_switch+0x559/frame 0xfffffe010dac0dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dac0de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dac0e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dac0ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dac0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dac0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100175 td 0xfffffe010e0c9720 sched_switch() at sched_switch+0x559/frame 0xfffffe010dabbdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dabbde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dabbe20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dabbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dabbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dabbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dabbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100176 td 0xfffffe010e0c9000 sched_switch() at sched_switch+0x559/frame 0xfffffe010dacadc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dacade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dacae20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dacaec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dacaef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dacaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dacaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100177 td 0xfffffe010deaf740 sched_switch() at sched_switch+0x559/frame 0xfffffe010dac5dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dac5de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dac5e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dac5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dac5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dac5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100178 td 0xfffffe010deaf020 sched_switch() at sched_switch+0x559/frame 0xfffffe010dad4dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dad4de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dad4e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dad4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dad4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dad4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dad4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100194 td 0xfffffe010e139020 sched_switch() at sched_switch+0x559/frame 0xfffffe010db24dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010db24de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db24e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010db24ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010db24ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db24f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db24f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe00e4c60ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00377e1a10 mi_switch() at mi_switch+0x157/frame 0xfffffe00377e1a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00377e1a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00377e1ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00377e1ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe00377e1b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe00377e1c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00377e1e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe00377e1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00377e1f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x28e8da, rsp = 0x820f4a3f8, rbp = 0x820f4a460 --- Tracing command clock pid 2 tid 100078 td 0xfffffe00e4d11020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49b9ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49b9ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49b9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49b9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49b9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100079 td 0xfffffe00e4d10900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49c8ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49c8ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49c8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100080 td 0xfffffe00e4d101e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49c3ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49c3ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49c3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100081 td 0xfffffe00e4d0fac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49d2ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49d2ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49d2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49d2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49d2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100082 td 0xfffffe00e4d0f3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49cdea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49cdec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49cdef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49cdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49cdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100083 td 0xfffffe00e4d0ec80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49dcea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49dcec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49dcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49dcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49dcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100084 td 0xfffffe00e4d0e560 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100085 td 0xfffffe00e4d1a1e0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100086 td 0xfffffe00e4d19ac0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100087 td 0xfffffe00e4d193a0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100088 td 0xfffffe00e4d18c80 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100089 td 0xfffffe00e4d18560 fork_trampoline() at fork_trampoline Tracing command crypto pid 3 tid 100107 td 0xfffffe00e4d2eac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e84db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e84dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e84e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e84eb0 crypto_dispatch_thread() at crypto_dispatch_thread+0xbf/frame 0xfffffe00e4e84ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e84f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e84f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100108 td 0xfffffe00e4d2e3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e7fdb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e7fdd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e7fe10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e7feb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e7fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100109 td 0xfffffe00e4d3a020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e8edb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e8edd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e8ee10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e8eeb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e8eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e8ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e8ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100110 td 0xfffffe00e4d39900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e89db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e89dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e89e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e89eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e89ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e89f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e89f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100111 td 0xfffffe00e4d391e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e98db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e98dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e98e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e98eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e98ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e98f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e98f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100112 td 0xfffffe00e4d38ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e93db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e93dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e93e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e93eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e93ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e93f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e93f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100113 td 0xfffffe00e4d383a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ea2db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ea2dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ea2e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ea2eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ea2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100114 td 0xfffffe00e4d37c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e9ddb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e9ddd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e9de10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e9deb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e9def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e9df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e9df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100115 td 0xfffffe00e4d37560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4eacdb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eacdd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eace10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4eaceb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eacef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eacf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eacf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100116 td 0xfffffe00e4d36e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ea7db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ea7dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ea7e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ea7eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ea7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100117 td 0xfffffe00e4d3dac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4eb6db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eb6dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eb6e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4eb6eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eb6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100118 td 0xfffffe00e4d3d3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4eb1db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eb1dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eb1e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4eb1eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eb1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100119 td 0xfffffe00e4d3cc80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ec0db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ec0dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ec0e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ec0eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ec0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100121 td 0xfffffe00e4d3be40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ecada0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ecadc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ecae00 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ecaea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ecaef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ecaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100122 td 0xfffffe00e4d3b720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ec5da0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ec5dc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ec5e00 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ec5ea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ec5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100123 td 0xfffffe00e4d3b000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ed4da0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ed4dc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ed4e00 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ed4ea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ed4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100124 td 0xfffffe00e4d3a740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ecfda0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ecfdc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ecfe00 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ecfea0 xpt_async_td() at xpt_async_td+0x74/frame 0xfffffe00e4ecfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ecff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100152 td 0xfffffe010a32d740 sched_switch() at sched_switch+0x559/frame 0xfffffe010da52dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da52de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da52e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da52ec0 xpt_scanner_thread() at xpt_scanner_thread+0x154/frame 0xfffffe010da52ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da52f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da52f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 5 tid 100146 td 0xfffffe010d9fd3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe010da34d20 mi_switch() at mi_switch+0x157/frame 0xfffffe010da34d40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da34d80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010da34dc0 _sleep() at _sleep+0x2ce/frame 0xfffffe010da34e60 random_kthread() at random_kthread+0xa7/frame 0xfffffe010da34ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da34f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da34f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 6 tid 100153 td 0xfffffe010ddbee40 sched_switch() at sched_switch+0x559/frame 0xfffffe010da5cd80 mi_switch() at mi_switch+0x157/frame 0xfffffe010da5cda0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da5cde0 _sleep() at _sleep+0x2e7/frame 0xfffffe010da5ce80 enc_daemon() at enc_daemon+0xeb/frame 0xfffffe010da5cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da5cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 7 tid 100154 td 0xfffffe010ddbe720 sched_switch() at sched_switch+0x559/frame 0xfffffe010da57d80 mi_switch() at mi_switch+0x157/frame 0xfffffe010da57da0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da57de0 _sleep() at _sleep+0x2e7/frame 0xfffffe010da57e80 enc_daemon() at enc_daemon+0xeb/frame 0xfffffe010da57ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da57f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 8 tid 100195 td 0xfffffe010e138900 sched_switch() at sched_switch+0x559/frame 0xfffffe010db1fab0 mi_switch() at mi_switch+0x157/frame 0xfffffe010db1fad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db1fb10 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db1fb50 _sleep() at _sleep+0x2ce/frame 0xfffffe010db1fbf0 vm_pageout_worker() at vm_pageout_worker+0x28c/frame 0xfffffe010db1feb0 vm_pageout() at vm_pageout+0x1d7/frame 0xfffffe010db1fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db1ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db1ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 8 tid 100205 td 0xfffffe010e3e2560 sched_switch() at sched_switch+0x559/frame 0xfffffe010db69b70 mi_switch() at mi_switch+0x157/frame 0xfffffe010db69b90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db69bd0 _sleep() at _sleep+0x2e7/frame 0xfffffe010db69c70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xb33/frame 0xfffffe010db69ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db69f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db69f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 8 tid 100206 td 0xfffffe010e3e1e40 sched_switch() at sched_switch+0x559/frame 0xfffffe0114d73d80 mi_switch() at mi_switch+0x157/frame 0xfffffe0114d73da0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0114d73de0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0114d73e20 _sleep() at _sleep+0x2ce/frame 0xfffffe0114d73ec0 uma_reclaim_worker() at uma_reclaim_worker+0xc8/frame 0xfffffe0114d73ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0114d73f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0114d73f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command vmdaemon pid 9 tid 100196 td 0xfffffe010e1381e0 sched_switch() at sched_switch+0x559/frame 0xfffffe010db3ad80 mi_switch() at mi_switch+0x157/frame 0xfffffe010db3ada0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db3ade0 _sleep() at _sleep+0x2e7/frame 0xfffffe010db3ae80 vm_daemon() at vm_daemon+0x92/frame 0xfffffe010db3aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db3af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db3af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe00e4c611e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00377e6dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00377e6df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00377e6e30 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00377e6e90 audit_worker() at audit_worker+0x9f/frame 0xfffffe00377e6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe00e4c603a0 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81fea310 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81fea320 trap() at trap+0x56/frame 0xffffffff81fea430 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fea430 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00377f0dd0, rbp = 0xfffffe00377f0dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377f0dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377f0e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377f0e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377f0e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe00e4c5fc80 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e10 trap() at trap+0x56/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00377ebdd0, rbp = 0xfffffe00377ebdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377ebdd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377ebe10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377ebe30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377ebe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377ebef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ebf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe00e4c5f560 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce2de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce2de10 trap() at trap+0x56/frame 0xfffffe003ce2df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce2df20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00377fadd0, rbp = 0xfffffe00377fadd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377fadd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377fae10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377fae30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377fae50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377faef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe00e4c5ee40 sched_switch() at sched_switch+0x559/frame 0xfffffe00377f5e30 mi_switch() at mi_switch+0x157/frame 0xfffffe00377f5e50 sched_idletd() at sched_idletd+0xa1/frame 0xfffffe00377f5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00e4c5e720 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce47e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce47e10 trap() at trap+0x56/frame 0xfffffe003ce47f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce47f20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00e4830dd0, rbp = 0xfffffe00e4830dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4830dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4830e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4830e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4830e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4830ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4830f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4830f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe00e4c5e000 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce54e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce54e10 trap() at trap+0x56/frame 0xfffffe003ce54f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce54f20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00377ffdd0, rbp = 0xfffffe00377ffdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377ffdd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377ffe10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377ffe30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377ffe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe00e4c66c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e483ae30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e483ae50 sched_idletd() at sched_idletd+0xa1/frame 0xfffffe00e483aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe00e4c66560 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6ee10 trap() at trap+0x56/frame 0xfffffe003ce6ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6ef20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00e4835dd0, rbp = 0xfffffe00e4835dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4835dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4835e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4835e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4835e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4835ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4835f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4835f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe00e4c65e40 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7be00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7be10 trap() at trap+0x56/frame 0xfffffe003ce7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7bf20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00e4844dd0, rbp = 0xfffffe00e4844dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4844dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4844e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4844e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4844e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4844ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4844f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4844f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe00e4c65720 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce88e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce88e10 trap() at trap+0x56/frame 0xfffffe003ce88f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce88f20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00e483fdd0, rbp = 0xfffffe00e483fdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e483fdd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e483fe10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e483fe30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e483fe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e483fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00e4c65000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce95e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce95e10 trap() at trap+0x56/frame 0xfffffe003ce95f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce95f20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00e484edd0, rbp = 0xfffffe00e484edd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e484edd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e484ee10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e484ee30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e484ee50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e484eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e484ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e484ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00e4c62740 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea2e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea2e10 trap() at trap+0x56/frame 0xfffffe003cea2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea2f20 --- trap 0x13, rip = 0xffffffff81091866, rsp = 0xfffffe00e4849dd0, rbp = 0xfffffe00e4849dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4849dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4849e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4849e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4849e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4849ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4849f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4849f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100043 td 0xfffffe00e4cf8720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffffe00e4cf41e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48f3e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48f3e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e48f3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48f3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffffe00e4d01000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4902e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4902e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4902ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4902f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4902f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100077 td 0xfffffe00e4d11740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49bee40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49bee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49beef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49bef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49bef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100090 td 0xfffffe00e4d17e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100125 td 0xfffffe00e4d89560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100126 td 0xfffffe00e4d88e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ed9e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ed9e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ed9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100127 td 0xfffffe00e4d88720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ee8e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ee8e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ee8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ee8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100133 td 0xfffffe010a329000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f06e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f06e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f06ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f06f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f06f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100144 td 0xfffffe010a32a560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100145 td 0xfffffe010a329e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f4ee40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f4ee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f4eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f4ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f4ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100159 td 0xfffffe010ddc11e0 sched_switch() at sched_switch+0x559/frame 0xfffffe010da6be40 mi_switch() at mi_switch+0x157/frame 0xfffffe010da6be60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010da6bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da6bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da6bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100160 td 0xfffffe010ddc0ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100161 td 0xfffffe010ddc03a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100162 td 0xfffffe010ddbfc80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100163 td 0xfffffe010ddbf560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100164 td 0xfffffe010deae1e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100165 td 0xfffffe010deadac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100166 td 0xfffffe010dead3a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100167 td 0xfffffe010deacc80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100168 td 0xfffffe010deac560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100169 td 0xfffffe010deabe40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100170 td 0xfffffe010deab720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100171 td 0xfffffe010deab000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100172 td 0xfffffe010e0cac80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100173 td 0xfffffe010e0ca560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe010deae900 sched_switch() at sched_switch+0x559/frame 0xfffffe010dacfe40 mi_switch() at mi_switch+0x157/frame 0xfffffe010dacfe60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010dacfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dacff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dacff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100180 td 0xfffffe010ddbe000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffffe010d9ff740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffffe010d9ff020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffffe010d9fe900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffffe010d9fe1e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffffe010d9fdac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffffe010e135720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffffe010e135000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffffe010e0cd740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffffe010e0cd020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffffe010e0cc900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100191 td 0xfffffe010e0cc1e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100192 td 0xfffffe010e0cbac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100193 td 0xfffffe010e0cb3a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100253 td 0xfffffe010e63a3a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100254 td 0xfffffe010e639c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100255 td 0xfffffe010e639560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100256 td 0xfffffe010e638e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100257 td 0xfffffe010e638720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100258 td 0xfffffe0143684ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100259 td 0xfffffe01436843a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100260 td 0xfffffe0143683c80 fork_trampoline() at fork_trampoline Tracing command geom pid 13 tid 100092 td 0xfffffe00e4d17000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49ffdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49ffde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e49ffe20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e49ffec0 g_run_events() at g_run_events+0x444/frame 0xfffffe00e49ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100093 td 0xfffffe00e4d2dc80 (CPU 3) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e4e3ecd0 vpanic() at vpanic+0x1b0/frame 0xfffffe00e4e3ed20 panic() at panic+0x43/frame 0xfffffe00e4e3ed80 trap_fatal() at trap_fatal+0x385/frame 0xfffffe00e4e3ede0 calltrap() at calltrap+0x8/frame 0xfffffe00e4e3ede0 --- trap 0x9, rip = 0xffffffff80b3d2cf, rsp = 0xfffffe00e4e3eeb0, rbp = 0xfffffe00e4e3eeb0 --- g_bioq_first() at g_bioq_first+0x2f/frame 0xfffffe00e4e3eeb0 g_io_schedule_up() at g_io_schedule_up+0x62/frame 0xfffffe00e4e3eee0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00e4e3eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100094 td 0xfffffe00e4d2d560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e39db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e39dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e39e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e39eb0 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe00e4e39ee0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe00e4e39ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e39f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100120 td 0xfffffe00e4d3c560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ebbdb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ebbdd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ebbe10 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ebbe70 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe00e4ebbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ebbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ebbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100128 td 0xfffffe00e4d88000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ee3e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ee3e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ee3e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ee3ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ee3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ee3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100129 td 0xfffffe00e4d3f740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ef2e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ef2e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ef2e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ef2ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100130 td 0xfffffe00e4d3f020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4eede00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eede20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eede60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4eedec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eedef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eedf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eedf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100131 td 0xfffffe00e4d3e900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4efce00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4efce20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4efce60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4efcec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4efcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4efcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4efcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100132 td 0xfffffe00e4d3e1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ef7e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ef7e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ef7e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ef7ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100134 td 0xfffffe00e4d8c740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f01e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f01e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f01e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f01ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f01ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f01f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f01f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100135 td 0xfffffe00e4d8c020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f10e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f10e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f10e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f10ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f10ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f10f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f10f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100136 td 0xfffffe00e4d8b900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f0be00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f0be20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f0be60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f0bec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f0bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f0bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f0bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100137 td 0xfffffe00e4d8b1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f1ae00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f1ae20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f1ae60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f1aec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f1aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f1af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f1af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100138 td 0xfffffe00e4d8aac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f15e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f15e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f15e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f15ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f15ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f15f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f15f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100139 td 0xfffffe010a32c900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f30e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f30e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f30e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f30ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f30ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f30f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f30f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100140 td 0xfffffe010a32c1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f2be00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f2be20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f2be60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f2bec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f2bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f2bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f2bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100141 td 0xfffffe010a32bac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f3ae00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f3ae20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f3ae60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f3aec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f3aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f3af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f3af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100142 td 0xfffffe010a32b3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f35e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f35e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f35e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f35ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f35ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f35f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f35f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100143 td 0xfffffe010a32ac80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f44e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f44e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f44e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f44ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f44ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f44f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f44f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100197 td 0xfffffe010e137ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe010db35d60 mi_switch() at mi_switch+0x157/frame 0xfffffe010db35d80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db35dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db35e00 _sleep() at _sleep+0x2ce/frame 0xfffffe010db35ea0 buf_daemon() at buf_daemon+0x139/frame 0xfffffe010db35ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db35f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db35f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100198 td 0xfffffe010e39bac0 sched_switch() at sched_switch+0x559/frame 0xfffffe010ef0bd50 mi_switch() at mi_switch+0x157/frame 0xfffffe010ef0bd70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010ef0bdb0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010ef0bdf0 _sleep() at _sleep+0x2ce/frame 0xfffffe010ef0be90 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010ef0bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010ef0bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010ef0bf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command bufdaemon pid 16 tid 100199 td 0xfffffe010e39b3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe010db4bd50 mi_switch() at mi_switch+0x157/frame 0xfffffe010db4bd70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db4bdb0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db4bdf0 _sleep() at _sleep+0x2ce/frame 0xfffffe010db4be90 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010db4bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db4bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db4bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100200 td 0xfffffe010e39ac80 sched_switch() at sched_switch+0x559/frame 0xfffffe010fd1ed50 mi_switch() at mi_switch+0x157/frame 0xfffffe010fd1ed70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010fd1edb0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010fd1edf0 _sleep() at _sleep+0x2ce/frame 0xfffffe010fd1ee90 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010fd1eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010fd1ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010fd1ef30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command bufdaemon pid 16 tid 100201 td 0xfffffe010e39a560 sched_switch() at sched_switch+0x559/frame 0xfffffe010db50d50 mi_switch() at mi_switch+0x157/frame 0xfffffe010db50d70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db50db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db50df0 _sleep() at _sleep+0x2ce/frame 0xfffffe010db50e90 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010db50ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db50f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db50f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100202 td 0xfffffe010e399e40 sched_switch() at sched_switch+0x559/frame 0xfffffe010db5ad50 mi_switch() at mi_switch+0x157/frame 0xfffffe010db5ad70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db5adb0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db5adf0 _sleep() at _sleep+0x2ce/frame 0xfffffe010db5ae90 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010db5aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db5af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db5af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100203 td 0xfffffe010e399720 sched_switch() at sched_switch+0x559/frame 0xfffffe010db55d50 mi_switch() at mi_switch+0x157/frame 0xfffffe010db55d70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db55db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db55df0 _sleep() at _sleep+0x2ce/frame 0xfffffe010db55e90 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010db55ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db55f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db55f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100204 td 0xfffffe010e399000 sched_switch() at sched_switch+0x559/frame 0xfffffe010db64d50 mi_switch() at mi_switch+0x157/frame 0xfffffe010db64d70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db64db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db64df0 _sleep() at _sleep+0x2ce/frame 0xfffffe010db64e90 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010db64ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db64f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db64f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100219 td 0xfffffe010e63aac0 sched_switch() at sched_switch+0x559/frame 0xfffffe014178ad70 mi_switch() at mi_switch+0x157/frame 0xfffffe014178ad90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014178add0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe014178ae10 _sleep() at _sleep+0x2ce/frame 0xfffffe014178aeb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe014178aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe014178af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014178af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100224 td 0xfffffe01434d31e0 sched_switch() at sched_switch+0x559/frame 0xfffffe01417d4d70 mi_switch() at mi_switch+0x157/frame 0xfffffe01417d4d90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01417d4dd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01417d4e10 _sleep() at _sleep+0x2ce/frame 0xfffffe01417d4eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe01417d4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01417d4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01417d4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 17 tid 100207 td 0xfffffe010e1373a0 sched_switch() at sched_switch+0x559/frame 0xfffffe0141744d10 mi_switch() at mi_switch+0x157/frame 0xfffffe0141744d30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141744d70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0141744db0 _sleep() at _sleep+0x2ce/frame 0xfffffe0141744e50 vnlru_proc() at vnlru_proc+0x9fc/frame 0xfffffe0141744ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0141744f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0141744f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 18 tid 100208 td 0xfffffe010e136c80 sched_switch() at sched_switch+0x559/frame 0xfffffe014173fd40 mi_switch() at mi_switch+0x157/frame 0xfffffe014173fd60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014173fda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe014173fde0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x19a/frame 0xfffffe014173fe60 sched_sync() at sched_sync+0x63d/frame 0xfffffe014173fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe014173ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014173ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command dhclient pid 2321 tid 100252 td 0xfffffe0141808740 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbd9ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbd9ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbd9b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbd9b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbd9b70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010dbd9bd0 kern_select() at kern_select+0xa95/frame 0xfffffe010dbd9dc0 sys_select() at sys_select+0x56/frame 0xfffffe010dbd9e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbd9f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbd9f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x3ac8551e177a, rsp = 0x3ac8512d32d8, rbp = 0x3ac8512d3390 --- Tracing command dhclient pid 2324 tid 100235 td 0xfffffe00e4d0aac0 sched_switch() at sched_switch+0x559/frame 0xfffffe0141799ae0 mi_switch() at mi_switch+0x157/frame 0xfffffe0141799b00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141799b40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141799b90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141799ba0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141799c00 kern_poll_kfds() at kern_poll_kfds+0x4bc/frame 0xfffffe0141799c90 kern_poll() at kern_poll+0x9f/frame 0xfffffe0141799de0 sys_poll() at sys_poll+0x50/frame 0xfffffe0141799e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141799f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141799f30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x3ac8551e167a, rsp = 0x3ac8512d3518, rbp = 0x3ac8512d3550 --- Tracing command dhclient pid 2383 tid 100212 td 0xfffffe010e139740 sched_switch() at sched_switch+0x559/frame 0xfffffe010db5fa90 mi_switch() at mi_switch+0x157/frame 0xfffffe010db5fab0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db5faf0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db5fb40 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010db5fb80 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe010db5fc00 kern_poll_kfds() at kern_poll_kfds+0x485/frame 0xfffffe010db5fc90 kern_poll() at kern_poll+0x9f/frame 0xfffffe010db5fde0 sys_poll() at sys_poll+0x50/frame 0xfffffe010db5fe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db5ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db5ff30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x3ac8551e167a, rsp = 0x3ac8512d3518, rbp = 0x3ac8512d3550 --- Tracing command devd pid 2388 tid 100231 td 0xfffffe01434d7e40 sched_switch() at sched_switch+0x559/frame 0xfffffe010db84a60 mi_switch() at mi_switch+0x157/frame 0xfffffe010db84a80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db84ac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db84b10 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010db84b50 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe010db84bd0 kern_select() at kern_select+0xa6f/frame 0xfffffe010db84dc0 sys_select() at sys_select+0x56/frame 0xfffffe010db84e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db84f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db84f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x28b20a, rsp = 0x820a37568, rbp = 0x820a39700 --- Tracing command syslogd pid 2575 tid 100277 td 0xfffffe01436941e0 sched_switch() at sched_switch+0x559/frame 0xfffffe01438e1ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe01438e1ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438e1b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438e1b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01438e1b70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01438e1bd0 kern_select() at kern_select+0xa95/frame 0xfffffe01438e1dc0 sys_select() at sys_select+0x56/frame 0xfffffe01438e1e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438e1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438e1f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0xaa77509977a, rsp = 0xaa771eb7f48, rbp = 0xaa771eb84d0 --- Tracing command watchdogd pid 2583 tid 100227 td 0xfffffe010a329720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f49bb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f49bd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f49c10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00e4f49c60 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e4f49ca0 _sleep() at _sleep+0x2bf/frame 0xfffffe00e4f49d40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1d1/frame 0xfffffe00e4f49dc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe00e4f49e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe00e4f49f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e4f49f30 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x99a6799f5fa, rsp = 0x99a65beb9e8, rbp = 0x99a65beba30 --- Tracing command rpcbind pid 2605 tid 100213 td 0xfffffe010e63b900 sched_switch() at sched_switch+0x559/frame 0xfffffe014176ca90 mi_switch() at mi_switch+0x157/frame 0xfffffe014176cab0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014176caf0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014176cb40 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014176cb80 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe014176cc00 kern_poll_kfds() at kern_poll_kfds+0x485/frame 0xfffffe014176cc90 kern_poll() at kern_poll+0x9f/frame 0xfffffe014176cde0 sys_poll() at sys_poll+0x50/frame 0xfffffe014176ce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014176cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014176cf30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x1e4e74e0567a, rsp = 0x1e4e71d454e8, rbp = 0x1e4e71d47710 --- Tracing command rpc.statd pid 2630 tid 100264 td 0xfffffe01428b4ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe014388fa60 mi_switch() at mi_switch+0x157/frame 0xfffffe014388fa80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014388fac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014388fb10 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014388fb50 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe014388fbd0 kern_select() at kern_select+0xa6f/frame 0xfffffe014388fdc0 sys_select() at sys_select+0x56/frame 0xfffffe014388fe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014388ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014388ff30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x3c7b8c7bb77a, rsp = 0x3c7b8a8ee178, rbp = 0x3c7b8a8ee2c0 --- Tracing command rpc.lockd pid 2633 tid 100276 td 0xfffffe0143694900 sched_switch() at sched_switch+0x559/frame 0xfffffe01438d2990 mi_switch() at mi_switch+0x157/frame 0xfffffe01438d29b0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438d29f0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438d2a40 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01438d2a80 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe01438d2b00 svc_run_internal() at svc_run_internal+0xada/frame 0xfffffe01438d2c30 svc_run() at svc_run+0x230/frame 0xfffffe01438d2c90 sys_nlm_syscall() at sys_nlm_syscall+0x6fa/frame 0xfffffe01438d2e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438d2f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438d2f30 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x38e86ce60eba, rsp = 0x38e86b0e1a18, rbp = 0x38e86b0e1ae0 --- Tracing command powerd pid 2638 tid 100280 td 0xfffffe01428b3c80 sched_switch() at sched_switch+0x559/frame 0xfffffe01438f5a60 mi_switch() at mi_switch+0x157/frame 0xfffffe01438f5a80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438f5ac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438f5b10 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01438f5b50 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe01438f5bd0 kern_select() at kern_select+0xa6f/frame 0xfffffe01438f5dc0 sys_select() at sys_select+0x56/frame 0xfffffe01438f5e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438f5f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438f5f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2757ec70977a, rsp = 0x2757eb23f928, rbp = 0x2757eb23fa60 --- Tracing command ntpd pid 2664 tid 100281 td 0xfffffe0143683560 sched_switch() at sched_switch+0x559/frame 0xfffffe014386cab0 mi_switch() at mi_switch+0x157/frame 0xfffffe014386cad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014386cb10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014386cb60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014386cb70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014386cbd0 kern_select() at kern_select+0xa95/frame 0xfffffe014386cdc0 sys_select() at sys_select+0x56/frame 0xfffffe014386ce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014386cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014386cf30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x25f00413c77a, rsp = 0x25f000eec718, rbp = 0x25f000eec750 --- Tracing command inetd pid 2690 tid 100218 td 0xfffffe00e4d8a3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe0141780ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe0141780ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141780b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141780b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141780b70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141780bd0 kern_select() at kern_select+0xa95/frame 0xfffffe0141780dc0 sys_select() at sys_select+0x56/frame 0xfffffe0141780e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141780f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141780f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x3dd6a096777a, rsp = 0x3dd69ce04f88, rbp = 0x3dd69ce05e20 --- Tracing command sshd pid 2709 tid 100237 td 0xfffffe01434d1c80 sched_switch() at sched_switch+0x559/frame 0xfffffe010db9da70 mi_switch() at mi_switch+0x157/frame 0xfffffe010db9da90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db9dad0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db9db20 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db9db30 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010db9db90 kern_select() at kern_select+0xa95/frame 0xfffffe010db9dd80 sys_pselect() at sys_pselect+0x127/frame 0xfffffe010db9de00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db9df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db9df30 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x3a8b69e3b6ba, rsp = 0x3a8b6236dba8, rbp = 0x3a8b6236dbf0 --- Tracing command cron pid 2713 tid 100245 td 0xfffffe01434d1560 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbcabb0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbcabd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbcac10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbcac60 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010dbcaca0 _sleep() at _sleep+0x2bf/frame 0xfffffe010dbcad40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1d1/frame 0xfffffe010dbcadc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe010dbcae00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbcaf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbcaf30 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x218cd306d5fa, rsp = 0x218ccfed8398, rbp = 0x218ccfed8580 --- Tracing command getty pid 2727 tid 100209 td 0xfffffe010e3e1720 sched_switch() at sched_switch+0x559/frame 0xfffffe014174eaf0 mi_switch() at mi_switch+0x157/frame 0xfffffe014174eb10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014174eb50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014174eba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014174ebb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014174ec10 tty_wait() at tty_wait+0x42/frame 0xfffffe014174ec40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe014174ecb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe014174ece0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe014174ed40 dofileread() at dofileread+0x81/frame 0xfffffe014174ed90 sys_read() at sys_read+0xc0/frame 0xfffffe014174ee00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014174ef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014174ef30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x1e1985f786fa, rsp = 0x1e1984dafe18, rbp = 0x1e1984dafe60 --- Tracing command getty pid 2728 tid 100210 td 0xfffffe010e638000 sched_switch() at sched_switch+0x559/frame 0xfffffe0141758af0 mi_switch() at mi_switch+0x157/frame 0xfffffe0141758b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141758b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141758ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141758bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141758c10 tty_wait() at tty_wait+0x42/frame 0xfffffe0141758c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe0141758cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0141758ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0141758d40 dofileread() at dofileread+0x81/frame 0xfffffe0141758d90 sys_read() at sys_read+0xc0/frame 0xfffffe0141758e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141758f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141758f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x14be984dd6fa, rsp = 0x14be95c10868, rbp = 0x14be95c108b0 --- Tracing command getty pid 2729 tid 100238 td 0xfffffe0143618900 sched_switch() at sched_switch+0x559/frame 0xfffffe010dba7af0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dba7b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dba7b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dba7ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dba7bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010dba7c10 tty_wait() at tty_wait+0x42/frame 0xfffffe010dba7c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe010dba7cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010dba7ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010dba7d40 dofileread() at dofileread+0x81/frame 0xfffffe010dba7d90 sys_read() at sys_read+0xc0/frame 0xfffffe010dba7e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dba7f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dba7f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x120ec2a8c6fa, rsp = 0x120ebf92ed98, rbp = 0x120ebf92ede0 --- Tracing command getty pid 2730 tid 100285 td 0xfffffe01436181e0 sched_switch() at sched_switch+0x559/frame 0xfffffe0143913af0 mi_switch() at mi_switch+0x157/frame 0xfffffe0143913b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143913b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143913ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143913bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0143913c10 tty_wait() at tty_wait+0x42/frame 0xfffffe0143913c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe0143913cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0143913ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0143913d40 dofileread() at dofileread+0x81/frame 0xfffffe0143913d90 sys_read() at sys_read+0xc0/frame 0xfffffe0143913e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143913f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143913f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x239f52276fa, rsp = 0x239f270ddd8, rbp = 0x239f270de20 --- Tracing command getty pid 2731 tid 100286 td 0xfffffe0143617ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe014390eaf0 mi_switch() at mi_switch+0x157/frame 0xfffffe014390eb10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014390eb50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014390eba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014390ebb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014390ec10 tty_wait() at tty_wait+0x42/frame 0xfffffe014390ec40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe014390ecb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe014390ece0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe014390ed40 dofileread() at dofileread+0x81/frame 0xfffffe014390ed90 sys_read() at sys_read+0xc0/frame 0xfffffe014390ee00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014390ef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014390ef30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x17c0fb4d86fa, rsp = 0x17c0f9df2b68, rbp = 0x17c0f9df2bb0 --- Tracing command getty pid 2732 tid 100287 td 0xfffffe01436173a0 sched_switch() at sched_switch+0x559/frame 0xfffffe014391daf0 mi_switch() at mi_switch+0x157/frame 0xfffffe014391db10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014391db50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014391dba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014391dbb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014391dc10 tty_wait() at tty_wait+0x42/frame 0xfffffe014391dc40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe014391dcb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe014391dce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe014391dd40 dofileread() at dofileread+0x81/frame 0xfffffe014391dd90 sys_read() at sys_read+0xc0/frame 0xfffffe014391de00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014391df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014391df30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x1663a758e6fa, rsp = 0x1663a6cd1808, rbp = 0x1663a6cd1850 --- Tracing command getty pid 2733 tid 100288 td 0xfffffe0143616c80 sched_switch() at sched_switch+0x559/frame 0xfffffe0143918af0 mi_switch() at mi_switch+0x157/frame 0xfffffe0143918b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143918b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143918ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143918bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0143918c10 tty_wait() at tty_wait+0x42/frame 0xfffffe0143918c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe0143918cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0143918ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0143918d40 dofileread() at dofileread+0x81/frame 0xfffffe0143918d90 sys_read() at sys_read+0xc0/frame 0xfffffe0143918e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143918f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143918f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x2a307dee26fa, rsp = 0x2a307cfbb0c8, rbp = 0x2a307cfbb110 --- Tracing command getty pid 2734 tid 100289 td 0xfffffe0143616560 sched_switch() at sched_switch+0x559/frame 0xfffffe0143927af0 mi_switch() at mi_switch+0x157/frame 0xfffffe0143927b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143927b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143927ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143927bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0143927c10 tty_wait() at tty_wait+0x42/frame 0xfffffe0143927c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe0143927cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0143927ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0143927d40 dofileread() at dofileread+0x81/frame 0xfffffe0143927d90 sys_read() at sys_read+0xc0/frame 0xfffffe0143927e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143927f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143927f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x1dcb0180c6fa, rsp = 0x1dcafedcbb88, rbp = 0x1dcafedcbbd0 --- Tracing command getty pid 2735 tid 100290 td 0xfffffe0143615e40 sched_switch() at sched_switch+0x559/frame 0xfffffe0143922af0 mi_switch() at mi_switch+0x157/frame 0xfffffe0143922b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143922b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143922ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143922bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0143922c10 tty_wait() at tty_wait+0x42/frame 0xfffffe0143922c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe0143922cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0143922ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0143922d40 dofileread() at dofileread+0x81/frame 0xfffffe0143922d90 sys_read() at sys_read+0xc0/frame 0xfffffe0143922e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143922f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143922f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x28f39b7366fa, rsp = 0x28f399a641f8, rbp = 0x28f399a64240 --- Tracing command login pid 2736 tid 100225 td 0xfffffe01434d2ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe01417cfa10 mi_switch() at mi_switch+0x157/frame 0xfffffe01417cfa30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01417cfa70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417cfac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417cfad0 _sleep() at _sleep+0x2dd/frame 0xfffffe01417cfb70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01417cfc00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01417cfe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01417cff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417cff30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x1f99117838da, rsp = 0x1f990daa59c8, rbp = 0x1f990daa5ba0 --- Tracing command sshd pid 2737 tid 100251 td 0xfffffe01428b51e0 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbbbae0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbbbb00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbbbb40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbbbb90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbbbba0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010dbbbc00 kern_poll_kfds() at kern_poll_kfds+0x4bc/frame 0xfffffe010dbbbc90 kern_poll() at kern_poll+0x9f/frame 0xfffffe010dbbbde0 sys_poll() at sys_poll+0x50/frame 0xfffffe010dbbbe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbbbf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbbbf30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x13c6b907467a, rsp = 0x13c6b2069c58, rbp = 0x13c6b2069c90 --- Tracing command sshd pid 2740 tid 100291 td 0xfffffe0143693ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe01438dca70 mi_switch() at mi_switch+0x157/frame 0xfffffe01438dca90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438dcad0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438dcb20 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01438dcb30 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01438dcb90 kern_select() at kern_select+0xa95/frame 0xfffffe01438dcd80 sys_pselect() at sys_pselect+0x127/frame 0xfffffe01438dce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438dcf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438dcf30 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x13c6b90746ba, rsp = 0x13c6b2065bd8, rbp = 0x13c6b2065c20 --- Tracing command bash pid 2741 tid 100284 td 0xfffffe01443953a0 sched_switch() at sched_switch+0x559/frame 0xfffffe0143909a70 mi_switch() at mi_switch+0x157/frame 0xfffffe0143909a90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143909ad0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143909b20 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143909b30 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0143909b90 kern_select() at kern_select+0xa95/frame 0xfffffe0143909d80 sys_pselect() at sys_pselect+0x127/frame 0xfffffe0143909e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143909f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143909f30 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x824da46ba, rsp = 0x8207c86c8, rbp = 0x8207c8790 --- Tracing command csh pid 2758 tid 100239 td 0xfffffe01428b2720 sched_switch() at sched_switch+0x559/frame 0xfffffe014178fba0 mi_switch() at mi_switch+0x157/frame 0xfffffe014178fbc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014178fc00 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014178fc50 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014178fc60 _sleep() at _sleep+0x2dd/frame 0xfffffe014178fd00 kern_sigsuspend() at kern_sigsuspend+0x1ec/frame 0xfffffe014178fdd0 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe014178fe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014178ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014178ff30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x39128ca0883a, rsp = 0x391289654cd8, rbp = 0x391289654d60 --- Tracing command sh pid 2763 tid 100272 td 0xfffffe01434d0000 sched_switch() at sched_switch+0x559/frame 0xfffffe0143894a10 mi_switch() at mi_switch+0x157/frame 0xfffffe0143894a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143894a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143894ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143894ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe0143894b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe0143894c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143894e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143894f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143894f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x3c41a13e78da, rsp = 0x3c419fb78768, rbp = 0x3c419fb78820 --- Tracing command md10 pid 2781 tid 100222 td 0xfffffe010e136560 sched_switch() at sched_switch+0x559/frame 0xfffffe01417a8da0 mi_switch() at mi_switch+0x157/frame 0xfffffe01417a8dc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01417a8e00 _sleep() at _sleep+0x2e7/frame 0xfffffe01417a8ea0 md_kthread() at md_kthread+0xd5/frame 0xfffffe01417a8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01417a8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01417a8f30 --- trap 0xc, rip = 0x2d3f4b1cc31a, rsp = 0x2d3f493560d8, rbp = 0x2d3f493560f0 --- Tracing command g_journal switcher pid 2784 tid 100278 td 0xfffffe014410b900 sched_switch() at sched_switch+0x559/frame 0xfffffe01438eb9c0 mi_switch() at mi_switch+0x157/frame 0xfffffe01438eb9e0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438eba20 _sleep() at _sleep+0x2e7/frame 0xfffffe01438ebac0 bufobj_wwait() at bufobj_wwait+0x88/frame 0xfffffe01438ebb00 ffs_syncvnode() at ffs_syncvnode+0x3c7/frame 0xfffffe01438ebb90 ffs_copyonwrite() at ffs_copyonwrite+0x593/frame 0xfffffe01438ebc20 ffs_geom_strategy() at ffs_geom_strategy+0xcf/frame 0xfffffe01438ebc50 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe01438ebc80 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x61/frame 0xfffffe01438ebca0 bufstrategy() at bufstrategy+0x3e/frame 0xfffffe01438ebcd0 bufwrite() at bufwrite+0x24c/frame 0xfffffe01438ebd20 ffs_syncvnode() at ffs_syncvnode+0x133/frame 0xfffffe01438ebdb0 ffs_sync() at ffs_sync+0x1ed/frame 0xfffffe01438ebe50 g_journal_switcher() at g_journal_switcher+0x44e/frame 0xfffffe01438ebef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01438ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01438ebf30 --- trap 0xc, rip = 0x1dbcab20931a, rsp = 0x1dbca96f3e38, rbp = 0x1dbca96f3f30 --- Tracing command g_journal md10 pid 2785 tid 100221 td 0xfffffe00e4d0b1e0 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce61e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce61e10 trap() at trap+0x56/frame 0xfffffe003ce61f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce61f20 --- trap 0x13, rip = 0xffffffff80c54470, rsp = 0xfffffe014179ea80, rbp = 0xfffffe014179ea90 --- lock_delay() at lock_delay+0x20/frame 0xfffffe014179ea90 __mtx_lock_sleep() at __mtx_lock_sleep+0xf8/frame 0xfffffe014179eb20 __mtx_lock_flags() at __mtx_lock_flags+0xe5/frame 0xfffffe014179eb70 g_io_deliver() at g_io_deliver+0x289/frame 0xfffffe014179ebc0 g_journal_add_current() at g_journal_add_current+0x97/frame 0xfffffe014179ebe0 g_journal_worker() at g_journal_worker+0x1227/frame 0xfffffe014179eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe014179ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014179ef30 --- trap 0xc, rip = 0x3397456d931a, rsp = 0x339741da77e8, rbp = 0x339741da7800 --- Tracing command su pid 2790 tid 100214 td 0xfffffe010e63b1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe0141767a10 mi_switch() at mi_switch+0x157/frame 0xfffffe0141767a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141767a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141767ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141767ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe0141767b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe0141767c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0141767e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141767f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141767f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2fe7eb51a8da, rsp = 0x2fe7ea05cdd8, rbp = 0x2fe7ea05d320 --- Tracing command rw pid 2792 tid 100294 td 0xfffffe0143692c80 sched_switch() at sched_switch+0x559/frame 0xfffffe014392cbb0 mi_switch() at mi_switch+0x157/frame 0xfffffe014392cbd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014392cc10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014392cc60 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014392cca0 _sleep() at _sleep+0x2bf/frame 0xfffffe014392cd40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1d1/frame 0xfffffe014392cdc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe014392ce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014392cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014392cf30 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x1980fd9c55fa, rsp = 0x1980fd23db18, rbp = 0x1980fd23db60 --- Tracing command rw pid 2794 tid 100273 td 0xfffffe0144108000 sched_switch() at sched_switch+0x559/frame 0xfffffe01438cda10 mi_switch() at mi_switch+0x157/frame 0xfffffe01438cda30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438cda70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438cdac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01438cdad0 _sleep() at _sleep+0x2dd/frame 0xfffffe01438cdb70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01438cdc00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01438cde00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438cdf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438cdf30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x1980fd9c58da, rsp = 0x1980fd23db68, rbp = 0x1980fd23dc90 --- Tracing command rw pid 2795 tid 100279 td 0xfffffe01428b43a0 sched_switch() at sched_switch+0x559/frame 0xfffffe014388a3c0 mi_switch() at mi_switch+0x157/frame 0xfffffe014388a3e0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014388a420 sleeplk() at sleeplk+0x107/frame 0xfffffe014388a480 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3ef/frame 0xfffffe014388a520 __lockmgr_args() at __lockmgr_args+0x1f9/frame 0xfffffe014388a5c0 ffs_copyonwrite() at ffs_copyonwrite+0x1b3/frame 0xfffffe014388a660 ffs_geom_strategy() at ffs_geom_strategy+0x107/frame 0xfffffe014388a690 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe014388a6c0 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x61/frame 0xfffffe014388a6e0 bufstrategy() at bufstrategy+0x3e/frame 0xfffffe014388a710 bufwrite() at bufwrite+0x24c/frame 0xfffffe014388a760 cluster_wbuild() at cluster_wbuild+0x73f/frame 0xfffffe014388a800 cluster_write() at cluster_write+0x12c/frame 0xfffffe014388a8d0 ffs_write() at ffs_write+0x422/frame 0xfffffe014388a980 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe014388aa90 vn_write() at vn_write+0x2fc/frame 0xfffffe014388ab20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe014388ab80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe014388acc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe014388ad40 dofilewrite() at dofilewrite+0x81/frame 0xfffffe014388ad90 sys_write() at sys_write+0xc0/frame 0xfffffe014388ae00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014388af30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014388af30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x1980fd9c591a, rsp = 0x1980fd23caa8, rbp = 0x1980fd23db60 --- Tracing command rw pid 2796 tid 100282 td 0xfffffe0143682e40 sched_switch() at sched_switch+0x559/frame 0xfffffe01438ff340 mi_switch() at mi_switch+0x157/frame 0xfffffe01438ff360 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438ff3a0 sleeplk() at sleeplk+0x107/frame 0xfffffe01438ff400 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3ef/frame 0xfffffe01438ff4a0 __lockmgr_args() at __lockmgr_args+0x1f9/frame 0xfffffe01438ff540 ffs_snapblkfree() at ffs_snapblkfree+0xb0/frame 0xfffffe01438ff600 ffs_blkfree() at ffs_blkfree+0x62/frame 0xfffffe01438ff660 ffs_reallocblks() at ffs_reallocblks+0x1275/frame 0xfffffe01438ff7e0 VOP_REALLOCBLKS_APV() at VOP_REALLOCBLKS_APV+0x59/frame 0xfffffe01438ff800 cluster_write() at cluster_write+0x5c6/frame 0xfffffe01438ff8d0 ffs_write() at ffs_write+0x422/frame 0xfffffe01438ff980 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe01438ffa90 vn_write() at vn_write+0x2fc/frame 0xfffffe01438ffb20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe01438ffb80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe01438ffcc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe01438ffd40 dofilewrite() at dofilewrite+0x81/frame 0xfffffe01438ffd90 sys_write() at sys_write+0xc0/frame 0xfffffe01438ffe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438fff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438fff30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x1980fd9c591a, rsp = 0x1980fd23caa8, rbp = 0x1980fd23db60 --- Tracing command rw pid 2797 tid 100296 td 0xfffffe0143682720 sched_switch() at sched_switch+0x559/frame 0xfffffe01438fa340 mi_switch() at mi_switch+0x157/frame 0xfffffe01438fa360 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438fa3a0 sleeplk() at sleeplk+0x107/frame 0xfffffe01438fa400 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3ef/frame 0xfffffe01438fa4a0 __lockmgr_args() at __lockmgr_args+0x1f9/frame 0xfffffe01438fa540 ffs_snapblkfree() at ffs_snapblkfree+0xb0/frame 0xfffffe01438fa600 ffs_blkfree() at ffs_blkfree+0x62/frame 0xfffffe01438fa660 ffs_reallocblks() at ffs_reallocblks+0x1275/frame 0xfffffe01438fa7e0 VOP_REALLOCBLKS_APV() at VOP_REALLOCBLKS_APV+0x59/frame 0xfffffe01438fa800 cluster_write() at cluster_write+0x5c6/frame 0xfffffe01438fa8d0 ffs_write() at ffs_write+0x422/frame 0xfffffe01438fa980 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe01438faa90 vn_write() at vn_write+0x2fc/frame 0xfffffe01438fab20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe01438fab80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe01438facc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe01438fad40 dofilewrite() at dofilewrite+0x81/frame 0xfffffe01438fad90 sys_write() at sys_write+0xc0/frame 0xfffffe01438fae00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438faf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438faf30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x1980fd9c591a, rsp = 0x1980fd23caa8, rbp = 0x1980fd23db60 --- Tracing command rw pid 2798 tid 100297 td 0xfffffe0143682000 sched_switch() at sched_switch+0x559/frame 0xfffffe0143981340 mi_switch() at mi_switch+0x157/frame 0xfffffe0143981360 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01439813a0 sleeplk() at sleeplk+0x107/frame 0xfffffe0143981400 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3ef/frame 0xfffffe01439814a0 __lockmgr_args() at __lockmgr_args+0x1f9/frame 0xfffffe0143981540 ffs_snapblkfree() at ffs_snapblkfree+0xb0/frame 0xfffffe0143981600 ffs_blkfree() at ffs_blkfree+0x62/frame 0xfffffe0143981660 ffs_reallocblks() at ffs_reallocblks+0x1275/frame 0xfffffe01439817e0 VOP_REALLOCBLKS_APV() at VOP_REALLOCBLKS_APV+0x59/frame 0xfffffe0143981800 cluster_write() at cluster_write+0x5c6/frame 0xfffffe01439818d0 ffs_write() at ffs_write+0x422/frame 0xfffffe0143981980 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe0143981a90 vn_write() at vn_write+0x2fc/frame 0xfffffe0143981b20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe0143981b80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe0143981cc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe0143981d40 dofilewrite() at dofilewrite+0x81/frame 0xfffffe0143981d90 sys_write() at sys_write+0xc0/frame 0xfffffe0143981e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143981f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143981f30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x1980fd9c591a, rsp = 0x1980fd23caa8, rbp = 0x1980fd23db60 --- Tracing command rw pid 2799 tid 100298 td 0xfffffe0143619740 sched_switch() at sched_switch+0x559/frame 0xfffffe014397c4c0 mi_switch() at mi_switch+0x157/frame 0xfffffe014397c4e0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014397c520 sleeplk() at sleeplk+0x107/frame 0xfffffe014397c580 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3ef/frame 0xfffffe014397c620 __lockmgr_args() at __lockmgr_args+0x1f9/frame 0xfffffe014397c6c0 ffs_snapblkfree() at ffs_snapblkfree+0xb0/frame 0xfffffe014397c780 ffs_blkfree() at ffs_blkfree+0x62/frame 0xfffffe014397c7e0 ffs_indirtrunc() at ffs_indirtrunc+0x329/frame 0xfffffe014397c8d0 ffs_truncate() at ffs_truncate+0xe68/frame 0xfffffe014397caa0 ufs_inactive() at ufs_inactive+0x1aa/frame 0xfffffe014397cae0 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x59/frame 0xfffffe014397cb00 vinactivef() at vinactivef+0xda/frame 0xfffffe014397cb40 vput_final() at vput_final+0x2aa/frame 0xfffffe014397cba0 kern_funlinkat() at kern_funlinkat+0x275/frame 0xfffffe014397cde0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe014397ce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014397cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014397cf30 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x1980fd9c253a, rsp = 0x1980fd23caa8, rbp = 0x1980fd23db60 --- Tracing command rw pid 2800 tid 100299 td 0xfffffe0144597e40 sched_switch() at sched_switch+0x559/frame 0xfffffe014398b340 mi_switch() at mi_switch+0x157/frame 0xfffffe014398b360 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014398b3a0 sleeplk() at sleeplk+0x107/frame 0xfffffe014398b400 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3ef/frame 0xfffffe014398b4a0 __lockmgr_args() at __lockmgr_args+0x1f9/frame 0xfffffe014398b540 ffs_snapblkfree() at ffs_snapblkfree+0xb0/frame 0xfffffe014398b600 ffs_blkfree() at ffs_blkfree+0x62/frame 0xfffffe014398b660 ffs_reallocblks() at ffs_reallocblks+0x1275/frame 0xfffffe014398b7e0 VOP_REALLOCBLKS_APV() at VOP_REALLOCBLKS_APV+0x59/frame 0xfffffe014398b800 cluster_write() at cluster_write+0x5c6/frame 0xfffffe014398b8d0 ffs_write() at ffs_write+0x422/frame 0xfffffe014398b980 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe014398ba90 vn_write() at vn_write+0x2fc/frame 0xfffffe014398bb20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe014398bb80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe014398bcc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe014398bd40 dofilewrite() at dofilewrite+0x81/frame 0xfffffe014398bd90 sys_write() at sys_write+0xc0/frame 0xfffffe014398be00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014398bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014398bf30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x1980fd9c591a, rsp = 0x1980fd23caa8, rbp = 0x1980fd23db60 --- Tracing command rw pid 2801 tid 100300 td 0xfffffe0144597720 sched_switch() at sched_switch+0x559/frame 0xfffffe0143986340 mi_switch() at mi_switch+0x157/frame 0xfffffe0143986360 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01439863a0 sleeplk() at sleeplk+0x107/frame 0xfffffe0143986400 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3ef/frame 0xfffffe01439864a0 __lockmgr_args() at __lockmgr_args+0x1f9/frame 0xfffffe0143986540 ffs_snapblkfree() at ffs_snapblkfree+0xb0/frame 0xfffffe0143986600 ffs_blkfree() at ffs_blkfree+0x62/frame 0xfffffe0143986660 ffs_reallocblks() at ffs_reallocblks+0x1275/frame 0xfffffe01439867e0 VOP_REALLOCBLKS_APV() at VOP_REALLOCBLKS_APV+0x59/frame 0xfffffe0143986800 cluster_write() at cluster_write+0x5c6/frame 0xfffffe01439868d0 ffs_write() at ffs_write+0x422/frame 0xfffffe0143986980 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe0143986a90 vn_write() at vn_write+0x2fc/frame 0xfffffe0143986b20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe0143986b80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe0143986cc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe0143986d40 dofilewrite() at dofilewrite+0x81/frame 0xfffffe0143986d90 sys_write() at sys_write+0xc0/frame 0xfffffe0143986e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143986f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143986f30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x1980fd9c591a, rsp = 0x1980fd23caa8, rbp = 0x1980fd23db60 --- Tracing command rw pid 2802 tid 100301 td 0xfffffe0144597000 sched_switch() at sched_switch+0x559/frame 0xfffffe0143995340 mi_switch() at mi_switch+0x157/frame 0xfffffe0143995360 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01439953a0 sleeplk() at sleeplk+0x107/frame 0xfffffe0143995400 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3ef/frame 0xfffffe01439954a0 __lockmgr_args() at __lockmgr_args+0x1f9/frame 0xfffffe0143995540 ffs_snapblkfree() at ffs_snapblkfree+0xb0/frame 0xfffffe0143995600 ffs_blkfree() at ffs_blkfree+0x62/frame 0xfffffe0143995660 ffs_reallocblks() at ffs_reallocblks+0x1275/frame 0xfffffe01439957e0 VOP_REALLOCBLKS_APV() at VOP_REALLOCBLKS_APV+0x59/frame 0xfffffe0143995800 cluster_write() at cluster_write+0x5c6/frame 0xfffffe01439958d0 ffs_write() at ffs_write+0x422/frame 0xfffffe0143995980 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe0143995a90 vn_write() at vn_write+0x2fc/frame 0xfffffe0143995b20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe0143995b80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe0143995cc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe0143995d40 dofilewrite() at dofilewrite+0x81/frame 0xfffffe0143995d90 sys_write() at sys_write+0xc0/frame 0xfffffe0143995e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143995f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143995f30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x1980fd9c591a, rsp = 0x1980fd23caa8, rbp = 0x1980fd23db60 --- Tracing command rw pid 2803 tid 100302 td 0xfffffe0144397740 sched_switch() at sched_switch+0x559/frame 0xfffffe0143990340 mi_switch() at mi_switch+0x157/frame 0xfffffe0143990360 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01439903a0 sleeplk() at sleeplk+0x107/frame 0xfffffe0143990400 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3ef/frame 0xfffffe01439904a0 __lockmgr_args() at __lockmgr_args+0x1f9/frame 0xfffffe0143990540 ffs_snapblkfree() at ffs_snapblkfree+0xb0/frame 0xfffffe0143990600 ffs_blkfree() at ffs_blkfree+0x62/frame 0xfffffe0143990660 ffs_reallocblks() at ffs_reallocblks+0x1275/frame 0xfffffe01439907e0 VOP_REALLOCBLKS_APV() at VOP_REALLOCBLKS_APV+0x59/frame 0xfffffe0143990800 cluster_write() at cluster_write+0x5c6/frame 0xfffffe01439908d0 ffs_write() at ffs_write+0x422/frame 0xfffffe0143990980 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe0143990a90 vn_write() at vn_write+0x2fc/frame 0xfffffe0143990b20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe0143990b80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe0143990cc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe0143990d40 dofilewrite() at dofilewrite+0x81/frame 0xfffffe0143990d90 sys_write() at sys_write+0xc0/frame 0xfffffe0143990e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143990f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143990f30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x1980fd9c591a, rsp = 0x1980fd23caa8, rbp = 0x1980fd23db60 --- Tracing command rw pid 2804 tid 100303 td 0xfffffe0144397020 sched_switch() at sched_switch+0x559/frame 0xfffffe014399f290 mi_switch() at mi_switch+0x157/frame 0xfffffe014399f2b0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014399f2f0 sleeplk() at sleeplk+0x107/frame 0xfffffe014399f350 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3ef/frame 0xfffffe014399f3f0 __lockmgr_args() at __lockmgr_args+0x1f9/frame 0xfffffe014399f490 ffs_snapblkfree() at ffs_snapblkfree+0xb0/frame 0xfffffe014399f550 ffs_blkfree() at ffs_blkfree+0x62/frame 0xfffffe014399f5b0 ffs_realloccg() at ffs_realloccg+0x7c0/frame 0xfffffe014399f6f0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x534/frame 0xfffffe014399f8d0 ffs_write() at ffs_write+0x262/frame 0xfffffe014399f980 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe014399fa90 vn_write() at vn_write+0x2fc/frame 0xfffffe014399fb20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe014399fb80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe014399fcc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe014399fd40 dofilewrite() at dofilewrite+0x81/frame 0xfffffe014399fd90 sys_write() at sys_write+0xc0/frame 0xfffffe014399fe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014399ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014399ff30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x1980fd9c591a, rsp = 0x1980fd23caa8, rbp = 0x1980fd23db60 --- Tracing command sleep pid 3469 tid 100246 td 0xfffffe01434d0e40 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbc5bb0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbc5bd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbc5c10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbc5c60 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010dbc5ca0 _sleep() at _sleep+0x2bf/frame 0xfffffe010dbc5d40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1d1/frame 0xfffffe010dbc5dc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe010dbc5e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbc5f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbc5f30 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x289497d505fa, rsp = 0x289496b60668, rbp = 0x289496b606c0 --- db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 3 (kgdb) bt #0 __curthread () at /var/tmp/deviant3/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=textdump@entry=0x0) at ../../../kern/kern_shutdown.c:399 #2 0xffffffff804c693a in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #3 0xffffffff804c67f2 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x0) at ../../../ddb/db_command.c:482 #4 0xffffffff804c6886 in db_command_script (command=command@entry=0xffffffff81bd3cc0 "dump") at ../../../ddb/db_command.c:553 #5 0xffffffff804cbbb8 in db_script_exec (scriptname=0xffffffff81bd3630 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #6 0xffffffff804c67f2 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x0) at ../../../ddb/db_command.c:482 #7 0xffffffff804c6886 in db_command_script (command=command@entry=0xffffffff81bd3c52 "run pho1") at ../../../ddb/db_command.c:553 #8 0xffffffff804cbbb8 in db_script_exec (scriptname=0xffffffff81bd3630 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #9 0xffffffff804c67f2 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x1) at ../../../ddb/db_command.c:482 #10 0xffffffff804c644d in db_command_loop () at ../../../ddb/db_command.c:535 #11 0xffffffff804c9a86 in db_trap (type=, code=) at ../../../ddb/db_main.c:270 #12 0xffffffff80c536eb in kdb_trap (type=type@entry=0x3, code=code@entry=0x0, tf=tf@entry=0xfffffe00e4e3ec00) at ../../../kern/subr_kdb.c:733 #13 0xffffffff810d667a in trap (frame=0xfffffe00e4e3ec00) at ../../../amd64/amd64/trap.c:609 #14 #15 kdb_enter (why=0xffffffff812d5f61 "panic", msg=) at ../../../kern/subr_kdb.c:506 #16 0xffffffff80c05c80 in vpanic (fmt=0xffffffff811e59c8 "%s", ap=ap@entry=0xfffffe00e4e3ed60) at ../../../kern/kern_shutdown.c:908 #17 0xffffffff80c05a13 in panic (fmt=0xffffffff81e8cf60 "\b\")\201\377\377\377\377") at ../../../kern/kern_shutdown.c:844 #18 0xffffffff810d6a85 in trap_fatal (frame=0xfffffe00e4e3edf0, eva=0x0) at ../../../amd64/amd64/trap.c:946 #19 #20 0xffffffff80b3d2cf in g_bioq_first (bq=0xffffffff81e8af00 ) at ../../../geom/geom_io.c:133 #21 0xffffffff80b3d3b2 in g_io_schedule_up (tp=) at ../../../geom/geom_io.c:852 #22 0xffffffff80b3dcec in g_up_procbody (arg=arg@entry=0x0) at ../../../geom/geom_kern.c:99 #23 0xffffffff80bbd3a0 in fork_exit (callout=0xffffffff80b3dc90 , arg=0x0, frame=0xfffffe00e4e3ef40) at ../../../kern/kern_fork.c:1102 #24 (kgdb) f 20 #20 0xffffffff80b3d2cf in g_bioq_first (bq=0xffffffff81e8af00 ) at ../../../geom/geom_io.c:133 133 TAILQ_REMOVE(&bq->bio_queue, bp, bio_queue); (kgdb) l 128 bp = TAILQ_FIRST(&bq->bio_queue); 129 if (bp != NULL) { 130 KASSERT((bp->bio_flags & BIO_ONQUEUE), 131 ("Bio not on queue bp=%p target %p", bp, bq)); 132 bp->bio_flags &= ~BIO_ONQUEUE; 133 TAILQ_REMOVE(&bq->bio_queue, bp, bio_queue); 134 bq->bio_queue_length--; 135 } 136 return (bp); 137 } (kgdb) info loc oldprev = 0xfffff801a63e8ba8 oldnext = 0xfffff801a63e8ba0 bp = 0xfffff801a63e8b28 (kgdb) p *bq $1 = {bio_queue = {tqh_first = 0xfffff801a63e8b28, tqh_last = 0xfffff801a63e8ba0}, bio_queue_lock = {lock_object = { lo_name = 0xffffffff811df5bb "bio queue", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7d580}, mtx_lock = 0xfffffe00e4d2dc80}, bio_queue_length = 0x1} (kgdb) p *bp $2 = {bio_cmd = 0xc0de, bio_flags = 0xdea9, bio_cflags = 0xc0de, bio_pflags = 0xdead, bio_dev = 0xdeadc0dedeadc0de, bio_disk = 0xdeadc0dedeadc0de, bio_offset = 0xdeadc0dedeadc0de, bio_bcount = 0xdeadc0dedeadc0de, bio_data = 0xdeadc0dedeadc0de , bio_ma = 0xdeadc0dedeadc0de, bio_ma_offset = 0xdeadc0de, bio_ma_n = 0xdeadc0de, bio_error = 0xdeadc0de, bio_resid = 0xdeadc0dedeadc0de, bio_done = 0xdeadc0dedeadc0de, bio_driver1 = 0xdeadc0dedeadc0de, bio_driver2 = 0xdeadc0dedeadc0de, bio_caller1 = 0xdeadc0dedeadc0de, bio_caller2 = 0xdeadc0dedeadc0de, bio_queue = {tqe_next = 0xdeadc0dedeadc0de, tqe_prev = 0xdeadc0dedeadc0de}, bio_attribute = 0xdeadc0dedeadc0de , bio_zone = { zone_cmd = 0xde, zone_params = {disk_params = {zone_mode = 0xdeadc0de, flags = 0xdeadc0dedeadc0de, optimal_seq_zones = 0xdeadc0dedeadc0de, optimal_nonseq_zones = 0xdeadc0dedeadc0de, max_seq_zones = 0xdeadc0dedeadc0de}, rwp = {id = 0xdeadc0dedeadc0de, flags = 0xde}, report = { starting_id = 0xdeadc0dedeadc0de, rep_options = 0xde, header = {same = 0xde, maximum_lba = 0xdeadc0dedeadc0de, reserved = "\336\300\255\336\336\300\255\336\336\300\255\336\336\300\255\336\336\300\255\336\336\300\255\336\336\300\255\336\336\300\255\336\336\300\255\336\336\300\255\336\336\300\255\336\336\300\255\336\336\300\255\336\336\300\255\336\336\300\255\336\336\300\255\336"}, entries_allocated = 0xdeadc0de, entries_filled = 0xdeadc0de, entries_available = 0xdeadc0de, entries = 0xdeadc0dedeadc0de}}}, bio_from = 0xdeadc0dedeadc0de, bio_to = 0xdeadc0dedeadc0de, bio_length = 0xdeadc0dedeadc0de, bio_completed = 0xdeadc0dedeadc0de, bio_children = 0xdeadc0de, bio_inbed = 0xdeadc0de, bio_parent = 0xdeadc0dedeadc0de, bio_t0 = {sec = 0xdeadc0dedeadc0de, frac = 0xdeadc0dedeadc0de}, bio_task = 0xdeadc0dedeadc0de, bio_task_arg = 0xdeadc0dedeadc0de, bio_spare1 = 0xdeadc0dedeadc0de, bio_spare2 = 0xdeadc0dedeadc0de, _bio_caller1 = 0xdeadc0dedeadc0de, _bio_caller2 = 0xdeadc0dedeadc0de, _bio_cflags = 0xde, bio_track_bp = 0xdeadc0dedeadc0de, bio_pblkno = 0xdeadc0dedeadc0de} (kgdb) diff --git a/sys/ufs/ffs/ffs_snapshot.c b/sys/ufs/ffs/ffs_snapshot.c index 76b377da3cd..0ff0b0e2b3a 100644 --- a/sys/ufs/ffs/ffs_snapshot.c +++ b/sys/ufs/ffs/ffs_snapshot.c @@ -181,6 +181,7 @@ static int mapacct_ufs2(struct vnode *, ufs2_daddr_t *, ufs2_daddr_t *, struct fs *, ufs_lbn_t, int); static int readblock(struct vnode *vp, struct buf *, ufs2_daddr_t); static void try_free_snapdata(struct vnode *devvp); +static void revert_snaplock(struct vnode *, struct vnode *, struct snapdata *); static struct snapdata *ffs_snapdata_acquire(struct vnode *devvp); static int ffs_bp_snapblk(struct vnode *, struct buf *); @@ -1657,7 +1658,7 @@ ffs_snapremove(vp) struct buf *ibp; struct fs *fs; ufs2_daddr_t numblks, blkno, dblk; - int error, i, last, loc; + int error, last, loc; struct snapdata *sn; ip = VTOI(vp); @@ -1675,20 +1676,10 @@ ffs_snapremove(vp) sn = devvp->v_rdev->si_snapdata; TAILQ_REMOVE(&sn->sn_head, ip, i_nextsnap); ip->i_nextsnap.tqe_prev = 0; - VI_UNLOCK(devvp); - lockmgr(&vp->v_lock, LK_EXCLUSIVE, NULL); - for (i = 0; i < sn->sn_lock.lk_recurse; i++) - lockmgr(&vp->v_lock, LK_EXCLUSIVE, NULL); - KASSERT(vp->v_vnlock == &sn->sn_lock, - ("ffs_snapremove: lost lock mutation")); - vp->v_vnlock = &vp->v_lock; - VI_LOCK(devvp); - while (sn->sn_lock.lk_recurse > 0) - lockmgr(&sn->sn_lock, LK_RELEASE, NULL); - lockmgr(&sn->sn_lock, LK_RELEASE, NULL); + revert_snaplock(vp, devvp, sn); try_free_snapdata(devvp); - } else - VI_UNLOCK(devvp); + } + VI_UNLOCK(devvp); /* * Clear all BLK_NOCOPY fields. Pass any block claims to other * snapshots that want them (see ffs_snapblkfree below). @@ -2158,27 +2149,18 @@ ffs_snapshot_unmount(mp) xp->i_nextsnap.tqe_prev = 0; lockmgr(&sn->sn_lock, LK_INTERLOCK | LK_EXCLUSIVE, VI_MTX(devvp)); - /* - * Avoid LOR with above snapshot lock. The LK_NOWAIT should - * never fail as the lock is currently unused. Rather than - * panic, we recover by doing the blocking lock. - */ - if (lockmgr(&vp->v_lock, LK_EXCLUSIVE | LK_NOWAIT, NULL) != 0) { - printf("ffs_snapshot_unmount: Unexpected LK_NOWAIT " - "failure\n"); - lockmgr(&vp->v_lock, LK_EXCLUSIVE, NULL); - } - KASSERT(vp->v_vnlock == &sn->sn_lock, - ("ffs_snapshot_unmount: lost lock mutation")); - vp->v_vnlock = &vp->v_lock; + VI_LOCK(devvp); + revert_snaplock(vp, devvp, sn); lockmgr(&vp->v_lock, LK_RELEASE, NULL); - lockmgr(&sn->sn_lock, LK_RELEASE, NULL); - if (xp->i_effnlink > 0) + if (xp->i_effnlink > 0) { + VI_UNLOCK(devvp); vrele(vp); - VI_LOCK(devvp); + VI_LOCK(devvp); + } sn = devvp->v_rdev->si_snapdata; } try_free_snapdata(devvp); + VI_UNLOCK(devvp); } /* @@ -2682,10 +2664,8 @@ try_free_snapdata(struct vnode *devvp) sn = devvp->v_rdev->si_snapdata; if (sn == NULL || TAILQ_FIRST(&sn->sn_head) != NULL || - (devvp->v_vflag & VV_COPYONWRITE) == 0) { - VI_UNLOCK(devvp); + (devvp->v_vflag & VV_COPYONWRITE) == 0) return; - } devvp->v_rdev->si_snapdata = NULL; devvp->v_vflag &= ~VV_COPYONWRITE; @@ -2697,6 +2677,46 @@ try_free_snapdata(struct vnode *devvp) if (snapblklist != NULL) free(snapblklist, M_UFSMNT); ffs_snapdata_free(sn); + VI_LOCK(devvp); +} + +/* + * Revert a vnode lock from using the snapshot lock back to its own lock. + * + * Aquire a lock on the vnode's own lock and release the lock on the + * snapshot lock. If there are any recursions on the snapshot lock + * get the same number of recursions on the vnode's own lock. + */ +static void +revert_snaplock(vp, devvp, sn) + struct vnode *vp; + struct vnode *devvp; + struct snapdata *sn; +{ + int i; + + ASSERT_VI_LOCKED(devvp, "revert_snaplock"); + /* + * Avoid LOR with snapshot lock. The LK_NOWAIT should + * never fail as the lock is currently unused. Rather than + * panic, we recover by doing the blocking lock. + */ + for (i = 0; i <= sn->sn_lock.lk_recurse; i++) { + if (lockmgr(&vp->v_lock, LK_EXCLUSIVE | LK_NOWAIT | + LK_INTERLOCK, VI_MTX(devvp)) != 0) { + printf("revert_snaplock: Unexpected LK_NOWAIT " + "failure\n"); + lockmgr(&vp->v_lock, LK_EXCLUSIVE | LK_INTERLOCK, + VI_MTX(devvp)); + } + VI_LOCK(devvp); + } + KASSERT(vp->v_vnlock == &sn->sn_lock, + ("revert_snaplock: lost lock mutation")); + vp->v_vnlock = &vp->v_lock; + while (sn->sn_lock.lk_recurse > 0) + lockmgr(&sn->sn_lock, LK_RELEASE, NULL); + lockmgr(&sn->sn_lock, LK_RELEASE, NULL); } static struct snapdata * -- Test scenario: misc/gjournal3.sh