Deadlock (?), vmcore.617 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2022 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 14.0-CURRENT #0 main-n259014-dabb3db7a817f-dirty: Thu Nov 3 13:44:53 CET 2022 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 14.0.5 (https://github.com/llvm/llvm-project.git llvmorg-14.0.5-0-gc12386ae247c) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.17-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33174519808 (31637 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 10 8 6 3 4 7 11 9 2 5 random: entropy device external interface kbd1 at kbdmux0 vtvga0: smbios0: at iomem 0xf0560-0xf057e smbios0: Version: 2.8, BCD Revision: 2.7 aesni0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 apei0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: EEPROM V1.63-0 eTrack 0x800009fa igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: EEPROM V1.63-0 eTrack 0x800009fa igb1: Using 1024 TX descriptors and 1024 RX descriptors igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounter "TSC-low" frequency 1749998382 Hz quality 1000 Timecounters tick every 1.000 msec Expensive timeout(9) function: 0xffffffff804f77c0(0xfffffe0109fa4000) 0.008108040 s ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ses0: pass0 in 'Slot 01', SATA Slot: scbus1 target 0 ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> mlx5_core0: mem 0xf8000000-0xf9ffffff irq 32 at device 0.0 on pci3 mlx5: Mellanox Core driver 3.7.1 (November 2021)ugen1.1: at usbus1 ugen2.1: at usbus2 uhub0 on usbus1 ugen0.1: at usbus0 uhub0: on usbus1 uhub1 on usbus0 uhub1: on usbus0 uhub2 on usbus2 uhub2: on usbus2 mlx5_core0: WARN: mlx5_vsc_set_space:127:(pid 0): Space 0x7 is not supported. mlx5_core0: WARN: mlx5_fwdump_prep:102:(pid 0): VSC scan space is not supported mlx5_core0: INFO: init_one:1658:(pid 0): cannot find SR-IOV PCIe cap mlx5_core: INFO: (mlx5_corirq 32 at device 0.1 on pci3 fsck2** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups FREE BLK COUNT(S) WRONG IN SUPERBLK SALVAGE? yes SUMMARY INFORMATION BAD SALVAGE? yes BLK(S) MISSING IN BIT MAPS SALVAGE? yes 385 files, 13813 used, 1251594 free (138 frags, 156432 blocks, 0.0% fragmentation) ***** FILE SYSTEM MARKED CLEAN ***** ***** FILE SYSTEM WAS MODIFIED ***** + set +x Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.00-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc10 /usr/local/lib/gcc8 /usr/local/lib/gcc9 /usr/local/lib/perl5/5.32/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: mercat1.netperf.freebsd.org. Setting up harvesting: PURE_RDRAND,[CALLOUT],[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . Autoloading module: acpi_wmi.ko Autoloading module: ichsmb.ko Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 ichsmb0: port 0x580-0x59f mem 0xfb431000-0xfb4310ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device lo0: link state changed to UP Starting Network: lo0 igb0 igb1 mce0 mce1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 igb0: flags=8863 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:da inet6 fe80::ec4:7aff:fea8:cdda%igb0 prefixlen 64 scopeid 0x1 media: Ethernet autoselect status: no carrier nd6 options=21 igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 mce0: flags=8822 metric 0 mtu 1500 options RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,HWRXTSTMP,MEXTPG,TXTLS4,TXTLS6,VXLAN_HWCSUM,VXLAN_HWTSO,RXTLS4,RXTLS6 ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 mce1: flags=8822 metric 0 mtu 1500 options RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,HWRXTSTMP,MEXTPG,TXTLS4,TXTLS6,VXLAN_HWCSUM,VXLAN_HWTSO,RXTLS4,RXTLS6 ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Starting devd. igb0: link state changed to UP Autoloading module: acpi_wmi.ko Autoloading module: mlx5.ko interface mlx5.1 already present in the KLD 'kernel'! linker_load_file: /boot/kernel/mlx5.ko - unsupported file type kldload: an error occurred while loading module mlx5.ko. Please check dmesg(8) for more details. Autoloading moduinterface mlx5.1 already present in the KLD 'kernel'! linker_load_file: /boot/kernel/mlx5.ko - unsupported file type le: mlx5.ko kldload: an error occurred while loading module mlx5.ko. Please check dmesg(8) for more details. Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: ichsmb.ko Starting Network: mce0. mce0: flags=8822 metric 0 mtu 1500 options RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,HWRXTSTMP,MEXTPG,TXTLS4,TXTLS6,VXLAN_HWCSUM,VXLAN_HWTSO,RXTLS4,RXTLS6 ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce1. mce1: flags=8822 metric 0 mtu 1500 options RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,HWRXTSTMP,MEXTPG,TXTLS4,TXTLS6,VXLAN_HWCSUM,VXLAN_HWTSO,RXTLS4,RXTLS6 ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko Autoloading module: usbhid.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. if_delmulti_locked: detaching ifnet instance 0xfffff800041d6000 DHCPDISCOVER on igb0 to 255.255.255.255 port 67 interval 3 DHCPOFFER from 192.168.5.1 DHCPREQUEST on igb0 to 255.255.255.255 port 67 if_delmulti_locked: detaching ifnet instance 0xfffff800041d6000 DHCPACK from 192.168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Recovering vi editor sessions:. Updating motd:. Clearing /tmp (X related). Starting syslogd. Starting watchdogd. Nov 3 19:21:49 mercat1 savecore[2632]: reboot after panic: handle_disk_io_initiation: Unexpected type jnewblk Setting date via ntp. 3 Nov 19:22:32 ntpdate[2635]: step time server 192.168.5.1 offset -1.230377 sec Starting powerd. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Mounting late filesystems:. Starting inetd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. sysctl: unknown oid 'debug.fail_point.pmap_allocpte_page_alloc' at line 12 Thu Nov 3 19:22 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: Nov 3 19:27:45 mercat1 su[2802]: pho to root on /dev/pts/0 20221103 19:34:49 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 19:36:09 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 356/408. 20221103 19:37:17 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 19:38:17 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 21/407. 20221103 19:39:17 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 19:40:28 all (1/1): force11.sh Nov 3 19:41:31 mercat1 kernel: pid 31672 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 6/408. 20221103 19:42:17 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 19:43:29 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 19:44:42 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 19:46:05 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 19:47:03 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 4/407. 20221103 19:48:36 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 20:01:06 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 20:02:06 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 304/383. 20221103 20:04:04 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 20:04:56 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt vnode_pager_putpages: I/O error 6 0xfffffe01571a04b0: type VREG usecount 0, writecount 0, refcount 3 seqc users 0 hold count flags () flags (VIRF_PGREAD|VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff80166e3d528 ref 0 pages 5 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe016c745000 (pid 49307, mmap, tid 100741) #0 0xffffffff80bbd85f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f46cbd at ffs_lock+0x9d #2 0xffffffff811acefc at VOP_LOCK1_APV+0x3c #3 0xffffffff80cfe1e4 at _vn_lock+0x54 #4 0xffffffff80cfe502 at vn_close1+0xa2 #5 0xffffffff80cfca2d at vn_closefile+0x3d #6 0xffffffff80b8becb at _fdrop+0x1b #7 0xffffffff80b8f71b at closef+0x1db #8 0xffffffff80b93477 at closefp_impl+0x77 #9 0xffffffff810da455 at amd64_syscall+0x145 #10 0xffffffff810ad16b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=19920, extsize 0 generation=abc4d547, uid=2007, gid=0, flags=0x0 ino 641192, on dev md10 vnode_pager_putpages: I/O error 6 0xfffffe01680cbbb8: type VREG usecount 0, writecount 0, refcount 3 seqc users 0 hold count flags () flags (VIRF_PGREAD|VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff80166d5f210 ref 0 pages 5 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe010e3eb720 (pid 49305, mmap, tid 100740) #0 0xffffffff80bbd85f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f46cbd at ffs_lock+0x9d #2 0xffffffff811acefc at VOP_LOCK1_APV+0x3c #3 0xffffffff80cfe1e4 at _vn_lock+0x54 #4 0xffffffff80cfe502 at vn_close1+0xa2 #5 0xffffffff80cfca2d at vn_closefile+0x3d #6 0xffffffff80b8becb at _fdrop+0x1b #7 0xffffffff80b8f71b at closef+0x1db #8 0xffffffff80b93477 at closefp_impl+0x77 #9 0xffffffff810da455 at amd64_syscall+0x145 #10 0xffffffff810ad16b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=19920, extsize 0 generation=b97b6d5c, uid=2007, gid=0, flags=0x0 ino 641969, on dev md10 vnode_pager_putpages: I/O error 6 0xfffffe01583da708: type VREG usecount 0, writecount 0, refcount 3 seqc users 0 hold count flags () flags (VIRF_PGREAD|VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff801664d3e70 ref 0 pages 5 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe016c745000 (pid 49307, mmap, tid 100741) #0 0xffffffff80bbd85f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f46cbd at ffs_lock+0x9d #2 0xffffffff811acefc at VOP_LOCK1_APV+0x3c #3 0xffffffff80cfe1e4 at _vn_lock+0x54 #4 0xffffffff80cfe502 at vn_close1+0xa2 #5 0xffffffff80cfca2d at vn_closefile+0x3d #6 0xffffffff80b8becb at _fdrop+0x1b #7 0xffffffff80b8f71b at closef+0x1db #8 0xffffffff80b93477 at closefp_impl+0x77 #9 0xffffffff810da455 at amd64_syscall+0x145 #10 0xffffffff810ad16b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=19920, extsize 0 generation=f89b7ec5, uid=2007, gid=0, flags=0x0 ino 642069, on dev md10 vnode_pager_putpages: I/O error 6 0xfffffe016dcce2c0: type VREG usecount 0, writecount 0, refcount 3 seqc users 0 hold count flags () flags (VIRF_PGREAD|VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff8047722c318 ref 0 pages 5 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe010e3eb720 (pid 49305, mmap, tid 100740) #0 0xffffffff80bbd85f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f46cbd at ffs_lock+0x9d #2 0xffffffff811acefc at VOP_LOCK1_APV+0x3c #3 0xffffffff80cfe1e4 at _vn_lock+0x54 #4 0xffffffff80cfe502 at vn_close1+0xa2 #5 0xffffffff80cfca2d at vn_closefile+0x3d #6 0xffffffff80b8becb at _fdrop+0x1b #7 0xffffffff80b8f71b at closef+0x1db #8 0xffffffff80b93477 at closefp_impl+0x77 #9 0xffffffff810da455 at amd64_syscall+0x145 #10 0xffffffff810ad16b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=19920, extsize 0 generation=37227e66, uid=2007, gid=0, flags=0x0 ino 642070, on dev md10 vnode_pager_putpages: I/O error 6 0xfffffe0158586960: type VREG usecount 0, writecount 0, refcount 2 seqc users 0 hold count flags () flags (VIRF_PGREAD|VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff80217f37d68 ref 0 pages 5 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe016c745000 (pid 49307, mmap, tid 100741) #0 0xffffffff80bbd85f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f46cbd at ffs_lock+0x9d #2 0xffffffff811acefc at VOP_LOCK1_APV+0x3c #3 0xffffffff80cfe1e4 at _vn_lock+0x54 #4 0xffffffff80cfe502 at vn_close1+0xa2 #5 0xffffffff80cfca2d at vn_closefile+0x3d #6 0xffffffff80b8becb at _fdrop+0x1b #7 0xffffffff80b8f71b at closef+0x1db #8 0xffffffff80b93477 at closefp_impl+0x77 #9 0xffffffff810da455 at amd64_syscall+0x145 #10 0xffffffff810ad16b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=19920, extsize 0 generation=82f2bc1a, uid=2007, gid=0, flags=0x0 ino 642071, on dev md10 vnode_pager_putpages: I/O error 6 0xfffffe0158ef7960: type VREG usecount 0, writecount 0, refcount 3 seqc users 0 hold count flags () flags (VIRF_PGREAD|VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff8018a416a50 ref 0 pages 5 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe0156dc7000 (pid 49261, mmap, tid 100628) with exclusive waiters pending #0 0xffffffff80bbd85f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f46cbd at ffs_lock+0x9d #2 0xffffffff811acefc at VOP_LOCK1_APV+0x3c #3 0xffffffff80cfe1e4 at _vn_lock+0x54 #4 0xffffffff80cfe502 at vn_close1+0xa2 #5 0xffffffff80cfca2d at vn_closefile+0x3d #6 0xffffffff80b8becb at _fdrop+0x1b #7 0xffffffff80b8f71b at closef+0x1db #8 0xffffffff80b93477 at closefp_impl+0x77 #9 0xffffffff810da455 at amd64_syscall+0x145 #10 0xffffffff810ad16b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=19920, extsize 0 generation=6cb70e35, uid=2007, gid=0, flags=0x0 ino 483651, on dev md10 vnode_pager_putpages: I/O error 6 0xfffffe0157f72708: type VREG usecount 0, writecount 0, refcount 2 seqc users 0 hold count flags () flags (VIRF_PGREAD|VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff80180766108 ref 0 pages 5 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe010e3eb720 (pid 49305, mmap, tid 100740) #0 0xffffffff80bbd85f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f46cbd at ffs_lock+0x9d #2 0xffffffff811acefc at VOP_LOCK1_APV+0x3c #3 0xffffffff80cfe1e4 at _vn_lock+0x54 #4 0xffffffff80cfe502 at vn_close1+0xa2 #5 0xffffffff80cfca2d at vn_closefile+0x3d #6 0xffffffff80b8becb at _fdrop+0x1b #7 0xffffffff80b8f71b at closef+0x1db #8 0xffffffff80b93477 at closefp_impl+0x77 #9 0xffffffff810da455 at amd64_syscall+0x145 #10 0xffffffff810ad16b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=19920, extsize 0 generation=e6a50b75, uid=2007, gid=0, flags=0x0 ino 643662, on dev md10 vnode_pager_putpages: I/O error 6 0xfffffe01584e7770: type VREG usecount 5, writecount 2, refcount 2 seqc users 0 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff8073299a738 ref 2 pages 5 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00e4ced000 (pid 0, kernel, tid 100044) with shared waiters pending #0 0xffffffff80bbd85f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f46cbd at ffs_lock+0x9d #2 0xffffffff811acefc at VOP_LOCK1_APV+0x3c #3 0xffffffff80cfe1e4 at _vn_lock+0x54 #4 0xffffffff80ce507a at vget_finish+0x7a #5 0xffffffff80ce7edf at vfs_periodic_msync_inactive+0x17f #6 0xffffffff80cdacb7 at dounmount+0x787 #7 0xffffffff80cdd3d5 at vfs_deferred_unmount+0xf5 #8 0xffffffff80c5515a at taskqueue_run_locked+0xaa #9 0xffffffff80c56202 at taskqueue_thread_loop+0xc2 #10 0xffffffff80ba6bb0 at fork_exit+0x80 #11 0xffffffff810ad8be at fork_trampoline+0xe nlink=1, effnlink=1, size=19920, extsize 0 generation=4b10c79f, uid=2007, gid=0, flags=0x0 ino 489229, on dev md10 20221103 20:06:56 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 279/389. 20221103 20:07:58 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 15/407. 20221103 20:09:56 all (1/1): force11.sh Nov 3 20:10:47 mercat1 kernel: pid 59382 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page UFS: forcibly unmounting /dev/md10 from /mnt 20221103 20:13:17 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 77/407. 20221103 20:15:06 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 20:16:25 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt vnode_pager_putpages: I/O error 6 0xfffffe01606ecc20: type VREG usecount 0, writecount 0, refcount 3 seqc users 0 hold count flags () flags (VIRF_PGREAD|VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff8017f37d630 ref 0 pages 5 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe0156010c80 (pid 90298, mmap, tid 100735) with exclusive waiters pending #0 0xffffffff80bbd85f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f46cbd at ffs_lock+0x9d #2 0xffffffff811acefc at VOP_LOCK1_APV+0x3c #3 0xffffffff80cfe1e4 at _vn_lock+0x54 #4 0xffffffff80cfe502 at vn_close1+0xa2 #5 0xffffffff80cfca2d at vn_closefile+0x3d #6 0xffffffff80b8becb at _fdrop+0x1b #7 0xffffffff80b8f71b at closef+0x1db #8 0xffffffff80b93477 at closefp_impl+0x77 #9 0xffffffff810da455 at amd64_syscall+0x145 #10 0xffffffff810ad16b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=19920, extsize 0 generation=9afa50de, uid=2007, gid=0, flags=0x0 ino 161390, on dev md10 20221103 20:19:55 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 308/314. stress2: pts leak: 1/2 20221103 20:21:18 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 22/339. 20221103 20:22:54 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 20:27:03 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 402/408. 20221103 20:28:13 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 20:29:04 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 20:30:07 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 78/408. 20221103 20:30:53 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 20:32:37 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 51/383. 20221103 20:33:46 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 20:34:38 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 378/408. 20221103 20:36:56 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 20:38:06 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 54/384. 20221103 20:39:09 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 20/407. 20221103 20:40:12 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 20:41:14 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 295/406. 20221103 20:42:25 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 20:43:48 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 296/407. 20221103 20:46:18 all (1/1): force11.sh Nov 3 20:47:08 mercat1 kernel: pid 5613 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page UFS: forcibly unmounting /dev/md10 from /mnt vnode_pager_putpages: I/O error 6 0xfffffe0157beb518: type VREG usecount 0, writecount 0, refcount 3 seqc users 0 hold count flags () flags (VIRF_PGREAD|VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff8018a2e2a50 ref 0 pages 5 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe01445fa900 (pid 5578, mmap, tid 100670) #0 0xffffffff80bbd85f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f46cbd at ffs_lock+0x9d #2 0xffffffff811acefc at VOP_LOCK1_APV+0x3c #3 0xffffffff80cfe1e4 at _vn_lock+0x54 #4 0xffffffff80cfe502 at vn_close1+0xa2 #5 0xffffffff80cfca2d at vn_closefile+0x3d #6 0xffffffff80b8becb at _fdrop+0x1b #7 0xffffffff80b8f71b at closef+0x1db #8 0xffffffff80b93477 at closefp_impl+0x77 #9 0xffffffff810da455 at amd64_syscall+0x145 #10 0xffffffff810ad16b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=19920, extsize 0 generation=4353cfb1, uid=2007, gid=0, flags=0x0 ino 808594, on dev md10 20221103 20:48:29 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt 20221103 20:49:46 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 303/308. 20221103 20:51:09 all (1/1): force11.sh UFS: forcibly unmounting /dev/md10 from /mnt fsync: giving up on dirty (error = 35) 0xfffffe0158c562c0: type VCHR usecount 1, writecount 0, refcount 888 seqc users 0 rdev 0xfffff804db839000 hold count flags () flags () v_object 0xfffff801668eca50 ref 0 pages 9955 cleanbuf 885 dirtybuf 1 lock type mntfs: EXCL by thread 0xfffffe00e4d41560 (pid 19237, mkdir, tid 100217) #0 0xffffffff80bbd85f at lockmgr_lock_flags+0x1cf #1 0xffffffff811acefc at VOP_LOCK1_APV+0x3c #2 0xffffffff80cfe1e4 at _vn_lock+0x54 #3 0xffffffff80f44240 at ffs_sync+0x2a0 #4 0xffffffff80f5c20e at ufs_sync_nlink+0xae #5 0xffffffff80f5a380 at ufs_mkdir+0x40 #6 0xffffffff811ac1b5 at VOP_MKDIR_APV+0x65 #7 0xffffffff80cfa09d at kern_mkdirat+0x20d #8 0xffffffff810da455 at amd64_syscall+0x145 #9 0xffffffff810ad16b at fast_syscall_common+0xf8 root Last login: Thu Nov 3 07:24:01 on ttyu1 Nov 3 21:30:44 mercat1 login[2768]: ROOT LOGIN (root) ON ttyu1 FreeBSD 14.0-CURRENT #0 main-n259014-dabb3db7a817f-dirty: Thu Nov 3 13:44:53 CET 2022 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO root@mercat1:~ # ps -lUroot | grep ufs 0 29588 29587 9 -52 0 13184 2744 ufs D< - 0:00.00 ls -l /tmp /dev /mnt /media 0 71293 70140 7 20 0 12896 2620 piperd S+ u1 0:00.00 grep ufs 0 41215 19169 4 68 0 13044 2808 ufs D+ 0 0:00.00 mount /dev/md10 /mnt root@mercat1:~ # KDB: enter: Break to debugger [ thread pid 11 tid 100003 ] Stopped at kdb_alt_break_internal+0x101: movq $0,0x129a014(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 2118 out of 32624 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 11 tid 100003 td 0xfffffe00e4c553a0 kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00377f0be0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00377f0bf0 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00377f0c20 uart_intr() at uart_intr+0x128/frame 0xfffffe00377f0c60 intr_event_handle() at intr_event_handle+0x12d/frame 0xfffffe00377f0cd0 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00377f0d00 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00377f0d00 --- interrupt, rip = 0xffffffff810965a6, rsp = 0xfffffe00377f0dd0, rbp = 0xfffffe00377f0dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377f0dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377f0e10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00377f0e30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00377f0e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x9c0840 curthread = 0xfffffe00e4c553a0: pid 11 tid 100003 critnest 2 "idle: cpu0" curpcb = 0xfffffe00e4c558c0 fpcurthread = none idlethread = 0xfffffe00e4c553a0: tid 100003 "idle: cpu0" self = 0xffffffff82610000 curpmap = 0xffffffff81e8d230 tssp = 0xffffffff82610384 rsp0 = 0xfffffe00377f1000 kcr3 = 0x8000000002571002 ucr3 = 0xffffffffffffffff scr3 = 0x6051428d1 gs32p = 0xffffffff82610404 ldt = 0xffffffff82610444 tss = 0xffffffff82610434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bb278840 curthread = 0xfffffe00e4c54c80: pid 11 tid 100004 critnest 1 "idle: cpu1" curpcb = 0xfffffe00e4c551a0 fpcurthread = none idlethread = 0xfffffe00e4c54c80: tid 100004 "idle: cpu1" self = 0xffffffff82611000 curpmap = 0xffffffff81e8d230 tssp = 0xffffffff82611384 rsp0 = 0xfffffe00377ec000 kcr3 = 0x8000000002571002 ucr3 = 0xffffffffffffffff scr3 = 0x739607c95 gs32p = 0xffffffff82611404 ldt = 0xffffffff82611444 tss = 0xffffffff82611434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bb285840 curthread = 0xfffffe00e4c54560: pid 11 tid 100005 critnest 1 "idle: cpu2" curpcb = 0xfffffe00e4c54a80 fpcurthread = none idlethread = 0xfffffe00e4c54560: tid 100005 "idle: cpu2" self = 0xffffffff82612000 curpmap = 0xffffffff81e8d230 tssp = 0xffffffff82612384 rsp0 = 0xfffffe00377fb000 kcr3 = 0x8000000002571002 ucr3 = 0xffffffffffffffff scr3 = 0x24f9ca9c7 gs32p = 0xffffffff82612404 ldt = 0xffffffff82612444 tss = 0xffffffff82612434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bb292840 curthread = 0xfffffe00e4c53e40: pid 11 tid 100006 critnest 1 "idle: cpu3" curpcb = 0xfffffe00e4c54360 fpcurthread = none idlethread = 0xfffffe00e4c53e40: tid 100006 "idle: cpu3" self = 0xffffffff82613000 curpmap = 0xffffffff81e8d230 tssp = 0xffffffff82613384 rsp0 = 0xfffffe00377f6000 kcr3 = 0x8000000002571002 ucr3 = 0xffffffffffffffff scr3 = 0x815395c82 gs32p = 0xffffffff82613404 ldt = 0xffffffff82613444 tss = 0xffffffff82613434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bb29f840 curthread = 0xfffffe00e4c53720: pid 11 tid 100007 critnest 1 "idle: cpu4" curpcb = 0xfffffe00e4c53c40 fpcurthread = none idlethread = 0xfffffe00e4c53720: tid 100007 "idle: cpu4" self = 0xffffffff82614000 curpmap = 0xffffffff81e8d230 tssp = 0xffffffff82614384 rsp0 = 0xfffffe00e4831000 kcr3 = 0x8000000002571002 ucr3 = 0xffffffffffffffff scr3 = 0x47e6b7bcd gs32p = 0xffffffff82614404 ldt = 0xffffffff82614444 tss = 0xffffffff82614434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bb2ac840 curthread = 0xfffffe00e4c53000: pid 11 tid 100008 critnest 1 "idle: cpu5" curpcb = 0xfffffe00e4c53520 fpcurthread = none idlethread = 0xfffffe00e4c53000: tid 100008 "idle: cpu5" self = 0xffffffff82615000 curpmap = 0xffffffff81e8d230 tssp = 0xffffffff82615384 rsp0 = 0xfffffe0037800000 kcr3 = 0x8000000002571002 ucr3 = 0xffffffffffffffff scr3 = 0x21dc559f7 gs32p = 0xffffffff82615404 ldt = 0xffffffff82615444 tss = 0xffffffff82615434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bb2b9840 curthread = 0xfffffe00e4c5bc80: pid 11 tid 100009 critnest 1 "idle: cpu6" curpcb = 0xfffffe00e4c5c1a0 fpcurthread = none idlethread = 0xfffffe00e4c5bc80: tid 100009 "idle: cpu6" self = 0xffffffff82616000 curpmap = 0xffffffff81e8d230 tssp = 0xffffffff82616384 rsp0 = 0xfffffe00e483b000 kcr3 = 0x8000000002571002 ucr3 = 0xffffffffffffffff scr3 = 0x49d30ebb4 gs32p = 0xffffffff82616404 ldt = 0xffffffff82616444 tss = 0xffffffff82616434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bb2c6840 curthread = 0xfffffe00e4c5b560: pid 11 tid 100010 critnest 1 "idle: cpu7" curpcb = 0xfffffe00e4c5ba80 fpcurthread = none idlethread = 0xfffffe00e4c5b560: tid 100010 "idle: cpu7" self = 0xffffffff82617000 curpmap = 0xffffffff81e8d230 tssp = 0xffffffff82617384 rsp0 = 0xfffffe00e4836000 kcr3 = 0x8000000002571002 ucr3 = 0xffffffffffffffff scr3 = 0x46d4c0a63 gs32p = 0xffffffff82617404 ldt = 0xffffffff82617444 tss = 0xffffffff82617434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bb2d3840 curthread = 0xfffffe00e4c5ae40: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffffe00e4c5b360 fpcurthread = none idlethread = 0xfffffe00e4c5ae40: tid 100011 "idle: cpu8" self = 0xffffffff82618000 curpmap = 0xffffffff81e8d230 tssp = 0xffffffff82618384 rsp0 = 0xfffffe00e4845000 kcr3 = 0x8000000002571002 ucr3 = 0xffffffffffffffff scr3 = 0x802706fab gs32p = 0xffffffff82618404 ldt = 0xffffffff82618444 tss = 0xffffffff82618434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bb2e0840 curthread = 0xfffffe00e4c5a720: pid 11 tid 100012 critnest 1 "idle: cpu9" curpcb = 0xfffffe00e4c5ac40 fpcurthread = none idlethread = 0xfffffe00e4c5a720: tid 100012 "idle: cpu9" self = 0xffffffff82619000 curpmap = 0xffffffff81e8d230 tssp = 0xffffffff82619384 rsp0 = 0xfffffe00e4840000 kcr3 = 0x8000000002571002 ucr3 = 0xffffffffffffffff scr3 = 0x33aa71c1b gs32p = 0xffffffff82619404 ldt = 0xffffffff82619444 tss = 0xffffffff82619434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bb2ed840 curthread = 0xfffffe00e4c5a000: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffffe00e4c5a520 fpcurthread = none idlethread = 0xfffffe00e4c5a000: tid 100013 "idle: cpu10" self = 0xffffffff8261a000 curpmap = 0xffffffff81e8d230 tssp = 0xffffffff8261a384 rsp0 = 0xfffffe00e484f000 kcr3 = 0x8000000002571002 ucr3 = 0xffffffffffffffff scr3 = 0x75badf950 gs32p = 0xffffffff8261a404 ldt = 0xffffffff8261a444 tss = 0xffffffff8261a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bb2fa840 curthread = 0xfffffe00e4c57740: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffffe00e4c57c60 fpcurthread = none idlethread = 0xfffffe00e4c57740: tid 100014 "idle: cpu11" self = 0xffffffff8261b000 curpmap = 0xffffffff81e8d230 tssp = 0xffffffff8261b384 rsp0 = 0xfffffe00e484a000 kcr3 = 0x8000000002571002 ucr3 = 0xffffffffffffffff scr3 = 0x77689af6b gs32p = 0xffffffff8261b404 ldt = 0xffffffff8261b444 tss = 0xffffffff8261b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 41215 (mount) thread 0xfffffe0142ada720 (100240) shared lockmgr ufs (ufs) r = 0 (0xfffffe010e398070) locked @ kern/vfs_lookup.c:974 Process 29588 (ls) thread 0xfffffe0155fc6ac0 (100678) shared lockmgr ufs (ufs) r = 0 (0xfffffe010e398070) locked @ kern/vfs_lookup.c:974 Process 23833 (sh) thread 0xfffffe0155fc7900 (100556) shared lockmgr ufs (ufs) r = 0 (0xfffffe010e398070) locked @ kern/vfs_lookup.c:974 Process 0 (kernel) thread 0xfffffe00e4ced000 (100044) exclusive lockmgr ufs (ufs) r = 0 (0xfffffe0143884778) locked @ kern/vfs_mount.c:2121 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffffe010e398000: type VDIR usecount 41, writecount 0, refcount 4 seqc users 0 mountedhere 0 hold count flags () flags (VV_ROOT|VMP_LAZYLIST) v_object 0xfffff800031ceb58 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 3) #0 0xffffffff80bbd85f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f46cbd at ffs_lock+0x9d #2 0xffffffff811acefc at VOP_LOCK1_APV+0x3c #3 0xffffffff80cfe1e4 at _vn_lock+0x54 #4 0xffffffff80cd55a0 at vfs_lookup+0x140 #5 0xffffffff80cd4bcd at namei+0x33d #6 0xffffffff80cfd8c6 at vn_open_cred+0x506 #7 0xffffffff80cf3c1c at kern_openat+0x29c #8 0xffffffff810da455 at amd64_syscall+0x145 #9 0xffffffff810ad16b at fast_syscall_common+0xf8 nlink=29, effnlink=29, size=1536, extsize 0 generation=447a1a37, uid=0, gid=0, flags=0x0 ino 2, on dev gpt/work vnode 0xfffffe0143884708: type VDIR usecount 4, writecount 0, refcount 2 seqc users 1 mountedhere 0xfffffe010e38f000 hold count flags () flags (VIRF_MOUNTPOINT) v_object 0xfffff80025fe1a50 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00e4ced000 (pid 0, kernel, tid 100044) with shared waiters pending #0 0xffffffff80bbd85f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f46cbd at ffs_lock+0x9d #2 0xffffffff811acefc at VOP_LOCK1_APV+0x3c #3 0xffffffff80cfe1e4 at _vn_lock+0x54 #4 0xffffffff80cda9d9 at dounmount+0x4a9 #5 0xffffffff80cdd3d5 at vfs_deferred_unmount+0xf5 #6 0xffffffff80c5515a at taskqueue_run_locked+0xaa #7 0xffffffff80c56202 at taskqueue_thread_loop+0xc2 #8 0xffffffff80ba6bb0 at fork_exit+0x80 #9 0xffffffff810ad8be at fork_trampoline+0xe nlink=906, effnlink=906, size=512, extsize 0 generation=ab2c1349, uid=0, gid=0, flags=0x0 ino 89405184, on dev gpt/work db:1:pho1> show mount 0xfffffe010e390700 /dev/gpt/work on / (ufs) 0xfffffe010e391280 devfs on /dev (devfs) 0xfffffe0142aeb280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe010e38f000 /dev/md10 on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 85416 Buf domain 0 freebufs 15047 lofreebufs 219 hifreebufs 329 bufspace 1073152 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 64 (618496) dirtyq count 0 (0) wakeup 0 lim 25 CPU 2, 2, 0, 0, 4, 1, 4, 0, 2, 1, 0, 6, Locked buffers: 0 space 0 Total buffers: 22021 space 1073152 Buf domain 1 freebufs 13962 lofreebufs 219 hifreebufs 329 bufspace 36536320 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1058 (33255424) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 24, 2, 0, 0, 15, 17, 6, 9, 3, 17, 16, 3, Locked buffers: 0 space 0 Total buffers: 46003 space 36536320 Buf domain 2 freebufs 7976 lofreebufs 219 hifreebufs 329 bufspace 234229760 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7054 (231145472) dirtyq count 2 (8192) wakeup 0 lim 25 CPU 14, 2, 18, 0, 17, 4, 1, 1, 21, 0, 7, 16, Locked buffers: 0 space 0 Total buffers: 11210 space 234229760 Buf domain 3 freebufs 12708 lofreebufs 219 hifreebufs 329 bufspace 77623296 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2294 (73842688) dirtyq count 2 (8192) wakeup 0 lim 25 CPU 17, 7, 23, 14, 14, 10, 1, 3, 13, 1, 23, 3, Locked buffers: 0 space 0 Total buffers: 9879 space 77623296 Buf domain 4 freebufs 7937 lofreebufs 219 hifreebufs 329 bufspace 235446272 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7077 (231870464) dirtyq count 1 (20480) wakeup 0 lim 25 CPU 23, 1, 16, 23, 8, 3, 2, 5, 13, 17, 5, 2, Locked buffers: 0 space 0 Total buffers: 13897 space 235446272 Buf domain 5 freebufs 15120 lofreebufs 219 hifreebufs 329 bufspace 65536 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1 (4096) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 1, 0, 0, 1, 2, 0, 0, 2, 1, 3, 2, Locked buffers: 0 space 0 Total buffers: 870 space 65536 Buf domain 6 freebufs 14069 lofreebufs 219 hifreebufs 329 bufspace 33529856 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 21 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 973 (30547968) dirtyq count 21 (688128) wakeup 0 lim 25 CPU 1, 5, 9, 8, 6, 6, 7, 6, 3, 0, 17, 2, Locked buffers: 0 space 0 Total buffers: 2051 space 33529856 db:1:pho1> show page vm_cnt.v_free_count: 6826601 vm_cnt.v_inactive_count: 899581 vm_cnt.v_active_count: 2734 vm_cnt.v_laundry_count: 116 vm_cnt.v_wire_count: 448494 vm_cnt.v_free_reserved: 10643 vm_cnt.v_free_min: 51262 vm_cnt.v_free_target: 173119 vm_cnt.v_inactive_target: 259678 db:1:pho1> show pageq pq_free 6826601 dom 0 page_cnt 8123862 free 6826601 pq_act 2734 pq_inact 899581 pq_laund 116 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000408 | 000098 11 (008192K) | 000783 | 000078 10 (004096K) | 001432 | 000083 09 (002048K) | 001868 | 000073 08 (001024K) | 001250 | 000149 07 (000512K) | 000000 | 000167 06 (000256K) | 000001 | 000309 05 (000128K) | 000001 | 000360 04 (000064K) | 000001 | 000001 03 (000032K) | 000000 | 000001 02 (000016K) | 000001 | 000001 01 (000008K) | 000000 | 000030 00 (000004K) | 000000 | 000388 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000001 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000001 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree FFS inode 1160 169228 45126 16118090 0 39 248650640 0 malloc-4096 4096 34122 12 130739 0 2 139812864 0 VNODE 600 169356 45313 16118482 0 38 128801400 0 VM OBJECT 264 65177 242293 21533618 0 31 81172080 0 FFS2 dinode 256 169228 44942 16118089 0 63 54827520 0 malloc-384 384 53 132357 15725284 0 30 50845440 0 malloc-256 256 1279 149651 36799992 0 62 38638080 0 mbuf_cluster 2048 12927 19 45182 0 8 26513408 0 S VFS Cache 104 170282 31192 8686083 0 126 20953296 0 BUF TRIE 144 1612 104340 5103368 0 62 15257088 0 malloc-128 128 817 96275 20127575 0 126 12427776 0 RADIX NODE 144 79117 2556 33780756 0 63 11760912 0 swblk 136 1472 64967 954483 0 62 9035704 0 malloc-256 256 38 23707 14126051 0 62 6078720 0 UMA Slabs 0 112 44185 773 131123 0 126 5035296 0 mbuf 256 15551 2548 32040 0 254 4633344 0 vmem btag 56 61088 20332 479705 0 254 4559520 0 malloc-128 128 14468 14982 28271541 0 126 3769600 0 malloc-128 128 26008 1768 169209134 0 126 3555328 0 64 Bucket 512 4231 2457 3169758 0 30 3424256 0 128 Bucket 1024 1319 664 2053423 0 16 2030592 0 pbuf 2776 0 723 0 0 0 2007048 0 malloc-128 128 12700 258 21676282 0 126 1658624 0 malloc-32768 32768 11 37 793 0 1 1572864 0 32 Bucket 256 3253 2822 4643913 0 62 1555200 0 malloc-4096 4096 335 8 5416 0 2 1404928 0 malloc-32768 32768 0 39 909839 0 1 1277952 0 256 Bucket 2048 464 78 808734 0 8 1110016 0 malloc-16384 16384 17 50 466440 0 1 1097728 0 THREAD 1824 486 64 817 0 8 1003200 0 swpctrie 144 218 6642 95750 0 62 987840 0 malloc-64 64 8598 4821 596491 0 254 858816 0 malloc-64 64 9491 3109 119597442 0 254 806400 0 malloc-65536 65536 3 8 140 0 1 720896 0 malloc-8192 8192 86 0 86 0 1 704512 0 malloc-4096 4096 72 100 572131 0 2 704512 0 VMSPACE 2560 52 212 572025 0 4 675840 0 malloc-65536 65536 3 7 4056 0 1 655360 0 g_bio 408 0 1590 27678199 0 30 648720 0 MAP ENTRY 96 2438 4282 30891213 0 126 645120 0 L VFS Cache 320 1816 104 1816 0 30 614400 0 FPU_save_area 832 488 178 8879 0 16 554112 0 DIRHASH 1024 109 387 31759786 0 16 507904 0 UMA Zones 2048 230 5 230 0 8 481280 0 malloc-128 128 2099 1528 251665 0 126 464256 0 malloc-512 512 510 330 2652759 0 30 430080 0 malloc-32768 32768 13 0 13 0 1 425984 0 mbuf_packet 256 14 1522 8147 0 254 393216 0 malloc-32768 32768 12 0 12 0 1 393216 0 PROC 1368 71 215 572130 0 8 391248 0 lkpimm 168 3 2325 3 0 62 391104 0 lkpicurr 168 13 2315 13 0 62 391104 0 malloc-64 64 4143 582 4171 0 254 302400 0 NAMEI 1024 10 282 174778077 0 16 299008 0 filedesc0 1072 72 201 572131 0 8 292656 0 malloc-32 32 8210 862 8210 0 254 290304 0 malloc-16 16 15900 1850 16062 0 254 284000 0 malloc-64 64 773 3574 705996 0 254 278208 0 ksiginfo 112 275 2173 14884 0 126 274176 0 malloc-1024 1024 68 192 493260 0 16 266240 0 malloc-256 256 107 928 26067968 0 62 264960 0 malloc-1024 1024 123 129 349 0 16 258048 0 pipe 728 7 345 335803 0 16 256256 0 malloc-64 64 272 3571 89117834 0 254 245952 0 malloc-1024 1024 163 77 702 0 16 245760 0 malloc-256 256 194 751 232241 0 62 241920 0 malloc-256 256 235 695 6674 0 62 238080 0 malloc-2048 2048 17 97 929 0 8 233472 0 malloc-8192 8192 22 5 4181 0 1 221184 0 malloc-1024 1024 20 192 1424 0 16 217088 0 16 Bucket 144 412 1072 4998746 0 62 213696 0 socket 960 37 179 6358 0 16 207360 0 malloc-64 64 117 3096 572568 0 254 205632 0 Files 80 116 2434 78834867 0 126 204000 0 malloc-256 256 29 751 8018994 0 62 199680 0 malloc-65536 65536 3 0 3 0 1 196608 0 malloc-65536 65536 3 0 3 0 1 196608 0 malloc-16384 16384 11 1 22 0 1 196608 0 malloc-2048 2048 14 82 2415 0 8 196608 0 malloc-128 128 128 1391 5249947 0 126 194432 0 malloc-4096 4096 31 14 3401 0 2 184320 0 unpcb 256 17 688 5875 0 62 180480 0 malloc-2048 2048 85 1 85 0 8 176128 0 4 Bucket 48 44 3484 533777 0 254 169344 0 clpbuf 2776 0 60 102855 0 2 166560 0 udp_inpcb 424 11 340 432 0 30 148824 0 ada_ccb 272 0 546 5848763 0 30 148512 0 8 Bucket 80 127 1723 4501578 0 126 148000 0 PWD 32 25 4511 6367679 0 254 145152 0 TURNSTILE 136 551 457 551 0 62 137088 0 malloc-64 64 77 2065 116540 0 254 137088 0 fakepg 104 0 1287 704 0 126 133848 0 malloc-8192 8192 16 0 58 0 1 131072 0 malloc-384 384 287 43 287 0 30 126720 0 PGRP 88 33 1393 205 0 126 125488 0 malloc-32 32 379 3149 136164 0 254 112896 0 malloc-512 512 4 212 8482 0 30 110592 0 malloc-32 32 329 3073 5047 0 254 108864 0 malloc-32 32 595 2807 32132 0 254 108864 0 DEVCTL 1024 0 104 2502 0 0 106496 0 malloc-8192 8192 13 0 18 0 1 106496 0 2 Bucket 32 461 2815 1291178 0 254 104832 0 malloc-32 32 279 2871 22106 0 254 100800 0 malloc-32768 32768 2 1 3630 0 1 98304 0 malloc-4096 4096 24 0 28 0 2 98304 0 rl_entry 40 267 2056 267 0 254 92920 0 malloc-8192 8192 11 0 13 0 1 90112 0 malloc-16 16 478 5022 907864 0 254 88000 0 malloc-384 384 2 218 205 0 30 84480 0 ttyinq 160 345 180 555 0 62 84000 0 ttyoutq 256 181 134 290 0 62 80640 0 SLEEPQUEUE 88 551 345 551 0 126 78848 0 UMA Kegs 384 200 3 200 0 30 77952 0 malloc-512 512 0 152 176 0 30 77824 0 Mountpoints 2944 4 20 91 0 4 70656 0 malloc-32 32 20 2122 69 0 254 68544 0 malloc-65536 65536 1 0 1 0 1 65536 0 malloc-65536 65536 0 1 708 0 1 65536 0 malloc-16384 16384 0 4 177 0 1 65536 0 udpcb 32 11 1879 432 0 254 60480 0 malloc-16 16 478 3272 1109926 0 254 60000 0 malloc-32 32 200 1564 3201 0 254 56448 0 malloc-4096 4096 4 9 288 0 2 53248 0 malloc-1024 1024 48 4 51 0 16 53248 0 ertt_txseginfo 40 0 1313 642 0 254 52520 0 swrbuf 2776 0 18 61501 0 2 49968 0 malloc-16 16 26 2974 18677 0 254 48000 0 malloc-384 384 109 11 111 0 30 46080 0 malloc-2048 2048 18 4 20 0 8 45056 0 pcpu-64 64 460 180 460 0 254 40960 0 pcpu-8 8 3527 1593 3539 0 254 40960 0 malloc-16 16 432 2068 117234 0 254 40000 0 cpuset 104 27 314 27 0 126 35464 0 malloc-384 384 33 57 9914 0 30 34560 0 malloc-384 384 44 46 812 0 30 34560 0 malloc-384 384 23 67 1325 0 30 34560 0 malloc-16 16 243 1757 287 0 254 32000 0 malloc-128 128 53 195 68 0 126 31744 0 tcpcb 1104 6 22 11 0 8 30912 0 mdpbuf 2776 0 11 1704856 0 1 30536 0 malloc-16 16 43 1707 779 0 254 28000 0 malloc-1024 1024 15 9 26 0 16 24576 0 malloc-512 512 26 22 27 0 30 24576 0 rtentry 168 12 132 16 0 62 24192 0 malloc-2048 2048 1 9 484 0 8 20480 0 udp_inpcb ports 32 3 627 11 0 254 20160 0 malloc-64 64 12 303 16 0 254 20160 0 routing nhops 256 9 66 16 0 62 19200 0 malloc-256 256 21 54 179 0 62 19200 0 malloc-256 256 10 65 22 0 62 19200 0 tcp_inpcb 424 6 39 11 0 30 19080 0 malloc-16384 16384 1 0 1 0 1 16384 0 malloc-8192 8192 2 0 2 0 1 16384 0 malloc-512 512 12 20 14 0 30 16384 0 pcpu-16 16 24 1000 24 0 254 16384 0 malloc-128 128 9 115 10 0 126 15872 0 malloc-2048 2048 4 2 5686 0 8 12288 0 malloc-1024 1024 7 5 19 0 16 12288 0 ertt 72 6 162 11 0 126 12096 0 malloc-16 16 5 745 6 0 254 12000 0 malloc-384 384 6 24 20 0 30 11520 0 malloc-8192 8192 1 0 1 0 1 8192 0 malloc-4096 4096 2 0 115782 0 2 8192 0 malloc-2048 2048 2 2 10 0 8 8192 0 malloc-512 512 2 14 54 0 30 8192 0 tcp_inpcb ports 32 2 250 2 0 254 8064 0 malloc-32 32 8 244 11 0 254 8064 0 kenv 258 18 12 21837 0 30 7740 0 ripcb 424 1 17 3 0 30 7632 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 malloc-1024 1024 2 2 24 0 16 4096 0 malloc-512 512 1 7 13 0 30 4096 0 SMR CPU 32 7 120 7 0 254 4064 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 KNOTE 160 0 25 4 0 62 4000 0 UMA Slabs 1 176 9 13 10 0 62 3872 0 KMAP ENTRY 96 33 6 35 0 0 3744 0 vmem 1856 1 1 1 0 8 3712 0 SMR SHARED 24 7 120 7 0 254 3048 0 FFS1 dinode 128 0 0 0 0 126 0 0 da_ccb 544 0 0 0 0 16 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 hostcache 64 0 0 0 0 254 0 0 syncache 168 0 0 2 0 62 0 0 ipq 56 0 0 0 0 254 0 0 tcp_log_id_node 120 0 0 0 0 126 0 0 tcp_log_id_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 30 0 0 tcpreass 48 0 0 0 0 254 0 0 ripcb ports 32 0 0 0 0 254 0 0 udplite_inpcb ports 32 0 0 0 0 254 0 0 udplite_inpcb 424 0 0 0 0 30 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 272 0 0 0 0 30 0 0 AIOCB 552 0 0 0 0 16 0 0 AIO 208 0 0 0 0 62 0 0 TMPFS node 224 0 0 0 0 62 0 0 NCLNODE 760 0 0 0 0 16 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 STS VFS Cache 144 0 0 0 0 62 0 0 cryptop 280 0 0 0 0 30 0 0 linux_dma_object 32 0 0 0 0 254 0 0 linux_dma_pctrie 144 0 0 0 0 62 0 0 IOMMU_MAP_ENTRY 104 0 0 0 0 126 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 6 0 2 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 2776 0 0 0 0 4 0 0 nfspbuf 2776 0 0 0 0 2 0 0 swwbuf 2776 0 0 529126 0 1 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 2 0 1 0 0 malloc-16384 16384 0 0 4 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-8192 8192 0 0 0 0 1 0 0 malloc-4096 4096 0 0 0 0 2 0 0 malloc-2048 2048 0 0 0 0 8 0 0 malloc-512 512 0 0 0 0 30 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 vm pgcache 4096 129541 2810 28539602 14 vm pgcache 4096 1014752 2534 116128186 31 buf free cache 848 19112 1403 16904918 17 buffer arena-65 65536 0 0 0 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 1265 303 8713311 1 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 4 3 930 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 kstack_cache 16384 486 1 817 1 db:0:pho> acttrace Tracing command idle pid 11 tid 100003 td 0xfffffe00e4c553a0 (CPU 0) kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00377f0be0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00377f0bf0 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00377f0c20 uart_intr() at uart_intr+0x128/frame 0xfffffe00377f0c60 intr_event_handle() at intr_event_handle+0x12d/frame 0xfffffe00377f0cd0 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00377f0d00 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00377f0d00 --- interrupt, rip = 0xffffffff810965a6, rsp = 0xfffffe00377f0dd0, rbp = 0xfffffe00377f0dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377f0dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377f0e10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00377f0e30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00377f0e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe00e4c54c80 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e00 trap() at trap+0x57/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00377ebdd0, rbp = 0xfffffe00377ebdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377ebdd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377ebe10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00377ebe30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00377ebe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377ebef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ebf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe00e4c54560 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce2ddf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce2de00 trap() at trap+0x57/frame 0xfffffe003ce2df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce2df20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00377fadd0, rbp = 0xfffffe00377fadd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377fadd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377fae10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00377fae30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00377fae50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377faef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe00e4c53e40 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3adf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ae00 trap() at trap+0x57/frame 0xfffffe003ce3af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3af20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00377f5dd0, rbp = 0xfffffe00377f5dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377f5dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377f5e10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00377f5e30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00377f5e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377f5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00e4c53720 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce47df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce47e00 trap() at trap+0x57/frame 0xfffffe003ce47f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce47f20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00e4830dd0, rbp = 0xfffffe00e4830dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4830dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4830e10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00e4830e30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00e4830e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4830ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4830f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4830f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe00e4c53000 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce54df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce54e00 trap() at trap+0x57/frame 0xfffffe003ce54f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce54f20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00377ffdd0, rbp = 0xfffffe00377ffdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377ffdd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377ffe10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00377ffe30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00377ffe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe00e4c5bc80 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce61df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce61e00 trap() at trap+0x57/frame 0xfffffe003ce61f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce61f20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00e483add0, rbp = 0xfffffe00e483add0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e483add0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e483ae10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00e483ae30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00e483ae50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e483aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe00e4c5b560 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6edf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6ee00 trap() at trap+0x57/frame 0xfffffe003ce6ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6ef20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00e4835dd0, rbp = 0xfffffe00e4835dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4835dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4835e10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00e4835e30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00e4835e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4835ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4835f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4835f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe00e4c5ae40 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7be00 trap() at trap+0x57/frame 0xfffffe003ce7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7bf20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00e4844dd0, rbp = 0xfffffe00e4844dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4844dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4844e10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00e4844e30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00e4844e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4844ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4844f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4844f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe00e4c5a720 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce88df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce88e00 trap() at trap+0x57/frame 0xfffffe003ce88f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce88f20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00e483fdd0, rbp = 0xfffffe00e483fdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e483fdd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e483fe10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00e483fe30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00e483fe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e483fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00e4c5a000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce95df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce95e00 trap() at trap+0x57/frame 0xfffffe003ce95f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce95f20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00e484edd0, rbp = 0xfffffe00e484edd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e484edd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e484ee10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00e484ee30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00e484ee50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e484eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e484ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e484ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00e4c57740 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea2df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea2e00 trap() at trap+0x57/frame 0xfffffe003cea2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea2f20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00e4849dd0, rbp = 0xfffffe00e4849dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4849dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4849e10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00e4849e30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00e4849e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4849ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4849f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4849f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 72442 3436 3395 0 S nanslp 0xffffffff81eac8a8 sleep 70140 2768 70140 0 S+ ttyin 0xfffff800250728b0 csh 41215 19169 3310 0 D+ ufs 0xfffffe0143884778 mount 40059 0 0 0 DL mdwait 0xfffff8041b288000 [md10] 29588 29587 2615 0 D ufs 0xfffffe0143884778 ls 29587 2615 2615 0 S wait 0xfffffe01445bd000 sh 23833 1 19197 2007 D+ ufs 0xfffffe0143884778 sh 19247 1 19197 2007 D+ vfs_bus 0xfffffe010e38f000 mkdir 19245 1 19197 2007 D+ vfs_bus 0xfffffe010e38f000 mkdir 19241 1 19197 2007 D+ vfs_bus 0xfffffe010e38f000 mkdir 19239 1 19197 2007 D+ vfs_bus 0xfffffe010e38f000 mkdir 19228 1 19197 2007 D+ vfs_bus 0xfffffe010e38f000 mkdir 19221 1 19197 2007 D+ vfs_bus 0xfffffe010e38f000 mkdir 19219 1 19197 2007 D+ vfs_bus 0xfffffe010e38f000 mkdir 19169 19167 3310 0 S+ wait 0xfffffe0156de0560 sh 19168 3310 3310 0 S+ piperd 0xfffffe015a5f8c70 tee 19167 3310 3310 0 S+ wait 0xfffffe013ea42568 sh 13512 13511 13512 2006 Ss+ select 0xfffff8037ffde440 bash 13511 12339 12339 2006 S select 0xfffff8037ffde340 sshd 12339 2741 12339 0 Ss select 0xfffff80003e8c540 sshd 3439 3395 3395 0 S piperd 0xfffffe0141a2be38 sh 3437 3395 3395 0 S piperd 0xfffffe013ea735b0 awk 3436 3395 3395 0 S wait 0xfffffe010e392558 sh 3395 1 3395 0 SWs wait 0xfffffe003ce1b008 sh 3310 2804 3310 0 S+ wait 0xfffffe0142ad7008 sh 2804 2802 2804 0 SW+ wait 0xfffffe0141a0b570 bash 2802 2801 2802 0 SW+ pause 0xfffffe003ce50b70 csh 2801 2796 2801 2006 SW+ wait 0xfffffe00e4c52018 su 2796 2795 2796 2006 SWs+ wait 0xfffffe014441d560 bash 2795 2792 2792 2006 S select 0xfffff800041a5540 sshd 2792 2741 2792 0 Ss select 0xfffff80003e8cbc0 sshd 2768 1 2768 0 Ss+ wait 0xfffffe014441dab8 login 2767 1 2767 0 Ss+ ttyin 0xfffff80025072cb0 getty 2766 1 2766 0 Ss+ ttyin 0xfffff800281890b0 getty 2765 1 2765 0 Ss+ ttyin 0xfffff800281894b0 getty 2764 1 2764 0 Ss+ ttyin 0xfffff800281898b0 getty 2763 1 2763 0 Ss+ ttyin 0xfffff80028189cb0 getty 2762 1 2762 0 Ss+ ttyin 0xfffff800281880b0 getty 2761 1 2761 0 Ss+ ttyin 0xfffff800281884b0 getty 2760 1 2760 0 Ss+ ttyin 0xfffff800281888b0 getty 2759 1 2759 0 Ss+ ttyin 0xfffff80028188cb0 getty 2745 1 2745 0 Ss nanslp 0xffffffff81eac8a0 cron 2741 1 2741 0 Ss select 0xfffff800041a6740 sshd 2722 1 2722 0 Ss select 0xfffff80003f7f0c0 inetd 2696 1 2696 123 Ss select 0xfffff800041a52c0 ntpd 2670 1 2670 0 Ss select 0xfffff80004036ac0 powerd 2615 1 2615 0 Ss wait 0xfffffe0142ad8010 watchdogd 2607 1 2607 0 Ss select 0xfffff80003e0d540 syslogd 2420 1 2420 0 Ss select 0xfffff80004036b40 devd 2415 1 2415 65 Ss select 0xfffff80003f7f3c0 dhclient 2339 1 2339 0 Ss select 0xfffff80003f7f4c0 dhclient 2336 1 2336 0 Ss select 0xfffff80003f7f140 dhclient 19 0 0 0 DL vlruwt 0xfffffe010e392ab0 [vnlru] 18 0 0 0 DL syncer 0xffffffff81f9d568 [syncer] 17 0 0 0 DL (threaded) [bufdaemon] 100197 D psleep 0xffffffff81f9c570 [bufdaemon] 100198 D - 0xffffffff81a0b0c0 [bufspacedaemon-0] 100199 D - 0xffffffff81a13380 [bufspacedaemon-1] 100200 D - 0xffffffff81a1b640 [bufspacedaemon-2] 100201 D - 0xffffffff81a23900 [bufspacedaemon-3] 100202 D - 0xffffffff81a2bbc0 [bufspacedaemon-4] 100203 D - 0xffffffff81a33e80 [bufspacedaemon-5] 100204 D - 0xffffffff81a3c140 [bufspacedaemon-6] 100218 D sdflush 0xfffff800250724e8 [/ worker] 100224 D sdflush 0xfffff80032481ce8 [/tmp worker] 100817 D sdflush 0xfffff80759ee74e8 [/mnt worker] 16 0 0 0 DL psleep 0xffffffff81fc2590 [vmdaemon] 9 0 0 0 DL (threaded) [pagedaemon] 100195 D psleep 0xffffffff81fb69f8 [dom0] 100205 D launds 0xffffffff81fb6a04 [laundry: dom0] 100206 D umarcl 0xffffffff80f68b50 [uma] 8 0 0 0 DL idle 0xfffffe003ce51018 [enc_daemon1] 7 0 0 0 DL idle 0xfffffe003ce51570 [enc_daemon0] 6 0 0 0 DL - 0xffffffff81ce0348 [rand_harvestq] 15 0 0 0 DL (threaded) [usb] 100128 D - 0xfffffe010a1a2440 [usbus0] 100129 D - 0xfffffe010a1a2498 [usbus0] 100130 D - 0xfffffe010a1a24f0 [usbus0] 100131 D - 0xfffffe010a1a2548 [usbus0] 100132 D - 0xfffffe010a1a25a0 [usbus0] 100134 D - 0xfffffe00e4d6bcf0 [usbus1] 100135 D - 0xfffffe00e4d6bd48 [usbus1] 100136 D - 0xfffffe00e4d6bda0 [usbus1] 100137 D - 0xfffffe00e4d6bdf8 [usbus1] 100138 D - 0xfffffe00e4d6be50 [usbus1] 100139 D - 0xfffffe010a562cf0 [usbus2] 100140 D - 0xfffffe010a562d48 [usbus2] 100141 D - 0xfffffe010a562da0 [usbus2] 100142 D - 0xfffffe010a562df8 [usbus2] 100143 D - 0xfffffe010a562e50 [usbus2] 5 0 0 0 DL - 0xffffffff81fcaf78 [busdma] 4 0 0 0 DL (threaded) [cam] 100120 D - 0xffffffff81bc9d40 [doneq0] 100121 D - 0xffffffff81bc9dc0 [doneq1] 100122 D - 0xffffffff81bc9e40 [doneq2] 100123 D - 0xffffffff81bc9cc0 [async] 100152 D - 0xffffffff81bc9b90 [scanner] 14 0 0 0 DL seqstat 0xfffff80003ba6488 [sequencer 00] 3 0 0 0 DL (threaded) [crypto] 100106 D crypto_ 0xffffffff81fb3e30 [crypto] 100107 D crypto_ 0xfffff8000444bc30 [crypto returns 0] 100108 D crypto_ 0xfffff8000444bc80 [crypto returns 1] 100109 D crypto_ 0xfffff8000444bcd0 [crypto returns 2] 100110 D crypto_ 0xfffff8000444bd20 [crypto returns 3] 100111 D crypto_ 0xfffff8000444bd70 [crypto returns 4] 100112 D crypto_ 0xfffff8000444bdc0 [crypto returns 5] 100113 D crypto_ 0xfffff8000444be10 [crypto returns 6] 100114 D crypto_ 0xfffff8000444be60 [crypto returns 7] 100115 D crypto_ 0xfffff8000444beb0 [crypto returns 8] 100116 D crypto_ 0xfffff8000444bf00 [crypto returns 9] 100117 D crypto_ 0xfffff8000444bf50 [crypto returns 10] 100118 D crypto_ 0xfffff8000444bfa0 [crypto returns 11] 13 0 0 0 DL (threaded) [geom] 100091 D - 0xffffffff81e8bed0 [g_event] 100092 D - 0xffffffff81e8bed8 [g_up] 100093 D - 0xffffffff81e8bee0 [g_down] 2 0 0 0 WL (threaded) [clock] 100077 I [clock (0)] 100078 I [clock (1)] 100079 I [clock (2)] 100080 I [clock (3)] 100081 I [clock (4)] 100082 I [clock (5)] 100083 I [clock (6)] 100084 I [clock (7)] 100085 I [clock (8)] 100086 I [clock (9)] 100087 I [clock (10)] 100088 I [clock (11)] 12 0 0 0 WL (threaded) [intr] 100041 I [swi6: task queue] 100045 I [swi6: Giant taskq] 100047 I [swi5: fast taskq] 100089 I [swi1: netisr 0] 100124 I [swi4: apei] 100125 I [irq56: ahci0] 100127 I [irq19: xhci0] 100133 I [irq18: ehci0 ehci1+] 100144 I [irq71: ahci1] 100145 I [swi0: uart uart] 100159 I [irq73: mlx5_core0] 100160 I [irq74: mlx5_core0] 100161 I [irq72: mlx5_core0] 100162 I [irq75: mlx5_core0] 100163 I [irq76: mlx5_core0] 100164 I [irq77: mlx5_core0] 100165 I [irq78: mlx5_core0] 100166 I [irq79: mlx5_core0] 100167 I [irq80: mlx5_core0] 100168 I [irq81: mlx5_core0] 100169 I [irq82: mlx5_core0] 100170 I [irq83: mlx5_core0] 100171 I [irq84: mlx5_core0] 100172 I [irq85: mlx5_core0] 100173 I [irq86: mlx5_core0] 100179 I [irq88: mlx5_core1] 100180 I [irq89: mlx5_core1] 100181 I [irq87: mlx5_core1] 100182 I [irq90: mlx5_core1] 100183 I [irq91: mlx5_core1] 100184 I [irq92: mlx5_core1] 100185 I [irq93: mlx5_core1] 100186 I [irq94: mlx5_core1] 100187 I [irq95: mlx5_core1] 100188 I [irq96: mlx5_core1] 100189 I [irq97: mlx5_core1] 100190 I [irq98: mlx5_core1] 100191 I [irq99: mlx5_core1] 100192 I [irq100: mlx5_core1] 100193 I [irq101: mlx5_core1] 100252 I [irq102: ioat0] 100253 I [irq103: ioat1] 100254 I [irq104: ioat2] 100255 I [irq105: ioat3] 100256 I [irq106: ioat4] 100257 I [irq107: ioat5] 100258 I [irq108: ioat6] 100259 I [irq109: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffffe00e4c51010 [init] 10 0 0 0 DL audit_w 0xffffffff81fb43d8 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81e8c450 [swapper] 100015 D - 0xfffff80003bf2100 [if_config_tqg_0] 100016 D - 0xfffff80003bf2000 [softirq_0] 100017 D - 0xfffff80003bf3e00 [softirq_1] 100018 D - 0xfffff80003bf3d00 [softirq_2] 100019 D - 0xfffff80003bf3c00 [softirq_3] 100020 D - 0xfffff80003bf3b00 [softirq_4] 100021 D - 0xfffff80003bf3a00 [softirq_5] 100022 D - 0xfffff80003bf3900 [softirq_6] 100023 D - 0xfffff80003bf3800 [softirq_7] 100024 D - 0xfffff80003bf3700 [softirq_8] 100025 D - 0xfffff80003bf3600 [softirq_9] 100026 D - 0xfffff80003bf3500 [softirq_10] 100027 D - 0xfffff80003bf3400 [softirq_11] 100028 D - 0xfffff80003bf3300 [if_io_tqg_0] 100029 D - 0xfffff80003bf3200 [if_io_tqg_1] 100030 D - 0xfffff80003bf3100 [if_io_tqg_2] 100031 D - 0xfffff80003bf3000 [if_io_tqg_3] 100032 D - 0xfffff80003bf4e00 [if_io_tqg_4] 100033 D - 0xfffff80003bf4d00 [if_io_tqg_5] 100034 D - 0xfffff80003bf4c00 [if_io_tqg_6] 100035 D - 0xfffff80003bf4b00 [if_io_tqg_7] 100036 D - 0xfffff80003bf4a00 [if_io_tqg_8] 100037 D - 0xfffff80003bf4900 [if_io_tqg_9] 100038 D - 0xfffff80003bf4800 [if_io_tqg_10] 100039 D - 0xfffff80003bf4700 [if_io_tqg_11] 100040 D - 0xfffff80003a12e00 [kqueue_ctx taskq] 100042 D - 0xfffff80003a12c00 [inm_free taskq] 100043 D - 0xfffff80003a12b00 [aiod_kick taskq] 100044 D suspwt 0xfffffe010e38f09c [deferred_unmount ta] 100046 D - 0xfffff80003a12800 [thread taskq] 100048 D - 0xfffff80003a12600 [pci_hp taskq] 100049 D - 0xfffff80003a12500 [in6m_free taskq] 100050 D - 0xfffff80003a12400 [linuxkpi_irq_wq] 100051 D - 0xfffff80003a12300 [linuxkpi_short_wq_0] 100052 D - 0xfffff80003a12300 [linuxkpi_short_wq_1] 100053 D - 0xfffff80003a12300 [linuxkpi_short_wq_2] 100054 D - 0xfffff80003a12300 [linuxkpi_short_wq_3] 100055 D - 0xfffff80003a12300 [linuxkpi_short_wq_4] 100056 D - 0xfffff80003a12300 [linuxkpi_short_wq_5] 100057 D - 0xfffff80003a12300 [linuxkpi_short_wq_6] 100058 D - 0xfffff80003a12300 [linuxkpi_short_wq_7] 100059 D - 0xfffff80003a12300 [linuxkpi_short_wq_8] 100060 D - 0xfffff80003a12300 [linuxkpi_short_wq_9] 100061 D - 0xfffff80003a12300 [linuxkpi_short_wq_1] 100062 D - 0xfffff80003a12300 [linuxkpi_short_wq_1] 100063 D - 0xfffff80003a12300 [linuxkpi_short_wq_1] 100064 D - 0xfffff80003a12200 [linuxkpi_long_wq_0] 100065 D - 0xfffff80003a12200 [linuxkpi_long_wq_1] 100066 D - 0xfffff80003a12200 [linuxkpi_long_wq_2] 100067 D - 0xfffff80003a12200 [linuxkpi_long_wq_3] 100068 D - 0xfffff80003a12200 [linuxkpi_long_wq_4] 100069 D - 0xfffff80003a12200 [linuxkpi_long_wq_5] 100070 D - 0xfffff80003a12200 [linuxkpi_long_wq_6] 100071 D - 0xfffff80003a12200 [linuxkpi_long_wq_7] 100072 D - 0xfffff80003a12200 [linuxkpi_long_wq_8] 100073 D - 0xfffff80003a12200 [linuxkpi_long_wq_9] 100074 D - 0xfffff80003a12200 [linuxkpi_long_wq_10] 100075 D - 0xfffff80003a12200 [linuxkpi_long_wq_11] 100076 D - 0xfffff80003a12200 [linuxkpi_long_wq_12] 100090 D - 0xfffff80003a12100 [firmware taskq] 100094 D - 0xfffff80003a11600 [crypto_0] 100095 D - 0xfffff80003a11600 [crypto_1] 100096 D - 0xfffff80003a11600 [crypto_2] 100097 D - 0xfffff80003a11600 [crypto_3] 100098 D - 0xfffff80003a11600 [crypto_4] 100099 D - 0xfffff80003a11600 [crypto_5] 100100 D - 0xfffff80003a11600 [crypto_6] 100101 D - 0xfffff80003a11600 [crypto_7] 100102 D - 0xfffff80003a11600 [crypto_8] 100103 D - 0xfffff80003a11600 [crypto_9] 100104 D - 0xfffff80003a11600 [crypto_10] 100105 D - 0xfffff80003a11600 [crypto_11] 100147 D - 0xfffff8002818e900 [acpi_task_0] 100148 D - 0xfffff8002818e900 [acpi_task_1] 100149 D - 0xfffff8002818e900 [acpi_task_2] 100150 D - 0xfffff80003a13100 [mca taskq] 100151 D - 0xfffff80003a10e00 [CAM taskq] 100155 D - 0xfffff8002818fc00 [mlx5_core0-rec] 100156 D - 0xfffff8002818fb00 [mlx5_core0-wdg] 100157 D - 0xfffff8002818fa00 [mlx5_core0-cmd] 100158 D - 0xfffff8002818f900 [mlx5_page_allocator] 100174 D - 0xfffff8002818f800 [mlx5_esw_wq] 100175 D - 0xfffff8002818f700 [mlx5_core1-rec] 100176 D - 0xfffff8002818f600 [mlx5_core1-wdg] 100177 D - 0xfffff8002818f500 [mlx5_core1-cmd] 100178 D - 0xfffff8002818f400 [mlx5_page_allocator] 100194 D - 0xfffff80004025d00 [mlx5_esw_wq] db:0:pho> allt Tracing command kernel pid 0 tid 100000 td 0xffffffff81e8c9c0 sched_switch() at sched_switch+0x582/frame 0xffffffff82569e10 mi_switch() at mi_switch+0x157/frame 0xffffffff82569e30 sleepq_switch() at sleepq_switch+0x107/frame 0xffffffff82569e70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82569eb0 _sleep() at _sleep+0x2d6/frame 0xffffffff82569f40 swapper() at swapper+0x75/frame 0xffffffff82569fa0 mi_startup() at mi_startup+0x30e/frame 0xffffffff82569ff0 btext() at btext+0x23 Tracing command kernel pid 0 tid 100015 td 0xfffffe00e4c57020 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4858de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4858e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4858e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4858ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4858ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4858f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4858f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe00e4c56900 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4853de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4853e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4853e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4853ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4853ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4853f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4853f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffffe00e4cdd720 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4862de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4862e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4862e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4862ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4862ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4862f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4862f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe00e4cdd000 sched_switch() at sched_switch+0x582/frame 0xfffffe00e485dde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e485de00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e485de40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e485dec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e485def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e485df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e485df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe00e4c5e740 sched_switch() at sched_switch+0x582/frame 0xfffffe00e486cde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e486ce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e486ce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e486cec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e486cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e486cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e486cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe00e4c5e020 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4867de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4867e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4867e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4867ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4867ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4867f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4867f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe00e4c5d900 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4876de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4876e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4876e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4876ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4876ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4876f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4876f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe00e4c5d1e0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4871de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4871e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4871e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4871ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4871ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4871f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4871f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe00e4c5cac0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4880de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4880e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4880e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4880ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4880ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4880f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4880f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe00e4c5c3a0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e487bde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e487be00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e487be40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e487bec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e487bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e487bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e487bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe00e4ce1020 sched_switch() at sched_switch+0x582/frame 0xfffffe00e488ade0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e488ae00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e488ae40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e488aec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e488aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe00e4ce0900 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4885de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4885e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4885e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4885ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4885ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4885f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4885f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe00e4ce01e0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4894de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4894e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4894e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4894ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4894ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4894f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4894f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe00e4cdfac0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e488fde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e488fe00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e488fe40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e488fec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e488fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe00e4cdf3a0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e489ede0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e489ee00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e489ee40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e489eec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e489eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e489ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e489ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe00e4cdec80 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4899de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4899e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4899e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4899ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4899ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4899f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4899f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe00e4cde560 sched_switch() at sched_switch+0x582/frame 0xfffffe00e48a8de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48a8e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48a8e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48a8ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48a8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe00e4cdde40 sched_switch() at sched_switch+0x582/frame 0xfffffe00e48a3de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48a3e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48a3e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48a3ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48a3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe00e4ceaac0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e48b2de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48b2e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48b2e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48b2ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48b2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe00e4cea3a0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e48adde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48ade00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48ade40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48adec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48adef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48adf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48adf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe00e4ce9c80 sched_switch() at sched_switch+0x582/frame 0xfffffe00e48bcde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48bce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48bce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48bcec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48bcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48bcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48bcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe00e4ce9560 sched_switch() at sched_switch+0x582/frame 0xfffffe00e48b7de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48b7e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48b7e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48b7ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48b7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe00e4ce8e40 sched_switch() at sched_switch+0x582/frame 0xfffffe00e48c6de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48c6e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48c6e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48c6ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48c6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe00e4ce8720 sched_switch() at sched_switch+0x582/frame 0xfffffe00e48c1de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48c1e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48c1e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48c1ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48c1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe00e4ce8000 sched_switch() at sched_switch+0x582/frame 0xfffffe00e48d0de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48d0e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48d0e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48d0ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48d0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe00e4ce1740 sched_switch() at sched_switch+0x582/frame 0xfffffe00e48cbdd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48cbdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48cbe30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48cbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48cbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48cbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48cbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffffe00e4cede40 sched_switch() at sched_switch+0x582/frame 0xfffffe00e48d5dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48d5df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48d5e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48d5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48d5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffffe00e4ced720 sched_switch() at sched_switch+0x582/frame 0xfffffe00e48e4dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48e4df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48e4e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48e4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48e4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48e4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffffe00e4ced000 sched_switch() at sched_switch+0x582/frame 0xfffffe00e48dfb90 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48dfbb0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48dfbf0 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48dfc80 vfs_write_suspend() at vfs_write_suspend+0x13e/frame 0xfffffe00e48dfcd0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe00e48dfd00 ffs_unmount() at ffs_unmount+0x35c/frame 0xfffffe00e48dfd80 dounmount() at dounmount+0x7ea/frame 0xfffffe00e48dfdf0 vfs_deferred_unmount() at vfs_deferred_unmount+0xf5/frame 0xfffffe00e48dfe40 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe00e48dfec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc2/frame 0xfffffe00e48dfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48dff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48dff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffffe00e4cec020 sched_switch() at sched_switch+0x582/frame 0xfffffe00e48e9dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48e9df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48e9e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48e9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48e9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48e9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100048 td 0xfffffe00e4ceb1e0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e48f3dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48f3df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48f3e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48f3ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48f3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48f3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100049 td 0xfffffe00e4cf6000 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4902dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4902df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4902e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4902ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4902ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4902f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4902f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100050 td 0xfffffe00e4cf1740 sched_switch() at sched_switch+0x582/frame 0xfffffe00e48fdde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48fde00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48fde40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48fdec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e48fdef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48fdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48fdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100051 td 0xfffffe00e4cf1020 sched_switch() at sched_switch+0x582/frame 0xfffffe00e490cdd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e490cdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e490ce30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e490cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e490cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e490cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e490cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100052 td 0xfffffe00e4cf0900 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4907dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4907df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4907e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4907ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4907ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4907f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4907f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffffe00e4cf01e0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4916dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4916df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4916e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4916ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4916ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4916f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4916f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100054 td 0xfffffe00e4cefac0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4911dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4911df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4911e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4911ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4911ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4911f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4911f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100055 td 0xfffffe00e4cef3a0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4920dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4920df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4920e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4920ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4920ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4920f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4920f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffffe00e4ceec80 sched_switch() at sched_switch+0x582/frame 0xfffffe00e491bdd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e491bdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e491be30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e491bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e491bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e491bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e491bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100057 td 0xfffffe00e4cf9900 sched_switch() at sched_switch+0x582/frame 0xfffffe00e492add0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e492adf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e492ae30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e492aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e492aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e492af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffffe00e4cf91e0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4925dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4925df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4925e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4925ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4925ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4925f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4925f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffffe00e4cf8ac0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4934dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4934df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4934e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4934ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4934ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4934f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4934f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffffe00e4cf83a0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e492fdd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e492fdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e492fe30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e492fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e492fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e492ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe00e4cf7c80 sched_switch() at sched_switch+0x582/frame 0xfffffe00e493edd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e493edf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e493ee30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e493eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e493eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e493ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e493ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffffe00e4cf7560 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4939dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4939df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4939e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4939ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4939ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4939f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4939f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffffe00e4cf6e40 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4948dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4948df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4948e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4948ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4948ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4948f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4948f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffffe00e4cf6720 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4943dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4943df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4943e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4943ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4943ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4943f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4943f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffffe00e4cff3a0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4952dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4952df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4952e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4952ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4952ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4952f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4952f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe00e4cfec80 sched_switch() at sched_switch+0x582/frame 0xfffffe00e494ddd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e494ddf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e494de30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e494dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e494def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e494df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e494df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe00e4cfe560 sched_switch() at sched_switch+0x582/frame 0xfffffe00e495cdd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e495cdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e495ce30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e495cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e495cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e495cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e495cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe00e4cfde40 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4957dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4957df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4957e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4957ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4957ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4957f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4957f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe00e4cfd720 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4966dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4966df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4966e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4966ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4966ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4966f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4966f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe00e4cfd000 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4961dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4961df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4961e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4961ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4961ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4961f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4961f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe00e4cfa740 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4970dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4970df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4970e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4970ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4970ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4970f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4970f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe00e4cfa020 sched_switch() at sched_switch+0x582/frame 0xfffffe00e496bdd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e496bdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e496be30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e496bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e496bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e496bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e496bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe00e4d02e40 sched_switch() at sched_switch+0x582/frame 0xfffffe00e497add0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e497adf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e497ae30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e497aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e497aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe00e4d02720 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4975dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4975df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4975e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4975ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4975ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4975f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4975f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe00e4d02000 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4984dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4984df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4984e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4984ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4984ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4984f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4984f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe00e4d01740 sched_switch() at sched_switch+0x582/frame 0xfffffe00e497fdd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e497fdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e497fe30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e497fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e497fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100090 td 0xfffffe00e4d0eac0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e49f5dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49f5df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e49f5e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e49f5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e49f5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100094 td 0xfffffe00e4d0ce40 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e39dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e39df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e39e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e39ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e39ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e39f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100095 td 0xfffffe00e4d0c720 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e48dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e48df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e48e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e48ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e48ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e48f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffffe00e4d0c000 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e43dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e43df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e43e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e43ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e43ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e43f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100097 td 0xfffffe00e4d27c80 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e52dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e52df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e52e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e52ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e52ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e52f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e52f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffffe00e4d27560 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e4ddd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e4ddf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e4de30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e4dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e4def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e4df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e4df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100099 td 0xfffffe00e4d26e40 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e5cdd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e5cdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e5ce30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e5cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e5cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e5cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffffe00e4d26720 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e57dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e57df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e57e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e57ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e57ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e57f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100101 td 0xfffffe00e4d26000 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e66dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e66df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e66e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e66ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e66ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e66f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffffe00e4d10740 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e61dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e61df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e61e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e61ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e61ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e61f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100103 td 0xfffffe00e4d10020 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e70dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e70df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e70e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e70ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e70ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e70f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e70f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffffe00e4d0f900 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e6bdd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e6bdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e6be30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e6bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e6bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e6bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e6bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100105 td 0xfffffe00e4d2b720 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e7add0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e7adf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e7ae30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e7aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e7aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100147 td 0xfffffe010dc29c80 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4ffade0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ffae00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ffae40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4ffaec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4ffaef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ffaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ffaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100148 td 0xfffffe010dc29560 sched_switch() at sched_switch+0x582/frame 0xfffffe010da45de0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da45e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da45e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da45ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da45ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da45f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da45f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100149 td 0xfffffe010dc28e40 sched_switch() at sched_switch+0x582/frame 0xfffffe010da40de0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da40e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da40e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da40ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da40ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da40f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da40f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100150 td 0xfffffe010dc28720 sched_switch() at sched_switch+0x582/frame 0xfffffe010da4fde0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da4fe00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da4fe40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da4fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da4fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da4ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da4ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100151 td 0xfffffe010dc28000 sched_switch() at sched_switch+0x582/frame 0xfffffe010da4add0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da4adf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da4ae30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da4aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da4aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da4af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da4af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100155 td 0xfffffe010a1a8020 sched_switch() at sched_switch+0x582/frame 0xfffffe010da54dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da54df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da54e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da54ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da54ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da54f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da54f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100156 td 0xfffffe010e115740 sched_switch() at sched_switch+0x582/frame 0xfffffe010da6ddd0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da6ddf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da6de30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da6dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da6def0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da6df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da6df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100157 td 0xfffffe010e115020 sched_switch() at sched_switch+0x582/frame 0xfffffe010da68dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da68df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da68e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da68ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da68ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da68f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da68f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100158 td 0xfffffe010e114900 sched_switch() at sched_switch+0x582/frame 0xfffffe010da77dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da77df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da77e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da77ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da77ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da77f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da77f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100174 td 0xfffffe010e0ade40 sched_switch() at sched_switch+0x582/frame 0xfffffe010dac7dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dac7df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dac7e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010dac7ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dac7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dac7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100175 td 0xfffffe010e0ad720 sched_switch() at sched_switch+0x582/frame 0xfffffe010dac2dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dac2df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dac2e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010dac2ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dac2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dac2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100176 td 0xfffffe010e0ad000 sched_switch() at sched_switch+0x582/frame 0xfffffe010dad1dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dad1df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dad1e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010dad1ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dad1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dad1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dad1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100177 td 0xfffffe010dfa6740 sched_switch() at sched_switch+0x582/frame 0xfffffe010daccdd0 mi_switch() at mi_switch+0x157/frame 0xfffffe010daccdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dacce30 _sleep() at _sleep+0x2ef/frame 0xfffffe010daccec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010daccef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010daccf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010daccf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100178 td 0xfffffe010dfa6020 sched_switch() at sched_switch+0x582/frame 0xfffffe010dadbdd0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dadbdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dadbe30 _sleep() at _sleep+0x2ef/frame 0xfffffe010dadbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dadbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dadbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dadbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100194 td 0xfffffe010e1ab560 sched_switch() at sched_switch+0x582/frame 0xfffffe010db2bdd0 mi_switch() at mi_switch+0x157/frame 0xfffffe010db2bdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db2be30 _sleep() at _sleep+0x2ef/frame 0xfffffe010db2bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010db2bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db2bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db2bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe00e4c55ac0 sched_switch() at sched_switch+0x582/frame 0xfffffe00377e1a20 mi_switch() at mi_switch+0x157/frame 0xfffffe00377e1a40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00377e1a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00377e1ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00377e1ae0 _sleep() at _sleep+0x2e5/frame 0xfffffe00377e1b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe00377e1c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00377e1e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe00377e1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00377e1f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x28e87a, rsp = 0x820d21eb8, rbp = 0x820d21f20 --- Tracing command clock pid 2 tid 100077 td 0xfffffe00e4d01020 sched_switch() at sched_switch+0x582/frame 0xfffffe00e49beea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49beec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49beef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49bef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49bef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100078 td 0xfffffe00e4d00900 sched_switch() at sched_switch+0x582/frame 0xfffffe00e49b9ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49b9ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49b9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49b9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49b9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100079 td 0xfffffe00e4d001e0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e49c8ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49c8ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49c8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100080 td 0xfffffe00e4cffac0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e49c3ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49c3ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49c3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100081 td 0xfffffe00e4d06740 sched_switch() at sched_switch+0x582/frame 0xfffffe00e49d2ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49d2ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49d2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49d2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49d2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100082 td 0xfffffe00e4d06020 sched_switch() at sched_switch+0x582/frame 0xfffffe00e49cdea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49cdec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49cdef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49cdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49cdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100083 td 0xfffffe00e4d05900 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100084 td 0xfffffe00e4d051e0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100085 td 0xfffffe00e4d04ac0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100086 td 0xfffffe00e4d043a0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100087 td 0xfffffe00e4d03c80 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100088 td 0xfffffe00e4d03560 fork_trampoline() at fork_trampoline Tracing command crypto pid 3 tid 100106 td 0xfffffe00e4d2b000 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e75dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e75de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e75e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e75eb0 crypto_dispatch_thread() at crypto_dispatch_thread+0xbf/frame 0xfffffe00e4e75ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e75f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e75f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100107 td 0xfffffe00e4d2a740 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e84dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e84de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e84e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e84eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e84ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e84f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e84f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100108 td 0xfffffe00e4d2a020 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e7fdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e7fde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e7fe20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e7feb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e7fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100109 td 0xfffffe00e4d29900 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e8edc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e8ede0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e8ee20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e8eeb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e8eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e8ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e8ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100110 td 0xfffffe00e4d291e0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e89dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e89de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e89e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e89eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e89ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e89f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e89f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100111 td 0xfffffe00e4d28ac0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e98dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e98de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e98e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e98eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e98ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e98f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e98f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100112 td 0xfffffe00e4d283a0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e93dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e93de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e93e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e93eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e93ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e93f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e93f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100113 td 0xfffffe00e4d2f020 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4ea2dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ea2de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ea2e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ea2eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ea2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100114 td 0xfffffe00e4d2e900 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e9ddc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e9dde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e9de20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e9deb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e9def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e9df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e9df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100115 td 0xfffffe00e4d2e1e0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4eacdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eacde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eace20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4eaceb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eacef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eacf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eacf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100116 td 0xfffffe00e4d2dac0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4ea7dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ea7de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ea7e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ea7eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ea7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100117 td 0xfffffe00e4d2d3a0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4eb6dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eb6de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eb6e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4eb6eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eb6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100118 td 0xfffffe00e4d2cc80 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4eb1dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eb1de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eb1e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4eb1eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eb1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100120 td 0xfffffe00e4d2be40 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4ebbdb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ebbdd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ebbe10 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ebbea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ebbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ebbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ebbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100121 td 0xfffffe00e4d42ac0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4ecadb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ecadd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ecae10 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ecaea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ecaef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ecaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100122 td 0xfffffe00e4d423a0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4ec5db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ec5dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ec5e10 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ec5ea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ec5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100123 td 0xfffffe00e4d41c80 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4ed4db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ed4dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ed4e10 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ed4ea0 xpt_async_td() at xpt_async_td+0x74/frame 0xfffffe00e4ed4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100152 td 0xfffffe010a1a8740 sched_switch() at sched_switch+0x582/frame 0xfffffe010da59dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da59df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da59e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da59ec0 xpt_scanner_thread() at xpt_scanner_thread+0x154/frame 0xfffffe010da59ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da59f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da59f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command busdma pid 5 tid 100126 td 0xfffffe00e4d7d720 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4ee8dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ee8df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ee8e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ee8ec0 busdma_thread() at busdma_thread+0xb5/frame 0xfffffe00e4ee8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ee8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 6 tid 100146 td 0xfffffe010dc2a3a0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4fffd30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4fffd50 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4fffd90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4fffdd0 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4fffe60 random_kthread() at random_kthread+0xa7/frame 0xfffffe00e4fffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ffff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ffff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 7 tid 100153 td 0xfffffe00e4d7ec80 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4f1fd90 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f1fdb0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f1fdf0 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4f1fe80 enc_daemon() at enc_daemon+0xde/frame 0xfffffe00e4f1fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f1ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f1ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 8 tid 100154 td 0xfffffe010e111e40 sched_switch() at sched_switch+0x582/frame 0xfffffe010da63d90 mi_switch() at mi_switch+0x157/frame 0xfffffe010da63db0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da63df0 _sleep() at _sleep+0x2ef/frame 0xfffffe010da63e80 enc_daemon() at enc_daemon+0xde/frame 0xfffffe010da63ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da63f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da63f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100195 td 0xfffffe010e1aae40 sched_switch() at sched_switch+0x582/frame 0xfffffe010db26ac0 mi_switch() at mi_switch+0x157/frame 0xfffffe010db26ae0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db26b20 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db26b60 _sleep() at _sleep+0x2d6/frame 0xfffffe010db26bf0 vm_pageout_worker() at vm_pageout_worker+0x28c/frame 0xfffffe010db26eb0 vm_pageout() at vm_pageout+0x1d7/frame 0xfffffe010db26ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db26f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db26f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100205 td 0xfffffe010a1a4720 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4f5fb80 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f5fba0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f5fbe0 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4f5fc70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xb43/frame 0xfffffe00e4f5fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f5ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f5ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100206 td 0xfffffe010e3eb000 sched_switch() at sched_switch+0x582/frame 0xfffffe0113d67d90 mi_switch() at mi_switch+0x157/frame 0xfffffe0113d67db0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0113d67df0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0113d67e30 _sleep() at _sleep+0x2d6/frame 0xfffffe0113d67ec0 uma_reclaim_worker() at uma_reclaim_worker+0xc8/frame 0xfffffe0113d67ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0113d67f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0113d67f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe00e4c561e0 sched_switch() at sched_switch+0x582/frame 0xfffffe00377e6dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00377e6df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00377e6e30 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00377e6e90 audit_worker() at audit_worker+0x9f/frame 0xfffffe00377e6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe00e4c553a0 (CPU 0) kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00377f0be0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00377f0bf0 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00377f0c20 uart_intr() at uart_intr+0x128/frame 0xfffffe00377f0c60 intr_event_handle() at intr_event_handle+0x12d/frame 0xfffffe00377f0cd0 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00377f0d00 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00377f0d00 --- interrupt, rip = 0xffffffff810965a6, rsp = 0xfffffe00377f0dd0, rbp = 0xfffffe00377f0dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377f0dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377f0e10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00377f0e30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00377f0e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe00e4c54c80 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e00 trap() at trap+0x57/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00377ebdd0, rbp = 0xfffffe00377ebdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377ebdd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377ebe10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00377ebe30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00377ebe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377ebef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ebf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe00e4c54560 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce2ddf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce2de00 trap() at trap+0x57/frame 0xfffffe003ce2df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce2df20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00377fadd0, rbp = 0xfffffe00377fadd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377fadd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377fae10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00377fae30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00377fae50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377faef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe00e4c53e40 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3adf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ae00 trap() at trap+0x57/frame 0xfffffe003ce3af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3af20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00377f5dd0, rbp = 0xfffffe00377f5dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377f5dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377f5e10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00377f5e30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00377f5e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377f5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00e4c53720 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce47df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce47e00 trap() at trap+0x57/frame 0xfffffe003ce47f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce47f20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00e4830dd0, rbp = 0xfffffe00e4830dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4830dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4830e10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00e4830e30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00e4830e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4830ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4830f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4830f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe00e4c53000 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce54df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce54e00 trap() at trap+0x57/frame 0xfffffe003ce54f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce54f20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00377ffdd0, rbp = 0xfffffe00377ffdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377ffdd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00377ffe10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00377ffe30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00377ffe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe00e4c5bc80 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce61df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce61e00 trap() at trap+0x57/frame 0xfffffe003ce61f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce61f20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00e483add0, rbp = 0xfffffe00e483add0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e483add0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e483ae10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00e483ae30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00e483ae50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e483aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe00e4c5b560 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6edf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6ee00 trap() at trap+0x57/frame 0xfffffe003ce6ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6ef20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00e4835dd0, rbp = 0xfffffe00e4835dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4835dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4835e10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00e4835e30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00e4835e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4835ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4835f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4835f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe00e4c5ae40 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7be00 trap() at trap+0x57/frame 0xfffffe003ce7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7bf20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00e4844dd0, rbp = 0xfffffe00e4844dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4844dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4844e10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00e4844e30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00e4844e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4844ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4844f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4844f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe00e4c5a720 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce88df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce88e00 trap() at trap+0x57/frame 0xfffffe003ce88f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce88f20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00e483fdd0, rbp = 0xfffffe00e483fdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e483fdd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e483fe10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00e483fe30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00e483fe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e483fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00e4c5a000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce95df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce95e00 trap() at trap+0x57/frame 0xfffffe003ce95f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce95f20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00e484edd0, rbp = 0xfffffe00e484edd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e484edd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e484ee10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00e484ee30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00e484ee50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e484eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e484ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e484ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00e4c57740 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea2df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea2e00 trap() at trap+0x57/frame 0xfffffe003cea2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea2f20 --- trap 0x13, rip = 0xffffffff810965a6, rsp = 0xfffffe00e4849dd0, rbp = 0xfffffe00e4849dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4849dd0 acpi_cpu_idle() at acpi_cpu_idle+0x278/frame 0xfffffe00e4849e10 cpu_idle_acpi() at cpu_idle_acpi+0x4d/frame 0xfffffe00e4849e30 cpu_idle() at cpu_idle+0xac/frame 0xfffffe00e4849e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4849ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4849f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4849f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100041 td 0xfffffe00e4cee560 sched_switch() at sched_switch+0x582/frame 0xfffffe00e48dae40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48dae60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e48daef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48daf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48daf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100045 td 0xfffffe00e4cec740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffffe00e4ceb900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100089 td 0xfffffe00e4d0f1e0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e49fae40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49fae60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49faef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100124 td 0xfffffe00e4d7e560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100125 td 0xfffffe00e4d7de40 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4ed9e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ed9e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ed9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100127 td 0xfffffe00e4d7d000 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4ee3e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ee3e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ee3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ee3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100133 td 0xfffffe00e4d81740 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4f01e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f01e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f01ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f01f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f01f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100144 td 0xfffffe010a1a5560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100145 td 0xfffffe010a1a4e40 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4f64e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f64e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f64ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f64f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f64f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100159 td 0xfffffe010e1141e0 sched_switch() at sched_switch+0x582/frame 0xfffffe010da72e40 mi_switch() at mi_switch+0x157/frame 0xfffffe010da72e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010da72ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da72f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da72f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100160 td 0xfffffe010e113ac0 sched_switch() at sched_switch+0x582/frame 0xfffffe010da81e40 mi_switch() at mi_switch+0x157/frame 0xfffffe010da81e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010da81ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da81f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da81f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100161 td 0xfffffe010e1133a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100162 td 0xfffffe010e112c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100163 td 0xfffffe010e112560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100164 td 0xfffffe010dfa51e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100165 td 0xfffffe010dfa4ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100166 td 0xfffffe010dfa43a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100167 td 0xfffffe010dfa3c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100168 td 0xfffffe010dfa3560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100169 td 0xfffffe010dfa2e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100170 td 0xfffffe010dfa2720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100171 td 0xfffffe010dfa2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100172 td 0xfffffe010e0aec80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100173 td 0xfffffe010e0ae560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe010dfa5900 sched_switch() at sched_switch+0x582/frame 0xfffffe010dad6e40 mi_switch() at mi_switch+0x157/frame 0xfffffe010dad6e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010dad6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dad6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dad6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100180 td 0xfffffe010e1aa720 sched_switch() at sched_switch+0x582/frame 0xfffffe010dae5e40 mi_switch() at mi_switch+0x157/frame 0xfffffe010dae5e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010dae5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dae5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dae5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100181 td 0xfffffe010e1aa000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffffe010e0b1740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffffe010e0b1020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffffe010e0b0900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffffe010e0b01e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffffe010e0afac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffffe010e0af3a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffffe010e1ae020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffffe010e1ad900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffffe010e1ad1e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100191 td 0xfffffe010e1acac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100192 td 0xfffffe010e1ac3a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100193 td 0xfffffe010e1abc80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100252 td 0xfffffe01436f31e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100253 td 0xfffffe01436f2ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100254 td 0xfffffe01436f23a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100255 td 0xfffffe01436f1c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100256 td 0xfffffe01436f1560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100257 td 0xfffffe01436f0e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100258 td 0xfffffe0143f34ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100259 td 0xfffffe0143f343a0 fork_trampoline() at fork_trampoline Tracing command geom pid 13 tid 100091 td 0xfffffe00e4d0e3a0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e34dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e34df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e34e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e34ec0 g_run_events() at g_run_events+0x444/frame 0xfffffe00e4e34ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e34f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e34f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100092 td 0xfffffe00e4d0dc80 sched_switch() at sched_switch+0x582/frame 0xfffffe00e49ffdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49ffde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e49ffe20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e49ffeb0 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe00e49ffee0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00e49ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100093 td 0xfffffe00e4d0d560 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4e3edc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e3ede0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e3ee20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e3eeb0 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe00e4e3eee0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe00e4e3eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100119 td 0xfffffe00e4d2c560 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4ec0db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ec0dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ec0e10 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ec0e70 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe00e4ec0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100128 td 0xfffffe00e4d44740 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4ef2e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ef2e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ef2e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ef2ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100129 td 0xfffffe00e4d44020 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4eede00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eede20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eede60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4eedec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eedef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eedf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eedf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100130 td 0xfffffe00e4d43900 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4efce00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4efce20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4efce60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4efcec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4efcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4efcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4efcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100131 td 0xfffffe00e4d431e0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4ef7e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ef7e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ef7e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ef7ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100132 td 0xfffffe010a1a4000 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4f06e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f06e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f06e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f06ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f06ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f06f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f06f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100134 td 0xfffffe00e4d81020 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4f10e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f10e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f10e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f10ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f10ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f10f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f10f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100135 td 0xfffffe00e4d80900 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4f0be00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f0be20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f0be60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f0bec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f0bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f0bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f0bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100136 td 0xfffffe00e4d801e0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4f1ae00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f1ae20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f1ae60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f1aec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f1aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f1af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f1af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100137 td 0xfffffe00e4d7fac0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4f15e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f15e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f15e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f15ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f15ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f15f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f15f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100138 td 0xfffffe00e4d7f3a0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4f24e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f24e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f24e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f24ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f24ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f24f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f24f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100139 td 0xfffffe010a1a7900 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4f46e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f46e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f46e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f46ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f46ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f46f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f46f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100140 td 0xfffffe010a1a71e0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4f41e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f41e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f41e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f41ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f41ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f41f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f41f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100141 td 0xfffffe010a1a6ac0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4f50e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f50e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f50e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f50ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f50ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f50f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f50f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100142 td 0xfffffe010a1a63a0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4f4be00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f4be20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f4be60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f4bec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f4bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f4bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f4bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100143 td 0xfffffe010a1a5c80 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4f5ae00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f5ae20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f5ae60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f5aec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f5aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f5af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f5af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 16 tid 100196 td 0xfffffe010e39cac0 sched_switch() at sched_switch+0x582/frame 0xfffffe010db41d90 mi_switch() at mi_switch+0x157/frame 0xfffffe010db41db0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db41df0 _sleep() at _sleep+0x2ef/frame 0xfffffe010db41e80 vm_daemon() at vm_daemon+0x82/frame 0xfffffe010db41ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db41f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db41f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100197 td 0xfffffe010e39c3a0 sched_switch() at sched_switch+0x582/frame 0xfffffe010db3cd70 mi_switch() at mi_switch+0x157/frame 0xfffffe010db3cd90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db3cdd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db3ce10 _sleep() at _sleep+0x2d6/frame 0xfffffe010db3cea0 buf_daemon() at buf_daemon+0x121/frame 0xfffffe010db3cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db3cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db3cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100198 td 0xfffffe010e3ad560 sched_switch() at sched_switch+0x582/frame 0xfffffe010db4bd50 mi_switch() at mi_switch+0x157/frame 0xfffffe010db4bd70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db4bdb0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db4bdf0 _sleep() at _sleep+0x2d6/frame 0xfffffe010db4be80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010db4bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db4bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db4bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100199 td 0xfffffe010e3ace40 sched_switch() at sched_switch+0x582/frame 0xfffffe010db46d50 mi_switch() at mi_switch+0x157/frame 0xfffffe010db46d70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db46db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db46df0 _sleep() at _sleep+0x2d6/frame 0xfffffe010db46e80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010db46ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db46f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db46f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100200 td 0xfffffe010e3ac720 sched_switch() at sched_switch+0x582/frame 0xfffffe010db50d50 mi_switch() at mi_switch+0x157/frame 0xfffffe010db50d70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db50db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db50df0 _sleep() at _sleep+0x2d6/frame 0xfffffe010db50e80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010db50ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db50f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db50f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100201 td 0xfffffe010e3ac000 sched_switch() at sched_switch+0x582/frame 0xfffffe0110929d50 mi_switch() at mi_switch+0x157/frame 0xfffffe0110929d70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0110929db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0110929df0 _sleep() at _sleep+0x2d6/frame 0xfffffe0110929e80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe0110929ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0110929f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0110929f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command bufdaemon pid 17 tid 100202 td 0xfffffe010e39e740 sched_switch() at sched_switch+0x582/frame 0xfffffe010db5ad50 mi_switch() at mi_switch+0x157/frame 0xfffffe010db5ad70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db5adb0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db5adf0 _sleep() at _sleep+0x2d6/frame 0xfffffe010db5ae80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010db5aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db5af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db5af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100203 td 0xfffffe010e39e020 sched_switch() at sched_switch+0x582/frame 0xfffffe010db55d50 mi_switch() at mi_switch+0x157/frame 0xfffffe010db55d70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db55db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db55df0 _sleep() at _sleep+0x2d6/frame 0xfffffe010db55e80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010db55ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db55f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db55f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100204 td 0xfffffe010e39d900 sched_switch() at sched_switch+0x582/frame 0xfffffe010db5fd50 mi_switch() at mi_switch+0x157/frame 0xfffffe010db5fd70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db5fdb0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db5fdf0 _sleep() at _sleep+0x2d6/frame 0xfffffe010db5fe80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010db5fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db5ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db5ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100218 td 0xfffffe010e3b0020 sched_switch() at sched_switch+0x582/frame 0xfffffe013e9ecd80 mi_switch() at mi_switch+0x157/frame 0xfffffe013e9ecda0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013e9ecde0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe013e9ece20 _sleep() at _sleep+0x2d6/frame 0xfffffe013e9eceb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe013e9ecef0 fork_exit() at fork_exit+0x80/frame 0xfffffe013e9ecf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe013e9ecf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100224 td 0xfffffe01436f0720 sched_switch() at sched_switch+0x582/frame 0xfffffe0113d82d80 mi_switch() at mi_switch+0x157/frame 0xfffffe0113d82da0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0113d82de0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0113d82e20 _sleep() at _sleep+0x2d6/frame 0xfffffe0113d82eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe0113d82ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0113d82f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0113d82f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100817 td 0xfffffe010dc2b900 sched_switch() at sched_switch+0x582/frame 0xfffffe0141992d80 mi_switch() at mi_switch+0x157/frame 0xfffffe0141992da0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141992de0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0141992e20 _sleep() at _sleep+0x2d6/frame 0xfffffe0141992eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe0141992ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0141992f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0141992f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 18 tid 100207 td 0xfffffe010e39bc80 sched_switch() at sched_switch+0x582/frame 0xfffffe013e9b0d40 mi_switch() at mi_switch+0x157/frame 0xfffffe013e9b0d60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013e9b0da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe013e9b0de0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x19a/frame 0xfffffe013e9b0e60 sched_sync() at sched_sync+0x62d/frame 0xfffffe013e9b0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe013e9b0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe013e9b0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 19 tid 100208 td 0xfffffe010e39b560 sched_switch() at sched_switch+0x582/frame 0xfffffe013e9abd20 mi_switch() at mi_switch+0x157/frame 0xfffffe013e9abd40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013e9abd80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe013e9abdc0 _sleep() at _sleep+0x2d6/frame 0xfffffe013e9abe50 vnlru_proc() at vnlru_proc+0x99c/frame 0xfffffe013e9abef0 fork_exit() at fork_exit+0x80/frame 0xfffffe013e9abf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe013e9abf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command mount pid 41215 tid 100240 td 0xfffffe0142ada720 sched_switch() at sched_switch+0x582/frame 0xfffffe0113df38a0 mi_switch() at mi_switch+0x157/frame 0xfffffe0113df38c0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0113df3900 sleeplk() at sleeplk+0x100/frame 0xfffffe0113df3960 lockmgr_slock_hard() at lockmgr_slock_hard+0x3df/frame 0xfffffe0113df3a00 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0113df3a40 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0113df3a60 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0113df3ac0 vget_finish() at vget_finish+0x7a/frame 0xfffffe0113df3af0 cache_lookup() at cache_lookup+0x314/frame 0xfffffe0113df3b50 vfs_cache_lookup() at vfs_cache_lookup+0x7b/frame 0xfffffe0113df3ba0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe0113df3bc0 vfs_lookup() at vfs_lookup+0x4b9/frame 0xfffffe0113df3c60 namei() at namei+0x33d/frame 0xfffffe0113df3ce0 sys___realpathat() at sys___realpathat+0xdb/frame 0xfffffe0113df3e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0113df3f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0113df3f30 --- syscall (574, FreeBSD ELF64, __realpathat), rip = 0x1a1f4393b19a, rsp = 0x1a1f3fc8f368, rbp = 0x1a1f3fc8f390 --- Tracing command dhclient pid 2336 tid 100214 td 0xfffffe013ebfb740 sched_switch() at sched_switch+0x582/frame 0xfffffe013e9d8ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe013e9d8ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013e9d8b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe013e9d8b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe013e9d8b70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe013e9d8bd0 kern_select() at kern_select+0xadd/frame 0xfffffe013e9d8dc0 sys_select() at sys_select+0x56/frame 0xfffffe013e9d8e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe013e9d8f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013e9d8f30 --- syscall (93, FreeBSD ELF64, select), rip = 0x3d8ff7c8a6fa, rsp = 0x3d8ff4a94158, rbp = 0x3d8ff4a94210 --- Tracing command dhclient pid 2339 tid 100223 td 0xfffffe013ebf7720 sched_switch() at sched_switch+0x582/frame 0xfffffe013e9c9ae0 mi_switch() at mi_switch+0x157/frame 0xfffffe013e9c9b00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013e9c9b40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe013e9c9b90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe013e9c9ba0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe013e9c9c00 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe013e9c9c90 kern_poll() at kern_poll+0x9f/frame 0xfffffe013e9c9de0 sys_poll() at sys_poll+0x50/frame 0xfffffe013e9c9e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe013e9c9f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013e9c9f30 --- syscall (209, FreeBSD ELF64, poll), rip = 0x3d8ff7c8a5fa, rsp = 0x3d8ff4a94398, rbp = 0x3d8ff4a943d0 --- Tracing command dhclient pid 2415 tid 100260 td 0xfffffe010e3af900 sched_switch() at sched_switch+0x582/frame 0xfffffe013e9e7a90 mi_switch() at mi_switch+0x157/frame 0xfffffe013e9e7ab0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013e9e7af0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe013e9e7b40 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe013e9e7b80 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe013e9e7c00 kern_poll_kfds() at kern_poll_kfds+0x4a9/frame 0xfffffe013e9e7c90 kern_poll() at kern_poll+0x9f/frame 0xfffffe013e9e7de0 sys_poll() at sys_poll+0x50/frame 0xfffffe013e9e7e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe013e9e7f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013e9e7f30 --- syscall (209, FreeBSD ELF64, poll), rip = 0x3d8ff7c8a5fa, rsp = 0x3d8ff4a94398, rbp = 0x3d8ff4a943d0 --- Tracing command devd pid 2420 tid 100210 td 0xfffffe013ea5c3a0 sched_switch() at sched_switch+0x582/frame 0xfffffe013e9c4a60 mi_switch() at mi_switch+0x157/frame 0xfffffe013e9c4a80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013e9c4ac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe013e9c4b10 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe013e9c4b50 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe013e9c4bd0 kern_select() at kern_select+0xab7/frame 0xfffffe013e9c4dc0 sys_select() at sys_select+0x56/frame 0xfffffe013e9c4e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe013e9c4f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013e9c4f30 --- syscall (93, FreeBSD ELF64, select), rip = 0x2ac35a, rsp = 0x82089d848, rbp = 0x82089f9e0 --- Tracing command syslogd pid 2607 tid 100245 td 0xfffffe013ea5a000 sched_switch() at sched_switch+0x582/frame 0xfffffe010db78ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe010db78ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db78b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db78b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db78b70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010db78bd0 kern_select() at kern_select+0xadd/frame 0xfffffe010db78dc0 sys_select() at sys_select+0x56/frame 0xfffffe010db78e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db78f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db78f30 --- syscall (93, FreeBSD ELF64, select), rip = 0x36686d5406fa, rsp = 0x36686b9682d8, rbp = 0x36686b968860 --- Tracing command watchdogd pid 2615 tid 100231 td 0xfffffe0142adb560 sched_switch() at sched_switch+0x582/frame 0xfffffe013e9fba20 mi_switch() at mi_switch+0x157/frame 0xfffffe013e9fba40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013e9fba80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe013e9fbad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe013e9fbae0 _sleep() at _sleep+0x2e5/frame 0xfffffe013e9fbb70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe013e9fbc00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe013e9fbe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe013e9fbf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013e9fbf30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x33397c7a585a, rsp = 0x33397a02b138, rbp = 0x33397a02b200 --- Tracing command powerd pid 2670 tid 100263 td 0xfffffe010e3ef740 sched_switch() at sched_switch+0x582/frame 0xfffffe014183fa60 mi_switch() at mi_switch+0x157/frame 0xfffffe014183fa80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014183fac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014183fb10 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014183fb50 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe014183fbd0 kern_select() at kern_select+0xab7/frame 0xfffffe014183fdc0 sys_select() at sys_select+0x56/frame 0xfffffe014183fe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014183ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014183ff30 --- syscall (93, FreeBSD ELF64, select), rip = 0x3b66cbe5a6fa, rsp = 0x3b66c9ecd6f8, rbp = 0x3b66c9ecd830 --- Tracing command ntpd pid 2696 tid 100261 td 0xfffffe010e3af1e0 sched_switch() at sched_switch+0x582/frame 0xfffffe010dbfdab0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbfdad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbfdb10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbfdb60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbfdb70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010dbfdbd0 kern_select() at kern_select+0xadd/frame 0xfffffe010dbfddc0 sys_select() at sys_select+0x56/frame 0xfffffe010dbfde00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbfdf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbfdf30 --- syscall (93, FreeBSD ELF64, select), rip = 0xa2ed3bb6fa, rsp = 0xa2e96ea248, rbp = 0xa2e96ea280 --- Tracing command inetd pid 2722 tid 100266 td 0xfffffe0143f32e40 sched_switch() at sched_switch+0x582/frame 0xfffffe0141853ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe0141853ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141853b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141853b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141853b70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141853bd0 kern_select() at kern_select+0xadd/frame 0xfffffe0141853dc0 sys_select() at sys_select+0x56/frame 0xfffffe0141853e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141853f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141853f30 --- syscall (93, FreeBSD ELF64, select), rip = 0x935414086fa, rsp = 0x9353f4ed8f8, rbp = 0x9353f4ee780 --- Tracing command sshd pid 2741 tid 100279 td 0xfffffe0144420000 sched_switch() at sched_switch+0x582/frame 0xfffffe01418a7ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe01418a7ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01418a7b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01418a7b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01418a7b70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01418a7bd0 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe01418a7c60 kern_poll() at kern_poll+0x9f/frame 0xfffffe01418a7db0 sys_ppoll() at sys_ppoll+0x6f/frame 0xfffffe01418a7e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01418a7f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01418a7f30 --- syscall (545, FreeBSD ELF64, ppoll), rip = 0x22cdb68e461a, rsp = 0x22cdace45d08, rbp = 0x22cdace45d40 --- Tracing command cron pid 2745 tid 100246 td 0xfffffe013ebfb020 sched_switch() at sched_switch+0x582/frame 0xfffffe013e9d3bc0 mi_switch() at mi_switch+0x157/frame 0xfffffe013e9d3be0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013e9d3c20 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe013e9d3c70 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe013e9d3cb0 _sleep() at _sleep+0x2c4/frame 0xfffffe013e9d3d40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1c1/frame 0xfffffe013e9d3dc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe013e9d3e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe013e9d3f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013e9d3f30 --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x13ed3baf657a, rsp = 0x13ed37ece368, rbp = 0x13ed37ece550 --- Tracing command getty pid 2759 tid 100209 td 0xfffffe010e3ee900 sched_switch() at sched_switch+0x582/frame 0xfffffe013e9bab00 mi_switch() at mi_switch+0x157/frame 0xfffffe013e9bab20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013e9bab60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe013e9babb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe013e9babc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe013e9bac20 tty_wait() at tty_wait+0x42/frame 0xfffffe013e9bac50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe013e9bacc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe013e9bacf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe013e9bad50 dofileread() at dofileread+0x83/frame 0xfffffe013e9bad90 sys_read() at sys_read+0xc0/frame 0xfffffe013e9bae00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe013e9baf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013e9baf30 --- syscall (3, FreeBSD ELF64, read), rip = 0x6bb0794c67a, rsp = 0x6bb058da878, rbp = 0x6bb058da8c0 --- Tracing command getty pid 2760 tid 100280 td 0xfffffe010e3adc80 sched_switch() at sched_switch+0x582/frame 0xfffffe0141898b00 mi_switch() at mi_switch+0x157/frame 0xfffffe0141898b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141898b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141898bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141898bc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141898c20 tty_wait() at tty_wait+0x42/frame 0xfffffe0141898c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe0141898cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0141898cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0141898d50 dofileread() at dofileread+0x83/frame 0xfffffe0141898d90 sys_read() at sys_read+0xc0/frame 0xfffffe0141898e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141898f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141898f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x246c4373067a, rsp = 0x246c3fe84bc8, rbp = 0x246c3fe84c10 --- Tracing command getty pid 2761 tid 100278 td 0xfffffe010e3ae3a0 sched_switch() at sched_switch+0x582/frame 0xfffffe014189db00 mi_switch() at mi_switch+0x157/frame 0xfffffe014189db20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014189db60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014189dbb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014189dbc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014189dc20 tty_wait() at tty_wait+0x42/frame 0xfffffe014189dc50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe014189dcc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe014189dcf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe014189dd50 dofileread() at dofileread+0x83/frame 0xfffffe014189dd90 sys_read() at sys_read+0xc0/frame 0xfffffe014189de00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014189df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014189df30 --- syscall (3, FreeBSD ELF64, read), rip = 0x33ebbe22567a, rsp = 0x33ebbb33eb28, rbp = 0x33ebbb33eb70 --- Tracing command getty pid 2762 tid 100281 td 0xfffffe0144423900 sched_switch() at sched_switch+0x582/frame 0xfffffe01418b1b00 mi_switch() at mi_switch+0x157/frame 0xfffffe01418b1b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01418b1b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01418b1bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01418b1bc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01418b1c20 tty_wait() at tty_wait+0x42/frame 0xfffffe01418b1c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe01418b1cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01418b1cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01418b1d50 dofileread() at dofileread+0x83/frame 0xfffffe01418b1d90 sys_read() at sys_read+0xc0/frame 0xfffffe01418b1e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01418b1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01418b1f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x33408168767a, rsp = 0x334080d0d998, rbp = 0x334080d0d9e0 --- Tracing command getty pid 2763 tid 100282 td 0xfffffe01444231e0 sched_switch() at sched_switch+0x582/frame 0xfffffe01418acb00 mi_switch() at mi_switch+0x157/frame 0xfffffe01418acb20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01418acb60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01418acbb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01418acbc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01418acc20 tty_wait() at tty_wait+0x42/frame 0xfffffe01418acc50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe01418accc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01418accf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01418acd50 dofileread() at dofileread+0x83/frame 0xfffffe01418acd90 sys_read() at sys_read+0xc0/frame 0xfffffe01418ace00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01418acf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01418acf30 --- syscall (3, FreeBSD ELF64, read), rip = 0x37b6c897267a, rsp = 0x37b6c76ad468, rbp = 0x37b6c76ad4b0 --- Tracing command getty pid 2764 tid 100283 td 0xfffffe0144422ac0 sched_switch() at sched_switch+0x582/frame 0xfffffe01418bbb00 mi_switch() at mi_switch+0x157/frame 0xfffffe01418bbb20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01418bbb60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01418bbbb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01418bbbc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01418bbc20 tty_wait() at tty_wait+0x42/frame 0xfffffe01418bbc50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe01418bbcc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01418bbcf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01418bbd50 dofileread() at dofileread+0x83/frame 0xfffffe01418bbd90 sys_read() at sys_read+0xc0/frame 0xfffffe01418bbe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01418bbf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01418bbf30 --- syscall (3, FreeBSD ELF64, read), rip = 0x23ae7457067a, rsp = 0x23ae71c8ee78, rbp = 0x23ae71c8eec0 --- Tracing command getty pid 2765 tid 100284 td 0xfffffe01444223a0 sched_switch() at sched_switch+0x582/frame 0xfffffe01418b6b00 mi_switch() at mi_switch+0x157/frame 0xfffffe01418b6b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01418b6b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01418b6bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01418b6bc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01418b6c20 tty_wait() at tty_wait+0x42/frame 0xfffffe01418b6c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe01418b6cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01418b6cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01418b6d50 dofileread() at dofileread+0x83/frame 0xfffffe01418b6d90 sys_read() at sys_read+0xc0/frame 0xfffffe01418b6e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01418b6f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01418b6f30 --- syscall (3, FreeBSD ELF64, read), rip = 0xd128852067a, rsp = 0xd12854dae68, rbp = 0xd12854daeb0 --- Tracing command getty pid 2766 tid 100285 td 0xfffffe0144421c80 sched_switch() at sched_switch+0x582/frame 0xfffffe01418c5b00 mi_switch() at mi_switch+0x157/frame 0xfffffe01418c5b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01418c5b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01418c5bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01418c5bc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01418c5c20 tty_wait() at tty_wait+0x42/frame 0xfffffe01418c5c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe01418c5cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01418c5cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01418c5d50 dofileread() at dofileread+0x83/frame 0xfffffe01418c5d90 sys_read() at sys_read+0xc0/frame 0xfffffe01418c5e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01418c5f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01418c5f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x1b681210567a, rsp = 0x1b680ff61018, rbp = 0x1b680ff61060 --- Tracing command getty pid 2767 tid 100286 td 0xfffffe0144421560 sched_switch() at sched_switch+0x582/frame 0xfffffe01418c0b00 mi_switch() at mi_switch+0x157/frame 0xfffffe01418c0b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01418c0b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01418c0bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01418c0bc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01418c0c20 tty_wait() at tty_wait+0x42/frame 0xfffffe01418c0c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe01418c0cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01418c0cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01418c0d50 dofileread() at dofileread+0x83/frame 0xfffffe01418c0d90 sys_read() at sys_read+0xc0/frame 0xfffffe01418c0e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01418c0f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01418c0f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x15d25dba167a, rsp = 0x15d25b7ea558, rbp = 0x15d25b7ea5a0 --- Tracing command login pid 2768 tid 100287 td 0xfffffe0144420e40 sched_switch() at sched_switch+0x582/frame 0xfffffe01418cfa20 mi_switch() at mi_switch+0x157/frame 0xfffffe01418cfa40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01418cfa80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01418cfad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01418cfae0 _sleep() at _sleep+0x2e5/frame 0xfffffe01418cfb70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01418cfc00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01418cfe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01418cff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01418cff30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x96c1dacc85a, rsp = 0x96c1b083da8, rbp = 0x96c1b083f80 --- Tracing command sh pid 19167 tid 100244 td 0xfffffe013ea5a720 sched_switch() at sched_switch+0x582/frame 0xfffffe010db7da20 mi_switch() at mi_switch+0x157/frame 0xfffffe010db7da40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db7da80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db7dad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db7dae0 _sleep() at _sleep+0x2e5/frame 0xfffffe010db7db70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe010db7dc00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe010db7de00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db7df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db7df30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x2db85a23485a, rsp = 0x2db857921348, rbp = 0x2db8579213f0 --- Tracing command tee pid 19168 tid 100585 td 0xfffffe0156017900 sched_switch() at sched_switch+0x582/frame 0xfffffe0156e13b90 mi_switch() at mi_switch+0x157/frame 0xfffffe0156e13bb0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0156e13bf0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0156e13c40 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0156e13c50 _sleep() at _sleep+0x2e5/frame 0xfffffe0156e13ce0 pipe_read() at pipe_read+0x42a/frame 0xfffffe0156e13d50 dofileread() at dofileread+0x83/frame 0xfffffe0156e13d90 sys_read() at sys_read+0xc0/frame 0xfffffe0156e13e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0156e13f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0156e13f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x17202b09f67a, rsp = 0x172029be61e8, rbp = 0x172029be6240 --- Tracing command sh pid 19169 tid 100665 td 0xfffffe0156010560 sched_switch() at sched_switch+0x582/frame 0xfffffe0156f82a20 mi_switch() at mi_switch+0x157/frame 0xfffffe0156f82a40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0156f82a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0156f82ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0156f82ae0 _sleep() at _sleep+0x2e5/frame 0xfffffe0156f82b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe0156f82c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0156f82e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0156f82f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0156f82f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x2bd7cc63485a, rsp = 0x2bd7c9c2f158, rbp = 0x2bd7c9c2f200 --- Tracing command sshd pid 2792 tid 100274 td 0xfffffe014413fe40 sched_switch() at sched_switch+0x582/frame 0xfffffe0141884ae0 mi_switch() at mi_switch+0x157/frame 0xfffffe0141884b00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141884b40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141884b90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141884ba0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141884c00 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe0141884c90 kern_poll() at kern_poll+0x9f/frame 0xfffffe0141884de0 sys_poll() at sys_poll+0x50/frame 0xfffffe0141884e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141884f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141884f30 --- syscall (209, FreeBSD ELF64, poll), rip = 0x7d87c2125fa, rsp = 0x7d87543f538, rbp = 0x7d87543f570 --- Tracing command sshd pid 2795 tid 100237 td 0xfffffe010e3ee1e0 sched_switch() at sched_switch+0x582/frame 0xfffffe013e9b5ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe013e9b5ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013e9b5b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe013e9b5b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe013e9b5b70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe013e9b5bd0 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe013e9b5c60 kern_poll() at kern_poll+0x9f/frame 0xfffffe013e9b5db0 sys_ppoll() at sys_ppoll+0x6f/frame 0xfffffe013e9b5e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe013e9b5f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013e9b5f30 --- syscall (545, FreeBSD ELF64, ppoll), rip = 0x7d87c21261a, rsp = 0x7d87543f2e8, rbp = 0x7d87543f320 --- Tracing command bash pid 2796 tid 100289 td 0xfffffe0144420720 --- swapped out Tracing command su pid 2801 tid 100273 td 0xfffffe0144140560 --- swapped out Tracing command csh pid 2802 tid 100216 td 0xfffffe010e111720 --- swapped out Tracing command bash pid 2804 tid 100215 td 0xfffffe0141a1b1e0 --- swapped out Tracing command mkdir pid 19219 tid 100268 td 0xfffffe010e3ed3a0 sched_switch() at sched_switch+0x582/frame 0xfffffe0113de98f0 mi_switch() at mi_switch+0x157/frame 0xfffffe0113de9910 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0113de9950 _sleep() at _sleep+0x2ef/frame 0xfffffe0113de99e0 vfs_busy() at vfs_busy+0x331/frame 0xfffffe0113de9a20 ufs_sync_nlink() at ufs_sync_nlink+0x99/frame 0xfffffe0113de9a60 ufs_mkdir() at ufs_mkdir+0x40/frame 0xfffffe0113de9be0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0113de9c00 kern_mkdirat() at kern_mkdirat+0x20d/frame 0xfffffe0113de9e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0113de9f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0113de9f30 --- syscall (136, FreeBSD ELF64, mkdir), rip = 0x4a9fbebfd7a, rsp = 0x4a9f8aa9f18, rbp = 0x4a9f8aaa350 --- Tracing command mkdir pid 19221 tid 100562 td 0xfffffe014f22ee40 sched_switch() at sched_switch+0x582/frame 0xfffffe01419b08f0 mi_switch() at mi_switch+0x157/frame 0xfffffe01419b0910 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01419b0950 _sleep() at _sleep+0x2ef/frame 0xfffffe01419b09e0 vfs_busy() at vfs_busy+0x331/frame 0xfffffe01419b0a20 ufs_sync_nlink() at ufs_sync_nlink+0x99/frame 0xfffffe01419b0a60 ufs_mkdir() at ufs_mkdir+0x40/frame 0xfffffe01419b0be0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01419b0c00 kern_mkdirat() at kern_mkdirat+0x20d/frame 0xfffffe01419b0e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01419b0f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01419b0f30 --- syscall (136, FreeBSD ELF64, mkdir), rip = 0x4a9fbebfd7a, rsp = 0x4a9f8aa9f18, rbp = 0x4a9f8aaa350 --- Tracing command mkdir pid 19228 tid 100636 td 0xfffffe0156dca900 sched_switch() at sched_switch+0x582/frame 0xfffffe0156f0d8f0 mi_switch() at mi_switch+0x157/frame 0xfffffe0156f0d910 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0156f0d950 _sleep() at _sleep+0x2ef/frame 0xfffffe0156f0d9e0 vfs_busy() at vfs_busy+0x331/frame 0xfffffe0156f0da20 ufs_sync_nlink() at ufs_sync_nlink+0x99/frame 0xfffffe0156f0da60 ufs_mkdir() at ufs_mkdir+0x40/frame 0xfffffe0156f0dbe0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0156f0dc00 kern_mkdirat() at kern_mkdirat+0x20d/frame 0xfffffe0156f0de00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0156f0df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0156f0df30 --- syscall (136, FreeBSD ELF64, mkdir), rip = 0x4a9fbebfd7a, rsp = 0x4a9f8aa9f18, rbp = 0x4a9f8aaa350 --- Tracing command mkdir pid 19239 tid 100681 td 0xfffffe0155fc4720 sched_switch() at sched_switch+0x582/frame 0xfffffe0156f6e8f0 mi_switch() at mi_switch+0x157/frame 0xfffffe0156f6e910 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0156f6e950 _sleep() at _sleep+0x2ef/frame 0xfffffe0156f6e9e0 vfs_busy() at vfs_busy+0x331/frame 0xfffffe0156f6ea20 ufs_sync_nlink() at ufs_sync_nlink+0x99/frame 0xfffffe0156f6ea60 ufs_mkdir() at ufs_mkdir+0x40/frame 0xfffffe0156f6ebe0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0156f6ec00 kern_mkdirat() at kern_mkdirat+0x20d/frame 0xfffffe0156f6ee00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0156f6ef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0156f6ef30 --- syscall (136, FreeBSD ELF64, mkdir), rip = 0x4a9fbebfd7a, rsp = 0x4a9f8aa9f18, rbp = 0x4a9f8aaa350 --- Tracing command mkdir pid 19241 tid 100675 td 0xfffffe0155f7c900 sched_switch() at sched_switch+0x582/frame 0xfffffe01419568f0 mi_switch() at mi_switch+0x157/frame 0xfffffe0141956910 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141956950 _sleep() at _sleep+0x2ef/frame 0xfffffe01419569e0 vfs_busy() at vfs_busy+0x331/frame 0xfffffe0141956a20 ufs_sync_nlink() at ufs_sync_nlink+0x99/frame 0xfffffe0141956a60 ufs_mkdir() at ufs_mkdir+0x40/frame 0xfffffe0141956be0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0141956c00 kern_mkdirat() at kern_mkdirat+0x20d/frame 0xfffffe0141956e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141956f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141956f30 --- syscall (136, FreeBSD ELF64, mkdir), rip = 0x4a9fbebfd7a, rsp = 0x4a9f8aa9f18, rbp = 0x4a9f8aaa350 --- Tracing command mkdir pid 19245 tid 100294 td 0xfffffe013ebf8560 sched_switch() at sched_switch+0x582/frame 0xfffffe01418de8f0 mi_switch() at mi_switch+0x157/frame 0xfffffe01418de910 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01418de950 _sleep() at _sleep+0x2ef/frame 0xfffffe01418de9e0 vfs_busy() at vfs_busy+0x331/frame 0xfffffe01418dea20 ufs_sync_nlink() at ufs_sync_nlink+0x99/frame 0xfffffe01418dea60 ufs_mkdir() at ufs_mkdir+0x40/frame 0xfffffe01418debe0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01418dec00 kern_mkdirat() at kern_mkdirat+0x20d/frame 0xfffffe01418dee00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01418def30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01418def30 --- syscall (136, FreeBSD ELF64, mkdir), rip = 0x4a9fbebfd7a, rsp = 0x4a9f8aa9f18, rbp = 0x4a9f8aaa350 --- Tracing command mkdir pid 19247 tid 100299 td 0xfffffe0144624e40 sched_switch() at sched_switch+0x582/frame 0xfffffe014190b8f0 mi_switch() at mi_switch+0x157/frame 0xfffffe014190b910 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014190b950 _sleep() at _sleep+0x2ef/frame 0xfffffe014190b9e0 vfs_busy() at vfs_busy+0x331/frame 0xfffffe014190ba20 ufs_sync_nlink() at ufs_sync_nlink+0x99/frame 0xfffffe014190ba60 ufs_mkdir() at ufs_mkdir+0x40/frame 0xfffffe014190bbe0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe014190bc00 kern_mkdirat() at kern_mkdirat+0x20d/frame 0xfffffe014190be00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014190bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014190bf30 --- syscall (136, FreeBSD ELF64, mkdir), rip = 0x4a9fbebfd7a, rsp = 0x4a9f8aa9f18, rbp = 0x4a9f8aaa350 --- Tracing command sh pid 3310 tid 100248 td 0xfffffe0142ada000 sched_switch() at sched_switch+0x582/frame 0xfffffe010db91a20 mi_switch() at mi_switch+0x157/frame 0xfffffe010db91a40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db91a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db91ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db91ae0 _sleep() at _sleep+0x2e5/frame 0xfffffe010db91b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe010db91c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe010db91e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db91f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db91f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x2db85a23485a, rsp = 0x2db8579216a8, rbp = 0x2db857921750 --- Tracing command sh pid 3395 tid 100267 td 0xfffffe0143f32720 --- swapped out Tracing command sh pid 3436 tid 100219 td 0xfffffe010e39ae40 sched_switch() at sched_switch+0x582/frame 0xfffffe013e9f6a20 mi_switch() at mi_switch+0x157/frame 0xfffffe013e9f6a40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe013e9f6a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe013e9f6ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe013e9f6ae0 _sleep() at _sleep+0x2e5/frame 0xfffffe013e9f6b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe013e9f6c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe013e9f6e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe013e9f6f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013e9f6f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x217447e1c85a, rsp = 0x21744459ec58, rbp = 0x21744459ed00 --- Tracing command awk pid 3437 tid 100233 td 0xfffffe013ea5ae40 sched_switch() at sched_switch+0x582/frame 0xfffffe0113dcbb90 mi_switch() at mi_switch+0x157/frame 0xfffffe0113dcbbb0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0113dcbbf0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0113dcbc40 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0113dcbc50 _sleep() at _sleep+0x2e5/frame 0xfffffe0113dcbce0 pipe_read() at pipe_read+0x42a/frame 0xfffffe0113dcbd50 dofileread() at dofileread+0x83/frame 0xfffffe0113dcbd90 sys_read() at sys_read+0xc0/frame 0xfffffe0113dcbe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0113dcbf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0113dcbf30 --- syscall (3, FreeBSD ELF64, read), rip = 0x349bc04b67a, rsp = 0x349b89a25b8, rbp = 0x349b89a25d0 --- Tracing command sh pid 3439 tid 100567 td 0xfffffe0155fc5560 sched_switch() at sched_switch+0x582/frame 0xfffffe0141933b90 mi_switch() at mi_switch+0x157/frame 0xfffffe0141933bb0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141933bf0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141933c40 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141933c50 _sleep() at _sleep+0x2e5/frame 0xfffffe0141933ce0 pipe_read() at pipe_read+0x42a/frame 0xfffffe0141933d50 dofileread() at dofileread+0x83/frame 0xfffffe0141933d90 sys_read() at sys_read+0xc0/frame 0xfffffe0141933e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141933f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141933f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x217447e1c67a, rsp = 0x21744459e818, rbp = 0x21744459ed40 --- Tracing command sshd pid 12339 tid 100669 td 0xfffffe015600f000 sched_switch() at sched_switch+0x582/frame 0xfffffe0156f91ae0 mi_switch() at mi_switch+0x157/frame 0xfffffe0156f91b00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0156f91b40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0156f91b90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0156f91ba0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0156f91c00 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe0156f91c90 kern_poll() at kern_poll+0x9f/frame 0xfffffe0156f91de0 sys_poll() at sys_poll+0x50/frame 0xfffffe0156f91e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0156f91f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0156f91f30 --- syscall (209, FreeBSD ELF64, poll), rip = 0x1279a349b5fa, rsp = 0x12799d75a468, rbp = 0x12799d75a4a0 --- Tracing command csh pid 70140 tid 100764 td 0xfffffe016c746560 sched_switch() at sched_switch+0x582/frame 0xfffffe00e4f73b00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f73b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f73b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00e4f73bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e4f73bc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe00e4f73c20 tty_wait() at tty_wait+0x42/frame 0xfffffe00e4f73c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe00e4f73cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e4f73cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe00e4f73d50 dofileread() at dofileread+0x83/frame 0xfffffe00e4f73d90 sys_read() at sys_read+0xc0/frame 0xfffffe00e4f73e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe00e4f73f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e4f73f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x63336f7f67a, rsp = 0x63334c05ca8, rbp = 0x63334c05cd0 --- Tracing command sh pid 29587 tid 100560 td 0xfffffe01446271e0 sched_switch() at sched_switch+0x582/frame 0xfffffe01419c9a20 mi_switch() at mi_switch+0x157/frame 0xfffffe01419c9a40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01419c9a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01419c9ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01419c9ae0 _sleep() at _sleep+0x2e5/frame 0xfffffe01419c9b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01419c9c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01419c9e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01419c9f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01419c9f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x25453f7a685a, rsp = 0x25453df99758, rbp = 0x25453df99800 --- Tracing command ls pid 29588 tid 100678 td 0xfffffe0155fc6ac0 sched_switch() at sched_switch+0x582/frame 0xfffffe01419bf780 mi_switch() at mi_switch+0x157/frame 0xfffffe01419bf7a0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01419bf7e0 sleeplk() at sleeplk+0x100/frame 0xfffffe01419bf840 lockmgr_slock_hard() at lockmgr_slock_hard+0x3df/frame 0xfffffe01419bf8e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01419bf920 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01419bf940 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01419bf9a0 vget_finish() at vget_finish+0x7a/frame 0xfffffe01419bf9d0 cache_lookup() at cache_lookup+0x314/frame 0xfffffe01419bfa30 vfs_cache_lookup() at vfs_cache_lookup+0x7b/frame 0xfffffe01419bfa80 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe01419bfaa0 vfs_lookup() at vfs_lookup+0x4b9/frame 0xfffffe01419bfb40 namei() at namei+0x33d/frame 0xfffffe01419bfbc0 kern_statat() at kern_statat+0x12f/frame 0xfffffe01419bfd00 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe01419bfe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01419bff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01419bff30 --- syscall (552, FreeBSD ELF64, fstatat), rip = 0x12f651e9735a, rsp = 0x12f64e93e9c8, rbp = 0x12f64e93eae0 --- Tracing command sshd pid 13511 tid 100761 td 0xfffffe01560113a0 sched_switch() at sched_switch+0x582/frame 0xfffffe00e49a7ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49a7ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e49a7b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00e49a7b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e49a7b70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe00e49a7bd0 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe00e49a7c60 kern_poll() at kern_poll+0x9f/frame 0xfffffe00e49a7db0 sys_ppoll() at sys_ppoll+0x6f/frame 0xfffffe00e49a7e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe00e49a7f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e49a7f30 --- syscall (545, FreeBSD ELF64, ppoll), rip = 0x1279a349b61a, rsp = 0x12799d75a218, rbp = 0x12799d75a250 --- Tracing command bash pid 13512 tid 100290 td 0xfffffe013ebfa1e0 sched_switch() at sched_switch+0x582/frame 0xfffffe010db82a70 mi_switch() at mi_switch+0x157/frame 0xfffffe010db82a90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db82ad0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db82b20 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db82b30 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010db82b90 kern_select() at kern_select+0xadd/frame 0xfffffe010db82d80 sys_pselect() at sys_pselect+0xf9/frame 0xfffffe010db82e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db82f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db82f30 --- syscall (522, FreeBSD ELF64, pselect), rip = 0x82499263a, rsp = 0x820ebe008, rbp = 0x820ebe0d0 --- Tracing command sleep pid 72442 tid 100735 td 0xfffffe0156010c80 sched_switch() at sched_switch+0x582/frame 0xfffffe0156f44bc0 mi_switch() at mi_switch+0x157/frame 0xfffffe0156f44be0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0156f44c20 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0156f44c70 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0156f44cb0 _sleep() at _sleep+0x2c4/frame 0xfffffe0156f44d40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1c1/frame 0xfffffe0156f44dc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0156f44e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0156f44f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0156f44f30 --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x3bb3b6a7f57a, rsp = 0x3bb3b4a1f278, rbp = 0x3bb3b4a1f2e0 --- Tracing command md10 pid 40059 tid 100583 td 0xfffffe0144141ac0 sched_switch() at sched_switch+0x582/frame 0xfffffe0156e09db0 mi_switch() at mi_switch+0x157/frame 0xfffffe0156e09dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0156e09e10 _sleep() at _sleep+0x2ef/frame 0xfffffe0156e09ea0 md_kthread() at md_kthread+0xd5/frame 0xfffffe0156e09ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0156e09f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0156e09f30 --- trap 0xc, rip = 0x2f8f591ab29a, rsp = 0x2f8f57901398, rbp = 0x2f8f579013b0 --- Tracing command sh pid 23833 tid 100556 td 0xfffffe0155fc7900 sched_switch() at sched_switch+0x582/frame 0xfffffe01419dd780 mi_switch() at mi_switch+0x157/frame 0xfffffe01419dd7a0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01419dd7e0 sleeplk() at sleeplk+0x100/frame 0xfffffe01419dd840 lockmgr_slock_hard() at lockmgr_slock_hard+0x3df/frame 0xfffffe01419dd8e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01419dd920 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01419dd940 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01419dd9a0 vget_finish() at vget_finish+0x7a/frame 0xfffffe01419dd9d0 cache_lookup() at cache_lookup+0x314/frame 0xfffffe01419dda30 vfs_cache_lookup() at vfs_cache_lookup+0x7b/frame 0xfffffe01419dda80 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe01419ddaa0 vfs_lookup() at vfs_lookup+0x4b9/frame 0xfffffe01419ddb40 namei() at namei+0x33d/frame 0xfffffe01419ddbc0 kern_statat() at kern_statat+0x12f/frame 0xfffffe01419ddd00 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe01419dde00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01419ddf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01419ddf30 --- syscall (552, FreeBSD ELF64, fstatat), rip = 0x3edc584b35a, rsp = 0x3edc27ab9e8, rbp = 0x3edc27abc00 --- db> reset (kgdb) thread 30 [Switching to thread 30 (Thread 100044)] #0 sched_switch (td=td@entry=0xfffffe00e4ced000, flags=flags@entry=0x104) at ../../../kern/sched_ule.c:2299 2299 cpuid = td->td_oncpu = PCPU_GET(cpuid); (kgdb) bt #0 sched_switch (td=td@entry=0xfffffe00e4ced000, flags=flags@entry=0x104) at ../../../kern/sched_ule.c:2299 #1 0xffffffff80bfdae7 in mi_switch (flags=flags@entry=0x104) at ../../../kern/kern_synch.c:545 #2 0xffffffff80c4fcc7 in sleepq_switch (wchan=wchan@entry=0xfffffe010e38f09c, pri=0x57, pri@entry=0xe38f040) at ../../../kern/subr_sleepqueue.c:609 #3 0xffffffff80c4fb9e in sleepq_wait (wchan=, pri=) at ../../../kern/subr_sleepqueue.c:660 #4 0xffffffff80bfd04f in _sleep (ident=0xfffffe010e38f09c, lock=0xfffffe010e38f040, priority=0x257, wmesg=0xffffffff812ae2d6 "suspwt", sbt=0x0, pr=0x0, flags=0x100) at ../../../kern/kern_synch.c:225 #5 0xffffffff80d0003e in vfs_write_suspend (mp=mp@entry=0xfffffe010e38f000, flags=flags@entry=0x0) at ../../../kern/vfs_vnops.c:2108 #6 0xffffffff80d00225 in vfs_write_suspend_umnt (mp=mp@entry=0xfffffe010e38f000) at ../../../kern/vfs_vnops.c:2166 #7 0xffffffff80f43cac in ffs_unmount (mp=0xfffffe010e38f000, mp@entry=, mntflags=0x80000, mntflags@entry=) at ../../../ufs/ffs/ffs_vfsops.c:1388 #8 0xffffffff80cdad1a in dounmount (mp=, mp@entry=0xfffffe010e38f000, flags=flags@entry=0x300000080000, td=0xfffffe00e4ced000) at ../../../kern/vfs_mount.c:2208 #9 0xffffffff80cdd3d5 in vfs_deferred_unmount (argi=, pending=) at ../../../kern/vfs_mount.c:1969 #10 0xffffffff80c5515a in taskqueue_run_locked (queue=queue@entry=0xfffff80003a12a00) at ../../../kern/subr_taskqueue.c:514 #11 0xffffffff80c56202 in taskqueue_thread_loop (arg=arg@entry=0xffffffff81f9cb58 ) at ../../../kern/subr_taskqueue.c:826 #12 0xffffffff80ba6bb0 in fork_exit (callout=0xffffffff80c56140 , arg=0xffffffff81f9cb58 , frame=0xfffffe00e48dff40) at ../../../kern/kern_fork.c:1102 #13 (kgdb) f 5 #5 0xffffffff80d0003e in vfs_write_suspend (mp=mp@entry=0xfffffe010e38f000, flags=flags@entry=0x0) at ../../../kern/vfs_vnops.c:2108 2108 (void) msleep(&mp->mnt_writeopcount, (kgdb) l 2103 } 2104 2105 mp->mnt_kern_flag |= MNTK_SUSPEND; 2106 mp->mnt_susp_owner = curthread; 2107 if (mp->mnt_writeopcount > 0) 2108 (void) msleep(&mp->mnt_writeopcount, 2109 MNT_MTX(mp), (PUSER - 1)|PDROP, "suspwt", 0); 2110 else 2111 MNT_IUNLOCK(mp); 2112 if ((error = VFS_SYNC(mp, MNT_SUSPEND)) != 0) { (kgdb) info loc error = (kgdb) p *mp $1 = {mnt_vfs_ops = 0x2, mnt_kern_flag = 0x4b846345, mnt_flag = 0x201000, mnt_pcpu = 0xfffffe018b51cfd0, mnt_rootvnode = 0x0, mnt_vnodecovered = 0xfffffe0143884708, mnt_op = 0xffffffff81b72540 , mnt_vfc = 0xffffffff81b72668 , mnt_mtx = { lock_object = {lo_name = 0xffffffff811b982c "struct mount mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd75b00}, mtx_lock = 0x0}, mnt_gen = 0x14, mnt_list = {tqe_next = 0x0, tqe_prev = 0xfffffe0142aeb2e8}, mnt_syncer = 0x0, mnt_ref = 0x213, mnt_nvnodelist = {tqh_first = 0xfffffe0158c56068, tqh_last = 0xfffffe016a047280}, mnt_nvnodelistsize = 0x1fc, mnt_writeopcount = 0x7, mnt_opt = 0xfffff800320580d0, mnt_optnew = 0x0, mnt_stat = {f_version = 0x20140518, f_type = 0x35, f_flags = 0x201000, f_bsize = 0x1000, f_iosize = 0x8000, f_blocks = 0x26b247, f_bfree = 0x26b245, f_bavail = 0x2399c5, f_files = 0x14c8fe, f_ffree = 0x14c8fc, f_syncwrites = 0x9c4, f_asyncwrites = 0xfec, f_syncreads = 0x38, f_asyncreads = 0x0, f_nvnodelistsize = 0x0, f_spare0 = 0x0, f_spare = { 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}, f_namemax = 0xff, f_owner = 0x0, f_fsid = {val = {0x63641bae, 0x21d20dd8}}, f_charspare = '\000' , f_fstypename = "ufs", '\000' , f_mntfromname = "/dev/md10", '\000' , f_mntonname = "/mnt", '\000' }, mnt_cred = 0xfffff8046d572e00, mnt_data = 0xfffff8050f039000, mnt_time = 0x0, mnt_iosize_max = 0x100000, mnt_export = 0x0, mnt_label = 0x0, mnt_hashseed = 0xaaaa45aa, mnt_lockref = 0x0, mnt_secondary_writes = 0x0, mnt_secondary_accwrites = 0x451e5d, mnt_susp_owner = 0xfffffe00e4ced000, mnt_gjprovider = 0x0, mnt_listmtx = {lock_object = { lo_name = 0xffffffff81258da7 "struct mount vlist mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd83d00}, mtx_lock = 0x0}, mnt_lazyvnodelist = {tqh_first = 0xfffffe0158c56068, tqh_last = 0xfffffe016a0473c0}, mnt_lazyvnodelistsize = 0x3c, mnt_upper_pending = 0x0, mnt_explock = {lock_object = {lo_name = 0xffffffff8129369e "explock", lo_flags = 0x6730000, lo_data = 0x0, lo_witness = 0xfffff8087fd81580}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_pri = 0x40, lk_timo = 0x0, lk_stack = {depth = 0x0, pcs = { 0x0 }}}, mnt_uppers = {tqh_first = 0x0, tqh_last = 0xfffffe010e38fb20}, mnt_notify = {tqh_first = 0x0, tqh_last = 0xfffffe010e38fb30}, mnt_taskqueue_link = {stqe_next = 0x0}, mnt_taskqueue_flags = 0x300000080000, mnt_unmount_retries = 0x0} (kgdb) diff --git a/sbin/fsck_ffs/dir.c b/sbin/fsck_ffs/dir.c index ba286a9655130..d09e6940f812d 100644 --- a/sbin/fsck_ffs/dir.c +++ b/sbin/fsck_ffs/dir.c @@ -679,14 +679,17 @@ expanddir(struct inode *ip, char *name) struct bufarea *bp, *nbp; struct inodesc idesc; union dinode *dp; - int indiralloced; + long cg, indiralloced; char *cp; nbp = NULL; indiralloced = newblk = indirblk = 0; + memset(&idesc, 0, sizeof(struct inodesc)); + idesc.id_type = ADDR; pwarn("NO SPACE LEFT IN %s", name); if (!preen && reply("EXPAND") == 0) return (0); + cg = ino_to_cg(&sblock, ip->i_number); dp = ip->i_dp; filesize = DIP(dp, di_size); lastlbn = lblkno(&sblock, filesize); @@ -705,7 +708,8 @@ expanddir(struct inode *ip, char *name) bp = getdirblk(oldblk, lastlbnsize); if (bp->b_errs) goto bad; - if ((newblk = allocblk(sblock.fs_frag)) == 0) + newblk = allocblk(cg, sblock.fs_frag, std_checkblkavail); + if (newblk == 0) goto bad; nbp = getdatablk(newblk, sblock.fs_bsize, BT_DIRDATA); if (nbp->b_errs) @@ -724,6 +728,7 @@ expanddir(struct inode *ip, char *name) memmove(cp, &emptydir, sizeof emptydir); dirty(nbp); brelse(nbp); + binval(bp); idesc.id_blkno = oldblk; idesc.id_numfrags = numfrags(&sblock, lastlbnsize); (void)freeblock(&idesc); @@ -731,7 +736,7 @@ expanddir(struct inode *ip, char *name) printf(" (EXPANDED)\n"); return (1); } - if ((newblk = allocblk(sblock.fs_frag)) == 0) + if ((newblk = allocblk(cg, sblock.fs_frag, std_checkblkavail)) == 0) goto bad; bp = getdirblk(newblk, sblock.fs_bsize); if (bp->b_errs) @@ -749,8 +754,12 @@ expanddir(struct inode *ip, char *name) * Allocate indirect block if needed. */ if ((indirblk = DIP(dp, di_ib[0])) == 0) { - if ((indirblk = allocblk(sblock.fs_frag)) == 0) + indirblk = allocblk(cg, sblock.fs_frag, + std_checkblkavail); + if (indirblk == 0) { + binval(bp); goto bad; + } indiralloced = 1; } nbp = getdatablk(indirblk, sblock.fs_bsize, BT_LEVEL1); @@ -774,8 +783,10 @@ expanddir(struct inode *ip, char *name) return (1); bad: pfatal(" (EXPANSION FAILED)\n"); - if (nbp != NULL) + if (nbp != NULL) { + binval(bp); brelse(nbp); + } if (newblk != 0) { idesc.id_blkno = newblk; idesc.id_numfrags = sblock.fs_frag; diff --git a/sbin/fsck_ffs/ea.c b/sbin/fsck_ffs/ea.c index 54353005bdc0d..c2429cddcff4e 100644 --- a/sbin/fsck_ffs/ea.c +++ b/sbin/fsck_ffs/ea.c @@ -74,8 +74,10 @@ eascan(struct inodesc *idesc, struct ufs2_dinode *dp) blksiz = sblock.fs_fsize; else blksiz = sblock.fs_bsize; - printf("blksiz = %ju\n", (intmax_t)blksiz); bp = getdatablk(dp->di_extb[0], blksiz, BT_EXTATTR); + if (bp->b_errs) + return (STOP); + printf("blksiz = %ju\n", (intmax_t)blksiz); cp = (u_char *)bp->b_un.b_buf; for (n = 0; n < blksiz; n++) { printf("%02x", cp[n]); diff --git a/sbin/fsck_ffs/fsck.h b/sbin/fsck_ffs/fsck.h index d1b45a0850dac..a00fedd9ef909 100644 --- a/sbin/fsck_ffs/fsck.h +++ b/sbin/fsck_ffs/fsck.h @@ -200,8 +200,7 @@ struct bufarea { #define BT_INODES 7 /* Buffer holds inodes */ #define BT_DIRDATA 8 /* Buffer holds directory data */ #define BT_DATA 9 /* Buffer holds user data */ -#define BT_EMPTY 10 /* Buffer allocated but not filled */ -#define BT_NUMBUFTYPES 11 +#define BT_NUMBUFTYPES 10 #define BT_NAMES { \ "unknown", \ "Superblock", \ @@ -212,8 +211,7 @@ struct bufarea { "External Attribute", \ "Inode Block", \ "Directory Contents", \ - "User Data", \ - "Allocated but not filled" } + "User Data" } extern char *buftype[]; #define BT_BUFTYPE(type) \ type < BT_NUMBUFTYPES ? buftype[type] : buftype[BT_UNKNOWN] @@ -234,7 +232,7 @@ extern struct bufarea *pdirbp; /* current directory contents */ (bp)->b_flags |= B_DIRTY; \ } while (0) #define initbarea(bp, type) do { \ - (bp)->b_bno = (ufs2_daddr_t)-1; \ + (bp)->b_bno = (ufs2_daddr_t)-4; \ (bp)->b_size = 0; \ (bp)->b_errs = 0; \ (bp)->b_flags = 0; \ @@ -347,6 +345,7 @@ extern char *blockmap; /* ptr to primary blk allocation map */ extern char *cdevname; /* name of device being checked */ extern char ckclean; /* only do work if not cleanly unmounted */ extern int ckhashadd; /* check hashes to be added */ +extern char *copybuf; /* buffer to copy snapshot blocks */ extern int cvtlevel; /* convert to newer file system format */ extern long dev_bsize; /* computed value of DEV_BSIZE */ extern u_int real_dev_bsize; /* actual disk sector size, not overridden */ @@ -371,6 +370,8 @@ extern char resolved; /* cleared if unresolved changes => not clean */ extern int returntosingle; /* 1 => return to single user mode on exit */ extern long secsize; /* actual disk sector size */ extern char skipclean; /* skip clean file systems if preening */ +extern int snapcnt; /* number of active snapshots */ +extern struct inode snaplist[FSMAXSNAP + 1]; /* list of active snapshots */ extern char snapname[BUFSIZ]; /* when doing snapshots, the name of the file */ extern int sujrecovery; /* 1 => doing check using the journal */ extern int surrender; /* Give up if reads fail */ @@ -441,9 +442,11 @@ struct fstab; void adjust(struct inodesc *, int lcnt); void alarmhandler(int sig); -ufs2_daddr_t allocblk(long frags); +ufs2_daddr_t allocblk(long cg, long frags, ufs2_daddr_t (*checkblkavail) + (ufs2_daddr_t blkno, long frags)); ino_t allocdir(ino_t parent, ino_t request, int mode); ino_t allocino(ino_t request, int type); +void binval(struct bufarea *); void blkerror(ino_t ino, const char *type, ufs2_daddr_t blk); char *blockcheck(char *name); int blread(int fd, char *buf, ufs2_daddr_t blk, long size); @@ -458,12 +461,15 @@ void catchquit(int); void cgdirty(struct bufarea *); struct bufarea *cglookup(int cg); int changeino(ino_t dir, const char *name, ino_t newnum); +void check_blkcnt(struct inode *ip); int check_cgmagic(int cg, struct bufarea *cgbp, int requestrebuild); int chkrange(ufs2_daddr_t blk, int cnt); void ckfini(int markclean); int ckinode(union dinode *dp, struct inodesc *); void clri(struct inodesc *, const char *type, int flag); int clearentry(struct inodesc *); +void copyonwrite(struct fs *, struct bufarea *, + ufs2_daddr_t (*checkblkavail)(long, long)); void direrror(ino_t ino, const char *errmesg); int dirscan(struct inodesc *); int dofix(struct inodesc *, const char *msg); @@ -476,6 +482,7 @@ void flush(int fd, struct bufarea *bp); int freeblock(struct inodesc *); void freeino(ino_t ino); void freeinodebuf(void); +void fsckinit(void); void fsutilinit(void); int ftypeok(union dinode *dp); void getblk(struct bufarea *bp, ufs2_daddr_t blk, long size); @@ -484,6 +491,7 @@ struct inoinfo *getinoinfo(ino_t inumber); union dinode *getnextinode(ino_t inumber, int rebuildcg); void getpathname(char *namebuf, ino_t curdir, ino_t ino); void ginode(ino_t, struct inode *); +void gjournal_check(const char *filesys); void infohandler(int sig); void irelse(struct inode *); ufs2_daddr_t ino_blkatoff(union dinode *, ino_t, ufs_lbn_t, int *, @@ -505,6 +513,7 @@ void pass4(void); void pass5(void); void pfatal(const char *fmt, ...) __printflike(1, 2); void propagate(void); +void prtbuf(struct bufarea *, const char *, ...) __printflike(2, 3); void prtinode(struct inode *); void pwarn(const char *fmt, ...) __printflike(1, 2); int readsb(void); @@ -513,9 +522,13 @@ void rwerror(const char *mesg, ufs2_daddr_t blk); void sblock_init(void); void setinodebuf(int, ino_t); int setup(char *dev); -void gjournal_check(const char *filesys); +int snapblkfree(struct fs *, ufs2_daddr_t, long, ino_t, + ufs2_daddr_t (*)(ufs2_daddr_t, long)); +void snapremove(ino_t); +void snapflush(ufs2_daddr_t (*checkblkavail)(long, long)); +ufs2_daddr_t std_checkblkavail(ufs2_daddr_t blkno, long frags); +ufs2_daddr_t suj_checkblkavail(ufs2_daddr_t, long); int suj_check(const char *filesys); void update_maps(struct cg *, struct cg*, int); -void fsckinit(void); #endif /* !_FSCK_H_ */ diff --git a/sbin/fsck_ffs/fsutil.c b/sbin/fsck_ffs/fsutil.c index f1834e1235d8c..39e708a6cb324 100644 --- a/sbin/fsck_ffs/fsutil.c +++ b/sbin/fsck_ffs/fsutil.c @@ -71,7 +71,6 @@ static void cg_write(struct bufarea *); static void slowio_start(void); static void slowio_end(void); static void printIOstats(void); -static void prtbuf(const char *, struct bufarea *); static long diskreads, totaldiskreads, totalreads; /* Disk cache statistics */ static struct timespec startpass, finishpass; @@ -79,8 +78,10 @@ struct timeval slowio_starttime; int slowio_delay_usec = 10000; /* Initial IO delay for background fsck */ int slowio_pollcnt; static struct bufarea cgblk; /* backup buffer for cylinder group blocks */ +static struct bufarea failedbuf; /* returned by failed getdatablk() */ static TAILQ_HEAD(bufqueue, bufarea) bufqueuehd; /* head of buffer cache LRU */ static LIST_HEAD(bufhash, bufarea) bufhashhd[HASHSIZE]; /* buffer hash list */ +static struct bufhash freebufs; /* unused buffers */ static int numbufs; /* size of buffer cache */ static int cachelookups; /* number of cache lookups */ static int cachereads; /* number of cache reads */ @@ -187,11 +188,15 @@ bufinit(void) { int i; + initbarea(&failedbuf, BT_UNKNOWN); + failedbuf.b_errs = -1; + failedbuf.b_un.b_buf = NULL; if ((cgblk.b_un.b_buf = Malloc((unsigned int)sblock.fs_bsize)) == NULL) errx(EEXIT, "Initial malloc(%d) failed", sblock.fs_bsize); initbarea(&cgblk, BT_CYLGRP); numbufs = cachelookups = cachereads = 0; TAILQ_INIT(&bufqueuehd); + LIST_INIT(&freebufs); for (i = 0; i < HASHSIZE; i++) LIST_INIT(&bufhashhd[i]); for (i = 0; i < BT_NUMBUFTYPES; i++) { @@ -300,7 +305,7 @@ flushentry(void) } /* - * Manage a cache of directory blocks. + * Manage a cache of filesystem disk blocks. */ struct bufarea * getdatablk(ufs2_daddr_t blkno, long size, int type) @@ -309,16 +314,19 @@ getdatablk(ufs2_daddr_t blkno, long size, int type) struct bufhash *bhdp; cachelookups++; - /* If out of range, return empty buffer with b_err == -1 */ - if (type != BT_INODES && chkrange(blkno, size / sblock.fs_fsize)) { - blkno = -1; - type = BT_EMPTY; - } + /* + * If out of range, return empty buffer with b_err == -1 + * + * Skip check for inodes because chkrange() considers + * metadata areas invalid to write data. + */ + if (type != BT_INODES && chkrange(blkno, size / sblock.fs_fsize)) + return (&failedbuf); bhdp = &bufhashhd[HASH(blkno)]; LIST_FOREACH(bp, bhdp, b_hash) if (bp->b_bno == fsbtodb(&sblock, blkno)) { if (debug && bp->b_size != size) { - prtbuf("getdatablk: size mismatch", bp); + prtbuf(bp, "getdatablk: size mismatch"); pfatal("getdatablk: b_size %d != size %ld\n", bp->b_size, size); } @@ -340,7 +348,9 @@ getdatablk(ufs2_daddr_t blkno, long size, int type) if (size > sblock.fs_bsize) errx(EEXIT, "Excessive buffer size %ld > %d\n", size, sblock.fs_bsize); - if (numbufs < MINBUFS) { + if ((bp = LIST_FIRST(&freebufs)) != NULL) { + LIST_REMOVE(bp, b_hash); + } else if (numbufs < MINBUFS) { bp = allocbuf("cannot create minimal buffer pool"); } else if (sujrecovery) { /* @@ -378,7 +388,7 @@ getdatablk(ufs2_daddr_t blkno, long size, int type) if (debug && bp->b_type != type) { printf("getdatablk: buffer type changed to %s", BT_BUFTYPE(type)); - prtbuf("", bp); + prtbuf(bp, ""); } TAILQ_REMOVE(&bufqueuehd, bp, b_list); TAILQ_INSERT_HEAD(&bufqueuehd, bp, b_list); @@ -401,11 +411,7 @@ getblk(struct bufarea *bp, ufs2_daddr_t blk, long size) readcnt[bp->b_type]++; clock_gettime(CLOCK_REALTIME_PRECISE, &start); } - if (bp->b_type != BT_EMPTY) - bp->b_errs = - blread(fsreadfd, bp->b_un.b_buf, dblk, size); - else - bp->b_errs = -1; + bp->b_errs = blread(fsreadfd, bp->b_un.b_buf, dblk, size); if (debug) { clock_gettime(CLOCK_REALTIME_PRECISE, &finish); timespecsub(&finish, &start, &finish); @@ -422,10 +428,19 @@ brelse(struct bufarea *bp) { if (bp->b_refcnt <= 0) - prtbuf("brelse: buffer with negative reference count", bp); + prtbuf(bp, "brelse: buffer with negative reference count"); bp->b_refcnt--; } +void +binval(struct bufarea *bp) +{ + + bp->b_flags &= ~B_DIRTY; + LIST_REMOVE(bp, b_hash); + LIST_INSERT_HEAD(&freebufs, bp, b_hash); +} + void flush(int fd, struct bufarea *bp) { @@ -451,10 +466,18 @@ flush(int fd, struct bufarea *bp) if (bp != &sblk) pfatal("BUFFER %p DOES NOT MATCH SBLK %p\n", bp, &sblk); + /* + * Superblocks are always pre-copied so we do not need + * to check them for copy-on-write. + */ if (sbput(fd, bp->b_un.b_fs, 0) == 0) fsmodified = 1; break; case BT_CYLGRP: + /* + * Cylinder groups are always pre-copied so we do not + * need to check them for copy-on-write. + */ if (sujrecovery) cg_write(bp); if (cgput(fswritefd, &sblock, bp->b_un.b_cg) == 0) @@ -483,11 +506,38 @@ flush(int fd, struct bufarea *bp) } /* FALLTHROUGH */ default: + copyonwrite(&sblock, bp, std_checkblkavail); blwrite(fd, bp->b_un.b_buf, bp->b_bno, bp->b_size); break; } } +/* + * If there are any snapshots, ensure that all the blocks that they + * care about have been copied, then release the snapshot inodes. + * These operations need to be done before we rebuild the cylinder + * groups so that any block allocations are properly recorded. + * Since all the cylinder group maps have already been copied in + * the snapshots, no further snapshot copies will need to be done. + */ +void +snapflush(ufs2_daddr_t (*checkblkavail)(long, long)) +{ + struct bufarea *bp; + int cnt; + + if (snapcnt > 0) { + if (debug) + printf("Check for snapshot copies\n"); + TAILQ_FOREACH_REVERSE(bp, &bufqueuehd, bufqueue, b_list) + if ((bp->b_flags & B_DIRTY) != 0) + copyonwrite(&sblock, bp, checkblkavail); + for (cnt = 0; cnt < snapcnt; cnt++) + irelse(&snaplist[cnt]); + snapcnt = 0; + } +} + /* * Journaled soft updates does not maintain cylinder group summary * information during cleanup, so this routine recalculates the summary @@ -499,6 +549,7 @@ cg_write(struct bufarea *bp) { ufs1_daddr_t fragno, cgbno, maxbno; u_int8_t *blksfree; + struct csum *csp; struct cg *cgp; int blk; int i; @@ -536,6 +587,11 @@ cg_write(struct bufarea *bp) * Update the superblock cg summary from our now correct values * before writing the block. */ + csp = &sblock.fs_cs(&sblock, cgp->cg_cgx); + sblock.fs_cstotal.cs_ndir += cgp->cg_cs.cs_ndir - csp->cs_ndir; + sblock.fs_cstotal.cs_nbfree += cgp->cg_cs.cs_nbfree - csp->cs_nbfree; + sblock.fs_cstotal.cs_nifree += cgp->cg_cs.cs_nifree - csp->cs_nifree; + sblock.fs_cstotal.cs_nffree += cgp->cg_cs.cs_nffree - csp->cs_nffree; sblock.fs_cs(&sblock, cgp->cg_cgx) = cgp->cg_cs; } @@ -587,6 +643,7 @@ ckfini(int markclean) (void)close(fsreadfd); return; } + /* * To remain idempotent with partial truncations the buffers * must be flushed in this order: @@ -629,14 +686,9 @@ ckfini(int markclean) case BT_SUPERBLK: case BT_CYLGRP: default: - prtbuf("ckfini: improper buffer type on cache list",bp); + prtbuf(bp,"ckfini: improper buffer type on cache list"); continue; /* These are the ones to flush in this step */ - case BT_EMPTY: - if (bp->b_bno >= 0) - pfatal("Unused BT_EMPTY buffer for block %jd\n", - (intmax_t)bp->b_bno); - /* FALLTHROUGH */ case BT_LEVEL1: case BT_LEVEL2: case BT_LEVEL3: @@ -649,10 +701,11 @@ ckfini(int markclean) continue; } if (debug && bp->b_refcnt != 0) { - prtbuf("ckfini: clearing in-use buffer", bp); + prtbuf(bp, "ckfini: clearing in-use buffer"); pfatal("ckfini: clearing in-use buffer\n"); } TAILQ_REMOVE(&bufqueuehd, bp, b_list); + LIST_REMOVE(bp, b_hash); cnt++; flush(fswritefd, bp); free(bp->b_un.b_buf); @@ -667,10 +720,11 @@ ckfini(int markclean) } TAILQ_FOREACH_REVERSE_SAFE(bp, &bufqueuehd, bufqueue, b_list, nbp) { if (debug && bp->b_refcnt != 0) { - prtbuf("ckfini: clearing in-use buffer", bp); + prtbuf(bp, "ckfini: clearing in-use buffer"); pfatal("ckfini: clearing in-use buffer\n"); } TAILQ_REMOVE(&bufqueuehd, bp, b_list); + LIST_REMOVE(bp, b_hash); cnt++; flush(fswritefd, bp); free(bp->b_un.b_buf); @@ -1050,45 +1104,77 @@ check_cgmagic(int cg, struct bufarea *cgbp, int request_rebuild) * allocate a data block with the specified number of fragments */ ufs2_daddr_t -allocblk(long frags) +allocblk(long startcg, long frags, + ufs2_daddr_t (*checkblkavail)(ufs2_daddr_t blkno, long frags)) { - int i, j, k, cg, baseblk; - struct bufarea *cgbp; - struct cg *cgp; + ufs2_daddr_t blkno, newblk; + if (sujrecovery && checkblkavail == std_checkblkavail) { + pfatal("allocblk: std_checkblkavail used for SUJ recovery\n"); + return (0); + } if (frags <= 0 || frags > sblock.fs_frag) return (0); - for (i = 0; i < maxfsblock - sblock.fs_frag; i += sblock.fs_frag) { - for (j = 0; j <= sblock.fs_frag - frags; j++) { - if (testbmap(i + j)) - continue; - for (k = 1; k < frags; k++) - if (testbmap(i + j + k)) - break; - if (k < frags) { - j += k; - continue; - } - cg = dtog(&sblock, i + j); - cgbp = cglookup(cg); - cgp = cgbp->b_un.b_cg; - if (!check_cgmagic(cg, cgbp, 0)) { - i = (cg + 1) * sblock.fs_fpg - sblock.fs_frag; - continue; - } - baseblk = dtogd(&sblock, i + j); - for (k = 0; k < frags; k++) { - setbmap(i + j + k); - clrbit(cg_blksfree(cgp), baseblk + k); - } - n_blks += frags; - if (frags == sblock.fs_frag) - cgp->cg_cs.cs_nbfree--; - else - cgp->cg_cs.cs_nffree -= frags; - cgdirty(cgbp); - return (i + j); + for (blkno = cgdata(&sblock, startcg); + blkno < maxfsblock - sblock.fs_frag; + blkno += sblock.fs_frag) { + if ((newblk = (*checkblkavail)(blkno, frags)) == 0) + continue; + if (newblk > 0) + return (newblk); + if (newblk < 0) + blkno = -newblk; + } + for (blkno = cgdata(&sblock, 0); + blkno < cgbase(&sblock, startcg) - sblock.fs_frag; + blkno += sblock.fs_frag) { + if ((newblk = (*checkblkavail)(blkno, frags)) == 0) + continue; + if (newblk > 0) + return (newblk); + if (newblk < 0) + blkno = -newblk; + } + return (0); +} + +ufs2_daddr_t +std_checkblkavail(blkno, frags) + ufs2_daddr_t blkno; + long frags; +{ + struct bufarea *cgbp; + struct cg *cgp; + ufs2_daddr_t j, k, baseblk; + long cg; + + for (j = 0; j <= sblock.fs_frag - frags; j++) { + if (testbmap(blkno + j)) + continue; + for (k = 1; k < frags; k++) + if (testbmap(blkno + j + k)) + break; + if (k < frags) { + j += k; + continue; + } + cg = dtog(&sblock, blkno + j); + cgbp = cglookup(cg); + cgp = cgbp->b_un.b_cg; + if (!check_cgmagic(cg, cgbp, 0)) + return (-((cg + 1) * sblock.fs_fpg - sblock.fs_frag)); + baseblk = dtogd(&sblock, blkno + j); + for (k = 0; k < frags; k++) { + setbmap(blkno + j + k); + clrbit(cg_blksfree(cgp), baseblk + k); } + n_blks += frags; + if (frags == sblock.fs_frag) + cgp->cg_cs.cs_nbfree--; + else + cgp->cg_cs.cs_nffree -= frags; + cgdirty(cgbp); + return (blkno + j); } return (0); } @@ -1261,14 +1347,19 @@ dofix(struct inodesc *idesc, const char *msg) /* * Print details about a buffer. */ -static void -prtbuf(const char *msg, struct bufarea *bp) +void +prtbuf(struct bufarea *bp, const char *fmt, ...) { - - printf("%s: bp %p, type %s, bno %jd, size %d, refcnt %d, flags %s, " - "index %jd\n", msg, bp, BT_BUFTYPE(bp->b_type), - (intmax_t) bp->b_bno, bp->b_size, bp->b_refcnt, - bp->b_flags & B_DIRTY ? "dirty" : "clean", (intmax_t) bp->b_index); + va_list ap; + va_start(ap, fmt); + if (preen) + (void)fprintf(stdout, "%s: ", cdevname); + (void)vfprintf(stdout, fmt, ap); + va_end(ap); + printf(": bp %p, type %s, bno %jd, size %d, refcnt %d, flags %s, " + "index %jd\n", bp, BT_BUFTYPE(bp->b_type), (intmax_t) bp->b_bno, + bp->b_size, bp->b_refcnt, bp->b_flags & B_DIRTY ? "dirty" : "clean", + (intmax_t) bp->b_index); } /* diff --git a/sbin/fsck_ffs/inode.c b/sbin/fsck_ffs/inode.c index c261b254ace94..1d36a6ca3e45a 100644 --- a/sbin/fsck_ffs/inode.c +++ b/sbin/fsck_ffs/inode.c @@ -38,6 +38,7 @@ static const char sccsid[] = "@(#)inode.c 8.8 (Berkeley) 4/28/95"; __FBSDID("$FreeBSD$"); #include +#include #include #include @@ -58,6 +59,9 @@ struct bufarea *icachebp; /* inode cache buffer */ static int iblock(struct inodesc *, off_t isize, int type); static ufs2_daddr_t indir_blkatoff(ufs2_daddr_t, ino_t, ufs_lbn_t, ufs_lbn_t, struct bufarea **); +static int snapclean(struct inodesc *idesc); +static void chkcopyonwrite(struct fs *, ufs2_daddr_t, + ufs2_daddr_t (*checkblkavail)(long, long)); int ckinode(union dinode *dp, struct inodesc *idesc) @@ -378,8 +382,12 @@ chkrange(ufs2_daddr_t blk, int cnt) int c; if (cnt <= 0 || blk <= 0 || blk > maxfsblock || - cnt - 1 > maxfsblock - blk) + cnt - 1 > maxfsblock - blk) { + if (debug) + printf("out of range: blk %ld, offset %i, size %d\n", + (long)blk, (int)fragnum(&sblock, blk), cnt); return (1); + } if (cnt > sblock.fs_frag || fragnum(&sblock, blk) + cnt > sblock.fs_frag) { if (debug) @@ -650,11 +658,21 @@ int freeblock(struct inodesc *idesc) { struct dups *dlp; + struct bufarea *cgbp; + struct cg *cgp; ufs2_daddr_t blkno; - long nfrags, res; + long size, nfrags, res; res = KEEPON; blkno = idesc->id_blkno; + if (idesc->id_type == SNAP) { + pfatal("clearing a snapshot dinode\n"); + return (STOP); + } + size = lfragtosize(&sblock, idesc->id_numfrags); + if (snapblkfree(&sblock, blkno, size, idesc->id_number, + std_checkblkavail)) + return (res); for (nfrags = idesc->id_numfrags; nfrags > 0; blkno++, nfrags--) { if (chkrange(blkno, 1)) { res = SKIP; @@ -674,12 +692,407 @@ freeblock(struct inodesc *idesc) } } } + /* + * If all successfully returned, account for them. + */ + if (nfrags == 0) { + cgbp = cglookup(dtog(&sblock, idesc->id_blkno)); + cgp = cgbp->b_un.b_cg; + if (idesc->id_numfrags == sblock.fs_frag) + cgp->cg_cs.cs_nbfree++; + else + cgp->cg_cs.cs_nffree += idesc->id_numfrags; + cgdirty(cgbp); + } return (res); } +/* + * Prepare a snapshot file for being removed. + */ +void +snapremove(ino_t inum) +{ + struct inodesc idesc; + struct inode ip; + int i; + + for (i = 0; i < snapcnt; i++) + if (snaplist[i].i_number == inum) + break; + if (i == snapcnt) + ginode(inum, &ip); + else + ip = snaplist[i]; + if ((DIP(ip.i_dp, di_flags) & SF_SNAPSHOT) == 0) { + printf("snapremove: inode %jd is not a snapshot\n", + (intmax_t)inum); + if (i == snapcnt) + irelse(&ip); + return; + } + if (debug) + printf("snapremove: remove %sactive snapshot %jd\n", + i == snapcnt ? "in" : "", (intmax_t)inum); + /* + * If on active snapshot list, remove it. + */ + if (i < snapcnt) { + for (i++; i < FSMAXSNAP; i++) { + if (sblock.fs_snapinum[i] == 0) + break; + snaplist[i - 1] = snaplist[i]; + sblock.fs_snapinum[i - 1] = sblock.fs_snapinum[i]; + } + sblock.fs_snapinum[i - 1] = 0; + bzero(&snaplist[i - 1], sizeof(struct inode)); + snapcnt--; + } + idesc.id_type = SNAP; + idesc.id_func = snapclean; + idesc.id_number = inum; + (void)ckinode(ip.i_dp, &idesc); + DIP_SET(ip.i_dp, di_flags, DIP(ip.i_dp, di_flags) & ~SF_SNAPSHOT); + inodirty(&ip); + irelse(&ip); +} + +static int +snapclean(struct inodesc *idesc) +{ + ufs2_daddr_t blkno; + struct bufarea *bp; + union dinode *dp; + + blkno = idesc->id_blkno; + if (blkno == 0) + return (KEEPON); + + bp = idesc->id_bp; + dp = idesc->id_dp; + if (blkno == BLK_NOCOPY || blkno == BLK_SNAP) { + if (idesc->id_lbn < UFS_NDADDR) + DIP_SET(dp, di_db[idesc->id_lbn], 0); + else + IBLK_SET(bp, bp->b_index, 0); + dirty(bp); + } + return (KEEPON); +} + +/* + * Notification that a block is being freed. Return zero if the free + * should be allowed to proceed. Return non-zero if the snapshot file + * wants to claim the block. The block will be claimed if it is an + * uncopied part of one of the snapshots. It will be freed if it is + * either a BLK_NOCOPY or has already been copied in all of the snapshots. + * If a fragment is being freed, then all snapshots that care about + * it must make a copy since a snapshot file can only claim full sized + * blocks. Note that if more than one snapshot file maps the block, + * we can pick one at random to claim it. Since none of the snapshots + * can change, we are assurred that they will all see the same unmodified + * image. When deleting a snapshot file (see ino_trunc above), we + * must push any of these claimed blocks to one of the other snapshots + * that maps it. These claimed blocks are easily identified as they will + * have a block number equal to their logical block number within the + * snapshot. A copied block can never have this property because they + * must always have been allocated from a BLK_NOCOPY location. + */ +int +snapblkfree(fs, bno, size, inum, checkblkavail) + struct fs *fs; + ufs2_daddr_t bno; + long size; + ino_t inum; + ufs2_daddr_t (*checkblkavail)(long cg, long frags); +{ + union dinode *dp; + struct inode ip; + struct bufarea *snapbp; + ufs_lbn_t lbn; + ufs2_daddr_t blkno, relblkno; + int i, frags, claimedblk, copydone; + + /* If no snapshots, nothing to do */ + if (snapcnt == 0) + return (0); + if (debug) + printf("snapblkfree: in ino %ld free blkno %ld, size %ld\n", + inum, bno, size); + relblkno = blknum(fs, bno); + lbn = fragstoblks(fs, relblkno); + /* Direct blocks are always pre-copied */ + if (lbn < UFS_NDADDR) + return (0); + copydone = 0; + claimedblk = 0; + for (i = 0; i < snapcnt; i++) { + /* + * Lookup block being freed. + */ + ip = snaplist[i]; + dp = ip.i_dp; + blkno = ino_blkatoff(dp, inum != 0 ? inum : ip.i_number, + lbn, &frags, &snapbp); + /* + * Check to see if block needs to be copied. + */ + if (blkno == 0) { + /* + * A block that we map is being freed. If it has not + * been claimed yet, we will claim or copy it (below). + */ + claimedblk = 1; + } else if (blkno == BLK_SNAP) { + /* + * No previous snapshot claimed the block, + * so it will be freed and become a BLK_NOCOPY + * (don't care) for us. + */ + if (claimedblk) + pfatal("snapblkfree: inconsistent block type"); + IBLK_SET(snapbp, snapbp->b_index, BLK_NOCOPY); + dirty(snapbp); + brelse(snapbp); + continue; + } else /* BLK_NOCOPY or default */ { + /* + * If the snapshot has already copied the block + * (default), or does not care about the block, + * it is not needed. + */ + brelse(snapbp); + continue; + } + /* + * If this is a full size block, we will just grab it + * and assign it to the snapshot inode. Otherwise we + * will proceed to copy it. See explanation for this + * routine as to why only a single snapshot needs to + * claim this block. + */ + if (size == fs->fs_bsize) { + if (debug) + printf("Grabonremove snapshot %ju lbn %jd " + "from inum %ju\n", (intmax_t)ip.i_number, + (intmax_t)lbn, (uintmax_t)inum); + IBLK_SET(snapbp, snapbp->b_index, relblkno); + dirty(snapbp); + brelse(snapbp); + DIP_SET(dp, di_blocks, + DIP(dp, di_blocks) + btodb(size)); + inodirty(&ip); + return (1); + } + + /* First time through, read the contents of the old block. */ + if (copydone == 0) { + copydone = 1; + if (blread(fsreadfd, copybuf, fsbtodb(fs, relblkno), + fs->fs_bsize) != 0) { + pfatal("Could not read snapshot %ju block " + "%jd\n", (intmax_t)ip.i_number, + (intmax_t)relblkno); + continue; + } + } + /* + * This allocation will never require any additional + * allocations for the snapshot inode. + */ + blkno = allocblk(dtog(fs, relblkno), fs->fs_frag, + checkblkavail); + if (blkno == 0) { + pfatal("Could not allocate block for snapshot %ju\n", + (intmax_t)ip.i_number); + continue; + } + if (debug) + printf("Copyonremove: snapino %jd lbn %jd for inum %ju " + "size %ld new blkno %jd\n", (intmax_t)ip.i_number, + (intmax_t)lbn, (uintmax_t)inum, size, + (intmax_t)blkno); + blwrite(fswritefd, copybuf, fsbtodb(fs, blkno), fs->fs_bsize); + IBLK_SET(snapbp, snapbp->b_index, blkno); + dirty(snapbp); + brelse(snapbp); + DIP_SET(dp, di_blocks, + DIP(dp, di_blocks) + btodb(fs->fs_bsize)); + inodirty(&ip); + } + return (0); +} + +/* + * Notification that a block is being written. Return if the block + * is part of a snapshot as snapshots never track other snapshots. + * The block will be copied in all of the snapshots that are tracking + * it and have not yet copied it. Some buffers may hold more than one + * block. Here we need to check each block in the buffer. + */ +void +copyonwrite(fs, bp, checkblkavail) + struct fs *fs; + struct bufarea *bp; + ufs2_daddr_t (*checkblkavail)(long cg, long frags); +{ + ufs2_daddr_t copyblkno; + long i, numblks; + + /* If no snapshots, nothing to do. */ + if (snapcnt == 0) + return; + numblks = blkroundup(fs, bp->b_size) / fs->fs_bsize; + if (debug) + prtbuf(bp, "copyonwrite: checking %jd block%s in buffer", + numblks, numblks > 1 ? "s" : ""); + copyblkno = blknum(fs, dbtofsb(fs, bp->b_bno)); + for (i = 0; i < numblks; i++) { + chkcopyonwrite(fs, copyblkno, checkblkavail); + copyblkno += fs->fs_frag; + } +} + +static void +chkcopyonwrite(fs, copyblkno, checkblkavail) + struct fs *fs; + ufs2_daddr_t copyblkno; + ufs2_daddr_t (*checkblkavail)(long cg, long frags); +{ + struct inode ip; + union dinode *dp; + struct bufarea *snapbp; + ufs2_daddr_t blkno; + int i, frags, copydone; + ufs_lbn_t lbn; + + lbn = fragstoblks(fs, copyblkno); + /* Direct blocks are always pre-copied */ + if (lbn < UFS_NDADDR) + return; + copydone = 0; + for (i = 0; i < snapcnt; i++) { + /* + * Lookup block being freed. + */ + ip = snaplist[i]; + dp = ip.i_dp; + blkno = ino_blkatoff(dp, ip.i_number, lbn, &frags, &snapbp); + /* + * Check to see if block needs to be copied. + */ + if (blkno != 0) { + /* + * A block that we have already copied or don't track. + */ + brelse(snapbp); + continue; + } + /* First time through, read the contents of the old block. */ + if (copydone == 0) { + copydone = 1; + if (blread(fsreadfd, copybuf, fsbtodb(fs, copyblkno), + fs->fs_bsize) != 0) { + pfatal("Could not read snapshot %ju block " + "%jd\n", (intmax_t)ip.i_number, + (intmax_t)copyblkno); + continue; + } + } + /* + * This allocation will never require any additional + * allocations for the snapshot inode. + */ + if ((blkno = allocblk(dtog(fs, copyblkno), fs->fs_frag, + checkblkavail)) == 0) { + pfatal("Could not allocate block for snapshot %ju\n", + (intmax_t)ip.i_number); + continue; + } + if (debug) + prtbuf(snapbp, "Copyonwrite: snapino %jd lbn %jd using " + "blkno %ju setting in buffer", + (intmax_t)ip.i_number, (intmax_t)lbn, + (intmax_t)blkno); + blwrite(fswritefd, copybuf, fsbtodb(fs, blkno), fs->fs_bsize); + IBLK_SET(snapbp, snapbp->b_index, blkno); + dirty(snapbp); + brelse(snapbp); + DIP_SET(dp, di_blocks, + DIP(dp, di_blocks) + btodb(fs->fs_bsize)); + inodirty(&ip); + } + return; +} + +/* + * Traverse an inode and check that its block count is correct + * fixing it if necessary. + */ +void +check_blkcnt(struct inode *ip) +{ + struct inodesc idesc; + union dinode *dp; + ufs2_daddr_t ndb; + int j, ret, offset; + + dp = ip->i_dp; + memset(&idesc, 0, sizeof(struct inodesc)); + idesc.id_func = pass1check; + idesc.id_number = ip->i_number; + idesc.id_type = (DIP(dp, di_flags) & SF_SNAPSHOT) == 0 ? ADDR : SNAP; + (void)ckinode(dp, &idesc); + if (sblock.fs_magic == FS_UFS2_MAGIC && dp->dp2.di_extsize > 0) { + ndb = howmany(dp->dp2.di_extsize, sblock.fs_bsize); + for (j = 0; j < UFS_NXADDR; j++) { + if (--ndb == 0 && + (offset = blkoff(&sblock, dp->dp2.di_extsize)) != 0) + idesc.id_numfrags = numfrags(&sblock, + fragroundup(&sblock, offset)); + else + idesc.id_numfrags = sblock.fs_frag; + if (dp->dp2.di_extb[j] == 0) + continue; + idesc.id_blkno = dp->dp2.di_extb[j]; + ret = (*idesc.id_func)(&idesc); + if (ret & STOP) + break; + } + } + idesc.id_entryno *= btodb(sblock.fs_fsize); + if (DIP(dp, di_blocks) != idesc.id_entryno) { + if (!(sujrecovery && preen)) { + pwarn("INCORRECT BLOCK COUNT I=%lu (%ju should be %ju)", + (u_long)idesc.id_number, + (uintmax_t)DIP(dp, di_blocks), + (uintmax_t)idesc.id_entryno); + if (preen) + printf(" (CORRECTED)\n"); + else if (reply("CORRECT") == 0) + return; + } + if (bkgrdflag == 0) { + DIP_SET(dp, di_blocks, idesc.id_entryno); + inodirty(ip); + } else { + cmd.value = idesc.id_number; + cmd.size = idesc.id_entryno - DIP(dp, di_blocks); + if (debug) + printf("adjblkcnt ino %ju amount %lld\n", + (uintmax_t)cmd.value, (long long)cmd.size); + if (sysctl(adjblkcnt, MIBSIZE, 0, 0, + &cmd, sizeof cmd) == -1) + rwerror("ADJUST INODE BLOCK COUNT", cmd.value); + } + } +} + void freeinodebuf(void) { + struct bufarea *bp; + int i; /* * Flush old contents in case they have been updated. @@ -689,6 +1102,14 @@ freeinodebuf(void) free((char *)inobuf.b_un.b_buf); inobuf.b_un.b_buf = NULL; firstinum = lastinum = 0; + /* + * Reload the snapshot inodes in case any of them changed. + */ + for (i = 0; i < snapcnt; i++) { + bp = snaplist[i].i_bp; + bp->b_errs = blread(fsreadfd, bp->b_un.b_buf, bp->b_bno, + bp->b_size); + } } /* @@ -720,6 +1141,7 @@ cacheino(union dinode *dp, ino_t inumber) inpp = &inphead[inumber % dirhash]; inp->i_nexthash = *inpp; *inpp = inp; + inp->i_flags = 0; inp->i_parent = inumber == UFS_ROOTINO ? UFS_ROOTINO : (ino_t)0; inp->i_dotdot = (ino_t)0; inp->i_number = inumber; @@ -803,6 +1225,10 @@ clri(struct inodesc *idesc, const char *type, int flag) printf(" (CLEARED)\n"); n_files--; if (bkgrdflag == 0) { + if (idesc->id_type == SNAP) { + snapremove(idesc->id_number); + idesc->id_type = ADDR; + } (void)ckinode(dp, idesc); inoinfo(idesc->id_number)->ino_state = USTATE; clearinode(dp); @@ -967,7 +1393,8 @@ allocino(ino_t request, int type) cgdirty(cgbp); ginode(ino, &ip); dp = ip.i_dp; - DIP_SET(dp, di_db[0], allocblk((long)1)); + DIP_SET(dp, di_db[0], allocblk(ino_to_cg(&sblock, ino), (long)1, + std_checkblkavail)); if (DIP(dp, di_db[0]) == 0) { inoinfo(ino)->ino_state = USTATE; irelse(&ip); diff --git a/sbin/fsck_ffs/main.c b/sbin/fsck_ffs/main.c index b638d31040dd0..7e4dcc3e1e32b 100644 --- a/sbin/fsck_ffs/main.c +++ b/sbin/fsck_ffs/main.c @@ -491,6 +491,7 @@ checkfilesys(char *filesys) */ if (preen == 0) printf("** Phase 5 - Check Cyl groups\n"); + snapflush(std_checkblkavail); pass5(); IOstats("Pass5"); diff --git a/sbin/fsck_ffs/setup.c b/sbin/fsck_ffs/setup.c index 69b027a3a5c82..527d125dd6705 100644 --- a/sbin/fsck_ffs/setup.c +++ b/sbin/fsck_ffs/setup.c @@ -59,6 +59,9 @@ __FBSDID("$FreeBSD$"); #include "fsck.h" struct inoinfo **inphead, **inpsort; /* info about all inodes */ +struct inode snaplist[FSMAXSNAP + 1]; /* list of active snapshots */ +int snapcnt; /* number of active snapshots */ +char *copybuf; /* buffer to copy snapshot blocks */ static int sbhashfailed; #define POWEROF2(num) (((num) & ((num) - 1)) == 0) @@ -66,6 +69,8 @@ static int sbhashfailed; static int calcsb(char *dev, int devfd, struct fs *fs); static void saverecovery(int readfd, int writefd); static int chkrecovery(int devfd); +static int getlbnblkno(struct inodesc *); +static int checksnapinfo(struct inode *); /* * Read in a superblock finding an alternate if necessary. @@ -75,7 +80,8 @@ static int chkrecovery(int devfd); int setup(char *dev) { - long bmapsize; + long i, bmapsize; + struct inode ip; /* * We are expected to have an open file descriptor and a superblock. @@ -174,6 +180,42 @@ setup(char *dev) usedsoftdep = 1; else usedsoftdep = 0; + /* + * Collect any snapshot inodes so that we can allow them to + * claim any blocks that we free. The code for doing this is + * imported here and into inode.c from sys/ufs/ffs/ffs_snapshot.c. + */ + for (snapcnt = 0; snapcnt < FSMAXSNAP; snapcnt++) { + if (sblock.fs_snapinum[snapcnt] == 0) + break; + ginode(sblock.fs_snapinum[snapcnt], &ip); + if ((DIP(ip.i_dp, di_mode) & IFMT) == IFREG && + (DIP(ip.i_dp, di_flags) & SF_SNAPSHOT) != 0 && + checksnapinfo(&ip)) { + if (debug) + printf("Load snapshot %jd\n", + (intmax_t)sblock.fs_snapinum[snapcnt]); + snaplist[snapcnt] = ip; + continue; + } + printf("Removing non-snapshot inode %ju from snapshot list\n", + (uintmax_t)sblock.fs_snapinum[snapcnt]); + irelse(&ip); + for (i = snapcnt + 1; i < FSMAXSNAP; i++) { + if (sblock.fs_snapinum[i] == 0) + break; + sblock.fs_snapinum[i - 1] = sblock.fs_snapinum[i]; + } + sblock.fs_snapinum[i - 1] = 0; + snapcnt--; + sbdirty(); + } + if (snapcnt > 0 && copybuf == NULL) { + copybuf = Malloc(sblock.fs_bsize); + if (copybuf == NULL) + errx(EEXIT, "cannot allocate space for snapshot " + "copy buffer"); + } return (1); badsb: @@ -181,6 +223,144 @@ setup(char *dev) return (0); } +/* + * Check for valid snapshot information. + * + * Each snapshot has a list of blocks that have been copied. This list + * is consulted before checking the snapshot inode. Its purpose is to + * speed checking of commonly checked blocks and to avoid recursive + * checks of the snapshot inode. In particular, the list must contain + * the superblock, the superblock summary information, and all the + * cylinder group blocks. The list may contain other commonly checked + * pointers such as those of the blocks that contain the snapshot inodes. + * The list is sorted into block order to allow binary search lookup. + * + * The twelve direct direct block pointers of the snapshot are always + * copied, so we test for them first before checking the list itself + * (i.e., they are not in the list). + * + * The checksnapinfo() routine needs to ensure that the list contains at + * least the super block, its summary information, and the cylinder groups. + * Here we check the list first for the superblock, zero or more cylinder + * groups up to the location of the superblock summary information, the + * summary group information, and any remaining cylinder group maps that + * follow it. We skip over any other entries in the list. + */ +#define CHKBLKINLIST(chkblk) \ + /* All UFS_NDADDR blocks are copied */ \ + if ((chkblk) >= UFS_NDADDR) { \ + /* Skip over blocks that are not of interest */ \ + while (*blkp < (chkblk) && blkp < lastblkp) \ + blkp++; \ + /* Fail if end of list and not all blocks found */ \ + if (blkp >= lastblkp) { \ + pwarn("UFS%d snapshot inode %jd failed: " \ + "improper block list length (%jd)\n", \ + sblock.fs_magic == FS_UFS1_MAGIC ? 1 : 2, \ + (intmax_t)snapip->i_number, \ + (intmax_t)(lastblkp - &snapblklist[0])); \ + status = 0; \ + } \ + /* Fail if block we seek is missing */ \ + else if (*blkp++ != (chkblk)) { \ + pwarn("UFS%d snapshot inode %jd failed: " \ + "block list (%jd) != %s (%jd)\n", \ + sblock.fs_magic == FS_UFS1_MAGIC ? 1 : 2, \ + (intmax_t)snapip->i_number, \ + (intmax_t)blkp[-1], #chkblk, \ + (intmax_t)chkblk); \ + status = 0; \ + } \ + } + +static int +checksnapinfo(struct inode *snapip) +{ + struct fs *fs; + struct bufarea *bp; + struct inodesc idesc; + daddr_t *snapblklist, *blkp, *lastblkp, csblkno; + int cg, loc, len, status; + ufs_lbn_t lbn; + size_t size; + + fs = &sblock; + memset(&idesc, 0, sizeof(struct inodesc)); + idesc.id_type = ADDR; + idesc.id_func = getlbnblkno; + idesc.id_number = snapip->i_number; + lbn = howmany(fs->fs_size, fs->fs_frag); + idesc.id_parent = lbn; /* sought after blkno */ + if ((ckinode(snapip->i_dp, &idesc) & FOUND) == 0) + return (0); + size = fragroundup(fs, + DIP(snapip->i_dp, di_size) - lblktosize(fs, lbn)); + bp = getdatablk(idesc.id_parent, size, BT_DATA); + snapblklist = (daddr_t *)bp->b_un.b_buf; + /* + * snapblklist[0] is the size of the list + * snapblklist[1] is the first element of the list + * + * We need to be careful to bound the size of the list and verify + * that we have not run off the end of it if it or its size has + * been corrupted. + */ + blkp = &snapblklist[1]; + lastblkp = &snapblklist[MAX(0, + MIN(snapblklist[0] + 1, size / sizeof(daddr_t)))]; + status = 1; + /* Check that the superblock is listed. */ + CHKBLKINLIST(lblkno(fs, fs->fs_sblockloc)); + if (status == 0) + goto out; + /* + * Calculate where the summary information is located. + * Usually it is in the first cylinder group, but growfs + * may move it to the first cylinder group that it adds. + * + * Check all cylinder groups up to the summary information. + */ + csblkno = fragstoblks(fs, fs->fs_csaddr); + for (cg = 0; cg < fs->fs_ncg; cg++) { + if (fragstoblks(fs, cgtod(fs, cg)) > csblkno) + break; + CHKBLKINLIST(fragstoblks(fs, cgtod(fs, cg))); + if (status == 0) + goto out; + } + /* Check the summary information block(s). */ + len = howmany(fs->fs_cssize, fs->fs_bsize); + for (loc = 0; loc < len; loc++) { + CHKBLKINLIST(csblkno + loc); + if (status == 0) + goto out; + } + /* Check the remaining cylinder groups. */ + for (; cg < fs->fs_ncg; cg++) { + CHKBLKINLIST(fragstoblks(fs, cgtod(fs, cg))); + if (status == 0) + goto out; + } +out: + brelse(bp); + return (status); +} + +/* + * Return the block number associated with a specified inode lbn. + * Requested lbn is in id_parent. If found, block is returned in + * id_parent. + */ +static int +getlbnblkno(struct inodesc *idesc) +{ + + if (idesc->id_lbn < idesc->id_parent) + return (KEEPON); + idesc->id_parent = idesc->id_blkno; + return (STOP | FOUND); +} + /* * Open a device or file to be checked by fsck. */ diff --git a/sbin/fsck_ffs/suj.c b/sbin/fsck_ffs/suj.c index 4ad86b0dc14d7..b120bd3dd38c5 100644 --- a/sbin/fsck_ffs/suj.c +++ b/sbin/fsck_ffs/suj.c @@ -321,7 +321,7 @@ blk_freemask(ufs2_daddr_t blk, ino_t ino, ufs_lbn_t lbn, int frags) * To be certain we're not freeing a reallocated block we lookup * this block in the blk hash and see if there is an allocation * journal record that overlaps with any fragments in the block - * we're concerned with. If any fragments have ben reallocated + * we're concerned with. If any fragments have been reallocated * the block has already been freed and re-used for another purpose. */ mask = 0; @@ -378,6 +378,50 @@ blk_isindir(ufs2_daddr_t blk, ino_t ino, ufs_lbn_t lbn) return (0); } +/* + * Check to see if the requested block is available. + * We can just check in the cylinder-group maps as + * they will only have usable blocks in them. + */ +ufs2_daddr_t +suj_checkblkavail(blkno, frags) + ufs2_daddr_t blkno; + long frags; +{ + struct bufarea *cgbp; + struct cg *cgp; + ufs2_daddr_t j, k, baseblk; + long cg; + + cg = dtog(&sblock, blkno); + cgbp = cglookup(cg); + cgp = cgbp->b_un.b_cg; + if (!check_cgmagic(cg, cgbp, 0)) + return (-((cg + 1) * sblock.fs_fpg - sblock.fs_frag)); + baseblk = dtogd(&sblock, blkno); + for (j = 0; j <= sblock.fs_frag - frags; j++) { + if (!isset(cg_blksfree(cgp), baseblk + j)) + continue; + for (k = 1; k < frags; k++) + if (!isset(cg_blksfree(cgp), baseblk + j + k)) + break; + if (k < frags) { + j += k; + continue; + } + for (k = 0; k < frags; k++) + clrbit(cg_blksfree(cgp), baseblk + j + k); + n_blks += frags; + if (frags == sblock.fs_frag) + cgp->cg_cs.cs_nbfree--; + else + cgp->cg_cs.cs_nffree -= frags; + cgdirty(cgbp); + return ((cg * sblock.fs_fpg) + baseblk + j); + } + return (0); +} + /* * Clear an inode from the cg bitmap. If the inode was already clear return * 0 so the caller knows it does not have to check the inode contents. @@ -420,7 +464,7 @@ ino_free(ino_t ino, int mode) * set in the mask. */ static void -blk_free(ufs2_daddr_t bno, int mask, int frags) +blk_free(ino_t ino, ufs2_daddr_t bno, int mask, int frags) { ufs1_daddr_t fragno, cgbno; struct suj_cg *sc; @@ -431,6 +475,13 @@ blk_free(ufs2_daddr_t bno, int mask, int frags) if (debug) printf("Freeing %d frags at blk %jd mask 0x%x\n", frags, bno, mask); + /* + * Check to see if the block needs to be claimed by a snapshot. + * If wanted, the snapshot references it. Otherwise we free it. + */ + if (snapblkfree(fs, bno, lfragtosize(fs, frags), ino, + suj_checkblkavail)) + return; cg = dtog(fs, bno); sc = cg_lookup(cg); cgp = sc->sc_cgp; @@ -846,7 +897,7 @@ static void blk_free_visit(ino_t ino, ufs_lbn_t lbn, ufs2_daddr_t blk, int frags) { - blk_free(blk, blk_freemask(blk, ino, lbn, frags), frags); + blk_free(ino, blk, blk_freemask(blk, ino, lbn, frags), frags); } /* @@ -865,7 +916,7 @@ blk_free_lbn(ufs2_daddr_t blk, ino_t ino, ufs_lbn_t lbn, int frags, int follow) if (lbn <= -UFS_NDADDR && follow && mask == 0) indir_visit(ino, lbn, blk, &resid, blk_free_visit, VISIT_INDIR); else - blk_free(blk, mask, frags); + blk_free(ino, blk, mask, frags); } static void @@ -997,6 +1048,8 @@ ino_reclaim(struct inode *ip, ino_t ino, int mode) if ((DIP(dp, di_mode) & IFMT) == IFDIR) ino_visit(dp, ino, ino_free_children, 0); DIP_SET(dp, di_nlink, 0); + if ((DIP(dp, di_flags) & SF_SNAPSHOT) != 0) + snapremove(ino); ino_visit(dp, ino, blk_free_visit, VISIT_EXT | VISIT_INDIR); /* Here we have to clear the inode and release any blocks it holds. */ gen = DIP(dp, di_gen); @@ -1209,7 +1262,7 @@ indir_trunc(ino_t ino, ufs_lbn_t lbn, ufs2_daddr_t blk, ufs_lbn_t lastlbn, continue; } isdirty = 1; - blk_free(nblk, 0, fs->fs_frag); + blk_free(ino, nblk, 0, fs->fs_frag); IBLK_SET(bp, i, 0); } if (isdirty) @@ -1245,6 +1298,11 @@ ino_trunc(ino_t ino, off_t size) dp = ip.i_dp; mode = DIP(dp, di_mode) & IFMT; cursize = DIP(dp, di_size); + /* If no size change, nothing to do */ + if (size == cursize) { + irelse(&ip); + return; + } if (debug) printf("Truncating ino %ju, mode %o to size %jd from size %jd\n", (uintmax_t)ino, mode, size, cursize); @@ -1264,13 +1322,14 @@ ino_trunc(ino_t ino, off_t size) if (size > 0) err_suj("Partial truncation of ino %ju snapshot file\n", (uintmax_t)ino); + snapremove(ino); } lastlbn = lblkno(fs, blkroundup(fs, size)); for (i = lastlbn; i < UFS_NDADDR; i++) { if ((bn = DIP(dp, di_db[i])) == 0) continue; blksize = sblksize(fs, cursize, i); - blk_free(bn, 0, numfrags(fs, blksize)); + blk_free(ino, bn, 0, numfrags(fs, blksize)); DIP_SET(dp, di_db[i], 0); } /* @@ -1283,13 +1342,13 @@ ino_trunc(ino_t ino, off_t size) /* If we're not freeing any in this indirect range skip it. */ if (lastlbn >= nextlbn) continue; - if (DIP(dp, di_ib[i]) == 0) - continue; - indir_trunc(ino, -lbn - i, DIP(dp, di_ib[i]), lastlbn, dp); - /* If we freed everything in this indirect free the indir. */ - if (lastlbn > lbn) - continue; - blk_free(DIP(dp, di_ib[i]), 0, fs->fs_frag); + if ((bn = DIP(dp, di_ib[i])) == 0) + continue; + indir_trunc(ino, -lbn - i, bn, lastlbn, dp); + /* If we freed everything in this indirect free the indir. */ + if (lastlbn > lbn) + continue; + blk_free(ino, bn, 0, fs->fs_frag); DIP_SET(dp, di_ib[i], 0); } /* @@ -1319,7 +1378,7 @@ ino_trunc(ino_t ino, off_t size) if (oldspace != newspace) { bn += numfrags(fs, newspace); frags = numfrags(fs, oldspace - newspace); - blk_free(bn, 0, frags); + blk_free(ino, bn, 0, frags); totalfrags -= frags; } } @@ -1468,7 +1527,7 @@ blk_check(struct suj_blk *sblk) mask >>= frags; blk += frags; frags = brec->jb_frags - frags; - blk_free(blk, mask, frags); + blk_free(brec->jb_ino, blk, mask, frags); continue; } /* @@ -2406,6 +2465,13 @@ suj_check(const char *filesys) } if (preen == 0 && (jrecs > 0 || jbytes > 0) && reply("WRITE CHANGES") == 0) return (0); + /* + * Check block counts of snapshot inodes and + * make copies of any needed snapshot blocks. + */ + for (i = 0; i < snapcnt; i++) + check_blkcnt(&snaplist[i]); + snapflush(suj_checkblkavail); /* * Recompute the fs summary info from correct cs summaries. */ diff --git a/sys/ufs/ffs/ffs_snapshot.c b/sys/ufs/ffs/ffs_snapshot.c index bcdf94a10cda4..7ee5dd2bfa43a 100644 --- a/sys/ufs/ffs/ffs_snapshot.c +++ b/sys/ufs/ffs/ffs_snapshot.c @@ -226,15 +226,6 @@ ffs_snapshot(struct mount *mp, char *snapfile) ump = VFSTOUFS(mp); fs = ump->um_fs; sn = NULL; - /* - * At the moment, journaled soft updates cannot support - * taking snapshots. - */ - if (MOUNTEDSUJ(mp)) { - vfs_mount_error(mp, "%s: Snapshots are not yet supported when " - "running with journaled soft updates", fs->fs_fsmnt); - return (EOPNOTSUPP); - } MNT_ILOCK(mp); flag = mp->mnt_flag; MNT_IUNLOCK(mp); -- Test scenario: misc/force11.sh