VOP_FSYNC: 0xfffffe010e309258 is not locked but should be, vmcore.434 KDB: enter: lock violation KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2021 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 14.0-CURRENT #0 ufs-n250403-0c9b07a154e: Tue Nov 2 12:33:36 CET 2021 pho@mercat1.netperf.freebsd.org:/var/tmp/deviant3/sys/amd64/compile/PHO amd64 FreeBSD clang version 12.0.1 (git@github.com:llvm/llvm-project.git llvmorg-12.0.1-0-gfed41342a82f) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33174499328 (31637 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 7 8 2 5 10 6 11 4 9 3 Timecounter "TSC-low" frequency 1750037490 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 vtvga0: smbios0: at iomem 0xf0560-0xf057e smbios0: Version: 2.8, BCD Revision: 2.7 aesni0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 apei0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: EEPROM V1.63-0 eTrack 0x800009fa igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: EEPROM V1.63-0 eTrack 0x800009fa igb1: Using 1024 TX descriptors and 1024 RX descriptors igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec Expensive timeout(9) function: 0xffffffff80513500(0xfffffe0109f91000) 0.005045729 s ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ses0: (none) in 'Slot 01', SATA Slot: scbus1 target 0 ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> Expensive timeout(9) function: 0xffffffff80a7c1d0(0xffffffff81aea288) 0.007408046 s mlx5_core0: mem 0xf8000000-0xf9ffffff irq 32 at device 0.0 on pci3 mlx5: Mellanox Core driver 3.7.0 (July 2021)ugen2.1: at usbus2 ugen0.1: <0x8086 XHCI root HUB> at usbus0 ugen1.1: at usbus1 uhub0 on usbus2 uhub0: on usbus2 uhub1 on usbus0 uhub1: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 uhub2 on usbus1 uhub2: on usbus1 mlx5_core0: WARN: mlx5_vsc_set_space:124:(pid 0): Space 0x7 is not supported. mlx5_core0: WARN: mlx5_fwdump_prep:99:(pid 0): VSC scan space is not supported mlx5_core0: INFO: init_one:1614:(pid 0): cannot find SR-IOV PCIe cap mlx5_core: INFO: (mlx5_core0): E-Switch: Total vports 1, l2 table size(65536), per vport: max uc(1024) max mc(16384) mlx5_core0: Failed to initialize SR-IOV support, error 2 mlx5_core1: mem 0xf6000000-0xf7ffffff irq 32 at device 0.1 on pci3 ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 275 files, 4054 used, 1261353 free (113 frags, 157655 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc10 /usr/local/lib/gcc8 /usr/local/lib/gcc9 /usr/local/lib/perl5/5.32/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: mercat1.netperf.freebsd.org. Setting up harvesting: PURE_RDRAND,[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . Autoloading module: acpi_wmi.ko Autoloading module: ichsmb.ko Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 ichsmb0: port 0x580-0x59f mem 0xfb431000-0xfb4310ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device lo0: link state changed to UP Autoloading module: acpi_wmi.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: ichsmb.ko Starting Network: mce0. mce0: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce1. mce1: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko Autoloading module: usbhid.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff800040d0800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Recovering vi editor sessions:. Updating motd:. Clearing /tmp (X related). Starting syslogd. Starting watchdogd. No core dumps found. Setting date via ntp. 3 Nov 11:41:48 ntpdate[2602]: step time server 192.168.5.1 offset -0.412450 sec Starting rpcbind. NFS access cache time=60 Starting statd. Starting lockd. Starting powerd. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Mounting late filesystems:. Starting inetd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. sysctl: unknown oid 'debug.fail_point.pmap_allocpte_page_alloc' at line 12 Wed Nov 3 11:41 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: Nov 3 11:41:57 mercat1 su[2754]: pho to root on /dev/pts/0 20211103 11:42:45 all (1/152): suj23.sh 20211103 11:47:29 all (2/152): mlockall6.sh Expensive timeout(9) function: 0xffffffff80a28cb0(0xfffffe010a18f428) 0.064597822 s 20211103 11:57:38 all (3/152): maxvnodes.sh Nov 3 12:06:39 mercat1 kernel: pid 72838 (swap), jid 0, uid 2007, was killed: out of swap space 20211103 12:08:02 all (4/152): tmpfs.sh 20211103 12:18:29 all (5/152): datamove2.sh Nov 3 12:19:29 mercat1 kernel: pid 97073 (swap), jid 0, uid 0, was killed: out of swap space Nov 3 12:25:49 mercat1 kernel: pid 99899 (swap), jid 0, uid 0, was killed: out of swap space Nov 3 12:26:49 mercat1 kernel: pid 99861 (swap), jid 0, uid 0, was killed: out of swap space Nov 3 12:28:06 mercat1 kernel: pid 99930 (swap), jid 0, uid 0, was killed: out of swap space 20211103 12:28:55 all (6/152): nullfs27.sh Nov 3 12:29:08 mercat1 kernel: pid 2328 (rw), uid 2007 inumber 5197 on /mnt: filesystem full Nov 3 12:30:18 mercat1 kernel: pid 2417 (creat), uid 2007 inumber 131105 on /mnt: out of inodes 20211103 12:39:22 all (7/152): md3.sh Nov 3 12:45:16 mercat1 kernel: pid 27221 (creat), uid 0 inumber 134417 on /mnt: out of inodes Nov 3 12:47:54 mercat1 kernel: pid 31834 (rw), uid 0 inumber 57106 on /mnt: filesystem full Nov 3 12:47:59 mercat1 kernel: pid 31899 (rw), uid 0 inumber 119370 on /mnt: filesystem full 20211103 12:49:52 all (8/152): overcommit.sh uid 2007, pid 48772: swap reservation for 1342181376 bytes failed uid 2007, pid 55405: swap reservation for 2147483648 bytes failed uid 2007, pid 55400: swap reservation for 1879052288 bytes failed uid 2007, pid 58467: swap reservation for 1073741824 bytes failed uid 2007, pid 58460: swap reservation for 939528192 bytes failed 20211103 13:00:13 all (9/152): snap6.sh lock order reversal: 1st 0xfffffe0039d1ee90 bufwait (bufwait, lockmgr) @ ufs/ffs/ffs_vnops.c:318 2nd 0xfffff80135ffb430 snaplk (snaplk, lockmgr) @ ufs/ffs/ffs_snapshot.c:2359 lock order snaplk -> bufwait established at: #0 0xffffffff80c9f959 at witness_checkorder+0x459 #1 0xffffffff80bfd93c at lockmgr_xlock_hard+0x6c #2 0xffffffff80bfe27e at __lockmgr_args+0x1fe #3 0xffffffff80cf6344 at getnewbuf+0x344 #4 0xffffffff80cf3849 at getblkx+0x639 #5 0xffffffff80cf5fe2 at getblk+0x22 #6 0xffffffff80f3ddb8 at indiracct_ufs2+0xa8 #7 0xffffffff80f3a9c3 at expunge_ufs2+0x393 #8 0xffffffff80f397b9 at ffs_snapshot+0x1e89 #9 0xffffffff80f5edfc at ffs_mount+0x61c #10 0xffffffff80d15c39 at vfs_domount+0x7b9 #11 0xffffffff80d13f6b at vfs_donmount+0x81b #12 0xffffffff80d13719 at sys_nmount+0x69 #13 0xffffffff811009a7 at amd64_syscall+0x147 #14 0xffffffff810d0b6b at fast_syscall_common+0xf8 lock order bufwait -> snaplk attempted at: #0 0xffffffff80ca028f at witness_checkorder+0xd8f #1 0xffffffff80bfd93c at lockmgr_xlock_hard+0x6c #2 0xffffffff80bfe27e at __lockmgr_args+0x1fe #3 0xffffffff80f3d3e3 at ffs_copyonwrite+0x1a3 #4 0xffffffff80f61816 at ffs_geom_strategy+0xd6 #5 0xffffffff80f779a3 at ufs_strategy+0x83 #6 0xffffffff811ca2f1 at VOP_STRATEGY_APV+0x61 #7 0xffffffff80cf171e at bufstrategy+0x3e #8 0xffffffff80cf15bc at bufwrite+0x24c #9 0xffffffff80f63de4 at ffs_syncvnode+0x384 #10 0xffffffff80f6284e at ffs_fsync+0x1e #11 0xffffffff811c8a59 at VOP_FSYNC_APV+0x59 #12 0xffffffff80f75364 at ufs_remove+0x114 #13 0xffffffff811c8c15 at VOP_REMOVE_APV+0x85 #14 0xffffffff80d30b9a at kern_funlinkat+0x35a #15 0xffffffff80d30838 at sys_unlink+0x28 #16 0xffffffff811009a7 at amd64_syscall+0x147 #17 0xffffffff810d0b6b at fast_syscall_common+0xf8 lock order reversal: 1st 0xfffff80135ffb430 snaplk (snaplk, lockmgr) @ ufs/ufs/ufs_vnops.c:1037 2nd 0xfffffe0146acd0d8 ufs (ufs, lockmgr) @ ufs/ffs/ffs_snapshot.c:1671 lock order ufs -> snaplk established at: #0 0xffffffff80c9f959 at witness_checkorder+0x459 #1 0xffffffff80bfd15c at lockmgr_lock_flags+0x7c #2 0xffffffff80f629ad at ffs_lock+0x9d #3 0xffffffff811c9e7c at VOP_LOCK1_APV+0x3c #4 0xffffffff80d38e84 at _vn_lock+0x54 #5 0xffffffff80d207ea at vget_finish+0x7a #6 0xffffffff80d0eca1 at vfs_hash_get+0xd1 #7 0xffffffff80f5dd38 at ffs_vgetf+0x58 #8 0xffffffff80f6cf4d at ufs_lookup_ino+0xedd #9 0xffffffff811c683a at VOP_CACHEDLOOKUP_APV+0x5a #10 0xffffffff80cffd36 at vfs_cache_lookup+0xa6 #11 0xffffffff811c667a at VOP_LOOKUP_APV+0x5a #12 0xffffffff80d117d1 at lookup+0x4d1 #13 0xffffffff80d1063f at namei+0x3df #14 0xffffffff80d38493 at vn_open_cred+0x4b3 #15 0xffffffff80d2f175 at kern_openat+0x285 #16 0xffffffff811009a7 at amd64_syscall+0x147 #17 0xffffffff810d0b6b at fast_syscall_common+0xf8 lock order snaplk -> ufs attempted at: #0 0xffffffff80ca028f at witness_checkorder+0xd8f #1 0xffffffff80bfd93c at lockmgr_xlock_hard+0x6c #2 0xffffffff80bfe27e at __lockmgr_args+0x1fe #3 0xffffffff80f3b913 at ffs_snapremove+0x113 #4 0xffffffff80f35e74 at ffs_truncate+0x254 #5 0xffffffff80f6bd9a at ufs_inactive+0x1aa #6 0xffffffff811c9a09 at VOP_INACTIVE_APV+0x59 #7 0xffffffff80d21a5a at vinactivef+0xda #8 0xffffffff80d210fe at vput_final+0x2fe #9 0xffffffff80d30ab5 at kern_funlinkat+0x275 #10 0xffffffff80d30838 at sys_unlink+0x28 #11 0xffffffff811009a7 at amd64_syscall+0x147 #12 0xffffffff810d0b6b at fast_syscall_common+0xf8 20211103 13:10:53 all (10/152): ext2fs.sh lock order reversal: 1st 0xffffffff81e9d310 GEOM topology (GEOM topology, sx) @ /var/tmp/deviant3/sys/fs/ext2fs/ext2_vfsops.c:1036 2nd 0xfffffe014e0470d8 devfs (devfs, lockmgr) @ geom/geom_vfs.c:312 lock order devfs -> GEOM topology established at: #0 0xffffffff80c9f959 at witness_checkorder+0x459 #1 0xffffffff80c39217 at _sx_xlock+0x67 #2 0xffffffff80f7ca5b at sys_swapon+0x18b #3 0xffffffff811009a7 at amd64_syscall+0x147 #4 0xffffffff810d0b6b at fast_syscall_common+0xf8 lock order GEOM topology -> devfs attempted at: #0 0xffffffff80ca028f at witness_checkorder+0xd8f #1 0xffffffff80bfed45 at lockmgr_xlock+0x55 #2 0xffffffff811c9e7c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d38e84 at _vn_lock+0x54 #4 0xffffffff80b6f1a6 at g_vfs_close+0x56 #5 0xffffffff8276123b at ext2_unmount+0xbb #6 0xffffffff80d178b9 at dounmount+0x8b9 #7 0xffffffff80d16fb7 at kern_unmount+0x2d7 #8 0xffffffff811009a7 at amd64_syscall+0x147 #9 0xffffffff810d0b6b at fast_syscall_common+0xf8 20211103 13:21:22 all (11/152): nullfs26.sh 20211103 13:31:44 all (12/152): sendfile14.sh 20211103 13:42:14 all (13/152): union.sh Nov 3 13:51:07 mercat1 kernel: pid 64185 (swap), jid 0, uid 0, was killed: out of swap space 20211103 13:52:30 all (14/152): dangling.sh 20211103 14:02:57 all (15/152): tmpfs20.sh 20211103 14:13:27 all (16/152): full.sh Nov 3 14:13:40 mercat1 kernel: pid 44533 (rw), uid 2007 inumber 112094 on /mnt: filesystem full Nov 3 14:20:07 mercat1 kernel: pid 52879 (mmap), uid 2007 inumber 197444 on /mnt: filesystem full 20211103 14:23:58 all (17/152): snap5-1.sh 20211103 14:34:19 all (18/152): nullfs5.sh Nov 3 14:44:34 mercat1 kernel: pid 70853 (swap), jid 0, uid 0, was killed: out of swap space stress2: newblk leak: 16390/16394. stress2: mount leak: 13/44 20211103 14:44:41 all (19/152): tmpfs3.sh 20211103 14:54:55 all (20/152): md7.sh Nov 3 14:55:08 mercat1 kernel: pid 33995 (rw), uid 0 inumber 119623 on /mnt: filesystem full 20211103 15:05:21 all (21/152): rename15.sh 20211103 15:17:07 all (22/152): badcode.sh 20211103 15:27:51 all (23/152): graid1.sh Nov 3 15:28:01 mercat1 kernel: pid 2597 (link), uid 2007 inumber 65541 on /mnt: filesystem full Nov 3 15:31:10 mercat1 kernel: pid 10564 (swap), jid 0, uid 2007, was killed: out of swap space Nov 3 15:33:45 mercat1 kernel: pid 11848 (rw), uid 2007 inumber 116779 on /mnt: filesystem full Nov 3 15:33:45 mercat1 kernel: pid 11933 (swap), jid 0, uid 2007, was killed: out of swap space 20211103 15:38:46 all (24/152): oovm2.sh 20211103 15:49:26 all (25/152): pts.sh stress2: pts leak: 135/136 20211103 16:00:17 all (26/152): nullfs20.sh Nov 3 16:08:11 mercat1 kernel: pid 51438 (swap), jid 0, uid 2007, was killed: out of swap space 20211103 16:10:51 all (27/152): msdos4.sh Nov 3 16:17:48 mercat1 kernel: pid 63557 (swap), jid 0, uid 0, was killed: out of swap space 20211103 16:21:32 all (28/152): extattr2.sh 20211103 16:32:09 all (29/152): sysctl3.sh Nov 3 16:33:37 mercat1 kernel: pid 20182 (swap), jid 0, uid 2007, was killed: out of swap space stress2: freework leak: 233/238. stress2: newblk leak: 98214/98219. 20211103 16:43:04 all (30/152): zfs9.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Nov 3 16:46:06 mercat1 kernel: pid 31239 (swap), jid 0, uid 0, was killed: out of swap space 20211103 16:53:50 all (31/152): rw.sh Nov 3 16:54:41 mercat1 kernel: pid 42755 (swap), jid 0, uid 2007, was killed: out of swap space Nov 3 16:54:52 mercat1 kernel: pid 42749 (swap), jid 0, uid 2007, was killed: out of swap space Nov 3 17:03:03 mercat1 kernel: pid 47681 (swap), jid 0, uid 2007, was killed: out of swap space Nov 3 17:03:33 mercat1 kernel: pid 47680 (swap), jid 0, uid 2007, was killed: out of swap space Nov 3 17:04:16 mercat1 kernel: pid 47658 (swap), jid 0, uid 2007, was killed: out of swap space 20211103 17:04:37 all (32/152): badcode2.sh Nov 3 17:05:30 mercat1 kernel: pid 49013 (swap), jid 0, uid 2007, was killed: out of swap space Nov 3 17:13:30 mercat1 kernel: pid 56080 (swap), jid 0, uid 2007, was killed: out of swap space 20211103 17:16:06 all (33/152): marcus7.sh witness_lock_list_get: witness exhausted 20211103 17:26:42 all (34/152): fdgrowtable.sh Nov 3 17:32:10 mercat1 kernel: pid 1809 (swap), jid 0, uid 0, was killed: out of swap space Nov 3 17:32:51 mercat1 kernel: pid 1793 (swap), jid 0, uid 0, was killed: out of swap space Nov 3 17:33:02 mercat1 kernel: pid 1785 (swap), jid 0, uid 0, was killed: out of swap space Nov 3 17:34:55 mercat1 kernel: pid 3315 (swap), jid 0, uid 0, was killed: out of swap space 20211103 17:37:49 all (35/152): graid0.sh GEOM_STRIPE: Device data created (id=515308260). GEOM_STRIPE: Disk md10 attached to data. GEOM_STRIPE: Disk md11 attached to data. GEOM_STRIPE: Disk md12 attached to data. GEOM_STRIPE: Device stripe/data activated. GEOM_STRIPE: Cannot add disk ufsid/6182badf7f5d8288 to data (error=17). Nov 3 17:38:02 mercat1 kernel: pid 6356 (rw), uid 2007 inumber 107567 on /mnt: filesystem full Nov 3 17:39:22 mercat1 kernel: pid 6298 (rw), uid 2007 inumber 118324 on /mnt: filesystem full Nov 3 17:47:45 mercat1 kernel: pid 15188 (rw), uid 2007 inumber 22787 on /mnt: filesystem full GEOM_STRIPE: Cannot add disk ufsid/6182badf7f5d8288 to data (error=17). GEOM_STRIPE: Disk md12 removed from data. GEOM_STRIPE: Device stripe/data deactivated. GEOM_STRIPE: Disk md11 removed from data. GEOM_STRIPE: Disk md10 removed from data. GEOM_STRIPE: Device data destroyed. 20211103 17:48:22 all (36/152): pfl4.sh Nov 3 17:49:31 mercat1 kernel: pid 21128 (swap), jid 0, uid 2007, was killed: out of swap space 20211103 17:59:38 all (37/152): oovm.sh 20211103 18:10:51 all (38/152): zfs5.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) 20211103 18:21:28 all (39/152): zfs3.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) 20211103 18:33:30 all (40/152): zfs4.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Nov 3 18:42:51 mercat1 sshd[31090]: error: PAM: Authentication error for pho from 192.168.5.1 Nov 3 18:42:56 mercat1 su[32481]: pho to root on /dev/pts/134 stress2: pts leak: 1/137 20211103 18:44:00 all (41/152): nullfs2.sh Nov 3 18:44:49 mercat1 kernel: pid 41231 (swap), jid 0, uid 0, was killed: out of swap space stress2: freework leak: 102/137. stress2: newblk leak: 106/109. 20211103 18:55:49 all (42/152): graid1_4.sh UFS: forcibly unmounting /dev/mirror/test from /mnt 20211103 19:07:11 all (43/152): cluster.sh stress2: newblk leak: 46536/46539. 20211103 19:19:43 all (44/152): readdir.sh 20211103 19:31:46 all (45/152): suj34.sh Nov 3 19:39:10 mercat1 kernel: pid 99785 (swap), jid 0, uid 0, was killed: out of swap space stress2: GEOM leak: 29/103 20211103 19:43:26 all (46/152): pfl2.sh Nov 3 19:44:13 mercat1 kernel: pid 10575 (swap), jid 0, uid 2007, was killed: out of swap space Nov 3 19:50:53 mercat1 kernel: pid 15518 (swap), jid 0, uid 2007, was killed: out of swap space Nov 3 19:53:49 mercat1 kernel: pid 16488 (swap), jid 0, uid 2007, was killed: out of swap space 20211103 19:54:20 all (47/152): suj9.sh Nov 3 19:54:24 mercat1 kernel: pid 18705 (creat), uid 2007 inumber 12293 on /mnt: out of inodes Nov 3 19:55:14 mercat1 kernel: pid 18774 (symlink), uid 2007 inumber 8 on /mnt: out of inodes Nov 3 19:56:04 mercat1 kernel: pid 18766 (openat), uid 2007 inumber 12319 on /mnt: out of inodes Nov 3 19:58:38 mercat1 kernel: pid 23260 (openat), uid 2007 inumber 12329 on /mnt: out of inodes Nov 3 19:58:51 mercat1 kernel: pid 23306 (creat), uid 2007 inumber 12378 on /mnt: out of inodes Nov 3 19:58:59 mercat1 kernel: pid 23267 (openat), uid 2007 inumber 12340 on /mnt: out of inodes Nov 3 19:59:12 mercat1 kernel: pid 23247 (link), uid 2007 inumber 12424 on /mnt: out of inodes Nov 3 19:59:14 mercat1 kernel: pid 23205 (swap), jid 0, uid 2007, was killed: out of swap space Nov 3 19:59:17 mercat1 kernel: pid 23274 (creat), uid 2007 inumber 12346 on /mnt: out of inodes Nov 3 19:59:27 mercat1 kernel: pid 23183 (mkdir), uid 2007 inumber 12539 on /mnt: out of inodes Nov 3 19:59:30 mercat1 kernel: pid 23261 (creat), uid 2007 inumber 12426 on /mnt: out of inodes Nov 3 19:59:39 mercat1 kernel: pid 23217 (link), uid 2007 inumber 12433 on /mnt: out of inodes Nov 3 19:59:45 mercat1 kernel: pid 23252 (creat), uid 2007 inumber 12325 on /mnt: out of inodes Nov 3 19:59:49 mercat1 kernel: pid 23301 (creat), uid 2007 inumber 12374 on /mnt: out of inodes Nov 3 19:59:53 mercat1 kernel: pid 23291 (creat), uid 2007 inumber 12358 on /mnt: out of inodes Nov 3 19:59:57 mercat1 kernel: pid 23287 (creat), uid 2007 inumber 12357 on /mnt: out of inodes Nov 3 20:00:08 mercat1 syslogd: last message repeated 1 times Nov 3 20:00:13 mercat1 kernel: pid 23274 (creat), uid 2007 inumber 12346 on /mnt: out of inodes Nov 3 20:00:19 mercat1 kernel: pid 23209 (link), uid 2007 inumber 12421 on /mnt: out of inodes Nov 3 20:00:29 mercat1 kernel: pid 23252 (creat), uid 2007 inumber 12325 on /mnt: out of inodes 20211103 20:06:53 all (48/152): tar.sh stress2: freework leak: 209931/209937. stress2: newblk leak: 12777/12781. 20211103 20:12:55 all (49/152): altbufferflushes.sh KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0152526af0 assert_vop_locked() at assert_vop_locked+0x55/frame 0xfffffe0152526b20 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x42/frame 0xfffffe0152526b40 ffs_bdflush() at ffs_bdflush+0x156/frame 0xfffffe0152526bb0 bdwrite() at bdwrite+0x83/frame 0xfffffe0152526c20 ffs_update() at ffs_update+0x355/frame 0xfffffe0152526c80 ufs_inactive() at ufs_inactive+0x260/frame 0xfffffe0152526cc0 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x59/frame 0xfffffe0152526ce0 vinactivef() at vinactivef+0xda/frame 0xfffffe0152526d20 vput_final() at vput_final+0x2fe/frame 0xfffffe0152526d80 exit1() at exit1+0x579/frame 0xfffffe0152526df0 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe0152526e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0152526f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0152526f30 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8011ad91a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe5c0 --- vnode 0xfffffe010e309258: type VCHR usecount 1, writecount 0, refcount 2485 seqc users 0 rdev 0xfffff8001c74f800 hold count flags () flags (VV_COPYONWRITE) v_object 0xfffff800031cec60 ref 0 pages 31841 cleanbuf 2462 dirtybuf 21 lock type mntfs: UNLOCKED #0 0xffffffff80bfd2c7 at lockmgr_lock_flags+0x1e7 #1 0xffffffff811c9e7c at VOP_LOCK1_APV+0x3c #2 0xffffffff80d38e84 at _vn_lock+0x54 #3 0xffffffff80f60bd0 at ffs_sync+0x2a0 #4 0xffffffff80d3aae5 at vfs_write_suspend+0x165 #5 0xffffffff80f38689 at ffs_snapshot+0xd59 #6 0xffffffff80f5edfc at ffs_mount+0x61c #7 0xffffffff80d15c39 at vfs_domount+0x7b9 #8 0xffffffff80d13f6b at vfs_donmount+0x81b #9 0xffffffff80d13719 at sys_nmount+0x69 #10 0xffffffff811009a7 at amd64_syscall+0x147 #11 0xffffffff810d0b6b at fast_syscall_common+0xf8 VOP_FSYNC: 0xfffffe010e309258 is not locked but should be KDB: enter: lock violation [ thread pid 73299 tid 102488 ] Stopped at kdb_enter+0x37: movq $0,0x126e1ee(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 2727 out of 32624 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 73299 tid 102488 td 0xfffffe0143fc2740 kdb_enter() at kdb_enter+0x37/frame 0xfffffe0152526af0 assert_vop_locked() at assert_vop_locked+0xaf/frame 0xfffffe0152526b20 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x42/frame 0xfffffe0152526b40 ffs_bdflush() at ffs_bdflush+0x156/frame 0xfffffe0152526bb0 bdwrite() at bdwrite+0x83/frame 0xfffffe0152526c20 ffs_update() at ffs_update+0x355/frame 0xfffffe0152526c80 ufs_inactive() at ufs_inactive+0x260/frame 0xfffffe0152526cc0 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x59/frame 0xfffffe0152526ce0 vinactivef() at vinactivef+0xda/frame 0xfffffe0152526d20 vput_final() at vput_final+0x2fe/frame 0xfffffe0152526d80 exit1() at exit1+0x579/frame 0xfffffe0152526df0 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe0152526e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0152526f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0152526f30 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8011ad91a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe5c0 --- db:1:pho1> show allpcpu Current CPU: 5 cpuid = 0 dynamic pcpu = 0x9b8a00 curthread = 0xfffffe00e4c603a0: pid 11 tid 100003 critnest 1 "idle: cpu0" curpcb = 0xfffffe00e4c608b0 fpcurthread = none idlethread = 0xfffffe00e4c603a0: tid 100003 "idle: cpu0" self = 0xffffffff82610000 curpmap = 0xffffffff81e9e698 tssp = 0xffffffff82610384 rsp0 = 0xfffffe00377f1000 kcr3 = 0x800000000255a002 ucr3 = 0xffffffffffffffff scr3 = 0x6b56b9e3f gs32p = 0xffffffff82610404 ldt = 0xffffffff82610444 tss = 0xffffffff82610434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bb287a00 curthread = 0xfffffe00e4c5fc80: pid 11 tid 100004 critnest 1 "idle: cpu1" curpcb = 0xfffffe00e4c60190 fpcurthread = none idlethread = 0xfffffe00e4c5fc80: tid 100004 "idle: cpu1" self = 0xffffffff82611000 curpmap = 0xffffffff81e9e698 tssp = 0xffffffff82611384 rsp0 = 0xfffffe00377ec000 kcr3 = 0x800000000255a002 ucr3 = 0xffffffffffffffff scr3 = 0x51354187f gs32p = 0xffffffff82611404 ldt = 0xffffffff82611444 tss = 0xffffffff82611434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bb294a00 curthread = 0xfffffe00e4c5f560: pid 11 tid 100005 critnest 0 "idle: cpu2" curpcb = 0xfffffe00e4c5fa70 fpcurthread = none idlethread = 0xfffffe00e4c5f560: tid 100005 "idle: cpu2" self = 0xffffffff82612000 curpmap = 0xffffffff81e9e698 tssp = 0xffffffff82612384 rsp0 = 0xfffffe00377fb000 kcr3 = 0x800000000255a002 ucr3 = 0xffffffffffffffff scr3 = 0x6aa809cc gs32p = 0xffffffff82612404 ldt = 0xffffffff82612444 tss = 0xffffffff82612434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bb2a1a00 curthread = 0xfffffe00e4c5ee40: pid 11 tid 100006 critnest 1 "idle: cpu3" curpcb = 0xfffffe00e4c5f350 fpcurthread = none idlethread = 0xfffffe00e4c5ee40: tid 100006 "idle: cpu3" self = 0xffffffff82613000 curpmap = 0xffffffff81e9e698 tssp = 0xffffffff82613384 rsp0 = 0xfffffe00377f6000 kcr3 = 0x800000000255a002 ucr3 = 0xffffffffffffffff scr3 = 0x4cdee2be2 gs32p = 0xffffffff82613404 ldt = 0xffffffff82613444 tss = 0xffffffff82613434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bb2aea00 curthread = 0xfffffe00e4c5e720: pid 11 tid 100007 critnest 1 "idle: cpu4" curpcb = 0xfffffe00e4c5ec30 fpcurthread = none idlethread = 0xfffffe00e4c5e720: tid 100007 "idle: cpu4" self = 0xffffffff82614000 curpmap = 0xffffffff81e9e698 tssp = 0xffffffff82614384 rsp0 = 0xfffffe00e4831000 kcr3 = 0x800000000255a002 ucr3 = 0xffffffffffffffff scr3 = 0x196001bb7 gs32p = 0xffffffff82614404 ldt = 0xffffffff82614444 tss = 0xffffffff82614434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bb2bba00 curthread = 0xfffffe0143fc2740: pid 73299 tid 102488 critnest 0 "sed" curpcb = 0xfffffe0143fc2c50 fpcurthread = 0xfffffe0143fc2740: pid 73299 "sed" idlethread = 0xfffffe00e4c5e000: tid 100008 "idle: cpu5" self = 0xffffffff82615000 curpmap = 0xffffffff81e9e698 tssp = 0xffffffff82615384 rsp0 = 0xfffffe0152527000 kcr3 = 0x800000000255a002 ucr3 = 0xffffffffffffffff scr3 = 0x47b80daf1 gs32p = 0xffffffff82615404 ldt = 0xffffffff82615444 tss = 0xffffffff82615434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bb2c8a00 curthread = 0xfffffe00e4c66c80: pid 11 tid 100009 critnest 1 "idle: cpu6" curpcb = 0xfffffe00e4c67190 fpcurthread = none idlethread = 0xfffffe00e4c66c80: tid 100009 "idle: cpu6" self = 0xffffffff82616000 curpmap = 0xffffffff81e9e698 tssp = 0xffffffff82616384 rsp0 = 0xfffffe00e483b000 kcr3 = 0x800000000255a002 ucr3 = 0xffffffffffffffff scr3 = 0x14d7ffa1c gs32p = 0xffffffff82616404 ldt = 0xffffffff82616444 tss = 0xffffffff82616434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bb2d5a00 curthread = 0xfffffe00e4c66560: pid 11 tid 100010 critnest 1 "idle: cpu7" curpcb = 0xfffffe00e4c66a70 fpcurthread = none idlethread = 0xfffffe00e4c66560: tid 100010 "idle: cpu7" self = 0xffffffff82617000 curpmap = 0xffffffff81e9e698 tssp = 0xffffffff82617384 rsp0 = 0xfffffe00e4836000 kcr3 = 0x800000000255a002 ucr3 = 0xffffffffffffffff scr3 = 0x4cdee290f gs32p = 0xffffffff82617404 ldt = 0xffffffff82617444 tss = 0xffffffff82617434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bb2e2a00 curthread = 0xfffffe00e4c65e40: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffffe00e4c66350 fpcurthread = none idlethread = 0xfffffe00e4c65e40: tid 100011 "idle: cpu8" self = 0xffffffff82618000 curpmap = 0xffffffff81e9e698 tssp = 0xffffffff82618384 rsp0 = 0xfffffe00e4845000 kcr3 = 0x800000000255a002 ucr3 = 0xffffffffffffffff scr3 = 0x1a9f73d38 gs32p = 0xffffffff82618404 ldt = 0xffffffff82618444 tss = 0xffffffff82618434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bb2efa00 curthread = 0xfffffe00e4c65720: pid 11 tid 100012 critnest 1 "idle: cpu9" curpcb = 0xfffffe00e4c65c30 fpcurthread = none idlethread = 0xfffffe00e4c65720: tid 100012 "idle: cpu9" self = 0xffffffff82619000 curpmap = 0xffffffff81e9e698 tssp = 0xffffffff82619384 rsp0 = 0xfffffe00e4840000 kcr3 = 0x800000000255a002 ucr3 = 0xffffffffffffffff scr3 = 0x51354ff87 gs32p = 0xffffffff82619404 ldt = 0xffffffff82619444 tss = 0xffffffff82619434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bb2fca00 curthread = 0xfffffe00e4c65000: pid 11 tid 100013 critnest 0 "idle: cpu10" curpcb = 0xfffffe00e4c65510 fpcurthread = none idlethread = 0xfffffe00e4c65000: tid 100013 "idle: cpu10" self = 0xffffffff8261a000 curpmap = 0xffffffff81e9e698 tssp = 0xffffffff8261a384 rsp0 = 0xfffffe00e484f000 kcr3 = 0x800000000255a002 ucr3 = 0xffffffffffffffff scr3 = 0x1cf69994b gs32p = 0xffffffff8261a404 ldt = 0xffffffff8261a444 tss = 0xffffffff8261a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bb309a00 curthread = 0xfffffe00e4c62740: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffffe00e4c62c50 fpcurthread = none idlethread = 0xfffffe00e4c62740: tid 100014 "idle: cpu11" self = 0xffffffff8261b000 curpmap = 0xffffffff81e9e698 tssp = 0xffffffff8261b384 rsp0 = 0xfffffe00e484a000 kcr3 = 0x800000000255a002 ucr3 = 0xffffffffffffffff scr3 = 0x1cf685808 gs32p = 0xffffffff8261b404 ldt = 0xffffffff8261b444 tss = 0xffffffff8261b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffffe0143f29518: type VREG usecount 1, writecount 1, refcount 3 seqc users 0 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff8004b298e70 ref 0 pages 3 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe010ebfbe40 (pid 2582, syslogd, tid 100257) #0 0xffffffff80bfd2c7 at lockmgr_lock_flags+0x1e7 #1 0xffffffff80f629ad at ffs_lock+0x9d #2 0xffffffff811c9e7c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d38e84 at _vn_lock+0x54 #4 0xffffffff80d345fa at kern_fsync+0xfa #5 0xffffffff811009a7 at amd64_syscall+0x147 #6 0xffffffff810d0b6b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=140901, extsize 0 generation=6839101, uid=0, gid=0, flags=0x0 ino 90930059, on dev gpt/work vnode 0xfffffe01468319c8: type VREG usecount 0, writecount 0, refcount 2 seqc users 0 hold count flags () flags (VIRF_PGREAD|VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff8028e319a50 ref 0 pages 10 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe0143fc2740 (pid 73299, sed, tid 102488) #0 0xffffffff80bfd2c7 at lockmgr_lock_flags+0x1e7 #1 0xffffffff80f629ad at ffs_lock+0x9d #2 0xffffffff811c9e7c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d38e84 at _vn_lock+0x54 #4 0xffffffff80d20f72 at vput_final+0x172 #5 0xffffffff80be1039 at exit1+0x579 #6 0xffffffff80be0abd at sys_sys_exit+0xd #7 0xffffffff811009a7 at amd64_syscall+0x147 #8 0xffffffff810d0b6b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=40040, extsize 0 generation=2810086d, uid=0, gid=0, flags=0x0 ino 15653511, on dev gpt/work vnode 0xfffffe0168a504b0: type VREG usecount 1, writecount 1, refcount 7187 seqc users 0 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff806ed104630 ref 0 pages 760792 cleanbuf 7175 dirtybuf 10 lock type ufs: EXCL by thread 0xfffffe01591ad1e0 (pid 72906, dd, tid 1027314) #0 0xffffffff80bfd2c7 at lockmgr_lock_flags+0x1e7 #1 0xffffffff80f629ad at ffs_lock+0x9d #2 0xffffffff811c9e7c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d38e84 at _vn_lock+0x54 #4 0xffffffff80d3dbd8 at vn_write+0x1e8 #5 0xffffffff80d3d5c3 at vn_io_fault_doio+0x43 #6 0xffffffff80d39673 at vn_io_fault1+0x163 #7 0xffffffff80d3707a at vn_io_fault+0x1ba #8 0xffffffff80ca5701 at dofilewrite+0x81 #9 0xffffffff80ca5260 at sys_write+0xc0 #10 0xffffffff811009a7 at amd64_syscall+0x147 #11 0xffffffff810d0b6b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=3115384832, extsize 0 generation=a7a9929f, uid=0, gid=0, flags=0x0 ino 90529633, on dev gpt/work db:1:pho1> show mount 0xfffffe010e2fe700 /dev/gpt/work on / (ufs) 0xfffffe010e2ff280 devfs on /dev (devfs) 0xfffffe0143973280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe016bc6c280 procfs on /proc (procfs) More info: show mount db:1:pho1> show bufqueues bqempty: 47225 Buf domain 0 freebufs 15130 lofreebufs 219 hifreebufs 329 bufspace 16384 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 1 cleanq count 0 (0) dirtyq count 2 (12288) wakeup 0 lim 25 CPU 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 17942 space 16384 Buf domain 1 freebufs 15130 lofreebufs 219 hifreebufs 329 bufspace 45056 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 1 cleanq count 0 (0) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 1, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 11258 space 45056 Buf domain 2 freebufs 15125 lofreebufs 219 hifreebufs 329 bufspace 184320 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 1 cleanq count 0 (0) dirtyq count 1 (32768) wakeup 0 lim 25 CPU 0, 2, 1, 0, 0, 3, 1, 0, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 11246 space 184320 Buf domain 3 freebufs 15131 lofreebufs 219 hifreebufs 329 bufspace 12288 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 1 cleanq count 0 (0) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 9919 space 12288 Buf domain 4 freebufs 7948 lofreebufs 219 hifreebufs 329 bufspace 235438080 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 10 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 1 cleanq count 6585 (215777280) dirtyq count 447 (14647296) wakeup 0 lim 25 CPU 19, 13, 20, 20, 20, 6, 13, 3, 24, 10, 3, 1, Locked buffers: 438 space 14352384 Total buffers: 20711 space 235438080 Buf domain 5 freebufs 7944 lofreebufs 219 hifreebufs 329 bufspace 235483136 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 1 cleanq count 7086 (232165376) dirtyq count 1 (32768) wakeup 0 lim 25 CPU 4, 19, 20, 7, 22, 0, 5, 6, 8, 3, 0, 8, Locked buffers: 0 space 0 Total buffers: 18767 space 235483136 Buf domain 6 freebufs 12648 lofreebufs 219 hifreebufs 329 bufspace 81305600 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 21 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 1 cleanq count 2343 (76681216) dirtyq count 21 (659456) wakeup 0 lim 25 CPU 8, 18, 14, 0, 6, 2, 20, 2, 5, 17, 5, 13, Locked buffers: 13 space 425984 Total buffers: 16088 space 81305600 db:1:pho1> show page vm_cnt.v_free_count: 6855004 vm_cnt.v_inactive_count: 801349 vm_cnt.v_active_count: 1454 vm_cnt.v_laundry_count: 85 vm_cnt.v_wire_count: 523696 vm_cnt.v_free_reserved: 10643 vm_cnt.v_free_min: 51262 vm_cnt.v_free_target: 173119 vm_cnt.v_inactive_target: 259678 db:1:pho1> show pageq pq_free 6855004 dom 0 page_cnt 8123862 free 6855004 pq_act 1454 pq_inact 801349 pq_laund 85 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000124 | 000000 09 (002048K) | 001368 | 000000 08 (001024K) | 006175 | 000000 07 (000512K) | 013797 | 000017 06 (000256K) | 020395 | 000063 05 (000128K) | 025077 | 000093 04 (000064K) | 032311 | 000001 03 (000032K) | 000372 | 000001 02 (000016K) | 000001 | 000001 01 (000008K) | 000000 | 000000 00 (000004K) | 000001 | 000000 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000005 | 000000 04 (000064K) | 000005 | 000000 03 (000032K) | 000005 | 000000 02 (000016K) | 000005 | 000000 01 (000008K) | 000006 | 000000 00 (000004K) | 000007 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree FFS inode 1160 100168 110546 125449675 0 20 244428240 0 malloc-4096 4096 34128 10 747548 0 2 139829248 0 VNODE 600 100431 110572 838680935 0 22 126601800 0 malloc-256 256 95105 238390 117026614 0 62 85374720 0 RADIX NODE 144 84393 447828 200034306 0 63 76639824 0 VM OBJECT 264 13649 225811 525008271 0 30 63217440 0 FFS2 dinode 256 100168 110552 125449657 0 62 53944320 0 malloc-384 384 28 110402 604750264 0 30 42405120 0 mbuf_cluster 2048 12919 13 6031515 0 8 26484736 0 malloc-256 256 679 102611 177853553 0 63 26442240 0 swblk 136 2165 168819 6046265 0 62 23253824 0 VMSPACE 2552 48 7488 4668687 0 4 19231872 0 THREAD 1808 9376 271 17871944 0 8 17441776 0 BUF TRIE 144 1603 104349 110834549 0 63 15257088 0 S VFS Cache 104 101801 25300 374268933 0 126 13218504 0 malloc-128 128 23 102277 140248573 0 127 13094400 0 PROC 1352 81 9117 4668782 0 8 12435696 0 malloc-128 128 19986 42789 80061566 0 126 8035200 0 FPU_save_area 832 9378 198 17935062 0 16 7967232 0 g_bio 408 1752 15478 758988833 0 32 7029840 0 vmem btag 56 83357 35863 7678231 0 254 6676320 0 UMA Slabs 0 112 46449 21 3255895 0 126 5204640 0 malloc-128 128 38578 1784 10531367 0 126 5166336 0 64 Bucket 512 8036 1964 53533931 0 30 5120000 0 malloc-256 256 9502 9068 246217709 0 62 4753920 0 mbuf 256 15527 2550 691399023 0 254 4627712 0 32 Bucket 256 16215 975 58551122 0 62 4400640 0 malloc-384 384 9199 101 9299 0 30 3571200 0 TMPFS node 224 0 14022 560660458 0 62 3140928 0 malloc-128 128 514 23790 4482001793 0 126 3110912 0 malloc-256 256 10 11510 66886856 0 63 2949120 0 128 Bucket 1024 2250 609 27419203 0 16 2927616 0 swpctrie 144 352 15440 500730 0 62 2274048 0 malloc-32768 32768 12 48 20997 0 1 1966080 0 256 Bucket 2048 857 89 46135324 0 8 1937408 0 malloc-128 128 14435 228 70490110 0 126 1876864 0 pbuf 2776 0 601 0 0 0 1668376 0 malloc-4096 4096 335 28 1360833 0 2 1486848 0 TURNSTILE 136 9648 180 9648 0 62 1336608 0 ksiginfo 112 9166 1418 126281 0 126 1185408 0 malloc-4096 4096 83 158 4669372 0 2 987136 0 SLEEPQUEUE 88 9648 240 9648 0 126 870144 0 malloc-16384 16384 3 50 897629 0 1 868352 0 malloc-64 64 9311 3352 2781174315 0 254 810432 0 MAP ENTRY 96 2182 5588 151514482 0 126 745920 0 malloc-32768 32768 9 13 3079 0 1 720896 0 malloc-1024 1024 509 195 255573013 0 16 720896 0 malloc-8192 8192 86 0 1270 0 1 704512 0 malloc-64 64 8631 2331 2824692105 0 254 701568 0 malloc-64 64 4461 4485 44654618 0 254 572544 0 malloc-32768 32768 13 4 476568 0 1 557056 0 Files 80 146 6654 752796183 0 126 544000 0 UMA Zones 2048 226 0 607 0 8 462848 0 ttyinq 160 2370 305 115328265 0 62 428000 0 ttyoutq 256 1261 374 61508402 0 62 418560 0 filedesc0 1072 81 290 4668783 0 8 397712 0 mbuf_packet 256 4 1524 115377352 0 254 391168 0 lkpimm 168 3 2325 3 0 62 391104 0 lkpicurr 168 13 2315 13 0 62 391104 0 malloc-32 32 8252 3088 3238571 0 254 362880 0 malloc-256 256 408 972 102525048 0 62 353280 0 L VFS Cache 320 677 355 22046 0 30 330240 0 16 Bucket 144 482 1646 42391151 0 62 306432 0 clpbuf 2776 0 110 3006774 0 2 305360 0 NAMEI 1024 0 288 3919405328 0 16 294912 0 malloc-512 512 229 347 74871398 0 30 294912 0 malloc-16 16 15778 2222 6547849 0 254 288000 0 malloc-128 128 673 1528 5286972 0 126 281728 0 DIRHASH 1024 30 242 4280140 0 16 278528 0 malloc-8192 8192 34 0 44 0 1 278528 0 rl_entry 40 4448 2420 4456 0 254 274720 0 malloc-65536 65536 2 2 2607 0 1 262144 0 pipe 744 9 341 847808 0 16 260400 0 malloc-256 256 201 729 71738620 0 62 238080 0 malloc-2048 2048 108 8 23688069 0 8 237568 0 malloc-1024 1024 26 194 530735 0 16 225280 0 4 Bucket 48 263 4357 3790175 0 254 221760 0 swrbuf 2776 0 78 868097 13 2 216528 0 malloc-256 256 177 663 7695130 0 62 215040 0 malloc-64 64 44 3106 558814 0 254 201600 0 malloc-65536 65536 1 2 278 0 1 196608 0 malloc-65536 65536 3 0 3928 0 1 196608 0 malloc-65536 65536 3 0 200 0 1 196608 0 malloc-65536 65536 2 1 5346 0 1 196608 0 malloc-16384 16384 12 0 4830 0 1 196608 0 8 Bucket 80 175 2225 41174653 0 126 192000 0 socket 960 56 112 8552 0 16 161280 0 PWD 32 21 4767 305148967 0 254 153216 0 ada_ccb 272 0 560 14381718 0 30 152320 0 malloc-16384 16384 9 0 2583 0 1 147456 0 malloc-65536 65536 1 1 13 0 1 131072 0 malloc-384 384 3 337 79251 0 30 130560 0 2 Bucket 32 372 3660 14228223 0 254 129024 0 PGRP 88 37 1389 329 0 126 125488 0 malloc-128 128 49 912 10047 0 126 123008 0 fakepg 104 0 1170 360 0 126 121680 0 unpcb 256 19 446 6408 0 62 119040 0 Mountpoints 2944 4 36 94 0 4 117760 0 DEVCTL 1024 0 112 781753 0 0 114688 0 malloc-256 256 53 382 16367 0 62 111360 0 malloc-8192 8192 12 1 3048 0 1 106496 0 malloc-32 32 169 3107 32501743 0 254 104832 0 malloc-32 32 144 3132 378785 0 254 104832 0 malloc-64 64 665 910 991 0 254 100800 0 malloc-384 384 191 69 34819 0 30 99840 0 malloc-32 32 22 2876 6176631 0 254 92736 0 malloc-2048 2048 3 41 12572712 0 8 90112 0 malloc-1024 1024 23 65 1596372 0 16 90112 0 malloc-16 16 60 4940 7103579 0 254 80000 0 UMA Kegs 384 196 7 577 0 30 77952 0 malloc-64 64 353 844 1325 0 254 76608 0 malloc-8192 8192 9 0 12758901 0 1 73728 0 malloc-32 32 888 1254 276682901 0 254 68544 0 malloc-128 128 46 481 3484 0 126 67456 0 malloc-65536 65536 1 0 2559 0 1 65536 0 malloc-32768 32768 1 1 14 0 1 65536 0 malloc-16384 16384 4 0 4085338 0 1 65536 0 malloc-4096 4096 16 0 69 0 2 65536 0 swwbuf 2776 0 23 3364638 0 1 63848 0 malloc-4096 4096 15 0 2734 0 2 61440 0 malloc-8192 8192 3 4 2571 0 1 57344 0 malloc-8192 8192 5 2 94 0 1 57344 0 malloc-2048 2048 20 8 40 0 8 57344 0 malloc-32 32 226 1538 22367 0 254 56448 0 malloc-16 16 315 3185 687301163 0 254 56000 0 malloc-16384 16384 2 1 5 0 1 49152 0 malloc-16384 16384 1 2 5525 0 1 49152 0 pcpu-64 64 455 313 481 0 254 49152 0 malloc-64 64 19 674 776 0 254 44352 0 malloc-16 16 294 2456 1869 0 254 44000 0 malloc-16 16 471 2279 56664981 0 254 44000 0 udp_inpcb 496 22 66 1394 0 30 43648 0 pcpu-8 8 3495 1625 5754 0 254 40960 0 malloc-32 32 25 1235 30753405 0 254 40320 0 malloc-16 16 299 2201 35547 0 254 40000 0 malloc-4096 4096 9 0 97043 0 2 36864 0 malloc-1024 1024 32 4 4849 0 16 36864 0 malloc-64 64 26 541 91539365 0 254 36288 0 malloc-32 32 270 864 1744 0 254 36288 0 cpuset 104 27 314 27 0 126 35464 0 malloc-32768 32768 1 0 2561 0 1 32768 0 malloc-32768 32768 1 0 3919 0 1 32768 0 malloc-32768 32768 1 0 1 0 1 32768 0 malloc-2048 2048 0 16 729 0 8 32768 0 malloc-512 512 0 64 8437 0 30 32768 0 rtentry 176 12 172 15 0 62 32384 0 malloc-16 16 40 1960 6212 0 254 32000 0 AIO 208 0 133 4 0 62 27664 0 AIOCB 552 0 49 56 0 16 27048 0 routing nhops 256 9 96 15 0 62 26880 0 AIOLIO 272 0 98 14 0 30 26656 0 malloc-2048 2048 10 2 6326813 0 8 24576 0 malloc-512 512 12 36 155590254 0 30 24576 0 udpcb 32 22 734 1394 0 254 24192 0 malloc-384 384 21 39 16872428 0 30 23040 0 tcpcb 1096 12 9 639 0 8 23016 0 malloc-4096 4096 5 0 101470886 0 2 20480 0 malloc-2048 2048 5 5 1517 0 8 20480 0 malloc-1024 1024 2 18 1347 0 16 20480 0 malloc-1024 1024 9 11 22946371 0 16 20480 0 malloc-512 512 7 33 1558 0 30 20480 0 malloc-16 16 15 1235 2296 0 254 20000 0 tcp_inpcb 496 12 28 639 0 30 19840 0 malloc-8192 8192 1 1 2708 0 1 16384 0 malloc-512 512 3 29 48 0 30 16384 0 pcpu-16 16 40 984 40 0 254 16384 0 malloc-4096 4096 1 2 60 0 2 12288 0 malloc-384 384 5 25 9928 0 30 11520 0 malloc-1024 1024 6 2 29250 0 16 8192 0 KMAP ENTRY 96 42 39 87 0 0 7776 0 kenv 258 18 12 21829 0 30 7740 0 malloc-384 384 11 9 11 0 30 7680 0 malloc-384 384 20 0 20 0 30 7680 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 malloc-2048 2048 1 1 4 0 8 4096 0 malloc-1024 1024 1 3 1274 0 16 4096 0 SMR CPU 32 3 124 3 0 254 4064 0 hostcache 64 0 63 2 0 254 4032 0 AIOP 32 4 122 4 0 254 4032 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 ripcb 496 1 7 3 0 30 3968 0 UMA Slabs 1 176 9 13 12 0 62 3872 0 vmem 1856 1 1 1 0 8 3712 0 SMR SHARED 24 3 124 3 0 254 3048 0 FFS1 dinode 128 0 0 0 0 126 0 0 da_ccb 544 0 0 0 0 16 0 0 udplite_inpcb 496 0 0 0 0 30 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 30 0 0 tcpreass 48 0 0 19 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 20 0 254 0 0 syncache 168 0 0 227 0 62 0 0 tcptw 88 0 0 0 0 126 0 0 ipq 56 0 0 0 0 254 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 KNOTE 160 0 0 0 0 62 0 0 itimer 352 0 0 0 0 30 0 0 NCLNODE 760 0 0 0 0 16 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 STS VFS Cache 144 0 0 0 0 62 0 0 cryptop 280 0 0 0 0 30 0 0 linux_dma_object 32 0 0 0 0 254 0 0 linux_dma_pctrie 144 0 0 0 0 62 0 0 IOMMU_MAP_ENTRY 120 0 0 0 0 126 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 98972878 0 2 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 2776 0 0 10976 0 4 0 0 mdpbuf 2776 0 0 11868 0 1 0 0 nfspbuf 2776 0 0 0 0 2 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-32768 32768 0 0 8 0 1 0 0 malloc-16384 16384 0 0 12 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-8192 8192 0 0 0 0 1 0 0 malloc-2048 2048 0 0 1272 0 8 0 0 malloc-512 512 0 0 1269 0 30 0 0 malloc-512 512 0 0 21156 0 30 0 0 malloc-512 512 0 0 12 0 30 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 vm pgcache 4096 165585 199 137098495 8 vm pgcache 4096 991596 1869 1771355444 142 buf free cache 848 16875 41831 122105085 17 buffer arena-65 65536 0 0 0 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 9691 968 20298961 9 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 3 67 39212631 3 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 1244 2 kstack_cache 16384 9376 12 17871944 1 db:0:pho> acttrace Tracing command idle pid 11 tid 100003 td 0xfffffe00e4c603a0 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81ffc790 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81ffc7a0 trap() at trap+0x56/frame 0xffffffff81ffc8b0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81ffc8b0 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00377f0dd0, rbp = 0xfffffe00377f0dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377f0dd0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377f0e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377f0e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377f0e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe00e4c5fc80 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e10 trap() at trap+0x56/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00377ebdd0, rbp = 0xfffffe00377ebdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377ebdd0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377ebe10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377ebe30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377ebe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377ebef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ebf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe00e4c5f560 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce2de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce2de10 trap() at trap+0x56/frame 0xfffffe003ce2df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce2df20 --- trap 0x13, rip = 0xffffffff810ba8ae, rsp = 0xfffffe00377fae40, rbp = 0xfffffe00377fae50 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00377fae50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377faef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe00e4c5ee40 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3ae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ae10 trap() at trap+0x56/frame 0xfffffe003ce3af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3af20 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00377f5dd0, rbp = 0xfffffe00377f5dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377f5dd0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377f5e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377f5e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377f5e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377f5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00e4c5e720 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce47e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce47e10 trap() at trap+0x56/frame 0xfffffe003ce47f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce47f20 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00e4830dd0, rbp = 0xfffffe00e4830dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4830dd0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00e4830e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4830e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4830e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4830ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4830f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4830f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe00e4c66c80 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce61e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce61e10 trap() at trap+0x56/frame 0xfffffe003ce61f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce61f20 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00e483add0, rbp = 0xfffffe00e483add0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e483add0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00e483ae10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e483ae30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e483ae50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e483aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe00e4c66560 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6ee10 trap() at trap+0x56/frame 0xfffffe003ce6ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6ef20 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00e4835dd0, rbp = 0xfffffe00e4835dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4835dd0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00e4835e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4835e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4835e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4835ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4835f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4835f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe00e4c65e40 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7be00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7be10 trap() at trap+0x56/frame 0xfffffe003ce7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7bf20 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00e4844dd0, rbp = 0xfffffe00e4844dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4844dd0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00e4844e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4844e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4844e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4844ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4844f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4844f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe00e4c65720 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce88e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce88e10 trap() at trap+0x56/frame 0xfffffe003ce88f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce88f20 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00e483fdd0, rbp = 0xfffffe00e483fdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e483fdd0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00e483fe10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e483fe30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e483fe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e483fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00e4c65000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce95e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce95e10 trap() at trap+0x56/frame 0xfffffe003ce95f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce95f20 --- trap 0x13, rip = 0xffffffff810ba8ae, rsp = 0xfffffe00e484ee40, rbp = 0xfffffe00e484ee50 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00e484ee50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e484eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e484ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e484ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00e4c62740 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea2e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea2e10 trap() at trap+0x56/frame 0xfffffe003cea2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea2f20 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00e4849dd0, rbp = 0xfffffe00e4849dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4849dd0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00e4849e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4849e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4849e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4849ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4849f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4849f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sed pid 73299 tid 102488 td 0xfffffe0143fc2740 (CPU 5) kdb_enter() at kdb_enter+0x37/frame 0xfffffe0152526af0 assert_vop_locked() at assert_vop_locked+0xaf/frame 0xfffffe0152526b20 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x42/frame 0xfffffe0152526b40 ffs_bdflush() at ffs_bdflush+0x156/frame 0xfffffe0152526bb0 bdwrite() at bdwrite+0x83/frame 0xfffffe0152526c20 ffs_update() at ffs_update+0x355/frame 0xfffffe0152526c80 ufs_inactive() at ufs_inactive+0x260/frame 0xfffffe0152526cc0 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x59/frame 0xfffffe0152526ce0 vinactivef() at vinactivef+0xda/frame 0xfffffe0152526d20 vput_final() at vput_final+0x2fe/frame 0xfffffe0152526d80 exit1() at exit1+0x579/frame 0xfffffe0152526df0 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe0152526e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0152526f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0152526f30 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8011ad91a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe5c0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 73299 73297 3533 0 RE CPU 5 sed 73297 72910 3533 0 S wait 0xfffff80776494a90 sh 72910 3600 3533 0 S piperd 0xfffff80632688000 sh 72906 68167 2995 0 D+ wdrain 0xffffffff81fada58 dd 68167 68165 2995 0 S+ wait 0xfffff80687d65a90 sh 68166 2995 2995 0 S+ piperd 0xfffff803cc0e8000 tee 68165 2995 2995 0 S+ wait 0xfffff80003a1c000 sh 32486 32481 32486 0 S+ select 0xfffff80513a400c0 bash 32481 32480 32481 0 SW+ pause 0xfffff801bde280b0 csh 32480 32475 32480 2006 SW+ wait 0xfffff80119d5d000 su 32475 32474 32475 2006 SWs+ wait 0xfffff8076b531548 bash 32474 31090 31090 2006 S select 0xfffff805d97bc340 sshd 31090 2716 31090 0 Ss select 0xfffff805270661c0 sshd 28926 0 0 0 DL aiordy 0xfffff80115724a90 [aiod4] 28925 0 0 0 DL aiordy 0xfffff80115724548 [aiod3] 28924 0 0 0 DL aiordy 0xfffff800319d3a90 [aiod2] 28923 0 0 0 DL aiordy 0xfffff800319d3548 [aiod1] 3603 3533 3533 0 S piperd 0xfffff80031e218b8 sh 3601 3533 3533 0 S piperd 0xfffff80031e21ba0 awk 3600 3533 3533 0 S wait 0xfffff8028e26c548 sh 3533 1 3533 0 SWs wait 0xfffff80031e7aa90 sh 2995 2756 2995 0 S+ wait 0xfffff80115724000 sh 2756 2754 2756 0 S+ select 0xfffff8001c8dc6c0 bash 2754 2753 2754 0 SW+ pause 0xfffff800319d30b0 csh 2753 2748 2753 2006 SW+ wait 0xfffff8001c8c0548 su 2748 2747 2748 2006 SWs+ wait 0xfffff80031906a90 bash 2747 2744 2744 2006 S select 0xfffff80031646cc0 sshd 2744 2716 2744 0 Ss select 0xfffff80115b511c0 sshd 2743 1 2743 0 Ss+ ttyin 0xfffff800065d18b0 getty 2742 1 2742 0 Ss+ ttyin 0xfffff80003cf34b0 getty 2741 1 2741 0 Ss+ ttyin 0xfffff8001c6d80b0 getty 2740 1 2740 0 Ss+ ttyin 0xfffff8001c6d88b0 getty 2739 1 2739 0 Ss+ ttyin 0xfffff80003fd50b0 getty 2738 1 2738 0 Ss+ ttyin 0xfffff80003fd58b0 getty 2737 1 2737 0 Ss+ ttyin 0xfffff80003fd40b0 getty 2736 1 2736 0 Ss+ ttyin 0xfffff80003fd48b0 getty 2735 1 2735 0 Ss+ ttyin 0xfffff80003fd30b0 getty 2734 1 2734 0 Ss+ ttyin 0xfffff80003fd38b0 getty 2720 1 2720 0 Ss nanslp 0xffffffff81ebdbe5 cron 2716 1 2716 0 Ss select 0xfffff8001c5952c0 sshd 2697 1 2697 0 Ss select 0xfffff80115b51140 inetd 2671 1 2671 123 Ss select 0xfffff80031646d40 ntpd 2645 1 2645 0 Ss select 0xfffff80031646dc0 powerd 2640 1 2640 0 Ss rpcsvc 0xfffff80003db7460 NLM: master 2637 1 2637 0 Ss select 0xfffff8001c854240 rpc.statd 2612 1 2612 0 Ss select 0xfffff8001c595440 rpcbind 2590 1 2590 0 Ss nanslp 0xffffffff81ebdbe5 watchdogd 2582 1 2582 0 Ds biowr 0xfffffe003b49f350 syslogd 2393 1 2393 0 Ss select 0xfffff80031e3f1c0 devd 2388 1 2388 65 Ss select 0xfffff8001c854140 dhclient 2329 1 2329 0 Ss select 0xfffff8001c8541c0 dhclient 2326 1 2326 0 Ss select 0xfffff8001c595340 dhclient 29 0 0 0 DL syncer 0xffffffff81faea30 [syncer] 28 0 0 0 DL vlruwt 0xfffff80031519548 [vnlru] 27 0 0 0 DL (threaded) [bufdaemon] 100197 D qsleep 0xffffffff81fada60 [bufdaemon] 100198 D - 0xffffffff81a0af40 [bufspacedaemon-0] 100199 D - 0xffffffff81a13200 [bufspacedaemon-1] 100200 D - 0xffffffff81a1b4c0 [bufspacedaemon-2] 100201 D - 0xffffffff81a23780 [bufspacedaemon-3] 100202 D - 0xffffffff81a2ba40 [bufspacedaemon-4] 100203 D - 0xffffffff81a33d00 [bufspacedaemon-5] 100204 D - 0xffffffff81a3bfc0 [bufspacedaemon-6] 100218 D sdflush 0xfffff80031a85ce8 [/ worker] 100226 D sdflush 0xfffff8004b18cce8 [/tmp worker] 26 0 0 0 DL psleep 0xffffffff81fd3750 [vmdaemon] 25 0 0 0 DL (threaded) [pagedaemon] 100195 D psleep 0xffffffff81fc7bb8 [dom0] 100205 D launds 0xffffffff81fc7bc4 [laundry: dom0] 100206 D umarcl 0xffffffff80f85050 [uma] 24 0 0 0 DL idle 0xfffff8001c5b1548 [enc_daemon1] 23 0 0 0 DL idle 0xfffff8001c5b1a90 [enc_daemon0] 22 0 0 0 DL - 0xffffffff81cf15c0 [rand_harvestq] 21 0 0 0 DL (threaded) [usb] 100128 D - 0xfffffe010a18f440 [usbus0] 100129 D - 0xfffffe010a18f498 [usbus0] 100130 D - 0xfffffe010a18f4f0 [usbus0] 100131 D - 0xfffffe010a18f548 [usbus0] 100132 D - 0xfffffe010a18f5a0 [usbus0] 100134 D - 0xfffffe00e4d51cf0 [usbus1] 100135 D - 0xfffffe00e4d51d48 [usbus1] 100136 D - 0xfffffe00e4d51da0 [usbus1] 100137 D - 0xfffffe00e4d51df8 [usbus1] 100138 D - 0xfffffe00e4d51e50 [usbus1] 100139 D - 0xfffffe010a543cf0 [usbus2] 100140 D - 0xfffffe010a543d48 [usbus2] 100141 D - 0xfffffe010a543da0 [usbus2] 100142 D - 0xfffffe010a543df8 [usbus2] 100143 D - 0xfffffe010a543e50 [usbus2] 20 0 0 0 DL (threaded) [cam] 100121 D - 0xffffffff81bc8cc0 [doneq0] 100122 D - 0xffffffff81bc8d40 [doneq1] 100123 D - 0xffffffff81bc8dc0 [doneq2] 100124 D - 0xffffffff81bc8c40 [async] 100152 D - 0xffffffff81bc8b10 [scanner] 19 0 0 0 DL seqstat 0xfffff8000402d888 [sequencer 00] 18 0 0 0 DL crypto_ 0xfffff80003efcba0 [crypto returns 11] 17 0 0 0 DL crypto_ 0xfffff80003efcb50 [crypto returns 10] 16 0 0 0 DL crypto_ 0xfffff80003efcb00 [crypto returns 9] 15 0 0 0 DL crypto_ 0xfffff80003efcab0 [crypto returns 8] 14 0 0 0 DL crypto_ 0xfffff80003efca60 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003efca10 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003efc9c0 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff80003efc970 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003efc920 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff80003efc8d0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003efc880 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003efc830 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81fc50e0 [crypto] 13 0 0 0 DL (threaded) [geom] 100092 D - 0xffffffff81e9d350 [g_event] 100093 D - 0xffffffff81e9d358 [g_up] 100094 D - 0xffffffff81e9d360 [g_down] 12 0 0 0 WL (threaded) [intr] 100041 I [swi6: task queue] 100042 I [swi6: Giant taskq] 100048 I [swi5: fast taskq] 100077 I [swi4: clock (0)] 100078 I [swi4: clock (1)] 100079 I [swi4: clock (2)] 100080 I [swi4: clock (3)] 100081 I [swi4: clock (4)] 100082 I [swi4: clock (5)] 100083 I [swi4: clock (6)] 100084 I [swi4: clock (7)] 100085 I [swi4: clock (8)] 100086 I [swi4: clock (9)] 100087 I [swi4: clock (10)] 100088 I [swi4: clock (11)] 100089 I [swi3: vm] 100090 I [swi1: netisr 0] 100125 I [swi4: apei] 100126 I [irq56: ahci0] 100127 I [irq19: xhci0] 100133 I [irq18: ehci0 ehci1+] 100144 I [irq71: ahci1] 100145 I [swi0: uart uart] 100159 I [irq73: mlx5_core0] 100160 I [irq74: mlx5_core0] 100161 I [irq72: mlx5_core0] 100162 I [irq75: mlx5_core0] 100163 I [irq76: mlx5_core0] 100164 I [irq77: mlx5_core0] 100165 I [irq78: mlx5_core0] 100166 I [irq79: mlx5_core0] 100167 I [irq80: mlx5_core0] 100168 I [irq81: mlx5_core0] 100169 I [irq82: mlx5_core0] 100170 I [irq83: mlx5_core0] 100171 I [irq84: mlx5_core0] 100172 I [irq85: mlx5_core0] 100173 I [irq86: mlx5_core0] 100179 I [irq88: mlx5_core1] 100180 I [irq89: mlx5_core1] 100181 I [irq87: mlx5_core1] 100182 I [irq90: mlx5_core1] 100183 I [irq91: mlx5_core1] 100184 I [irq92: mlx5_core1] 100185 I [irq93: mlx5_core1] 100186 I [irq94: mlx5_core1] 100187 I [irq95: mlx5_core1] 100188 I [irq96: mlx5_core1] 100189 I [irq97: mlx5_core1] 100190 I [irq98: mlx5_core1] 100191 I [irq99: mlx5_core1] 100192 I [irq100: mlx5_core1] 100193 I [irq101: mlx5_core1] 100245 I [irq102: ioat0] 100246 I [irq103: ioat1] 100247 I [irq104: ioat2] 100248 I [irq105: ioat3] 100249 I [irq106: ioat4] 100250 I [irq107: ioat5] 100251 I [irq108: ioat6] 100252 I [irq109: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff80003c0d000 [init] 10 0 0 0 DL audit_w 0xffffffff81fc55f0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81e9d8f0 [swapper] 100015 D - 0xfffff80003bc5100 [if_config_tqg_0] 100016 D - 0xfffff80003bc5000 [softirq_0] 100017 D - 0xfffff80003bc6e00 [softirq_1] 100018 D - 0xfffff80003bc6d00 [softirq_2] 100019 D - 0xfffff80003bc6c00 [softirq_3] 100020 D - 0xfffff80003bc6b00 [softirq_4] 100021 D - 0xfffff80003bc6a00 [softirq_5] 100022 D - 0xfffff80003bc6900 [softirq_6] 100023 D - 0xfffff80003bc6800 [softirq_7] 100024 D - 0xfffff80003bc6700 [softirq_8] 100025 D - 0xfffff80003bc6600 [softirq_9] 100026 D - 0xfffff80003bc6500 [softirq_10] 100027 D - 0xfffff80003bc6400 [softirq_11] 100028 D - 0xfffff80003bc6300 [if_io_tqg_0] 100029 D - 0xfffff80003bc6200 [if_io_tqg_1] 100030 D - 0xfffff80003bc6100 [if_io_tqg_2] 100031 D - 0xfffff80003bc6000 [if_io_tqg_3] 100032 D - 0xfffff80003bc7e00 [if_io_tqg_4] 100033 D - 0xfffff80003bc7d00 [if_io_tqg_5] 100034 D - 0xfffff80003bc7c00 [if_io_tqg_6] 100035 D - 0xfffff80003bc7b00 [if_io_tqg_7] 100036 D - 0xfffff80003bc7a00 [if_io_tqg_8] 100037 D - 0xfffff80003bc7900 [if_io_tqg_9] 100038 D - 0xfffff80003bc7800 [if_io_tqg_10] 100039 D - 0xfffff80003bc7700 [if_io_tqg_11] 100040 D - 0xfffff80003bb4100 [pci_hp taskq] 100043 D - 0xfffff80003bb5d00 [aiod_kick taskq] 100044 D - 0xfffff80003bb5c00 [inm_free taskq] 100045 D - 0xfffff80003bb5b00 [linuxkpi_irq_wq] 100046 D - 0xfffff80003bb5a00 [deferred_unmount ta] 100047 D - 0xfffff80003bb5900 [thread taskq] 100049 D - 0xfffff80003bb5700 [kqueue_ctx taskq] 100050 D - 0xfffff80003bb5600 [in6m_free taskq] 100051 D - 0xfffff80003bb5500 [linuxkpi_short_wq_0] 100052 D - 0xfffff80003bb5500 [linuxkpi_short_wq_1] 100053 D - 0xfffff80003bb5500 [linuxkpi_short_wq_2] 100054 D - 0xfffff80003bb5500 [linuxkpi_short_wq_3] 100055 D - 0xfffff80003bb5500 [linuxkpi_short_wq_4] 100056 D - 0xfffff80003bb5500 [linuxkpi_short_wq_5] 100057 D - 0xfffff80003bb5500 [linuxkpi_short_wq_6] 100058 D - 0xfffff80003bb5500 [linuxkpi_short_wq_7] 100059 D - 0xfffff80003bb5500 [linuxkpi_short_wq_8] 100060 D - 0xfffff80003bb5500 [linuxkpi_short_wq_9] 100061 D - 0xfffff80003bb5500 [linuxkpi_short_wq_1] 100062 D - 0xfffff80003bb5500 [linuxkpi_short_wq_1] 100063 D - 0xfffff80003bb5500 [linuxkpi_short_wq_1] 100064 D - 0xfffff80003bb5400 [linuxkpi_long_wq_0] 100065 D - 0xfffff80003bb5400 [linuxkpi_long_wq_1] 100066 D - 0xfffff80003bb5400 [linuxkpi_long_wq_2] 100067 D - 0xfffff80003bb5400 [linuxkpi_long_wq_3] 100068 D - 0xfffff80003bb5400 [linuxkpi_long_wq_4] 100069 D - 0xfffff80003bb5400 [linuxkpi_long_wq_5] 100070 D - 0xfffff80003bb5400 [linuxkpi_long_wq_6] 100071 D - 0xfffff80003bb5400 [linuxkpi_long_wq_7] 100072 D - 0xfffff80003bb5400 [linuxkpi_long_wq_8] 100073 D - 0xfffff80003bb5400 [linuxkpi_long_wq_9] 100074 D - 0xfffff80003bb5400 [linuxkpi_long_wq_10] 100075 D - 0xfffff80003bb5400 [linuxkpi_long_wq_11] 100076 D - 0xfffff80003bb5400 [linuxkpi_long_wq_12] 100091 D - 0xfffff80003e1d300 [firmware taskq] 100095 D - 0xfffff80003e1d200 [crypto_0] 100096 D - 0xfffff80003e1d200 [crypto_1] 100097 D - 0xfffff80003e1d200 [crypto_2] 100098 D - 0xfffff80003e1d200 [crypto_3] 100099 D - 0xfffff80003e1d200 [crypto_4] 100100 D - 0xfffff80003e1d200 [crypto_5] 100101 D - 0xfffff80003e1d200 [crypto_6] 100102 D - 0xfffff80003e1d200 [crypto_7] 100103 D - 0xfffff80003e1d200 [crypto_8] 100104 D - 0xfffff80003e1d200 [crypto_9] 100105 D - 0xfffff80003e1d200 [crypto_10] 100106 D - 0xfffff80003e1d200 [crypto_11] 100146 D - 0xfffff80003cbbc00 [mca taskq] 100148 D - 0xfffff8001c70fc00 [acpi_task_0] 100149 D - 0xfffff8001c70fc00 [acpi_task_1] 100150 D - 0xfffff8001c70fc00 [acpi_task_2] 100151 D - 0xfffff80003e1d000 [CAM taskq] 100155 D - 0xfffff8001c710d00 [mlx5_core0-rec] 100156 D - 0xfffff8001c710c00 [mlx5_core0-wdg] 100157 D - 0xfffff8001c710b00 [mlx5_core0-cmd] 100158 D - 0xfffff8001c710900 [mlx5_page_allocator] 100174 D - 0xfffff8001c711700 [mlx5_esw_wq] 100175 D - 0xfffff8001c711400 [mlx5_core1-rec] 100176 D - 0xfffff8001c711300 [mlx5_core1-wdg] 100177 D - 0xfffff8001c711200 [mlx5_core1-cmd] 100178 D - 0xfffff8001c711000 [mlx5_page_allocator] 100194 D - 0xfffff8003158da00 [mlx5_esw_wq] db:0:pho> allt Tracing command kernel pid 0 tid 100000 td 0xffffffff81e9de40 sched_switch() at sched_switch+0x578/frame 0xffffffff82552e00 mi_switch() at mi_switch+0x155/frame 0xffffffff82552e20 sleepq_switch() at sleepq_switch+0x119/frame 0xffffffff82552e60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82552ea0 _sleep() at _sleep+0x282/frame 0xffffffff82552f40 swapper() at swapper+0x75/frame 0xffffffff82552fa0 mi_startup() at mi_startup+0x2f3/frame 0xffffffff82552ff0 btext() at btext+0x22 Tracing command kernel pid 0 tid 100015 td 0xfffffe00e4c62020 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4858df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4858e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4858e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4858ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4858ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4858f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4858f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe00e4c61900 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4853df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4853e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4853e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4853ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4853ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4853f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4853f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffffe00e4ce8720 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4862df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4862e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4862e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4862ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4862ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4862f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4862f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe00e4ce8000 sched_switch() at sched_switch+0x578/frame 0xfffffe00e485ddf0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e485de10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e485de50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e485dec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e485def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e485df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e485df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe00e4c69740 sched_switch() at sched_switch+0x578/frame 0xfffffe00e486cdf0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e486ce10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e486ce50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e486cec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e486cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e486cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e486cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe00e4c69020 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4867df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4867e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4867e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4867ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4867ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4867f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4867f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe00e4c68900 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4876df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4876e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4876e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4876ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4876ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4876f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4876f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe00e4c681e0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4871df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4871e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4871e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4871ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4871ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4871f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4871f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe00e4c67ac0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4880df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4880e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4880e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4880ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4880ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4880f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4880f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe00e4c673a0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e487bdf0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e487be10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e487be50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e487bec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e487bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e487bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e487bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe00e4cec020 sched_switch() at sched_switch+0x578/frame 0xfffffe00e488adf0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e488ae10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e488ae50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e488aec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e488aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe00e4ceb900 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4885df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4885e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4885e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4885ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4885ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4885f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4885f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe00e4ceb1e0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4894df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4894e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4894e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4894ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4894ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4894f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4894f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe00e4ceaac0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e488fdf0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e488fe10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e488fe50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e488fec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e488fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe00e4cea3a0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e489edf0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e489ee10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e489ee50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e489eec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e489eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e489ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e489ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe00e4ce9c80 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4899df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4899e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4899e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4899ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4899ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4899f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4899f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe00e4ce9560 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48a8df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48a8e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48a8e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e48a8ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48a8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe00e4ce8e40 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48a3df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48a3e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48a3e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e48a3ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48a3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe00e4cf5ac0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48b2df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48b2e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48b2e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e48b2ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48b2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe00e4cf53a0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48addf0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48ade10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48ade50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e48adec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48adef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48adf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48adf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe00e4cf4c80 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48bcdf0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48bce10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48bce50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e48bcec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48bcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48bcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48bcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe00e4cf4560 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48b7df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48b7e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48b7e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e48b7ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48b7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe00e4cf3e40 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48c6df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48c6e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48c6e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e48c6ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48c6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe00e4cf3720 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48c1df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48c1e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48c1e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e48c1ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48c1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe00e4cf3000 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48d0df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48d0e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48d0e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e48d0ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48d0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe00e4cec740 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48cbdc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48cbde0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48cbe20 _sleep() at _sleep+0x29e/frame 0xfffffe00e48cbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48cbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48cbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48cbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffffe00e4cf8720 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48e4dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48e4de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48e4e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e48e4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48e4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48e4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffffe00e4cf8000 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48dfdc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48dfde0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48dfe20 _sleep() at _sleep+0x29e/frame 0xfffffe00e48dfec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48dfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48dff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48dff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffffe00e4cf7740 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48eedf0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48eee10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48eee50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e48eeec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e48eeef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48eef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48eef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffffe00e4cf7020 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48e9dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48e9de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48e9e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e48e9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48e9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48e9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100047 td 0xfffffe00e4cf6900 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48f8dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48f8de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48f8e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e48f8ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48f8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48f8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100049 td 0xfffffe00e4d01000 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4902dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4902de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4902e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4902ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4902ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4902f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4902f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100050 td 0xfffffe00e4cfc740 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48fddc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48fdde0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48fde20 _sleep() at _sleep+0x29e/frame 0xfffffe00e48fdec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48fdef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48fdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48fdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100051 td 0xfffffe00e4cfc020 sched_switch() at sched_switch+0x578/frame 0xfffffe00e490cdc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e490cde0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e490ce20 _sleep() at _sleep+0x29e/frame 0xfffffe00e490cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e490cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e490cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e490cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100052 td 0xfffffe00e4cfb900 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4907dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4907de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4907e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4907ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4907ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4907f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4907f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffffe00e4cfb1e0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4916dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4916de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4916e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4916ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4916ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4916f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4916f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100054 td 0xfffffe00e4cfaac0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4911dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4911de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4911e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4911ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4911ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4911f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4911f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100055 td 0xfffffe00e4cfa3a0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4920dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4920de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4920e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4920ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4920ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4920f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4920f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffffe00e4cf9c80 sched_switch() at sched_switch+0x578/frame 0xfffffe00e491bdc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e491bde0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e491be20 _sleep() at _sleep+0x29e/frame 0xfffffe00e491bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e491bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e491bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e491bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100057 td 0xfffffe00e4d04900 sched_switch() at sched_switch+0x578/frame 0xfffffe00e492adc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e492ade0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e492ae20 _sleep() at _sleep+0x29e/frame 0xfffffe00e492aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e492aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e492af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffffe00e4d041e0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4925dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4925de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4925e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4925ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4925ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4925f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4925f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffffe00e4d03ac0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4934dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4934de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4934e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4934ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4934ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4934f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4934f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffffe00e4d033a0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e492fdc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e492fde0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e492fe20 _sleep() at _sleep+0x29e/frame 0xfffffe00e492fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e492fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e492ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe00e4d02c80 sched_switch() at sched_switch+0x578/frame 0xfffffe00e493edc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e493ede0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e493ee20 _sleep() at _sleep+0x29e/frame 0xfffffe00e493eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e493eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e493ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e493ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffffe00e4d02560 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4939dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4939de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4939e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4939ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4939ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4939f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4939f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffffe00e4d01e40 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4948dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4948de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4948e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4948ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4948ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4948f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4948f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffffe00e4d01720 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4943dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4943de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4943e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4943ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4943ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4943f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4943f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffffe00e4d0a3a0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4952dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4952de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4952e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4952ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4952ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4952f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4952f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe00e4d09c80 sched_switch() at sched_switch+0x578/frame 0xfffffe00e494ddc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e494dde0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e494de20 _sleep() at _sleep+0x29e/frame 0xfffffe00e494dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e494def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e494df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e494df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe00e4d09560 sched_switch() at sched_switch+0x578/frame 0xfffffe00e495cdc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e495cde0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e495ce20 _sleep() at _sleep+0x29e/frame 0xfffffe00e495cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e495cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e495cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e495cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe00e4d08e40 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4957dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4957de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4957e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4957ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4957ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4957f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4957f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe00e4d08720 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4966dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4966de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4966e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4966ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4966ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4966f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4966f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe00e4d08000 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4961dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4961de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4961e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4961ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4961ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4961f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4961f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe00e4d05740 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4970dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4970de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4970e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4970ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4970ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4970f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4970f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe00e4d05020 sched_switch() at sched_switch+0x578/frame 0xfffffe00e496bdc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e496bde0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e496be20 _sleep() at _sleep+0x29e/frame 0xfffffe00e496bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e496bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e496bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e496bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe00e4d0de40 sched_switch() at sched_switch+0x578/frame 0xfffffe00e497adc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e497ade0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e497ae20 _sleep() at _sleep+0x29e/frame 0xfffffe00e497aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e497aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe00e4d0d720 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4975dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4975de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4975e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4975ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4975ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4975f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4975f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe00e4d0d000 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4984dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4984de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4984e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4984ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4984ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4984f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4984f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe00e4d0c740 sched_switch() at sched_switch+0x578/frame 0xfffffe00e497fdc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e497fde0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e497fe20 _sleep() at _sleep+0x29e/frame 0xfffffe00e497fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e497fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffffe00e4d12720 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e34dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e34de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e34e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e34ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e34ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e34f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e34f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100095 td 0xfffffe00e4d2ce40 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e48dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e48de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e48e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e48ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e48ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e48f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffffe00e4d2c720 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e43dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e43de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e43e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e43ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e43ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e43f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100097 td 0xfffffe00e4d2c000 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e52dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e52de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e52e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e52ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e52ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e52f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e52f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffffe00e4d16740 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e4ddc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e4dde0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e4de20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e4dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e4def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e4df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e4df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100099 td 0xfffffe00e4d16020 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e5cdc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e5cde0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e5ce20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e5cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e5cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e5cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffffe00e4d15900 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e57dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e57de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e57e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e57ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e57ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e57f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100101 td 0xfffffe00e4d31720 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e66dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e66de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e66e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e66ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e66ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e66f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffffe00e4d31000 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e61dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e61de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e61e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e61ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e61ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e61f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100103 td 0xfffffe00e4d30740 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e70dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e70de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e70e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e70ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e70ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e70f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e70f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffffe00e4d30020 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e6bdc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e6bde0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e6be20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e6bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e6bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e6bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e6bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100105 td 0xfffffe00e4d2f900 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e7adc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e7ade0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e7ae20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e7aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e7aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffffe00e4d2f1e0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e75dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e75de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e75e20 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e75ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e75ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e75f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e75f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100146 td 0xfffffe010a316720 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4f55df0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f55e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f55e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4f55ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4f55ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f55f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f55f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100148 td 0xfffffe010d9fbc80 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4ffcdf0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ffce10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ffce50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4ffcec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4ffcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ffcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ffcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100149 td 0xfffffe010d9fb560 sched_switch() at sched_switch+0x578/frame 0xfffffe010da32df0 mi_switch() at mi_switch+0x155/frame 0xfffffe010da32e10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010da32e50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe010da32ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da32ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da32f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da32f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100150 td 0xfffffe010d9fae40 sched_switch() at sched_switch+0x578/frame 0xfffffe010da2ddf0 mi_switch() at mi_switch+0x155/frame 0xfffffe010da2de10 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010da2de50 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe010da2dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da2def0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da2df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da2df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100151 td 0xfffffe010d9fa720 sched_switch() at sched_switch+0x578/frame 0xfffffe010da3cdc0 mi_switch() at mi_switch+0x155/frame 0xfffffe010da3cde0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010da3ce20 _sleep() at _sleep+0x29e/frame 0xfffffe010da3cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da3cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da3cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da3cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100155 td 0xfffffe010a31a740 sched_switch() at sched_switch+0x578/frame 0xfffffe010da50dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe010da50de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010da50e20 _sleep() at _sleep+0x29e/frame 0xfffffe010da50ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da50ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da50f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da50f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100156 td 0xfffffe010a31a020 sched_switch() at sched_switch+0x578/frame 0xfffffe010da4bdc0 mi_switch() at mi_switch+0x155/frame 0xfffffe010da4bde0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010da4be20 _sleep() at _sleep+0x29e/frame 0xfffffe010da4bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da4bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da4bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da4bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100157 td 0xfffffe010ddc2740 sched_switch() at sched_switch+0x578/frame 0xfffffe010da5adc0 mi_switch() at mi_switch+0x155/frame 0xfffffe010da5ade0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010da5ae20 _sleep() at _sleep+0x29e/frame 0xfffffe010da5aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da5aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da5af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da5af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100158 td 0xfffffe010ddc2020 sched_switch() at sched_switch+0x578/frame 0xfffffe010da55dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe010da55de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010da55e20 _sleep() at _sleep+0x29e/frame 0xfffffe010da55ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da55ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da55f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da55f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100174 td 0xfffffe010e678560 sched_switch() at sched_switch+0x578/frame 0xfffffe010daa5dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe010daa5de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010daa5e20 _sleep() at _sleep+0x29e/frame 0xfffffe010daa5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010daa5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010daa5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010daa5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100175 td 0xfffffe010e677e40 sched_switch() at sched_switch+0x578/frame 0xfffffe010dab4dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe010dab4de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010dab4e20 _sleep() at _sleep+0x29e/frame 0xfffffe010dab4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dab4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dab4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dab4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100176 td 0xfffffe010e677720 sched_switch() at sched_switch+0x578/frame 0xfffffe010daafdc0 mi_switch() at mi_switch+0x155/frame 0xfffffe010daafde0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010daafe20 _sleep() at _sleep+0x29e/frame 0xfffffe010daafec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010daafef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010daaff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010daaff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100177 td 0xfffffe010e677000 sched_switch() at sched_switch+0x578/frame 0xfffffe010dabedc0 mi_switch() at mi_switch+0x155/frame 0xfffffe010dabede0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010dabee20 _sleep() at _sleep+0x29e/frame 0xfffffe010dabeec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dabeef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dabef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dabef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100178 td 0xfffffe010e50e740 sched_switch() at sched_switch+0x578/frame 0xfffffe010dab9dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe010dab9de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010dab9e20 _sleep() at _sleep+0x29e/frame 0xfffffe010dab9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dab9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dab9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dab9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100194 td 0xfffffe010e73be40 sched_switch() at sched_switch+0x578/frame 0xfffffe010db09dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe010db09de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010db09e20 _sleep() at _sleep+0x29e/frame 0xfffffe010db09ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010db09ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db09f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db09f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe00e4c60ac0 sched_switch() at sched_switch+0x578/frame 0xfffffe00377e1a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00377e1a30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377e1a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00377e1ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00377e1ad0 _sleep() at _sleep+0x294/frame 0xfffffe00377e1b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe00377e1c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00377e1e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00377e1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00377e1f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x28e34a, rsp = 0x7fffffffe718, rbp = 0x7fffffffe780 --- Tracing command crypto pid 2 tid 100107 td 0xfffffe00e4d2eac0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e84db0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e84dd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e84e10 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e84eb0 crypto_proc() at crypto_proc+0xbf/frame 0xfffffe00e4e84ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e84f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e84f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100108 td 0xfffffe00e4d2e3a0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e7fdb0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e7fdd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e7fe10 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e7feb0 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e7fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100109 td 0xfffffe00e4d35020 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e8edb0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e8edd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e8ee10 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e8eeb0 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e8eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e8ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e8ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100110 td 0xfffffe00e4d34900 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e89db0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e89dd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e89e10 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e89eb0 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e89ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e89f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e89f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100111 td 0xfffffe00e4d341e0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e98db0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e98dd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e98e10 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e98eb0 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e98ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e98f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e98f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100112 td 0xfffffe00e4d33ac0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e93db0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e93dd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e93e10 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e93eb0 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e93ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e93f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e93f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100113 td 0xfffffe00e4d333a0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4ea2db0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ea2dd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ea2e10 _sleep() at _sleep+0x29e/frame 0xfffffe00e4ea2eb0 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4ea2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100114 td 0xfffffe00e4d32c80 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e9ddb0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e9ddd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e9de10 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e9deb0 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e9def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e9df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e9df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe00e4c611e0 sched_switch() at sched_switch+0x578/frame 0xfffffe00377e6dd0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377e6df0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377e6e30 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00377e6e90 audit_worker() at audit_worker+0x9f/frame 0xfffffe00377e6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe00e4c603a0 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81ffc790 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81ffc7a0 trap() at trap+0x56/frame 0xffffffff81ffc8b0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81ffc8b0 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00377f0dd0, rbp = 0xfffffe00377f0dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377f0dd0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377f0e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377f0e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377f0e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe00e4c5fc80 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e10 trap() at trap+0x56/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00377ebdd0, rbp = 0xfffffe00377ebdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377ebdd0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377ebe10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377ebe30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377ebe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377ebef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ebf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe00e4c5f560 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce2de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce2de10 trap() at trap+0x56/frame 0xfffffe003ce2df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce2df20 --- trap 0x13, rip = 0xffffffff810ba8ae, rsp = 0xfffffe00377fae40, rbp = 0xfffffe00377fae50 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00377fae50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377faef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe00e4c5ee40 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3ae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ae10 trap() at trap+0x56/frame 0xfffffe003ce3af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3af20 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00377f5dd0, rbp = 0xfffffe00377f5dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377f5dd0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377f5e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377f5e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377f5e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377f5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00e4c5e720 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce47e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce47e10 trap() at trap+0x56/frame 0xfffffe003ce47f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce47f20 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00e4830dd0, rbp = 0xfffffe00e4830dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4830dd0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00e4830e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4830e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4830e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4830ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4830f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4830f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe00e4c5e000 sched_switch() at sched_switch+0x578/frame 0xfffffe00377ffe30 mi_switch() at mi_switch+0x155/frame 0xfffffe00377ffe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe00e4c66c80 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce61e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce61e10 trap() at trap+0x56/frame 0xfffffe003ce61f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce61f20 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00e483add0, rbp = 0xfffffe00e483add0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e483add0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00e483ae10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e483ae30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e483ae50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e483aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe00e4c66560 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6ee10 trap() at trap+0x56/frame 0xfffffe003ce6ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6ef20 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00e4835dd0, rbp = 0xfffffe00e4835dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4835dd0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00e4835e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4835e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4835e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4835ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4835f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4835f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe00e4c65e40 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7be00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7be10 trap() at trap+0x56/frame 0xfffffe003ce7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7bf20 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00e4844dd0, rbp = 0xfffffe00e4844dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4844dd0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00e4844e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4844e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4844e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4844ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4844f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4844f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe00e4c65720 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce88e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce88e10 trap() at trap+0x56/frame 0xfffffe003ce88f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce88f20 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00e483fdd0, rbp = 0xfffffe00e483fdd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e483fdd0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00e483fe10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e483fe30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e483fe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e483fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00e4c65000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce95e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce95e10 trap() at trap+0x56/frame 0xfffffe003ce95f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce95f20 --- trap 0x13, rip = 0xffffffff810ba8ae, rsp = 0xfffffe00e484ee40, rbp = 0xfffffe00e484ee50 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00e484ee50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e484eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e484ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e484ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00e4c62740 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea2e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea2e10 trap() at trap+0x56/frame 0xfffffe003cea2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea2f20 --- trap 0x13, rip = 0xffffffff810ba1c6, rsp = 0xfffffe00e4849dd0, rbp = 0xfffffe00e4849dd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00e4849dd0 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00e4849e10 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e4849e30 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e4849e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4849ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4849f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4849f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100041 td 0xfffffe00e4cf9560 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48dae40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48dae60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e48daef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48daf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48daf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100042 td 0xfffffe00e4cf8e40 sched_switch() at sched_switch+0x578/frame 0xfffffe00e48d5e40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48d5e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e48d5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffffe00e4cf61e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100077 td 0xfffffe00e4d11740 sched_switch() at sched_switch+0x578/frame 0xfffffe00e49bee40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49bee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49beef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49bef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49bef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100078 td 0xfffffe00e4d11020 sched_switch() at sched_switch+0x578/frame 0xfffffe00e49b9e40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49b9e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49b9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49b9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49b9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100079 td 0xfffffe00e4d10900 sched_switch() at sched_switch+0x578/frame 0xfffffe00e49c8e40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49c8e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49c8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49c8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100080 td 0xfffffe00e4d101e0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e49c3e40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49c3e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49c3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49c3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100081 td 0xfffffe00e4d0fac0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e49d2e40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49d2e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49d2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49d2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49d2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100082 td 0xfffffe00e4d0f3a0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e49cde40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49cde60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49cdef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49cdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49cdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100083 td 0xfffffe00e4d0ec80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100084 td 0xfffffe00e4d0e560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100085 td 0xfffffe00e4d151e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100086 td 0xfffffe00e4d14ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100087 td 0xfffffe00e4d143a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100088 td 0xfffffe00e4d13c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100089 td 0xfffffe00e4d13560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100090 td 0xfffffe00e4d12e40 sched_switch() at sched_switch+0x578/frame 0xfffffe00e49f5e40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49f5e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49f5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100125 td 0xfffffe00e4d74560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100126 td 0xfffffe00e4d73e40 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4ed9e40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ed9e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ed9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100127 td 0xfffffe00e4d73720 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4ee8e40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ee8e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ee8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ee8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100133 td 0xfffffe010a316000 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4f06e40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f06e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f06ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f06f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f06f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100144 td 0xfffffe010a317560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100145 td 0xfffffe010a316e40 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4f5ae40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f5ae60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f5aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f5af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f5af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100159 td 0xfffffe010ddc1900 sched_switch() at sched_switch+0x578/frame 0xfffffe010da64e40 mi_switch() at mi_switch+0x155/frame 0xfffffe010da64e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010da64ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da64f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da64f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100160 td 0xfffffe010ddc11e0 sched_switch() at sched_switch+0x578/frame 0xfffffe010da5fe40 mi_switch() at mi_switch+0x155/frame 0xfffffe010da5fe60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010da5fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da5ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da5ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100161 td 0xfffffe010ddc0ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100162 td 0xfffffe010ddc03a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100163 td 0xfffffe010ddbfc80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100164 td 0xfffffe010ddbf560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100165 td 0xfffffe010e50d1e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100166 td 0xfffffe010e50cac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100167 td 0xfffffe010e50c3a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100168 td 0xfffffe010e50bc80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100169 td 0xfffffe010e50b560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100170 td 0xfffffe010e50ae40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100171 td 0xfffffe010e50a720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100172 td 0xfffffe010e50a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100173 td 0xfffffe010e678c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe010e73b720 sched_switch() at sched_switch+0x578/frame 0xfffffe010dac8e40 mi_switch() at mi_switch+0x155/frame 0xfffffe010dac8e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010dac8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dac8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100180 td 0xfffffe010e73b000 sched_switch() at sched_switch+0x578/frame 0xfffffe010dac3e40 mi_switch() at mi_switch+0x155/frame 0xfffffe010dac3e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010dac3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dac3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100181 td 0xfffffe010e67b740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffffe010e67b020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffffe010e67a900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffffe010e67a1e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffffe010e679ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffffe010e6793a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffffe010e73f020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffffe010e73e900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffffe010e73e1e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffffe010e73dac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100191 td 0xfffffe010e73d3a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100192 td 0xfffffe010e73cc80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100193 td 0xfffffe010e73c560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100245 td 0xfffffe010e019720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100246 td 0xfffffe010e019000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100247 td 0xfffffe010e36b740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100248 td 0xfffffe010e36b020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100249 td 0xfffffe010ebfdac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100250 td 0xfffffe010ebfd3a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100251 td 0xfffffe010ebfcc80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100252 td 0xfffffe010ebfc560 fork_trampoline() at fork_trampoline Tracing command geom pid 13 tid 100092 td 0xfffffe00e4d12000 sched_switch() at sched_switch+0x578/frame 0xfffffe00e49ffdc0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49ffde0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e49ffe20 _sleep() at _sleep+0x29e/frame 0xfffffe00e49ffec0 g_run_events() at g_run_events+0x474/frame 0xfffffe00e49ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100093 td 0xfffffe00e4d2dc80 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e3edb0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e3edd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e3ee10 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e3eeb0 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe00e4e3eee0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00e4e3eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100094 td 0xfffffe00e4d2d560 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4e39db0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e39dd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e39e10 _sleep() at _sleep+0x29e/frame 0xfffffe00e4e39eb0 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe00e4e39ee0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe00e4e39ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e39f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 14 tid 100115 td 0xfffffe00e4d32560 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4eacdb0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eacdd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4eace10 _sleep() at _sleep+0x29e/frame 0xfffffe00e4eaceb0 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4eacef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eacf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eacf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 15 tid 100116 td 0xfffffe00e4d31e40 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4ea7db0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ea7dd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ea7e10 _sleep() at _sleep+0x29e/frame 0xfffffe00e4ea7eb0 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4ea7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 16 tid 100117 td 0xfffffe00e4d38ac0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4eb6db0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eb6dd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4eb6e10 _sleep() at _sleep+0x29e/frame 0xfffffe00e4eb6eb0 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4eb6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 17 tid 100118 td 0xfffffe00e4d383a0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4eb1db0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eb1dd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4eb1e10 _sleep() at _sleep+0x29e/frame 0xfffffe00e4eb1eb0 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4eb1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 18 tid 100119 td 0xfffffe00e4d37c80 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4ec0db0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ec0dd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ec0e10 _sleep() at _sleep+0x29e/frame 0xfffffe00e4ec0eb0 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4ec0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 19 tid 100120 td 0xfffffe00e4d37560 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4ebbdb0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ebbdd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ebbe10 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ebbe70 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe00e4ebbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ebbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ebbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100121 td 0xfffffe00e4d36e40 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4ecada0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ecadc0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ecae00 _sleep() at _sleep+0x29e/frame 0xfffffe00e4ecaea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ecaef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ecaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100122 td 0xfffffe00e4d36720 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4ec5da0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ec5dc0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ec5e00 _sleep() at _sleep+0x29e/frame 0xfffffe00e4ec5ea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ec5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100123 td 0xfffffe00e4d36000 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4ed4da0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ed4dc0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ed4e00 _sleep() at _sleep+0x29e/frame 0xfffffe00e4ed4ea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ed4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100124 td 0xfffffe00e4d35740 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4ecfda0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ecfdc0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ecfe00 _sleep() at _sleep+0x29e/frame 0xfffffe00e4ecfea0 xpt_async_td() at xpt_async_td+0x74/frame 0xfffffe00e4ecfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ecff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100152 td 0xfffffe010d9fa000 sched_switch() at sched_switch+0x578/frame 0xfffffe010da37dc0 mi_switch() at mi_switch+0x155/frame 0xfffffe010da37de0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010da37e20 _sleep() at _sleep+0x29e/frame 0xfffffe010da37ec0 xpt_scanner_thread() at xpt_scanner_thread+0x158/frame 0xfffffe010da37ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da37f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da37f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100128 td 0xfffffe00e4d73000 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4ee3e00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ee3e20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ee3e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ee3ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ee3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ee3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100129 td 0xfffffe00e4d3a740 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4ef2e00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ef2e20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ef2e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ef2ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100130 td 0xfffffe00e4d3a020 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4eede00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eede20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4eede60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4eedec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eedef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eedf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eedf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100131 td 0xfffffe00e4d39900 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4efce00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4efce20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4efce60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4efcec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4efcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4efcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4efcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100132 td 0xfffffe00e4d391e0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4ef7e00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ef7e20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ef7e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ef7ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100134 td 0xfffffe00e4d77740 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4f01e00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f01e20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f01e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f01ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f01ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f01f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f01f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100135 td 0xfffffe00e4d77020 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4f10e00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f10e20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f10e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f10ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f10ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f10f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f10f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100136 td 0xfffffe00e4d76900 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4f0be00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f0be20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f0be60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f0bec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f0bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f0bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f0bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100137 td 0xfffffe00e4d761e0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4f1ae00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f1ae20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f1ae60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f1aec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f1aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f1af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f1af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100138 td 0xfffffe00e4d75ac0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4f15e00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f15e20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f15e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f15ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f15ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f15f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f15f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100139 td 0xfffffe010a319900 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4f3ce00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f3ce20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f3ce60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f3cec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f3cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f3cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f3cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100140 td 0xfffffe010a3191e0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4f37e00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f37e20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f37e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f37ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f37ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f37f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f37f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100141 td 0xfffffe010a318ac0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4f46e00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f46e20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f46e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f46ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f46ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f46f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f46f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100142 td 0xfffffe010a3183a0 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4f41e00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f41e20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f41e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f41ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f41ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f41f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f41f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100143 td 0xfffffe010a317c80 sched_switch() at sched_switch+0x578/frame 0xfffffe00e4f50e00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f50e20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f50e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f50ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f50ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f50f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f50f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 22 tid 100147 td 0xfffffe010d9fc3a0 sched_switch() at sched_switch+0x578/frame 0xfffffe010da28d20 mi_switch() at mi_switch+0x155/frame 0xfffffe010da28d40 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010da28d80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010da28dc0 _sleep() at _sleep+0x282/frame 0xfffffe010da28e60 random_kthread() at random_kthread+0xa7/frame 0xfffffe010da28ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da28f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da28f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 23 tid 100153 td 0xfffffe010ddbee40 sched_switch() at sched_switch+0x578/frame 0xfffffe010da46d80 mi_switch() at mi_switch+0x155/frame 0xfffffe010da46da0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010da46de0 _sleep() at _sleep+0x29e/frame 0xfffffe010da46e80 enc_daemon() at enc_daemon+0xf6/frame 0xfffffe010da46ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da46f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da46f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 24 tid 100154 td 0xfffffe010ddbe720 sched_switch() at sched_switch+0x578/frame 0xfffffe010da41d80 mi_switch() at mi_switch+0x155/frame 0xfffffe010da41da0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010da41de0 _sleep() at _sleep+0x29e/frame 0xfffffe010da41e80 enc_daemon() at enc_daemon+0xf6/frame 0xfffffe010da41ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da41f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da41f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 25 tid 100195 td 0xfffffe010e302ac0 sched_switch() at sched_switch+0x578/frame 0xfffffe010db30ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe010db30ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010db30b10 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db30b50 _sleep() at _sleep+0x282/frame 0xfffffe010db30bf0 vm_pageout_worker() at vm_pageout_worker+0x29c/frame 0xfffffe010db30eb0 vm_pageout() at vm_pageout+0x1d7/frame 0xfffffe010db30ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db30f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db30f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 25 tid 100205 td 0xfffffe010e367000 sched_switch() at sched_switch+0x578/frame 0xfffffe010db58b70 mi_switch() at mi_switch+0x155/frame 0xfffffe010db58b90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010db58bd0 _sleep() at _sleep+0x29e/frame 0xfffffe010db58c70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xb8c/frame 0xfffffe010db58ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db58f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db58f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 25 tid 100206 td 0xfffffe010e327740 sched_switch() at sched_switch+0x578/frame 0xfffffe010db53d80 mi_switch() at mi_switch+0x155/frame 0xfffffe010db53da0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010db53de0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db53e20 _sleep() at _sleep+0x282/frame 0xfffffe010db53ec0 uma_reclaim_worker() at uma_reclaim_worker+0xc8/frame 0xfffffe010db53ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db53f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db53f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 26 tid 100196 td 0xfffffe010e3023a0 sched_switch() at sched_switch+0x578/frame 0xfffffe010db2bd80 mi_switch() at mi_switch+0x155/frame 0xfffffe010db2bda0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010db2bde0 _sleep() at _sleep+0x29e/frame 0xfffffe010db2be80 vm_daemon() at vm_daemon+0x92/frame 0xfffffe010db2bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db2bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db2bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 27 tid 100197 td 0xfffffe010e301c80 sched_switch() at sched_switch+0x578/frame 0xfffffe010db3ad60 mi_switch() at mi_switch+0x155/frame 0xfffffe010db3ad80 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010db3adc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db3ae00 _sleep() at _sleep+0x282/frame 0xfffffe010db3aea0 buf_daemon() at buf_daemon+0x116/frame 0xfffffe010db3aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db3af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db3af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 27 tid 100198 td 0xfffffe010ddbe000 sched_switch() at sched_switch+0x578/frame 0xfffffe010db3fd50 mi_switch() at mi_switch+0x155/frame 0xfffffe010db3fd70 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010db3fdb0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db3fdf0 _sleep() at _sleep+0x282/frame 0xfffffe010db3fe90 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010db3fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db3ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db3ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 27 tid 100199 td 0xfffffe010d9fe740 sched_switch() at sched_switch+0x578/frame 0xfffffe010ef07d50 mi_switch() at mi_switch+0x155/frame 0xfffffe010ef07d70 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010ef07db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010ef07df0 _sleep() at _sleep+0x282/frame 0xfffffe010ef07e90 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010ef07ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010ef07f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010ef07f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command bufdaemon pid 27 tid 100200 td 0xfffffe010d9fe020 sched_switch() at sched_switch+0x578/frame 0xfffffe010f916d50 mi_switch() at mi_switch+0x155/frame 0xfffffe010f916d70 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010f916db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010f916df0 _sleep() at _sleep+0x282/frame 0xfffffe010f916e90 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010f916ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010f916f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010f916f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command bufdaemon pid 27 tid 100201 td 0xfffffe010d9fd900 sched_switch() at sched_switch+0x578/frame 0xfffffe010db44d50 mi_switch() at mi_switch+0x155/frame 0xfffffe010db44d70 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010db44db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db44df0 _sleep() at _sleep+0x282/frame 0xfffffe010db44e90 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010db44ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db44f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db44f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 27 tid 100202 td 0xfffffe010d9fd1e0 sched_switch() at sched_switch+0x578/frame 0xfffffe010db49d50 mi_switch() at mi_switch+0x155/frame 0xfffffe010db49d70 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010db49db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db49df0 _sleep() at _sleep+0x282/frame 0xfffffe010db49e90 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010db49ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db49f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db49f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 27 tid 100203 td 0xfffffe010d9fcac0 sched_switch() at sched_switch+0x578/frame 0xfffffe0110325d50 mi_switch() at mi_switch+0x155/frame 0xfffffe0110325d70 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0110325db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0110325df0 _sleep() at _sleep+0x282/frame 0xfffffe0110325e90 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0110325ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0110325f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0110325f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command bufdaemon pid 27 tid 100204 td 0xfffffe010e324560 sched_switch() at sched_switch+0x578/frame 0xfffffe0111138d50 mi_switch() at mi_switch+0x155/frame 0xfffffe0111138d70 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0111138db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0111138df0 _sleep() at _sleep+0x282/frame 0xfffffe0111138e90 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0111138ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0111138f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0111138f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command bufdaemon pid 27 tid 100218 td 0xfffffe010e50d900 sched_switch() at sched_switch+0x578/frame 0xfffffe0141b8ad70 mi_switch() at mi_switch+0x155/frame 0xfffffe0141b8ad90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141b8add0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0141b8ae10 _sleep() at _sleep+0x282/frame 0xfffffe0141b8aeb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe0141b8aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0141b8af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0141b8af30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command bufdaemon pid 27 tid 100226 td 0xfffffe010e814020 sched_switch() at sched_switch+0x578/frame 0xfffffe0141b9ed70 mi_switch() at mi_switch+0x155/frame 0xfffffe0141b9ed90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141b9edd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0141b9ee10 _sleep() at _sleep+0x282/frame 0xfffffe0141b9eeb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe0141b9eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0141b9ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0141b9ef30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command vnlru pid 28 tid 100207 td 0xfffffe010e301560 sched_switch() at sched_switch+0x578/frame 0xfffffe010db35d10 mi_switch() at mi_switch+0x155/frame 0xfffffe010db35d30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010db35d70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db35db0 _sleep() at _sleep+0x282/frame 0xfffffe010db35e50 vnlru_proc() at vnlru_proc+0xa2c/frame 0xfffffe010db35ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db35f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db35f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 29 tid 100208 td 0xfffffe010e300e40 sched_switch() at sched_switch+0x578/frame 0xfffffe0141b49d40 mi_switch() at mi_switch+0x155/frame 0xfffffe0141b49d60 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141b49da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0141b49de0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x19b/frame 0xfffffe0141b49e60 sched_sync() at sched_sync+0x63d/frame 0xfffffe0141b49ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0141b49f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0141b49f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command dhclient pid 2326 tid 100263 td 0xfffffe01439261e0 sched_switch() at sched_switch+0x578/frame 0xfffffe0144242a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0144242a80 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144242ac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144242b10 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0144242b20 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0144242b80 seltdwait() at seltdwait+0x8d/frame 0xfffffe0144242bc0 kern_select() at kern_select+0xa4e/frame 0xfffffe0144242dc0 sys_select() at sys_select+0x56/frame 0xfffffe0144242e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144242f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144242f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8011e3d3a, rsp = 0x7fffffffe938, rbp = 0x7fffffffe9f0 --- Tracing command dhclient pid 2329 tid 100212 td 0xfffffe010e300720 sched_switch() at sched_switch+0x578/frame 0xfffffe0141b44aa0 mi_switch() at mi_switch+0x155/frame 0xfffffe0141b44ac0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141b44b00 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141b44b50 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141b44b60 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141b44bc0 seltdwait() at seltdwait+0x8d/frame 0xfffffe0141b44c00 kern_poll_kfds() at kern_poll_kfds+0x41b/frame 0xfffffe0141b44c90 kern_poll() at kern_poll+0x9f/frame 0xfffffe0141b44de0 sys_poll() at sys_poll+0x50/frame 0xfffffe0141b44e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141b44f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141b44f30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8011e3c3a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffebb0 --- Tracing command dhclient pid 2388 tid 100258 td 0xfffffe010ebfb720 sched_switch() at sched_switch+0x578/frame 0xfffffe014421fa50 mi_switch() at mi_switch+0x155/frame 0xfffffe014421fa70 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014421fab0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014421fb00 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014421fb40 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19b/frame 0xfffffe014421fbc0 seltdwait() at seltdwait+0x7f/frame 0xfffffe014421fc00 kern_poll_kfds() at kern_poll_kfds+0x41b/frame 0xfffffe014421fc90 kern_poll() at kern_poll+0x9f/frame 0xfffffe014421fde0 sys_poll() at sys_poll+0x50/frame 0xfffffe014421fe00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014421ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014421ff30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8011e3c3a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffebb0 --- Tracing command devd pid 2393 tid 100228 td 0xfffffe01438b7c80 sched_switch() at sched_switch+0x578/frame 0xfffffe0141bffa10 mi_switch() at mi_switch+0x155/frame 0xfffffe0141bffa30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141bffa70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141bffac0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0141bffb00 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19b/frame 0xfffffe0141bffb80 seltdwait() at seltdwait+0x7f/frame 0xfffffe0141bffbc0 kern_select() at kern_select+0xa4e/frame 0xfffffe0141bffdc0 sys_select() at sys_select+0x56/frame 0xfffffe0141bffe00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141bfff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141bfff30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x28c66a, rsp = 0x7fffffffcab8, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2582 tid 100257 td 0xfffffe010ebfbe40 sched_switch() at sched_switch+0x578/frame 0xfffffe0144224ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0144224ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144224b10 _sleep() at _sleep+0x29e/frame 0xfffffe0144224bb0 bufwait() at bufwait+0xc4/frame 0xfffffe0144224bf0 bufwrite() at bufwrite+0x25a/frame 0xfffffe0144224c40 ffs_update() at ffs_update+0x2f6/frame 0xfffffe0144224ca0 ffs_syncvnode() at ffs_syncvnode+0x4bc/frame 0xfffffe0144224d30 ffs_fsync() at ffs_fsync+0x1e/frame 0xfffffe0144224d60 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x59/frame 0xfffffe0144224d80 kern_fsync() at kern_fsync+0x184/frame 0xfffffe0144224e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144224f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144224f30 --- syscall (95, FreeBSD ELF64, sys_fsync), rip = 0x8011c8b5a, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffec20 --- Tracing command watchdogd pid 2590 tid 100244 td 0xfffffe010e019e40 sched_switch() at sched_switch+0x578/frame 0xfffffe010db99bb0 mi_switch() at mi_switch+0x155/frame 0xfffffe010db99bd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010db99c10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db99c60 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010db99ca0 _sleep() at _sleep+0x26e/frame 0xfffffe010db99d40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe010db99dc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe010db99e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe010db99f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db99f30 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011bebda, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffea30 --- Tracing command rpcbind pid 2612 tid 100274 td 0xfffffe010e303900 sched_switch() at sched_switch+0x578/frame 0xfffffe014427ea50 mi_switch() at mi_switch+0x155/frame 0xfffffe014427ea70 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014427eab0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014427eb00 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014427eb40 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19b/frame 0xfffffe014427ebc0 seltdwait() at seltdwait+0x7f/frame 0xfffffe014427ec00 kern_poll_kfds() at kern_poll_kfds+0x41b/frame 0xfffffe014427ec90 kern_poll() at kern_poll+0x9f/frame 0xfffffe014427ede0 sys_poll() at sys_poll+0x50/frame 0xfffffe014427ee00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014427ef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014427ef30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8011bac3a, rsp = 0x7fffffffc978, rbp = 0x7fffffffeba0 --- Tracing command sh pid 68165 tid 102134 td 0xfffffe014fe81900 sched_switch() at sched_switch+0x578/frame 0xfffffe0151e3ca10 mi_switch() at mi_switch+0x155/frame 0xfffffe0151e3ca30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0151e3ca70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0151e3cac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0151e3cad0 _sleep() at _sleep+0x294/frame 0xfffffe0151e3cb70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe0151e3cc00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0151e3ce00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0151e3cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0151e3cf30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x801209e9a, rsp = 0x7fffffffd688, rbp = 0x7fffffffd730 --- Tracing command tee pid 68166 tid 1027588 td 0xfffffe0158d5c900 sched_switch() at sched_switch+0x578/frame 0xfffffe0172db3b80 mi_switch() at mi_switch+0x155/frame 0xfffffe0172db3ba0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0172db3be0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0172db3c30 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0172db3c40 _sleep() at _sleep+0x294/frame 0xfffffe0172db3ce0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe0172db3d40 dofileread() at dofileread+0x81/frame 0xfffffe0172db3d90 sys_read() at sys_read+0xc0/frame 0xfffffe0172db3e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0172db3f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0172db3f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011a5cba, rsp = 0x7fffffffe5b8, rbp = 0x7fffffffe610 --- Tracing command sh pid 68167 tid 102359 td 0xfffffe0143eed3a0 sched_switch() at sched_switch+0x578/frame 0xfffffe01522a1a10 mi_switch() at mi_switch+0x155/frame 0xfffffe01522a1a30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01522a1a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01522a1ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01522a1ad0 _sleep() at _sleep+0x294/frame 0xfffffe01522a1b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01522a1c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01522a1e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01522a1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01522a1f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x801209e9a, rsp = 0x7fffffffe068, rbp = 0x7fffffffe110 --- Tracing command rpc.statd pid 2637 tid 100272 td 0xfffffe010e811560 sched_switch() at sched_switch+0x578/frame 0xfffffe0144251a10 mi_switch() at mi_switch+0x155/frame 0xfffffe0144251a30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144251a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144251ac0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0144251b00 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19b/frame 0xfffffe0144251b80 seltdwait() at seltdwait+0x7f/frame 0xfffffe0144251bc0 kern_select() at kern_select+0xa4e/frame 0xfffffe0144251dc0 sys_select() at sys_select+0x56/frame 0xfffffe0144251e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144251f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144251f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8011b4d3a, rsp = 0x7fffffffe9f8, rbp = 0x7fffffffeb40 --- Tracing command rpc.lockd pid 2640 tid 100261 td 0xfffffe010ebfb000 sched_switch() at sched_switch+0x578/frame 0xfffffe0144238980 mi_switch() at mi_switch+0x155/frame 0xfffffe01442389a0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01442389e0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144238a30 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0144238a70 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19b/frame 0xfffffe0144238af0 svc_run_internal() at svc_run_internal+0xac1/frame 0xfffffe0144238c20 svc_run() at svc_run+0x250/frame 0xfffffe0144238c80 sys_nlm_syscall() at sys_nlm_syscall+0x74a/frame 0xfffffe0144238e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144238f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144238f30 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8011bd4ba, rsp = 0x7fffffffeb58, rbp = 0x7fffffffec20 --- Tracing command powerd pid 2645 tid 100240 td 0xfffffe010e304740 sched_switch() at sched_switch+0x578/frame 0xfffffe010db94a10 mi_switch() at mi_switch+0x155/frame 0xfffffe010db94a30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010db94a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db94ac0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010db94b00 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19b/frame 0xfffffe010db94b80 seltdwait() at seltdwait+0x7f/frame 0xfffffe010db94bc0 kern_select() at kern_select+0xa4e/frame 0xfffffe010db94dc0 sys_select() at sys_select+0x56/frame 0xfffffe010db94e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe010db94f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db94f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8011bed3a, rsp = 0x7fffffffeaf8, rbp = 0x7fffffffec30 --- Tracing command ntpd pid 2671 tid 100214 td 0xfffffe010e300000 sched_switch() at sched_switch+0x578/frame 0xfffffe0141b71a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0141b71a80 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141b71ac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141b71b10 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141b71b20 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141b71b80 seltdwait() at seltdwait+0x8d/frame 0xfffffe0141b71bc0 kern_select() at kern_select+0xa4e/frame 0xfffffe0141b71dc0 sys_select() at sys_select+0x56/frame 0xfffffe0141b71e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141b71f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141b71f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8015dcd3a, rsp = 0x7fffffffde78, rbp = 0x7fffffffdeb0 --- Tracing command inetd pid 2697 tid 100225 td 0xfffffe00e4d74c80 sched_switch() at sched_switch+0x578/frame 0xfffffe0141b58a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0141b58a80 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141b58ac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141b58b10 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141b58b20 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141b58b80 seltdwait() at seltdwait+0x8d/frame 0xfffffe0141b58bc0 kern_select() at kern_select+0xa4e/frame 0xfffffe0141b58dc0 sys_select() at sys_select+0x56/frame 0xfffffe0141b58e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141b58f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141b58f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8011ddd3a, rsp = 0x7fffffffdd78, rbp = 0x7fffffffec10 --- Tracing command sshd pid 2716 tid 100233 td 0xfffffe0143923000 sched_switch() at sched_switch+0x578/frame 0xfffffe010db5da20 mi_switch() at mi_switch+0x155/frame 0xfffffe010db5da40 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010db5da80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db5dad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db5dae0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010db5db40 seltdwait() at seltdwait+0x8d/frame 0xfffffe010db5db80 kern_select() at kern_select+0xa4e/frame 0xfffffe010db5dd80 sys_pselect() at sys_pselect+0x127/frame 0xfffffe010db5de00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe010db5df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db5df30 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x8016bfc7a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe5f0 --- Tracing command cron pid 2720 tid 100210 td 0xfffffe00e4d753a0 sched_switch() at sched_switch+0x578/frame 0xfffffe0141b5dbb0 mi_switch() at mi_switch+0x155/frame 0xfffffe0141b5dbd0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141b5dc10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141b5dc60 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0141b5dca0 _sleep() at _sleep+0x26e/frame 0xfffffe0141b5dd40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe0141b5ddc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0141b5de00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141b5df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141b5df30 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011d5bda, rsp = 0x7fffffffea48, rbp = 0x7fffffffec20 --- Tracing command getty pid 2734 tid 100209 td 0xfffffe010e36a900 sched_switch() at sched_switch+0x578/frame 0xfffffe0141b53b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0141b53b20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141b53b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141b53bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141b53bc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141b53c20 tty_wait() at tty_wait+0x42/frame 0xfffffe0141b53c50 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0141b53cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0141b53ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0141b53d40 dofileread() at dofileread+0x81/frame 0xfffffe0141b53d90 sys_read() at sys_read+0xc0/frame 0xfffffe0141b53e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141b53f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141b53f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c2cba, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2735 tid 100231 td 0xfffffe0143927020 sched_switch() at sched_switch+0x578/frame 0xfffffe010db6cb00 mi_switch() at mi_switch+0x155/frame 0xfffffe010db6cb20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010db6cb60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db6cbb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db6cbc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010db6cc20 tty_wait() at tty_wait+0x42/frame 0xfffffe010db6cc50 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe010db6ccb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010db6cce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010db6cd40 dofileread() at dofileread+0x81/frame 0xfffffe010db6cd90 sys_read() at sys_read+0xc0/frame 0xfffffe010db6ce00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe010db6cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db6cf30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c2cba, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2736 tid 100242 td 0xfffffe0143926900 sched_switch() at sched_switch+0x578/frame 0xfffffe010db67b00 mi_switch() at mi_switch+0x155/frame 0xfffffe010db67b20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010db67b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db67bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db67bc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010db67c20 tty_wait() at tty_wait+0x42/frame 0xfffffe010db67c50 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe010db67cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010db67ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010db67d40 dofileread() at dofileread+0x81/frame 0xfffffe010db67d90 sys_read() at sys_read+0xc0/frame 0xfffffe010db67e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe010db67f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db67f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c2cba, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2737 tid 100259 td 0xfffffe010e326900 sched_switch() at sched_switch+0x578/frame 0xfffffe0141b76b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0141b76b20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141b76b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141b76bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141b76bc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141b76c20 tty_wait() at tty_wait+0x42/frame 0xfffffe0141b76c50 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0141b76cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0141b76ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0141b76d40 dofileread() at dofileread+0x81/frame 0xfffffe0141b76d90 sys_read() at sys_read+0xc0/frame 0xfffffe0141b76e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141b76f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141b76f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c2cba, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2738 tid 100264 td 0xfffffe010e812ac0 sched_switch() at sched_switch+0x578/frame 0xfffffe014424cb00 mi_switch() at mi_switch+0x155/frame 0xfffffe014424cb20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014424cb60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014424cbb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014424cbc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014424cc20 tty_wait() at tty_wait+0x42/frame 0xfffffe014424cc50 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe014424ccb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe014424cce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe014424cd40 dofileread() at dofileread+0x81/frame 0xfffffe014424cd90 sys_read() at sys_read+0xc0/frame 0xfffffe014424ce00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014424cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014424cf30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c2cba, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2739 tid 100229 td 0xfffffe0143923720 sched_switch() at sched_switch+0x578/frame 0xfffffe010db62b00 mi_switch() at mi_switch+0x155/frame 0xfffffe010db62b20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010db62b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db62bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db62bc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010db62c20 tty_wait() at tty_wait+0x42/frame 0xfffffe010db62c50 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe010db62cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010db62ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010db62d40 dofileread() at dofileread+0x81/frame 0xfffffe010db62d90 sys_read() at sys_read+0xc0/frame 0xfffffe010db62e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe010db62f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db62f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c2cba, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2740 tid 100281 td 0xfffffe01438b7560 sched_switch() at sched_switch+0x578/frame 0xfffffe0141bfab00 mi_switch() at mi_switch+0x155/frame 0xfffffe0141bfab20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141bfab60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141bfabb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141bfabc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141bfac20 tty_wait() at tty_wait+0x42/frame 0xfffffe0141bfac50 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0141bfacb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0141bface0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0141bfad40 dofileread() at dofileread+0x81/frame 0xfffffe0141bfad90 sys_read() at sys_read+0xc0/frame 0xfffffe0141bfae00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141bfaf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141bfaf30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c2cba, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2741 tid 100236 td 0xfffffe0143938ac0 sched_switch() at sched_switch+0x578/frame 0xfffffe0141bb4b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0141bb4b20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141bb4b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141bb4bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141bb4bc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141bb4c20 tty_wait() at tty_wait+0x42/frame 0xfffffe0141bb4c50 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0141bb4cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0141bb4ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0141bb4d40 dofileread() at dofileread+0x81/frame 0xfffffe0141bb4d90 sys_read() at sys_read+0xc0/frame 0xfffffe0141bb4e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141bb4f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141bb4f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c2cba, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2742 tid 100237 td 0xfffffe01438ba740 sched_switch() at sched_switch+0x578/frame 0xfffffe010db8ab00 mi_switch() at mi_switch+0x155/frame 0xfffffe010db8ab20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010db8ab60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db8abb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db8abc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010db8ac20 tty_wait() at tty_wait+0x42/frame 0xfffffe010db8ac50 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe010db8acb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010db8ace0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010db8ad40 dofileread() at dofileread+0x81/frame 0xfffffe010db8ad90 sys_read() at sys_read+0xc0/frame 0xfffffe010db8ae00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe010db8af30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db8af30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c2cba, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2743 tid 100224 td 0xfffffe01439391e0 sched_switch() at sched_switch+0x578/frame 0xfffffe0141bb9b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0141bb9b20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141bb9b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141bb9bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141bb9bc0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141bb9c20 tty_wait() at tty_wait+0x42/frame 0xfffffe0141bb9c50 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0141bb9cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0141bb9ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0141bb9d40 dofileread() at dofileread+0x81/frame 0xfffffe0141bb9d90 sys_read() at sys_read+0xc0/frame 0xfffffe0141bb9e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141bb9f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141bb9f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c2cba, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command sshd pid 2744 tid 100278 td 0xfffffe01440ea900 sched_switch() at sched_switch+0x578/frame 0xfffffe014429caa0 mi_switch() at mi_switch+0x155/frame 0xfffffe014429cac0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014429cb00 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014429cb50 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014429cb60 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014429cbc0 seltdwait() at seltdwait+0x8d/frame 0xfffffe014429cc00 kern_poll_kfds() at kern_poll_kfds+0x41b/frame 0xfffffe014429cc90 kern_poll() at kern_poll+0x9f/frame 0xfffffe014429cde0 sys_poll() at sys_poll+0x50/frame 0xfffffe014429ce00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014429cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014429cf30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8016bfc3a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe550 --- Tracing command sshd pid 2747 tid 100277 td 0xfffffe0143924560 sched_switch() at sched_switch+0x578/frame 0xfffffe0144292a20 mi_switch() at mi_switch+0x155/frame 0xfffffe0144292a40 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144292a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144292ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0144292ae0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0144292b40 seltdwait() at seltdwait+0x8d/frame 0xfffffe0144292b80 kern_select() at kern_select+0xa4e/frame 0xfffffe0144292d80 sys_pselect() at sys_pselect+0x127/frame 0xfffffe0144292e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144292f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144292f30 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x8016bfc7a, rsp = 0x7fffffffa478, rbp = 0x7fffffffa4c0 --- Tracing command bash pid 2748 tid 100211 td 0xfffffe010e01b3a0 --- swapped out Tracing command su pid 2753 tid 100276 td 0xfffffe01440e7000 --- swapped out Tracing command csh pid 2754 tid 100254 td 0xfffffe010e8131e0 --- swapped out Tracing command bash pid 2756 tid 100262 td 0xfffffe0143927740 sched_switch() at sched_switch+0x578/frame 0xfffffe0144233a20 mi_switch() at mi_switch+0x155/frame 0xfffffe0144233a40 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144233a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144233ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0144233ae0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0144233b40 seltdwait() at seltdwait+0x8d/frame 0xfffffe0144233b80 kern_select() at kern_select+0xa4e/frame 0xfffffe0144233d80 sys_pselect() at sys_pselect+0x127/frame 0xfffffe0144233e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144233f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144233f30 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x8004ebc7a, rsp = 0x7fffffffd598, rbp = 0x7fffffffd660 --- Tracing command sh pid 2995 tid 100275 td 0xfffffe010e3031e0 sched_switch() at sched_switch+0x578/frame 0xfffffe0144279a10 mi_switch() at mi_switch+0x155/frame 0xfffffe0144279a30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144279a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144279ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0144279ad0 _sleep() at _sleep+0x294/frame 0xfffffe0144279b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe0144279c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0144279e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144279f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144279f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x801209e9a, rsp = 0x7fffffffd9e8, rbp = 0x7fffffffda90 --- Tracing command sh pid 3533 tid 100337 td 0xfffffe0143939900 --- swapped out Tracing command sh pid 3600 tid 100345 td 0xfffffe0144497740 sched_switch() at sched_switch+0x578/frame 0xfffffe0144319a10 mi_switch() at mi_switch+0x155/frame 0xfffffe0144319a30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144319a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144319ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0144319ad0 _sleep() at _sleep+0x294/frame 0xfffffe0144319b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe0144319c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0144319e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144319f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144319f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x801209e9a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe2d0 --- Tracing command awk pid 3601 tid 100346 td 0xfffffe0144497020 sched_switch() at sched_switch+0x578/frame 0xfffffe014433cb80 mi_switch() at mi_switch+0x155/frame 0xfffffe014433cba0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014433cbe0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014433cc30 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014433cc40 _sleep() at _sleep+0x294/frame 0xfffffe014433cce0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe014433cd40 dofileread() at dofileread+0x81/frame 0xfffffe014433cd90 sys_read() at sys_read+0xc0/frame 0xfffffe014433ce00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014433cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014433cf30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x801217cba, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe200 --- Tracing command sh pid 3603 tid 100343 td 0xfffffe014eab2000 sched_switch() at sched_switch+0x578/frame 0xfffffe0144328b80 mi_switch() at mi_switch+0x155/frame 0xfffffe0144328ba0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144328be0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144328c30 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0144328c40 _sleep() at _sleep+0x294/frame 0xfffffe0144328ce0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe0144328d40 dofileread() at dofileread+0x81/frame 0xfffffe0144328d90 sys_read() at sys_read+0xc0/frame 0xfffffe0144328e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144328f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144328f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x801209cba, rsp = 0x7fffffffdcc8, rbp = 0x7fffffffe1f0 --- Tracing command aiod1 pid 28923 tid 100253 td 0xfffffe010e813900 sched_switch() at sched_switch+0x578/frame 0xfffffe0144204d60 mi_switch() at mi_switch+0x155/frame 0xfffffe0144204d80 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144204dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0144204e00 _sleep() at _sleep+0x282/frame 0xfffffe0144204ea0 aio_daemon() at aio_daemon+0x305/frame 0xfffffe0144204ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0144204f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0144204f30 --- trap 0xc, rip = 0x8011be91a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4b0 --- Tracing command aiod2 pid 28924 tid 100222 td 0xfffffe010e814740 sched_switch() at sched_switch+0x578/frame 0xfffffe0141ba3d60 mi_switch() at mi_switch+0x155/frame 0xfffffe0141ba3d80 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141ba3dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0141ba3e00 _sleep() at _sleep+0x282/frame 0xfffffe0141ba3ea0 aio_daemon() at aio_daemon+0x305/frame 0xfffffe0141ba3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0141ba3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0141ba3f30 --- trap 0xc, rip = 0x8011ad91a, rsp = 0x7fffffffe598, rbp = 0x7fffffffe5b0 --- Tracing command aiod3 pid 28925 tid 100534 td 0xfffffe014faec020 sched_switch() at sched_switch+0x578/frame 0xfffffe014fcbdd60 mi_switch() at mi_switch+0x155/frame 0xfffffe014fcbdd80 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014fcbddc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe014fcbde00 _sleep() at _sleep+0x282/frame 0xfffffe014fcbdea0 aio_daemon() at aio_daemon+0x305/frame 0xfffffe014fcbdef0 fork_exit() at fork_exit+0x80/frame 0xfffffe014fcbdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014fcbdf30 --- trap 0xc, rip = 0x8011a891a, rsp = 0x7fffffffe478, rbp = 0x7fffffffe490 --- Tracing command aiod4 pid 28926 tid 100446 td 0xfffffe0143f45c80 sched_switch() at sched_switch+0x578/frame 0xfffffe0144369d60 mi_switch() at mi_switch+0x155/frame 0xfffffe0144369d80 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144369dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0144369e00 _sleep() at _sleep+0x282/frame 0xfffffe0144369ea0 aio_daemon() at aio_daemon+0x305/frame 0xfffffe0144369ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0144369f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0144369f30 --- trap 0xc, rip = 0x8011a891a, rsp = 0x7fffffffe478, rbp = 0x7fffffffe490 --- Tracing command sshd pid 31090 tid 1027114 td 0xfffffe015a7633a0 sched_switch() at sched_switch+0x578/frame 0xfffffe0169e6daa0 mi_switch() at mi_switch+0x155/frame 0xfffffe0169e6dac0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0169e6db00 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0169e6db50 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0169e6db60 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0169e6dbc0 seltdwait() at seltdwait+0x8d/frame 0xfffffe0169e6dc00 kern_poll_kfds() at kern_poll_kfds+0x41b/frame 0xfffffe0169e6dc90 kern_poll() at kern_poll+0x9f/frame 0xfffffe0169e6dde0 sys_poll() at sys_poll+0x50/frame 0xfffffe0169e6de00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0169e6df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0169e6df30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8016bfc3a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe550 --- Tracing command dd pid 72906 tid 1027314 td 0xfffffe01591ad1e0 sched_switch() at sched_switch+0x578/frame 0xfffffe0172859570 mi_switch() at mi_switch+0x155/frame 0xfffffe0172859590 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01728595d0 _sleep() at _sleep+0x29e/frame 0xfffffe0172859670 bufwrite() at bufwrite+0x2f6/frame 0xfffffe01728596c0 vfs_bio_awrite() at vfs_bio_awrite+0x24f/frame 0xfffffe0172859730 bufbdflush() at bufbdflush+0x1f3/frame 0xfffffe0172859780 bdwrite() at bdwrite+0x83/frame 0xfffffe01728597f0 cluster_write() at cluster_write+0x643/frame 0xfffffe01728598d0 ffs_write() at ffs_write+0x493/frame 0xfffffe0172859980 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe0172859a90 vn_write() at vn_write+0x2fc/frame 0xfffffe0172859b20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe0172859b80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe0172859cc0 vn_io_fault() at vn_io_fault+0x1ba/frame 0xfffffe0172859d40 dofilewrite() at dofilewrite+0x81/frame 0xfffffe0172859d90 sys_write() at sys_write+0xc0/frame 0xfffffe0172859e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0172859f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0172859f30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8011c2eda, rsp = 0x7fffffffe518, rbp = 0x7fffffffe550 --- Tracing command sh pid 72910 tid 1025141 td 0xfffffe0157b091e0 sched_switch() at sched_switch+0x578/frame 0xfffffe0169bbcb80 mi_switch() at mi_switch+0x155/frame 0xfffffe0169bbcba0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0169bbcbe0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0169bbcc30 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0169bbcc40 _sleep() at _sleep+0x294/frame 0xfffffe0169bbcce0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe0169bbcd40 dofileread() at dofileread+0x81/frame 0xfffffe0169bbcd90 sys_read() at sys_read+0xc0/frame 0xfffffe0169bbce00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0169bbcf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0169bbcf30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x801209cba, rsp = 0x7fffffffde08, rbp = 0x7fffffffdf50 --- Tracing command sh pid 73297 tid 1027529 td 0xfffffe0158d5d020 sched_switch() at sched_switch+0x578/frame 0xfffffe0172c8ca10 mi_switch() at mi_switch+0x155/frame 0xfffffe0172c8ca30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0172c8ca70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0172c8cac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0172c8cad0 _sleep() at _sleep+0x294/frame 0xfffffe0172c8cb70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe0172c8cc00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0172c8ce00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0172c8cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0172c8cf30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x801209e9a, rsp = 0x7fffffffdbb8, rbp = 0x7fffffffdc60 --- Tracing command sed pid 73299 tid 102488 td 0xfffffe0143fc2740 (CPU 5) kdb_enter() at kdb_enter+0x37/frame 0xfffffe0152526af0 assert_vop_locked() at assert_vop_locked+0xaf/frame 0xfffffe0152526b20 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x42/frame 0xfffffe0152526b40 ffs_bdflush() at ffs_bdflush+0x156/frame 0xfffffe0152526bb0 bdwrite() at bdwrite+0x83/frame 0xfffffe0152526c20 ffs_update() at ffs_update+0x355/frame 0xfffffe0152526c80 ufs_inactive() at ufs_inactive+0x260/frame 0xfffffe0152526cc0 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x59/frame 0xfffffe0152526ce0 vinactivef() at vinactivef+0xda/frame 0xfffffe0152526d20 vput_final() at vput_final+0x2fe/frame 0xfffffe0152526d80 exit1() at exit1+0x579/frame 0xfffffe0152526df0 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe0152526e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0152526f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0152526f30 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8011ad91a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe5c0 --- Tracing command sshd pid 32474 tid 1027337 td 0xfffffe0157ab6720 sched_switch() at sched_switch+0x578/frame 0xfffffe01728cca20 mi_switch() at mi_switch+0x155/frame 0xfffffe01728cca40 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01728cca80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01728ccad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01728ccae0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01728ccb40 seltdwait() at seltdwait+0x8d/frame 0xfffffe01728ccb80 kern_select() at kern_select+0xa4e/frame 0xfffffe01728ccd80 sys_pselect() at sys_pselect+0x127/frame 0xfffffe01728cce00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01728ccf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01728ccf30 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x8016bfc7a, rsp = 0x7fffffffa478, rbp = 0x7fffffffa4c0 --- Tracing command bash pid 32475 tid 1026884 td 0xfffffe0163699e40 --- swapped out Tracing command su pid 32480 tid 103462 td 0xfffffe01505ee720 --- swapped out Tracing command csh pid 32481 tid 1030599 td 0xfffffe0158d45c80 --- swapped out Tracing command bash pid 32486 tid 1029809 td 0xfffffe016ab14900 sched_switch() at sched_switch+0x578/frame 0xfffffe0180b18a20 mi_switch() at mi_switch+0x155/frame 0xfffffe0180b18a40 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0180b18a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0180b18ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0180b18ae0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0180b18b40 seltdwait() at seltdwait+0x8d/frame 0xfffffe0180b18b80 kern_select() at kern_select+0xa4e/frame 0xfffffe0180b18d80 sys_pselect() at sys_pselect+0x127/frame 0xfffffe0180b18e00 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0180b18f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0180b18f30 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x8004ebc7a, rsp = 0x7fffffffd598, rbp = 0x7fffffffd660 --- db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 5 (kgdb) bt #0 __curthread () at /var/tmp/deviant3/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=textdump@entry=0x0) at ../../../kern/kern_shutdown.c:399 #2 0xffffffff804d0e0a in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #3 0xffffffff804d0cc2 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x0) at ../../../ddb/db_command.c:482 #4 0xffffffff804d0d56 in db_command_script (command=command@entry=0xffffffff81bd39c0 "dump") at ../../../ddb/db_command.c:553 #5 0xffffffff804d61c8 in db_script_exec (scriptname=0xffffffff81bd3330 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #6 0xffffffff804d0cc2 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x0) at ../../../ddb/db_command.c:482 #7 0xffffffff804d0d56 in db_command_script (command=command@entry=0xffffffff81bd3952 "run pho1") at ../../../ddb/db_command.c:553 #8 0xffffffff804d61c8 in db_script_exec (scriptname=0xffffffff81bd3330 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #9 0xffffffff804d0cc2 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x1) at ../../../ddb/db_command.c:482 #10 0xffffffff804d093d in db_command_loop () at ../../../ddb/db_command.c:535 #11 0xffffffff804d40b6 in db_trap (type=, code=) at ../../../ddb/db_main.c:270 #12 0xffffffff80c7cb97 in kdb_trap (type=type@entry=0x3, code=code@entry=0x0, tf=tf@entry=0xfffffe0152526a20) at ../../../kern/subr_kdb.c:733 #13 0xffffffff810ffbb3 in trap (frame=0xfffffe0152526a20) at ../../../amd64/amd64/trap.c:609 #14 #15 kdb_enter (why=0xffffffff8120792a "vfslock", msg=) at ../../../kern/subr_kdb.c:506 #16 0xffffffff80d1f01f in vfs_badlock (msg=, str=0xffffffff812be904 "VOP_FSYNC", vp=0xfffffe010e309258) at ../../../kern/vfs_subr.c:5403 #17 assert_vop_locked (vp=0xfffffe010e309258, str=0xffffffff812be904 "VOP_FSYNC") at ../../../kern/vfs_subr.c:5432 #18 0xffffffff811c8a42 in VOP_FSYNC_APV (vop=0xffffffff81aeeb80 , a=a@entry=0xfffffe0152526b58) at vnode_if.c:1473 #19 0xffffffff80f3cf86 in VOP_FSYNC (vp=0xfffffe010e309258, waitfor=0x2, td=0xfffffe0143fc2740) at ./vnode_if.h:772 #20 ffs_bdflush (bo=0xfffffe010e3093d0, bp=) at ../../../ufs/ffs/ffs_snapshot.c:2239 #21 0xffffffff80cf4c03 in bdwrite (bp=0xfffffe003bbce0f0) at ../../../kern/vfs_bio.c:2423 #22 0xffffffff80f35be5 in ffs_update (vp=0xfffffe01468319c8, waitfor=0x0) at ../../../ufs/ffs/ffs_inode.c:223 #23 0xffffffff80f6be50 in ufs_inactive (ap=) at ../../../ufs/ufs/ufs_inode.c:203 #24 0xffffffff811c9a09 in VOP_INACTIVE_APV (vop=0xffffffff81b66750 , a=a@entry=0xfffffe0152526cf0) at vnode_if.c:2062 #25 0xffffffff80d21a5a in VOP_INACTIVE (vp=0xfffffe01468319c8) at ./vnode_if.h:1043 #26 vinactivef (vp=vp@entry=0xfffffe01468319c8) at ../../../kern/vfs_subr.c:3665 #27 0xffffffff80d210fe in vinactive (vp=0xfffffe01468319c8) at ../../../kern/vfs_subr.c:3689 #28 vput_final (vp=0xfffffe01468319c8, vp@entry=0xfffffe0143fc2740, func=, func@entry=VRELE) at ../../../kern/vfs_subr.c:3272 #29 0xffffffff80d206eb in vrele (vp=) at ../../../kern/vfs_subr.c:3312 #30 0xffffffff80be1039 in exit1 (td=, rval=, signo=signo@entry=0x0) at ../../../kern/kern_exit.c:431 #31 0xffffffff80be0abd in sys_sys_exit (td=0xffffffff81e9f320 , uap=) at ../../../kern/kern_exit.c:212 #32 0xffffffff811009a7 in syscallenter (td=0xfffffe0143fc2740) at ../../../amd64/amd64/../../kern/subr_syscall.c:189 #33 amd64_syscall (td=0xfffffe0143fc2740, traced=0x0) at ../../../amd64/amd64/trap.c:1191 #34 #35 0x00000008011ad91a in ?? () Backtrace stopped: Cannot access memory at address 0x7fffffffe5a8 (kgdb) f 17 #17 assert_vop_locked (vp=0xfffffe010e309258, str=0xffffffff812be904 "VOP_FSYNC") at ../../../kern/vfs_subr.c:5432 5432 vfs_badlock("is not locked but should be", str, vp); (kgdb) l 5427 if (KERNEL_PANICKED() || vp == NULL) 5428 return; 5429 5430 locked = VOP_ISLOCKED(vp); 5431 if (locked == 0 || locked == LK_EXCLOTHER) 5432 vfs_badlock("is not locked but should be", str, vp); 5433 } 5434 5435 void 5436 assert_vop_unlocked(struct vnode *vp, const char *str) (kgdb) p *vp $1 = {v_type = VCHR, v_irflag = 0x0, v_seqc = 0x0, v_nchash = 0x4b62f44, v_hash = 0x871849, v_op = 0xffffffff81aeeb80 , v_data = 0x0, v_mount = 0x0, v_nmntvnodes = {tqe_next = 0x0, tqe_prev = 0x0}, {v_mountedhere = 0xfffff8001c74f800, v_unpcb = 0xfffff8001c74f800, v_rdev = 0xfffff8001c74f800, v_fifoinfo = 0xfffff8001c74f800}, v_hashlist = {le_next = 0x0, le_prev = 0x0}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xfffffe010e3092b0}, v_cache_dd = 0x0, v_lock = {lock_object = {lo_name = 0xffffffff811e1836 "mntfs", lo_flags = 0x6f30008, lo_data = 0x0, lo_witness = 0xfffff8087fd83c80}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_pri = 0x60, lk_timo = 0x33, lk_stack = {depth = 0xc, pcs = {0xffffffff80bfd2c7, 0xffffffff811c9e7c, 0xffffffff80d38e84, 0xffffffff80f60bd0, 0xffffffff80d3aae5, 0xffffffff80f38689, 0xffffffff80f5edfc, 0xffffffff80d15c39, 0xffffffff80d13f6b, 0xffffffff80d13719, 0xffffffff811009a7, 0xffffffff810d0b6b, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = { lo_name = 0xffffffff8134a914 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd75500}, mtx_lock = 0x0}, v_vnlock = 0xfffffe010e3092c8, v_vnodelist = {tqe_next = 0xfffffe010e309bb8, tqe_prev = 0xfffffe010e309158}, v_lazylist = {tqe_next = 0x0, tqe_prev = 0x0}, v_bufobj = {bo_lock = {lock_object = { lo_name = 0xffffffff8130275a "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffff8087fd80900}, rw_lock = 0x1}, bo_ops = 0xffffffff81b661a8 , bo_object = 0xfffff800031cec60, bo_synclist = {le_next = 0x0, le_prev = 0xfffff8001c4a3190}, bo_private = 0xfffff8003163b580, bo_clean = {bv_hd = {tqh_first = 0xfffffe003bde14d0, tqh_last = 0xfffffe003ae43230}, bv_root = {pt_root = 0xfffff8001c35bea0}, bv_cnt = 0x99e}, bo_dirty = {bv_hd = { tqh_first = 0xfffffe003ba2e570, tqh_last = 0xfffffe0037ca41d0}, bv_root = {pt_root = 0xfffff8001c4d55a0}, bv_cnt = 0x14}, bo_numoutput = 0x1, bo_flag = 0x1, bo_domain = 0x6, bo_bsize = 0x200}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffffe010e309480}, rl_currdep = 0x0}, v_holdcnt = 0x9b4, v_usecount = 0x1, v_iflag = 0x0, v_vflag = 0x40, v_mflag = 0x0, v_dbatchcpu = 0xffff, v_writecount = 0x0, v_seqc_users = 0x0} (kgdb) (kgdb) f 22 #22 0xffffffff80f35be5 in ffs_update (vp=0xfffffe01468319c8, waitfor=0x0) at ../../../ufs/ffs/ffs_inode.c:223 223 bdwrite(bp); (kgdb) l 218 bawrite(bp); 219 error = 0; 220 } else { 221 if (bp->b_bufsize == fs->fs_bsize) 222 bp->b_flags |= B_CLUSTEROK; 223 bdwrite(bp); 224 error = 0; 225 } 226 return (error); 227 } (kgdb) info loc ip = fs = 0xfffffe010e415000 flags = bn = bp = 0xffffffff81e9f320 error = (kgdb) p *vp $2 = {v_type = VREG, v_irflag = 0x2, v_seqc = 0x0, v_nchash = 0xfcf31f2a, v_hash = 0xeeda87, v_op = 0xffffffff81b66750 , v_data = 0xfffffe014e2fd6a8, v_mount = 0xfffffe010e2fe700, v_nmntvnodes = {tqe_next = 0xfffffe014a0804b0, tqe_prev = 0xfffffe014eab94d8}, {v_mountedhere = 0x0, v_unpcb = 0x0, v_rdev = 0x0, v_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xfffffe014ed66b20}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0xfffff8028eae83a8, tqh_last = 0xfffff8028eae83b8}, v_cache_dd = 0xfffff8028eae83a8, v_lock = {lock_object = {lo_name = 0xffffffff811f9c10 "ufs", lo_flags = 0x6fb0000, lo_data = 0x0, lo_witness = 0xfffff8087fd83f00}, lk_lock = 0xfffffe0143fc2740, lk_exslpfail = 0x0, lk_pri = 0x60, lk_timo = 0x33, lk_stack = {depth = 0x9, pcs = {0xffffffff80bfd2c7, 0xffffffff80f629ad, 0xffffffff811c9e7c, 0xffffffff80d38e84, 0xffffffff80d20f72, 0xffffffff80be1039, 0xffffffff80be0abd, 0xffffffff811009a7, 0xffffffff810d0b6b, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = {lo_name = 0xffffffff8134a914 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd75500}, mtx_lock = 0x0}, v_vnlock = 0xfffffe0146831a38, v_vnodelist = {tqe_next = 0xfffffe0161196258, tqe_prev = 0xfffffe014d98dd78}, v_lazylist = {tqe_next = 0xfffffe014b3c0258, tqe_prev = 0xfffffe014dcc6f78}, v_bufobj = {bo_lock = {lock_object = {lo_name = 0xffffffff8130275a "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffff8087fd80900}, rw_lock = 0x1}, bo_ops = 0xffffffff81b26af0 , bo_object = 0xfffff8028e319a50, bo_synclist = {le_next = 0x0, le_prev = 0x0}, bo_private = 0xfffffe01468319c8, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffffe0146831b88}, bv_root = { pt_root = 0x0}, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffffe0146831ba8}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_domain = 0x6, bo_bsize = 0x8000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffffe0146831bf0}, rl_currdep = 0x0}, v_holdcnt = 0x2, v_usecount = 0x0, v_iflag = 0x4, v_vflag = 0x0, v_mflag = 0x1, v_dbatchcpu = 0xffff, v_writecount = 0x0, v_seqc_users = 0x0} (kgdb) p *bp $3 = {b_bufobj = 0xffffffff812b8cdc, b_bcount = 0x10000, b_caller1 = 0x0, b_data = 0x0, b_error = 0x0, b_iocmd = 0x0, b_ioflags = 0x0, b_iooffset = 0x0, b_resid = 0xffffffff81319b82, b_iodone = 0x1030000, b_ckhashcalc = 0xfffff8087fd79780, b_ckhash = 0x0, b_blkno = 0x0, b_offset = 0x0, b_bobufs = {tqe_next = 0x0, tqe_prev = 0x0}, b_vflags = 0x0, b_qindex = 0x0, b_domain = 0x0, b_subqueue = 0x0, b_flags = 0x0, b_xflags = 0x0, b_lock = {lock_object = {lo_name = 0x0, lo_flags = 0x0, lo_data = 0x0, lo_witness = 0x0}, lk_lock = 0x0, lk_exslpfail = 0x0, lk_pri = 0x0, lk_timo = 0x0, lk_stack = {depth = 0x0, pcs = {0x0 , 0x100000, 0x2, 0x0, 0x7476, 0x0}}}, b_bufsize = 0x0, b_runningbufspace = 0x4074400, b_kvasize = 0xfffff800, b_dirtyoff = 0x0, b_dirtyend = 0x0, b_kvabase = 0x0, b_lblkno = 0xffffffff812a76a7, b_vp = 0xb0000, b_rcred = 0x0, b_wcred = 0x0, {b_freelist = {tqe_next = 0xfffffe003cfef800, tqe_prev = 0xfffff800031f2f00}, { b_pgiodone = 0xfffffe003cfef800, b_pgbefore = 0x31f2f00, b_pgafter = 0xfffff800}}, b_cluster = {cluster_head = {tqh_first = 0xffffffff81a01090 , tqh_last = 0xfffffe003cff0000}, cluster_entry = {tqe_next = 0xffffffff81a01090 , tqe_prev = 0xfffffe003cff0000}}, b_npages = 0x3a220c8, b_dep = { lh_first = 0xffffffff81a010b8 }, b_fsprivate1 = 0xffffffff81a01250 , b_fsprivate2 = 0xfffff80003a21f00, b_fsprivate3 = 0xfffff80003a22080, b_io_tracking = {0xfffff80003a22000 "3", 0xfffff80003a21f00 "\336", 0x0, 0xfff , 0x0 }, b_io_tcnt = 0x0, b_pages = 0xffffffff81e9f5f0 } (kgdb) -- Test scenario: misc/altbufferflushes.sh