vmcore.257 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2020 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #1 r367980M: Tue Nov 24 14:22:29 CET 2020 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 11.0.0 (git@github.com:llvm/llvm-project.git llvmorg-11.0.0-0-g176249bd673) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33166503936 (31630 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 10 7 3 2 5 4 8 6 11 9 Timecounter "TSC-low" frequency 1750037812 Hz quality 1000 random: entropy device external interface WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 13.0. kbd1 at kbdmux0 000.000053 [4346] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 apei0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0:gpt/work... WARNING: / was not properly dismounted Dual Console: Serial Primary, Video Secondary igb0: link state changed to UP debugnet_any_ifnet_update: Bad dn_init result from igb0 (ifp 0xfffff8012b089800), ignoring. Interface IP-Address Broadcast Setting hostuuid: 00000000-0000-0000-0000-002590c99976. Setting hostid: 0x90b83241. Starting file system checks: WARNING: / was not properly dismounted Mounting local filesystems:. fscklock order reversal: 1st 0xfffff8012e7207f0 ufs (ufs, lockmgr) @ kern/vfs_mount.c:1724 2nd 0xfffff8012e7202f0 devfs (devfs, lockmgr) @ kern/vfs_subr.c:3135 lock order devfs -> ufs established at: #0 0xffffffff80c4d23d at witness_checkorder+0x46d #1 0xffffffff80bad8f2 at lockmgr_lock_flags+0x172 #2 0xffffffff80ea17cd at ffs_lock+0x9d #3 0xffffffff810f7170 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cd9064 at _vn_lock+0x54 #5 0xffffffff80cb7cbe at vfs_domount+0xe7e #6 0xffffffff80cb6162 at vfs_donmount+0x872 #7 0xffffffff80cba837 at kernel_mount+0x57 #8 0xffffffff80cbd161 at parse_mount+0x4a1 #9 0xffffffff80cbb669 at vfs_mountroot+0x589 #10 0xffffffff80b6d07f at start_init+0x1f #11 0xffffffff80b98ab0 at fork_exit+0x80 #12 0xffffffff81006a9e at fork_trampoline+0xe lock order ufs -> devfs attempted at: #0 0xffffffff80c4db9c at witness_checkorder+0xdcc #1 0xffffffff80bad8f2 at lockmgr_lock_flags+0x172 #2 0xffffffff810f7170 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cd9064 at _vn_lock+0x54 #4 0xffffffff80cc1d50 at vput_final+0x110 #5 0xffffffff80e9f44f at ffs_unmount+0x39f #6 0xffffffff80cb8d9b at dounmount+0x43b #7 0xffffffff80cb88ec at kern_unmount+0x2fc #8 0xffffffff810331d7 at amd64_syscall+0x147 #9 0xffffffff8100636e at fast_syscall_common+0xf8 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 490 files, 22093 used, 1243314 free (90 frags, 155403 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. Setting up harvesting: PURE_RDRAND,[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat /usr/local/lib/e2fsprogs /usr/local/lib/gcc8 /usr/local/lib/gcc9 /usr/local/lib/perl5/5.30/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: mercat1.netperf.freebsd.org. lo0: link state changed to UP Autoloading module: acpi_wmi.ko acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device device_attach: acpi_wmi0 attach returned 6 Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: ichsmb.ko ichsmb0: port 0x580-0x59f mem 0xfb431000-0xfb4310ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. if_delmulti_locked: detaching ifnet instance 0xfffff8012b089800 DHCPDISCOVER on igb0 to 255.255.255.255 port 67 interval 8 DHCPOFFER from 192.168.5.1 DHCPREQUEST on igb0 to 255.255.255.255 port 67 if_delmulti_locked: detaching ifnet instance 0xfffff8012b089800 DHCPACK from 192.168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Updating motd:. Recovering vi editor sessions:. Creating and/or trimming log files. Clearing /tmp (X related). Starting syslogd. Setting date via ntp. 24 Nov 14:49:59 ntpdate[2295]: step time server 192.168.5.1 offset -1.229194 sec Starting watchdogd. No core dumps found. Starting rpcbind. NFS access cache time=60 Starting statd. Starting lockd. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Performing sanity check on sshd configuration. Starting sshd. Configuring vt: blanktime. Starting cron. Starting inetd. sysctl: unknown oid 'debug.fail_point.pmap_allocpte_page_alloc' at line 12 Tue Nov 24 14:50 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: Nov 24 14:50:01 mercat1 ntpd[2383]: error resolving pool 0.freebsd.pool.ntp.org: Name does not resolve (8) root Nov 24 14:50:33 mercat1 login[2447]: ROOT LOGIN (root) ON ttyu1 Last login: Tue Nov 24 14:21:12 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #1 r367980M: Tue Nov 24 14:22:29 CET 2020 root@mercat1:~ # ~pho/vn_lock_pair_pause.sh & [1] 2452 root@mercat1:~ # 14:50:47 debug.vn_lock_pair_pause = 0 Nov 24 14:50:55 mercat1 su[2468]: pho to root on /dev/pts/0 Nov 24 14:51:06 mercat1 ntpd[2383]: error resolving pool 0.freebsd.pool.ntp.org: Name does not resolve (8) 14:51:47 debug.vn_lock_pair_pause = 25 20201124 14:52:00 all (1/1): trim4.sh Nov 24 14:52:09 mercat1 kernel: pid 4245 (rw), uid 2007 inumber 78310 on /mnt: filesystem full Nov 24 14:52:13 mercat1 ntpd[2383]: error resolving pool 0.freebsd.pool.ntp.org: Name does not resolve (8) Nov 24 14:52:16 mercat1 kernel: pid 4300 (mkdir), uid 2007 inumber 98344 on /mnt: filesystem full 14:52:47 debug.vn_lock_pair_pause = 67 Nov 24 14:53:18 mercat1 ntpd[2383]: error resolving pool 0.freebsd.pool.ntp.org: Name does not resolve (8) 14:53:47 debug.vn_lock_pair_pause = 83 Nov 24 14:54:18 mercat1 kernel: pid 6870 (rw), uid 2007 inumber 68805 on /mnt: filesystem full Nov 24 14:54:25 mercat1 ntpd[2383]: error resolving pool 0.freebsd.pool.ntp.org: Name does not resolve (8) 14:54:47 debug.vn_lock_pair_pause = 197 Nov 24 14:55:04 mercat1 kernel: pid 6853 (rw), uid 2007 inumber 72845 on /mnt: filesystem full Nov 24 14:55:30 mercat1 ntpd[2383]: error resolving pool 0.freebsd.pool.ntp.org: Name does not resolve (8) 14:55:47 debug.vn_lock_pair_pause = 203 Nov 24 14:56:35 mercat1 syslogd: last message repeated 1 times 14:57:27 debug.vn_lock_pair_pause = 1596 14:58:28 debug.vn_lock_pair_pause = 2324 Nov 24 14:57:42 mercat1 syslogd: last message repeated 1 times Nov 24 14:58:32 mercat1 kernel: pid 15834 (rw), uid 2007 inumber 59286 on /mnt: filesystem full Nov 24 14:58:47 mercat1 ntpd[2383]: error resolving pool 0.freebsd.pool.ntp.org: Name does not resolve (8) 14:59:28 debug.vn_lock_pair_pause = 3570 lock order reversal: 1st 0xfffff802a96792f0 syncer (syncer, lockmgr) @ kern/vfs_subr.c:2526 2nd 0xfffff8011bc782f0 ufs (ufs, lockmgr) @ kern/vfs_subr.c:3135 lock order ufs -> syncer established at: #0 0xffffffff80c4d23d at witness_checkorder+0x46d #1 0xffffffff80bad8f2 at lockmgr_lock_flags+0x172 #2 0xffffffff810f7170 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cd9064 at _vn_lock+0x54 #4 0xffffffff80cc1d50 at vput_final+0x110 #5 0xffffffff80cb8d8d at dounmount+0x42d #6 0xffffffff80cb88ec at kern_unmount+0x2fc #7 0xffffffff810331d7 at amd64_syscall+0x147 #8 0xffffffff8100636e at fast_syscall_common+0xf8 lock order syncer -> ufs attempted at: #0 0xffffffff80c4db9c at witness_checkorder+0xdcc #1 0xffffffff80bad8f2 at lockmgr_lock_flags+0x172 #2 0xffffffff80ea17cd at ffs_lock+0x9d #3 0xffffffff810f7170 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cd9064 at _vn_lock+0x54 #5 0xffffffff80cc1d50 at vput_final+0x110 #6 0xffffffff80cc164b at vget_finish+0x9b #7 0xffffffff80e9fc2d at ffs_sync+0x51d #8 0xffffffff80cccceb at sync_fsync+0xeb #9 0xffffffff810f5da9 at VOP_FSYNC_APV+0x59 #10 0xffffffff80cca0e4 at sched_sync+0x444 #11 0xffffffff80b98ab0 at fork_exit+0x80 #12 0xffffffff81006a9e at fork_trampoline+0xe Nov 24 14:59:54 mercat1 syslogd: last message repeated 1 times 15:00:28 debug.vn_lock_pair_pause = 4120 15:01:41 debug.vn_lock_pair_pause = 4380 Nov 24 15:00:59 mercat1 syslogd: last message repeated 1 times Nov 24 15:01:57 mercat1 kernel: pid 25355 (rw), uid 2007 inumber 47913 on /mnt: filesystem full Nov 24 15:01:58 mercat1 kernel: pid 25458 (swap), jid 0, uid 2007, was killed: out of swap space Nov 24 15:02:05 mercat1 ntpd[2383]: error resolving pool 0.freebsd.pool.ntp.org: Name does not resolve (8) 15:02:41 debug.vn_lock_pair_pause = 4513 Nov 24 15:03:10 mercat1 syslogd: last message repeated 1 times 15:03:41 debug.vn_lock_pair_pause = 5296 15:04:41 debug.vn_lock_pair_pause = 6297 Nov 24 15:04:14 mercat1 syslogd: last message repeated 1 times 15:05:54 debug.vn_lock_pair_pause = 6429 15:06:55 debug.vn_lock_pair_pause = 6752 Nov 24 15:06:59 mercat1 syslogd: last message repeated 2 times Nov 24 15:07:10 mercat1 kernel: pid 42575 (swap), jid 0, uid 2007, was killed: out of swap space Nov 24 15:07:56 mercat1 kernel: pid 42645 (rw), uid 2007 inumber 107417 on /mnt: filesystem full 15:07:59 debug.vn_lock_pair_pause = 6754 Nov 24 15:08:11 mercat1 ntpd[2383]: error resolving pool 0.freebsd.pool.ntp.org: Name does not resolve (8) 15:08:59 debug.vn_lock_pair_pause = 7287 Nov 24 15:09:45 mercat1 kernel: pid 44039 (swap), jid 0, uid 2007, was killed: out of swap space Nov 24 15:09:46 mercat1 ntpd[2383]: error resolving pool 0.freebsd.pool.ntp.org: Name does not resolve (8) Nov 24 15:09:52 mercat1 kernel: pid 43975 (rw), uid 2007 inumber 100391 on /mnt: filesystem full 15:09:59 debug.vn_lock_pair_pause = 7319 Nov 24 15:10:49 mercat1 ntpd[2383]: error resolving pool 0.freebsd.pool.ntp.org: Name does not resolve (8) 15:10:59 debug.vn_lock_pair_pause = 7521 stress2: pts leak: 1/2 20201124 15:11:03 all (1/1): trim4.sh Nov 24 15:11:54 mercat1 syslogd: last message repeated 1 times 15:12:30 debug.vn_lock_pair_pause = 7622 15:13:30 debug.vn_lock_pair_pause = 7993 Nov 24 15:14:06 mercat1 syslogd: last message repeated 2 times 15:14:34 debug.vn_lock_pair_pause = 8525 15:15:34 debug.vn_lock_pair_pause = 9664 15:16:34 debug.vn_lock_pair_pause = 9868 15:17:35 debug.vn_lock_pair_pause = 10029 15:18:35 debug.vn_lock_pair_pause = 10253 15:19:35 debug.vn_lock_pair_pause = 10708 15:20:35 debug.vn_lock_pair_pause = 11222 Nov 24 15:20:45 mercat1 syslogd: last message repeated 6 times Nov 24 15:21:27 mercat1 kernel: pid 66746 (rw), uid 2007 inumber 122765 on /mnt: filesystem full 15:21:35 debug.vn_lock_pair_pause = 11531 Nov 24 15:21:51 mercat1 ntpd[2383]: error resolving pool 0.freebsd.pool.ntp.org: Name does not resolve (8) 15:22:35 debug.vn_lock_pair_pause = 11748 Nov 24 15:22:56 mercat1 syslogd: last message repeated 1 times 15:23:35 debug.vn_lock_pair_pause = 11955 15:24:35 debug.vn_lock_pair_pause = 12134 Nov 24 15:25:06 mercat1 syslogd: last message repeated 2 times 15:25:35 debug.vn_lock_pair_pause = 12330 15:26:35 debug.vn_lock_pair_pause = 12516 15:27:35 debug.vn_lock_pair_pause = 12724 15:28:35 debug.vn_lock_pair_pause = 12929 15:29:35 debug.vn_lock_pair_pause = 13130 15:30:35 debug.vn_lock_pair_pause = 13359 15:31:35 debug.vn_lock_pair_pause = 13538 15:32:35 debug.vn_lock_pair_pause = 13764 15:33:35 debug.vn_lock_pair_pause = 13956 15:34:35 debug.vn_lock_pair_pause = 14200 Nov 24 15:34:50 mercat1 syslogd: last message repeated 9 times 15:35:35 debug.vn_lock_pair_pause = 14443 15:36:35 debug.vn_lock_pair_pause = 14689 15:37:35 debug.vn_lock_pair_pause = 14891 15:38:35 debug.vn_lock_pair_pause = 15048 15:39:35 debug.vn_lock_pair_pause = 15281 15:40:35 debug.vn_lock_pair_pause = 15455 15:41:35 debug.vn_lock_pair_pause = 15640 15:42:35 debug.vn_lock_pair_pause = 15828 15:43:35 debug.vn_lock_pair_pause = 16006 15:44:35 debug.vn_lock_pair_pause = 16167 Nov 24 15:44:34 mercat1 syslogd: last message repeated 9 times 15:45:35 debug.vn_lock_pair_pause = 16366 15:46:35 debug.vn_lock_pair_pause = 16542 15:47:35 debug.vn_lock_pair_pause = 16715 15:48:35 debug.vn_lock_pair_pause = 16935 15:49:35 debug.vn_lock_pair_pause = 17163 15:50:35 debug.vn_lock_pair_pause = 17428 15:51:35 debug.vn_lock_pair_pause = 17639 15:52:35 debug.vn_lock_pair_pause = 17860 15:53:35 debug.vn_lock_pair_pause = 18042 15:54:35 debug.vn_lock_pair_pause = 18274 Nov 24 15:54:19 mercat1 syslogd: last message repeated 9 times 15:55:35 debug.vn_lock_pair_pause = 18419 15:56:35 debug.vn_lock_pair_pause = 18646 15:57:35 debug.vn_lock_pair_pause = 18846 15:58:35 debug.vn_lock_pair_pause = 19070 15:59:35 debug.vn_lock_pair_pause = 19284 16:00:35 debug.vn_lock_pair_pause = 19457 16:01:35 debug.vn_lock_pair_pause = 19714 16:02:35 debug.vn_lock_pair_pause = 19908 16:03:35 debug.vn_lock_pair_pause = 20103 16:04:35 debug.vn_lock_pair_pause = 20289 Nov 24 16:05:13 mercat1 syslogd: last message repeated 10 times 16:05:35 debug.vn_lock_pair_pause = 20511 16:06:35 debug.vn_lock_pair_pause = 20758 16:07:35 debug.vn_lock_pair_pause = 20966 16:08:35 debug.vn_lock_pair_pause = 21182 16:09:35 debug.vn_lock_pair_pause = 21410 16:10:35 debug.vn_lock_pair_pause = 21582 16:11:35 debug.vn_lock_pair_pause = 21873 16:12:35 debug.vn_lock_pair_pause = 22084 16:13:35 debug.vn_lock_pair_pause = 22283 16:14:35 debug.vn_lock_pair_pause = 22544 Nov 24 16:15:00 mercat1 syslogd: last message repeated 9 times 16:15:35 debug.vn_lock_pair_pause = 22716 16:16:35 debug.vn_lock_pair_pause = 22867 16:17:35 debug.vn_lock_pair_pause = 23078 16:18:35 debug.vn_lock_pair_pause = 23220 16:19:36 debug.vn_lock_pair_pause = 23390 16:20:36 debug.vn_lock_pair_pause = 23598 16:21:36 debug.vn_lock_pair_pause = 23808 16:22:36 debug.vn_lock_pair_pause = 24001 16:23:36 debug.vn_lock_pair_pause = 24229 16:24:36 debug.vn_lock_pair_pause = 24523 Nov 24 16:24:55 mercat1 syslogd: last message repeated 9 times 16:25:36 debug.vn_lock_pair_pause = 24730 16:26:36 debug.vn_lock_pair_pause = 24878 16:27:36 debug.vn_lock_pair_pause = 25089 16:28:36 debug.vn_lock_pair_pause = 25363 16:29:36 debug.vn_lock_pair_pause = 25565 16:30:36 debug.vn_lock_pair_pause = 25745 16:31:36 debug.vn_lock_pair_pause = 25915 16:32:36 debug.vn_lock_pair_pause = 26097 date Tue Nov 24 16:33:04 CET 2020 root@mercat1:~ # ps -lUtest UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 2007 63189 63188 1 52 0 13720 0 wait IW 0 0:00.00 /bin/sh ./run.sh marcus.cfg 2007 63197 63189 6 20 0 12972 2592 wait I 0 0:00.01 ./testcases/run/run testcases/lockf2/lockf2 testcases/symlink/symlink testcases/openat/openat testcases/rw/rw testcases/fts/fts testcases/link/link testcases/lockf/lockf testcases/creat/creat testcases/mkdir/mkdir testcases/renam 2007 63198 63197 11 20 0 12972 424 wait I 0 0:00.00 ./testcases/run/run testcases/lockf2/lockf2 testcases/symlink/symlink testcases/openat/openat testcases/rw/rw testcases/fts/fts testcases/link/link testcases/lockf/lockf testcases/creat/creat testcases/mkdir/mkdir testcases/renam 2007 63199 63198 5 20 0 12972 1280 wait I 0 0:00.00 ./testcases/run/run testcases/lockf2/lockf2 testcases/symlink/symlink testcases/openat/openat testcases/rw/rw testcases/fts/fts testcases/link/link testcases/lockf/lockf testcases/creat/creat testcases/mkdir/mkdir testcases/renam 2007 66716 63199 0 20 0 12976 2784 wait I 0 0:00.00 lockf2 2007 66717 63199 10 20 0 12976 2784 wait I 0 0:00.00 symlink 2007 66718 63199 8 20 0 12980 2784 wait I 0 0:00.00 openat 2007 66719 63199 6 20 0 12976 2784 wait I 0 0:00.00 rw 2007 66720 63199 9 20 0 12972 2776 wait I 0 0:00.00 fts 2007 66721 63199 5 20 0 12976 2784 wait I 0 0:00.00 link 2007 66722 63199 2 20 0 12976 2784 wait I 0 0:00.00 lockf 2007 66723 63199 4 20 0 12976 2784 wait I 0 0:00.00 creat 2007 66724 63199 10 72 0 0 0 - Z 0 0:00.00 2007 66725 63199 2 20 0 12976 2784 wait I 0 0:00.00 rename 2007 66726 63199 5 72 0 0 0 - Z 0 0:00.00 2007 66727 63199 8 22 0 0 0 - Z 0 0:03.11 2007 66728 66716 10 20 0 12976 2780 wait I 0 0:00.00 lockf2 2007 66729 66728 3 20 0 12976 2784 ufs D 0 0:44.38 lockf2 2007 66730 66728 4 20 0 12976 2784 ufs D 0 0:41.41 lockf2 2007 66731 66718 6 20 0 12980 2780 wait I 0 0:00.00 openat 2007 66732 66728 1 20 0 12976 2784 ufs D 0 0:44.22 lockf2 2007 66733 66728 5 20 0 12976 2784 ufs D 0 0:20.83 lockf2 2007 66734 66731 7 52 0 12980 2784 - R 0 22:57.15 openat 2007 66735 66728 8 20 0 12976 2784 ufs D 0 0:36.33 lockf2 2007 66736 66731 10 52 0 12980 2784 - R 0 23:06.33 openat 2007 66737 66717 10 20 0 12976 2780 wait I 0 0:00.00 symlink 2007 66738 66728 7 20 0 12976 2784 ufs D 0 0:40.07 lockf2 2007 66739 66728 10 20 0 12976 2784 ufs D 0 0:40.32 lockf2 2007 66740 66737 11 52 0 12976 2784 - R 0 22:56.23 symlink 2007 66741 66728 7 20 0 12976 2784 ufs D 0 0:29.53 lockf2 2007 66742 66737 11 52 0 12976 2784 - R 0 22:50.50 symlink 2007 66743 66719 2 20 0 12976 2780 wait I 0 0:00.00 rw 2007 66744 66728 1 20 0 12976 2784 ufs D 0 0:37.47 lockf2 2007 66745 66737 6 52 0 12976 2784 - R 0 22:40.88 symlink 2007 66746 66743 5 20 0 12976 2800 ufs D 0 0:32.98 rw 2007 66747 66720 0 20 0 12972 2772 wait I 0 0:00.00 fts 2007 66748 66737 11 52 0 12976 2784 - R 0 22:54.94 symlink 2007 66749 66728 0 20 0 12976 2784 ufs D 0 0:28.38 lockf2 2007 66750 66743 10 20 0 12976 2800 ufs D 0 0:32.55 rw 2007 66751 66728 6 20 0 12976 2784 ufs D 0 0:36.49 lockf2 2007 66752 66747 6 20 0 15532 6956 ufs D 0 0:00.97 fts 2007 66753 66743 6 20 0 12976 2800 ufs D 0 0:32.24 rw 2007 66754 66737 4 52 0 12976 2784 - R 0 22:54.63 symlink 2007 66755 66728 8 20 0 12976 2784 ufs D 0 0:39.41 lockf2 2007 66756 66743 1 20 0 12976 2800 ufs D 0 0:32.69 rw 2007 66757 66737 0 52 0 12976 2784 getblk D 0 22:56.24 symlink 2007 66758 66728 0 20 0 12976 2784 ufs D 0 0:25.07 lockf2 2007 66759 66737 5 52 0 12976 2784 getblk D 0 22:39.74 symlink 2007 66760 66728 4 20 0 12976 2784 ufs D 0 0:24.66 lockf2 2007 66761 66737 0 52 0 12976 2784 getblk D 0 22:41.35 symlink 2007 66762 66728 8 20 0 12976 2784 ufs D 0 0:33.40 lockf2 2007 66763 66737 10 52 0 12976 2784 - R 0 22:54.06 symlink 2007 66764 66728 5 20 0 12976 2784 ufs D 0 0:23.49 lockf2 2007 66765 66725 6 20 0 12976 2780 wait I 0 0:00.00 rename 2007 66766 66765 3 20 0 12976 2784 ufs D 0 0:01.50 rename 2007 66767 66721 5 20 0 12976 2780 wait I 0 0:00.00 link 2007 66768 66765 9 20 0 12976 2784 ufs D 0 0:01.42 rename 2007 66769 66765 9 20 0 12976 2784 ufs D 0 0:01.44 rename 2007 66770 66767 4 52 0 12976 2784 getblk D 0 22:41.17 link 2007 66771 66765 3 20 0 12976 2784 ufs D 0 0:01.41 rename 2007 66772 66767 7 52 0 12976 2784 getblk D 0 22:43.16 link 2007 66773 66722 4 20 0 12976 2780 wait I 0 0:00.00 lockf 2007 66774 66765 6 29 0 12976 2784 - R 0 10:52.73 rename 2007 66775 66767 5 52 0 12976 2784 - R 0 22:38.36 link 2007 66776 66765 5 20 0 12976 2784 ufs D 0 0:01.38 rename 2007 66777 66767 9 52 0 12976 2784 - R 0 22:34.59 link 2007 66778 66773 9 20 0 12976 2784 ufs D 0 0:09.41 lockf 2007 66779 66765 10 20 0 12976 2784 ufs D 0 0:01.44 rename 2007 66780 66767 1 52 0 12976 2784 - R 0 22:37.16 link 2007 66781 66723 1 20 0 12976 2780 wait I 0 0:00.00 creat 2007 66782 66773 0 20 0 12976 2784 ufs D 0 0:05.95 lockf 2007 66783 66765 2 20 0 12976 2784 ufs D 0 0:01.38 rename 2007 66784 66767 1 52 0 12976 2784 - R 0 22:39.94 link 2007 66785 66773 10 20 0 12976 2784 ufs D 0 0:07.27 lockf 2007 66786 66765 1 32 0 12976 2784 ufs D 0 11:12.40 rename 2007 66787 66767 10 52 0 12976 2784 - R 0 22:40.57 link 2007 66788 66765 4 20 0 12976 2784 ufs D 0 0:01.42 rename 2007 66789 66781 4 52 0 12976 2784 - R 0 22:49.28 creat 2007 66790 66767 9 52 0 12976 2784 - R 0 22:47.74 link 2007 66791 66773 2 20 0 12976 2784 ufs D 0 0:09.10 lockf 2007 66792 66781 8 52 0 12976 2784 getblk D 0 22:44.69 creat 2007 66793 66765 2 23 0 12976 2784 ufs D 0 3:45.27 rename 2007 66794 66767 4 52 0 12976 2784 getblk D 0 22:37.72 link 2007 66795 66773 3 20 0 12976 2784 ufs D 0 0:07.72 lockf 2007 66796 66781 7 52 0 12976 2784 getblk D 0 22:35.97 creat 2007 66797 66767 0 52 0 12976 2784 - R 0 22:45.47 link 2007 66798 66773 1 20 0 12976 2784 ufs D 0 0:08.77 lockf 2007 66799 66781 0 52 0 12976 2800 getblk D 0 22:42.41 creat 2007 66800 66767 5 52 0 12976 2784 - R 0 22:43.60 link 2007 66801 66773 10 20 0 12976 2784 ufs D 0 0:08.27 lockf 2007 66802 66781 10 52 0 12976 2784 - R 0 22:52.89 creat 2007 66803 66773 7 20 0 12976 2784 ufs D 0 0:06.64 lockf 2007 66805 66781 6 52 0 12976 2784 getblk D 0 22:42.28 creat 2007 66806 66773 7 20 0 12976 2784 ufs D 0 0:08.00 lockf 2007 66807 66781 8 52 0 12976 2784 getblk D 0 22:51.25 creat 2007 66809 66773 10 20 0 12976 2784 ufs D 0 0:08.65 lockf 2007 66810 66781 2 52 0 12976 2784 - R 0 22:43.29 creat 2007 66812 66781 4 52 0 12976 2784 - R 0 22:41.82 creat 2007 66813 66773 4 20 0 12976 2784 ufs D 0 0:08.88 lockf 2007 66815 66773 7 20 0 12976 2784 ufs D 0 0:07.64 lockf 2007 66817 66773 2 20 0 12976 2784 ufs D 0 0:06.96 lockf 2007 66819 66773 10 20 0 12976 2784 ufs D 0 0:06.42 lockf 2007 66821 66773 10 20 0 12976 2784 ufs D 0 0:07.75 lockf 2007 66823 66773 8 20 0 12976 2784 ufs D 0 0:07.51 lockf 2007 66825 66773 6 20 0 12976 2784 ufs D 0 0:08.86 lockf 2007 66827 66773 2 20 0 12976 2784 ufs D 0 0:07.65 lockf 2007 66829 66773 4 20 0 12976 2784 ufs D 0 0:05.90 lockf root@mercat1:~ # 16:33:36 debug.vn_lock_pair_pause = 26240 16:34:36 debug.vn_lock_pair_pause = 26460 Nov 24 16:34:47 mercat1 syslogd: last message repeated 9 times 16:35:36 debug.vn_lock_pair_pause = 26732 16:36:36 debug.vn_lock_pair_pause = 26883 16:37:36 debug.vn_lock_pair_pause = 27048 16:38:36 debug.vn_lock_pair_pause = 27243 16:39:36 debug.vn_lock_pair_pause = 27410 16:40:36 debug.vn_lock_pair_pause = 27656 tail -1 16:41:36 debug.vn_lock_pair_pause = 27873 /tmp/stress2.d/log 124 08:31:01 all (1/1)20201124 15:11:03 all (1/1): trim4.sh root@mercat1:~ # 20201124 08:31:01 all (1/1): trim4.sh Badly placed ()'s. root@mercat1:~ # date Tue Nov 24 16:41:41 CET 2020 root@mercat1:~ # tail -1 /tmp/stress2.d/log 124 08:31:01 all (1/1)20201124 15:11:03 all (1/1): trim4.sh tail -1 /tmp/stress2.d/log 20201124 15:11:03 all (1/1): trim4.sh root@mercat1:~ # date Tue Nov 24 16:42:41 CET 2020 root@mercat1:~ # pgrep -Utest | wc -l 107 root@mercat1:~ # pkill -9 -Utest root@mercat1:~ # pgrep -Utest | wc -l 82 root@mercat1:~ # ps -lUtest UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 2007 66729 1 8 20 0 12976 2784 ufs D 0 0:44.43 lockf2 2007 66730 1 6 20 0 12976 2784 ufs D 0 0:41.48 lockf2 2007 66732 1 0 20 0 12976 2784 ufs D 0 0:44.29 lockf2 2007 66733 1 11 20 0 12976 2784 ufs D 0 0:20.90 lockf2 2007 66734 1 0 52 0 12980 2784 suspfs D 0 26:02.51 openat 2007 66735 1 0 20 0 12976 2784 ufs D 0 0:36.42 lockf2 2007 66736 1 7 52 0 12980 2784 - R 0 26:17.75 openat 2007 66738 1 3 20 0 12976 2784 ufs D 0 0:40.13 lockf2 2007 66739 1 10 20 0 12976 2784 ufs D 0 0:40.39 lockf2 2007 66740 1 7 52 0 12976 2784 suspfs D 0 26:01.50 symlink 2007 66741 1 7 20 0 12976 2784 ufs D 0 0:29.62 lockf2 2007 66742 1 5 52 0 12976 2784 suspfs D 0 25:55.12 symlink 2007 66744 1 11 20 0 12976 2784 ufs D 0 0:37.55 lockf2 2007 66745 1 9 52 0 12976 2784 suspfs D 0 25:44.03 symlink 2007 66746 1 1 20 0 12976 2800 ufs D 0 0:33.18 rw 2007 66748 1 8 52 0 12976 2784 suspfs D 0 26:00.34 symlink 2007 66749 1 4 20 0 12976 2784 ufs D 0 0:28.47 lockf2 2007 66750 1 4 20 0 12976 2800 ufs D 0 0:32.82 rw 2007 66751 1 4 20 0 12976 2784 ufs D 0 0:36.58 lockf2 2007 66752 1 8 20 0 15532 6956 ufs D 0 0:00.99 fts 2007 66753 1 0 20 0 12976 2800 ufs D 0 0:32.43 rw 2007 66754 1 2 52 0 12976 2784 suspfs D 0 26:00.32 symlink 2007 66755 1 2 20 0 12976 2784 ufs D 0 0:39.50 lockf2 2007 66756 1 7 20 0 12976 2800 ufs D 0 0:32.90 rw 2007 66757 1 4 52 0 12976 2784 suspfs D 0 26:01.65 symlink 2007 66758 1 2 20 0 12976 2784 ufs D 0 0:25.17 lockf2 2007 66759 1 2 52 0 12976 2784 suspfs D 0 25:43.27 symlink 2007 66760 1 2 20 0 12976 2784 ufs D 0 0:24.76 lockf2 2007 66761 1 5 52 0 12976 2784 suspfs D 0 25:44.71 symlink 2007 66762 1 0 20 0 12976 2784 ufs D 0 0:33.49 lockf2 2007 66763 1 5 52 0 12976 2784 suspfs D 0 25:59.12 symlink 2007 66764 1 7 20 0 12976 2784 ufs D 0 0:23.58 lockf2 2007 66766 1 9 20 0 12976 2784 ufs D 0 0:01.61 rename 2007 66768 1 10 20 0 12976 2784 ufs D 0 0:01.49 rename 2007 66769 1 9 20 0 12976 2784 ufs D 0 0:01.52 rename 2007 66770 1 0 52 0 12976 2784 suspfs D 0 25:44.71 link 2007 66771 1 3 20 0 12976 2784 ufs D 0 0:01.49 rename 2007 66772 1 10 52 0 12976 2784 suspfs D 0 25:46.79 link 2007 66774 1 7 39 0 12976 2784 - R 0 12:24.11 rename 2007 66775 1 0 52 0 12976 2784 suspfs D 0 25:41.22 link 2007 66776 1 2 20 0 12976 2784 ufs D 0 0:01.47 rename 2007 66777 1 4 52 0 12976 2784 suspfs D 0 25:36.69 link 2007 66778 1 10 20 0 12976 2784 ufs D 0 0:09.50 lockf 2007 66779 1 4 20 0 12976 2784 ufs D 0 0:01.51 rename 2007 66780 1 2 52 0 12976 2784 suspfs D 0 25:40.03 link 2007 66782 1 5 20 0 12976 2784 ufs D 0 0:06.03 lockf 2007 66783 1 9 20 0 12976 2784 ufs D 0 0:01.48 rename 2007 66784 1 6 52 0 12976 2784 suspfs D 0 25:43.48 link 2007 66785 1 6 20 0 12976 2784 ufs D 0 0:07.36 lockf 2007 66786 1 4 36 0 12976 2784 - R 0 12:46.24 rename 2007 66787 1 4 52 0 12976 2784 suspfs D 0 25:44.18 link 2007 66788 1 5 20 0 12976 2784 ufs D 0 0:01.50 rename 2007 66789 1 8 52 0 12976 2784 suspfs D 0 25:54.06 creat 2007 66790 1 2 52 0 12976 2784 suspfs D 0 25:52.17 link 2007 66791 1 7 20 0 12976 2784 ufs D 0 0:09.17 lockf 2007 66792 1 4 52 0 12976 2784 suspfs D 0 25:48.13 creat 2007 66793 1 0 36 0 12976 2784 ufs D 0 4:18.01 rename 2007 66794 1 6 52 0 12976 2784 suspfs D 0 25:40.42 link 2007 66795 1 9 20 0 12976 2784 ufs D 0 0:07.80 lockf 2007 66796 1 9 52 0 12976 2784 suspfs D 0 25:38.61 creat 2007 66797 1 10 52 0 12976 2784 suspfs D 0 25:49.22 link 2007 66798 1 3 20 0 12976 2784 ufs D 0 0:08.85 lockf 2007 66799 1 9 52 0 12976 2800 suspfs D 0 25:45.96 creat 2007 66800 1 0 52 0 12976 2784 suspfs D 0 25:47.14 link 2007 66801 1 8 20 0 12976 2784 ufs D 0 0:08.36 lockf 2007 66802 1 1 52 0 12976 2784 suspfs D 0 25:57.82 creat 2007 66803 1 8 20 0 12976 2784 ufs D 0 0:06.73 lockf 2007 66805 1 0 52 0 12976 2784 suspfs D 0 25:45.77 creat 2007 66806 1 11 20 0 12976 2784 ufs D 0 0:08.08 lockf 2007 66807 1 9 52 0 12976 2784 suspfs D 0 25:56.10 creat 2007 66809 1 5 20 0 12976 2784 ufs D 0 0:08.75 lockf 2007 66810 1 8 52 0 12976 2784 suspfs D 0 25:46.86 creat 2007 66812 1 11 52 0 12976 2784 suspfs D 0 25:45.32 creat 2007 66813 1 3 20 0 12976 2784 ufs D 0 0:08.95 lockf 2007 66815 1 7 20 0 12976 2784 ufs D 0 0:07.70 lockf 2007 66817 1 6 20 0 12976 2784 ufs D 0 0:07.05 lockf 2007 66819 1 1 20 0 12976 2784 ufs D 0 0:06.50 lockf 2007 66821 1 1 20 0 12976 2784 ufs D 0 0:07.83 lockf 2007 66823 1 11 20 0 12976 2784 ufs D 0 0:07.57 lockf 2007 66825 1 1 20 0 12976 2784 ufs D 0 0:08.94 lockf 2007 66827 1 1 20 0 12976 2784 ufs D 0 0:07.72 lockf 2007 66829 1 0 20 0 12976 2784 ufs D 0 0:05.96 lockf root@mercat1:~ # pkill -9 -Utest root@mercat1:~ # 16:43:36 debug.vn_lock_pair_pause = 28164 umount -f /mnt Nov 24 16:44:32 mercat1 syslogd: last message repeated 9 times Nov 24 16:54:29 mercat1 syslogd: last message repeated 9 times Nov 24 17:04:20 mercat1 syslogd: last message repeated 9 times Nov 24 17:15:13 mercat1 syslogd: last message repeated 10 times Nov 24 17:25:05 mercat1 syslogd: last message repeated 9 times Nov 24 17:34:53 mercat1 syslogd: last message repeated 9 times Nov 24 17:44:37 mercat1 syslogd: last message repeated 9 times interrupt total irq3: uart1 2271 irq4: uart0 5 irq9: acpi0 4 irq18: ehci0 ehci1+ 21981 irq19: xhci0 13705 cpu0:timer 11995186 cpu1:timer 11993648 cpu2:timer 12001426 cpu3:timer 11999343 cpu4:timer 11998464 cpu5:timer 12005568 cpu6:timer 11968879 cpu7:timer 12007280 cpu8:timer 12001529 cpu9:timer 11998936 cpu10:timer 12001833 cpu11:timer 11999405 irq56: ahci0 2570187 irq57: igb0:rxq0 6246 irq58: igb0:rxq1 749 irq59: igb0:rxq2 703 irq60: igb0:rxq3 6606965 irq61: igb0:rxq4 103 irq62: igb0:rxq5 144 irq63: igb0:aq 2 Total 153194568 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1bd/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: watchdog timeout [ thread pid 63183 tid 100433 ] Stopped at kdb_enter+0x37: movq $0,0x10b3ef6(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 1601 out of 32628 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 63183 tid 100433 td 0xfffffe00e2152000 kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 1 cpuid = 0 dynamic pcpu = 0x7977c0 curthread = 0xfffffe00ad7fc300: pid 11 tid 100003 critnest 1 "idle: cpu0" curpcb = 0xfffffe00ad7fc810 fpcurthread = none idlethread = 0xfffffe00ad7fc300: tid 100003 "idle: cpu0" self = 0xffffffff82210000 curpmap = 0xffffffff81c924e0 tssp = 0xffffffff82210384 rsp0 = 0xfffffe00377abcc0 kcr3 = 0x800000000212d002 ucr3 = 0xffffffffffffffff scr3 = 0x43f191c90 gs32p = 0xffffffff82210404 ldt = 0xffffffff82210444 tss = 0xffffffff82210434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bc2477c0 curthread = 0xfffffe00e2152000: pid 63183 tid 100433 critnest 1 "md10" curpcb = 0xfffffe00e2152510 fpcurthread = none idlethread = 0xfffffe00ad7fbc00: tid 100004 "idle: cpu1" self = 0xffffffff82211000 curpmap = 0xffffffff81c924e0 tssp = 0xffffffff82211384 rsp0 = 0xfffffe00e1576cc0 kcr3 = 0x800000000212d002 ucr3 = 0xffffffffffffffff scr3 = 0x52075edf3 gs32p = 0xffffffff82211404 ldt = 0xffffffff82211444 tss = 0xffffffff82211434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bc2537c0 curthread = 0xfffffe00ad7fb500: pid 11 tid 100005 critnest 1 "idle: cpu2" curpcb = 0xfffffe00ad7fba10 fpcurthread = none idlethread = 0xfffffe00ad7fb500: tid 100005 "idle: cpu2" self = 0xffffffff82212000 curpmap = 0xffffffff81c924e0 tssp = 0xffffffff82212384 rsp0 = 0xfffffe00377b5cc0 kcr3 = 0x800000000212d002 ucr3 = 0xffffffffffffffff scr3 = 0x6b888ddaf gs32p = 0xffffffff82212404 ldt = 0xffffffff82212444 tss = 0xffffffff82212434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bc25f7c0 curthread = 0xfffffe00ad7fae00: pid 11 tid 100006 critnest 1 "idle: cpu3" curpcb = 0xfffffe00ad7fb310 fpcurthread = none idlethread = 0xfffffe00ad7fae00: tid 100006 "idle: cpu3" self = 0xffffffff82213000 curpmap = 0xffffffff81c924e0 tssp = 0xffffffff82213384 rsp0 = 0xfffffe00377bacc0 kcr3 = 0x800000000212d002 ucr3 = 0xffffffffffffffff scr3 = 0x5146d5a55 gs32p = 0xffffffff82213404 ldt = 0xffffffff82213444 tss = 0xffffffff82213434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bc26b7c0 curthread = 0xfffffe00ad7fa700: pid 11 tid 100007 critnest 1 "idle: cpu4" curpcb = 0xfffffe00ad7fac10 fpcurthread = none idlethread = 0xfffffe00ad7fa700: tid 100007 "idle: cpu4" self = 0xffffffff82214000 curpmap = 0xffffffff81c924e0 tssp = 0xffffffff82214384 rsp0 = 0xfffffe00377bfcc0 kcr3 = 0x800000000212d002 ucr3 = 0xffffffffffffffff scr3 = 0x3d9a4ad50 gs32p = 0xffffffff82214404 ldt = 0xffffffff82214444 tss = 0xffffffff82214434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bc2777c0 curthread = 0xfffffe00ad7fa000: pid 11 tid 100008 critnest 1 "idle: cpu5" curpcb = 0xfffffe00ad7fa510 fpcurthread = none idlethread = 0xfffffe00ad7fa000: tid 100008 "idle: cpu5" self = 0xffffffff82215000 curpmap = 0xffffffff81c924e0 tssp = 0xffffffff82215384 rsp0 = 0xfffffe00377c4cc0 kcr3 = 0x800000000212d002 ucr3 = 0xffffffffffffffff scr3 = 0x43f191a84 gs32p = 0xffffffff82215404 ldt = 0xffffffff82215444 tss = 0xffffffff82215434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bc2837c0 curthread = 0xfffffe00ad7fd800: pid 11 tid 100009 critnest 1 "idle: cpu6" curpcb = 0xfffffe00ad7fdd10 fpcurthread = none idlethread = 0xfffffe00ad7fd800: tid 100009 "idle: cpu6" self = 0xffffffff82216000 curpmap = 0xffffffff81c924e0 tssp = 0xffffffff82216384 rsp0 = 0xfffffe00377c9cc0 kcr3 = 0x800000000212d002 ucr3 = 0xffffffffffffffff scr3 = 0x6b88d192d gs32p = 0xffffffff82216404 ldt = 0xffffffff82216444 tss = 0xffffffff82216434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bc28f7c0 curthread = 0xfffffe00e0df4700: pid 88492 tid 100282 critnest 1 "egrep" curpcb = 0xfffffe00e0df4c10 fpcurthread = 0xfffffe00e0df4700: pid 88492 "egrep" idlethread = 0xfffffe00ad803100: tid 100010 "idle: cpu7" self = 0xffffffff82217000 curpmap = 0xfffffe00e1012120 tssp = 0xffffffff82217384 rsp0 = 0xfffffe00e0e81cc0 kcr3 = 0x80000002106f918a ucr3 = 0x80000003aa0c298a scr3 = 0x3aa0c298a gs32p = 0xffffffff82217404 ldt = 0xffffffff82217444 tss = 0xffffffff82217434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bc29b7c0 curthread = 0xfffffe00ad802a00: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffffe00ad802f10 fpcurthread = none idlethread = 0xfffffe00ad802a00: tid 100011 "idle: cpu8" self = 0xffffffff82218000 curpmap = 0xffffffff81c924e0 tssp = 0xffffffff82218384 rsp0 = 0xfffffe00377d3cc0 kcr3 = 0x800000000212d002 ucr3 = 0xffffffffffffffff scr3 = 0x26f68183c gs32p = 0xffffffff82218404 ldt = 0xffffffff82218444 tss = 0xffffffff82218434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bc2a77c0 curthread = 0xfffffe00ad802300: pid 11 tid 100012 critnest 1 "idle: cpu9" curpcb = 0xfffffe00ad802810 fpcurthread = none idlethread = 0xfffffe00ad802300: tid 100012 "idle: cpu9" self = 0xffffffff82219000 curpmap = 0xffffffff81c924e0 tssp = 0xffffffff82219384 rsp0 = 0xfffffe00377d8cc0 kcr3 = 0x800000000212d002 ucr3 = 0xffffffffffffffff scr3 = 0x3f0e6ecb gs32p = 0xffffffff82219404 ldt = 0xffffffff82219444 tss = 0xffffffff82219434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bc2b37c0 curthread = 0xfffffe00ad801c00: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffffe00ad802110 fpcurthread = none idlethread = 0xfffffe00ad801c00: tid 100013 "idle: cpu10" self = 0xffffffff8221a000 curpmap = 0xffffffff81c924e0 tssp = 0xffffffff8221a384 rsp0 = 0xfffffe00377ddcc0 kcr3 = 0x800000000212d002 ucr3 = 0xffffffffffffffff scr3 = 0x3aa0c2dc5 gs32p = 0xffffffff8221a404 ldt = 0xffffffff8221a444 tss = 0xffffffff8221a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bc2bf7c0 curthread = 0xfffffe00ad801500: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffffe00ad801a10 fpcurthread = none idlethread = 0xfffffe00ad801500: tid 100014 "idle: cpu11" self = 0xffffffff8221b000 curpmap = 0xffffffff81c924e0 tssp = 0xffffffff8221b384 rsp0 = 0xfffffe00377e2cc0 kcr3 = 0x800000000212d002 ucr3 = 0xffffffffffffffff scr3 = 0x43f191a99 gs32p = 0xffffffff8221b404 ldt = 0xffffffff8221b444 tss = 0xffffffff8221b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 88492 (egrep) thread 0xfffffe00e0df4700 (100282) exclusive sleep mutex pmap (pmap) r = 0 (0xffffffff81df05c0) locked @ amd64/amd64/pmap.c:5923 exclusive sx vm map (user) (vm map (user)) r = 0 (0xffffffff81db6a48) locked @ vm/vm_map.c:4010 Process 74739 (umount) thread 0xfffffe00deb95000 (100378) shared lockmgr ufs (ufs) r = 0 (0xfffff8012e2a1a70) locked @ kern/vfs_lookup.c:850 Process 69211 (umount) thread 0xfffffe00dede6000 (100247) exclusive lockmgr ufs (ufs) r = 0 (0xfffff801b3d537f0) locked @ kern/vfs_mount.c:1724 Process 66774 (rename) thread 0xfffffe00df7ad100 (100212) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003d63ed80) locked @ kern/vfs_bio.c:3900 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80694d8b570) locked @ ufs/ufs/ufs_vnops.c:1288 Process 66736 (openat) thread 0xfffffe00df862000 (100253) exclusive lockmgr ufs (ufs) r = 0 (0xfffff806efeaaa70) locked @ ufs/ufs/ufs_vnops.c:1288 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff8012e2a1a00: type VDIR usecount 78, writecount 0, refcount 4 seqc users 0 mountedhere 0 hold count flags () flags (VV_ROOT|VMP_LAZYLIST) v_object 0xfffff8012e634e70 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80bad955 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ea17cd at ffs_lock+0x9d #2 0xffffffff810f7170 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cd9064 at _vn_lock+0x54 #4 0xffffffff80cd9232 at vn_close1+0xa2 #5 0xffffffff80cd7baa at vn_closefile+0x4a #6 0xffffffff80b7fceb at _fdrop+0x1b #7 0xffffffff80b8320a at closef+0x1ea #8 0xffffffff80b80160 at closefp+0x90 #9 0xffffffff810331d7 at amd64_syscall+0x147 #10 0xffffffff8100636e at fast_syscall_common+0xf8 nlink=36, effnlink=36, size=2048, extsize 0 generation=56909bb9, uid=0, gid=0, flags=0x0 ino 2, on dev gpt/work vnode 0xfffff801b3d53780: type VDIR usecount 2, writecount 0, refcount 2 seqc users 1 mountedhere 0xfffffe00e0107280 hold count flags () flags () v_object 0xfffff8012e885738 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00dede6000 (pid 69211, umount, tid 100247) with shared waiters pending #0 0xffffffff80bad955 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ea17cd at ffs_lock+0x9d #2 0xffffffff810f7170 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cd9064 at _vn_lock+0x54 #4 0xffffffff80cb89d9 at dounmount+0x79 #5 0xffffffff80cb88ec at kern_unmount+0x2fc #6 0xffffffff810331d7 at amd64_syscall+0x147 #7 0xffffffff8100636e at fast_syscall_common+0xf8 nlink=2, effnlink=2, size=1536, extsize 0 generation=74d5cf41, uid=0, gid=0, flags=0x0 ino 37078272, on dev gpt/work vnode 0xfffff80694d8b500: type VDIR usecount 70, writecount 0, refcount 15 seqc users 0 mountedhere 0 hold count flags () flags (VMP_LAZYLIST) v_object 0xfffff801c25eac60 ref 0 pages 58 cleanbuf 9 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00df7ad100 (pid 66774, rename, tid 100212) with exclusive waiters pending with shared waiters pending #0 0xffffffff80bae44e at lockmgr_xlock_hard+0x4be #1 0xffffffff80ea17cd at ffs_lock+0x9d #2 0xffffffff810f7170 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cd9064 at _vn_lock+0x54 #4 0xffffffff80eb476b at ufs_rename+0x80b #5 0xffffffff810f62e0 at VOP_RENAME_APV+0x40 #6 0xffffffff80cd4dcd at kern_renameat+0x3ed #7 0xffffffff810331d7 at amd64_syscall+0x147 #8 0xffffffff8100636e at fast_syscall_common+0xf8 nlink=37, effnlink=37, size=267776, extsize 0 generation=2c6c3b1e, uid=2007, gid=0, flags=0x0 ino 98304, on dev md10a vnode 0xfffff806efeaaa00: type VDIR usecount 5, writecount 0, refcount 3 seqc users 0 mountedhere 0 hold count flags () flags (VMP_LAZYLIST) v_object 0xfffff802c773ed68 ref 0 pages 0 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00df862000 (pid 66736, openat, tid 100253) #0 0xffffffff80bad955 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ea17cd at ffs_lock+0x9d #2 0xffffffff810f7170 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cd9064 at _vn_lock+0x54 #4 0xffffffff80eb476b at ufs_rename+0x80b #5 0xffffffff810f62e0 at VOP_RENAME_APV+0x40 #6 0xffffffff80cd4dcd at kern_renameat+0x3ed #7 0xffffffff810331d7 at amd64_syscall+0x147 #8 0xffffffff8100636e at fast_syscall_common+0xf8 nlink=2, effnlink=2, size=512, extsize 0 generation=a334b2f4, uid=2007, gid=0, flags=0x0 ino 98317, on dev md10a db:1:pho1> show mount 0xfffffe00d664d700 /dev/gpt/work on / (ufs) 0xfffffe00d664e280 devfs on /dev (devfs) 0xfffffe00d664cb80 /dev/gpt/tmp on /tmp (ufs) 0xfffffe00e0107280 /dev/md10a on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 85586 Buf domain 0 freebufs 15060 lofreebufs 219 hifreebufs 329 bufspace 1925120 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 9 (266240) dirtyq count 0 (0) wakeup 0 lim 25 CPU 5, 7, 5, 5, 1, 5, 7, 5, 5, 10, 6, 3, Locked buffers: 0 space 0 Total buffers: 37080 space 1925120 Buf domain 1 freebufs 15112 lofreebufs 219 hifreebufs 329 bufspace 421888 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 5 (163840) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 2, 3, 0, 0, 2, 0, 3, 0, 3, 1, 2, Locked buffers: 0 space 0 Total buffers: 7698 space 421888 Buf domain 2 freebufs 10786 lofreebufs 219 hifreebufs 329 bufspace 142163968 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 4213 (138051584) dirtyq count 0 (0) wakeup 0 lim 25 CPU 23, 12, 20, 19, 7, 3, 13, 1, 2, 0, 19, 15, Locked buffers: 0 space 0 Total buffers: 12922 space 142163968 Buf domain 3 freebufs 15110 lofreebufs 219 hifreebufs 329 bufspace 585728 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 12 (393216) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 1, 2, 1, 1, 0, 1, 2, 0, 2, 0, 0, Locked buffers: 0 space 0 Total buffers: 9125 space 585728 Buf domain 4 freebufs 8371 lofreebufs 219 hifreebufs 329 bufspace 221376512 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 6599 (216207360) dirtyq count 0 (0) wakeup 0 lim 25 CPU 10, 12, 18, 20, 10, 15, 11, 18, 8, 22, 5, 14, Locked buffers: 0 space 0 Total buffers: 15218 space 221376512 Buf domain 5 freebufs 11468 lofreebufs 219 hifreebufs 329 bufspace 119799808 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 3539 (115900416) dirtyq count 0 (0) wakeup 0 lim 25 CPU 2, 9, 2, 23, 20, 16, 21, 13, 5, 1, 7, 7, Locked buffers: 0 space 0 Total buffers: 14552 space 119799808 Buf domain 6 freebufs 14545 lofreebufs 219 hifreebufs 329 bufspace 18759680 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 410 (13246464) dirtyq count 2 (65536) wakeup 0 lim 25 CPU 19, 4, 9, 18, 21, 8, 21, 16, 16, 13, 17, 14, Locked buffers: 2 space 65536 Total buffers: 9336 space 18759680 db:1:pho1> show page vm_cnt.v_free_count: 7678335 vm_cnt.v_inactive_count: 142447 vm_cnt.v_active_count: 6136 vm_cnt.v_laundry_count: 228 vm_cnt.v_wire_count: 293621 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51267 vm_cnt.v_free_target: 173136 vm_cnt.v_inactive_target: 259704 db:1:pho1> show pageq pq_free 7678335 dom 0 page_cnt 8124626 free 7678335 pq_act 6136 pq_inact 142447 pq_laund 228 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000149 | 000001 11 (008192K) | 000519 | 000000 10 (004096K) | 001173 | 000002 09 (002048K) | 003082 | 000031 08 (001024K) | 004898 | 000039 07 (000512K) | 006177 | 000063 06 (000256K) | 007060 | 000075 05 (000128K) | 007941 | 000108 04 (000064K) | 009137 | 000302 03 (000032K) | 007327 | 000343 02 (000016K) | 000000 | 000602 01 (000008K) | 000000 | 002820 00 (000004K) | 000000 | 003982 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree FFS inode 1128 80859 831 2420490 0 9 92146320 0 RADIX NODE 144 27144 504322 34746286 0 65 76531104 0 VNODE 640 80985 963 2420642 0 17 52446720 0 mbuf_cluster 2048 12058 12 6612276 0 8 24719360 0 FFS2 dinode 256 80859 936 2420490 0 62 20939520 0 swblk 136 1722 111436 517077 0 62 15389488 0 BUF TRIE 144 1188 104764 41333618 0 64 15257088 0 malloc-256 256 61 27299 11978832 0 62 7004160 0 malloc-128 128 14305 33807 26086027 0 127 6158336 0 VM OBJECT 264 19931 1969 14064408 0 30 5781600 0 malloc-256 256 10624 9476 5536494 0 62 5145600 0 S VFS Cache 104 15625 32384 1278060 0 126 4992936 0 mbuf 256 15606 1816 6648218 0 254 4460032 0 malloc-384 384 4 10896 7919639 0 30 4185600 0 g_bio 408 4 8666 1312057920 0 148 3537360 0 malloc-128 128 12444 12573 136096460 0 126 3202176 0 malloc-1024 1024 30 2906 6033334 0 28 3006464 0 malloc-256 256 16 9224 3340700 0 62 2365440 0 64 Bucket 512 1311 2473 2965452 0 30 1937408 0 128 Bucket 1024 1373 430 3172298 0 16 1846272 0 malloc-128 128 366 13956 26667100 0 126 1833216 0 256 Bucket 2048 691 121 1877028 0 8 1662976 0 vmem btag 56 26023 2405 45997 0 254 1591968 0 swpctrie 144 252 10332 43493 0 62 1524096 0 malloc-32768 32768 9 37 4346 0 1 1507328 0 malloc-4096 4096 357 5 1106 0 2 1482752 0 malloc-128 128 112 11451 8175152 0 126 1480064 0 malloc-64 64 926 21187 14135187 0 254 1415232 0 UMA Slabs 0 112 10831 146 66516 0 126 1229424 0 malloc-4096 4096 174 91 1078406 0 2 1085440 0 DIRHASH 1024 776 240 74104 0 16 1040384 0 32 Bucket 256 755 3295 1816694 0 62 1036800 0 malloc-65536 65536 3 12 3269 0 1 983040 0 THREAD 1792 504 27 514 0 8 951552 0 MAP ENTRY 96 4275 4461 48751256 0 126 838656 0 malloc-65536 65536 1 11 134 0 1 786432 0 malloc-64 64 8804 3103 262938639 0 254 762048 0 VMSPACE 2544 133 164 986852 0 4 755568 0 malloc-32768 32768 1 22 925 0 1 753664 0 malloc-8192 8192 86 0 86 0 1 704512 0 malloc-256 256 444 2196 10190181 0 62 675840 0 malloc-64 64 9297 972 21140 0 254 657216 0 16 Bucket 144 271 4237 1949184 0 62 649152 0 pbuf 984 0 654 0 0 0 643536 0 PROC 1320 166 218 986889 0 8 506880 0 UMA Zones 2048 220 6 220 0 8 462848 0 malloc-256 256 30 1590 8960920 0 62 414720 0 malloc-64 64 2979 3447 81810921 0 254 411264 0 filedesc0 1072 167 211 986890 0 8 405216 0 malloc-32768 32768 12 0 20 0 1 393216 0 malloc-32768 32768 12 0 12 0 1 393216 0 NAMEI 1024 64 288 66074122 0 16 360448 0 malloc-128 128 152 2576 3435472 0 126 349184 0 malloc-1024 1024 13 303 121690704 0 16 323584 0 ksiginfo 112 418 2318 14183 0 126 306432 0 malloc-16384 16384 7 11 37 0 1 294912 0 malloc-2048 2048 4 140 2573411 0 8 294912 0 malloc-32 32 7035 2163 11845 0 254 294336 0 malloc-128 128 462 1770 112830 0 126 285696 0 malloc-4096 4096 68 0 83 0 2 278528 0 malloc-1024 1024 7 261 1049153 0 16 274432 0 8 Bucket 80 301 2999 822643 0 126 264000 0 malloc-2048 2048 118 8 137 0 8 258048 0 malloc-256 256 100 905 99083 0 62 257280 0 malloc-16 16 13822 2178 14014 0 254 256000 0 malloc-64 64 450 3519 1974005 0 254 254016 0 malloc-1024 1024 216 28 278 0 16 249856 0 pipe 744 12 283 578287 0 16 219480 0 malloc-384 384 408 152 8724 0 30 215040 0 malloc-128 128 28 1646 4495915 0 126 214272 0 malloc-16384 16384 13 0 3959 0 1 212992 0 malloc-65536 65536 3 0 31 0 1 196608 0 malloc-8192 8192 17 6 454 0 1 188416 0 Files 80 174 2126 8173819 0 126 184000 0 socket 944 59 129 6743 0 16 177472 0 malloc-512 512 73 263 8992 0 30 172032 0 mbuf_packet 256 10 658 6580 0 254 171008 0 PWD 32 60 4602 972162 0 254 149184 0 malloc-65536 65536 2 0 2 0 1 131072 0 malloc-65536 65536 2 0 2 0 1 131072 0 2 Bucket 32 312 3720 1054614 0 254 129024 0 malloc-256 256 404 91 3456 0 62 126720 0 clpbuf 984 0 128 1699807 0 2 125952 0 4 Bucket 48 45 2475 248506 0 254 120960 0 malloc-32 32 249 3405 218516 0 254 116928 0 malloc-8192 8192 13 1 2569 0 1 114688 0 udp_inpcb 488 22 194 1200 0 30 105408 0 DEVCTL 1024 0 100 803 0 0 102400 0 malloc-32768 32768 3 0 5 0 1 98304 0 TURNSTILE 136 532 119 532 0 62 88536 0 rl_entry 40 351 1669 351 0 254 80800 0 malloc-128 128 380 240 840 0 126 79360 0 malloc-384 384 146 54 148 0 30 76800 0 malloc-256 256 46 254 1706 0 62 76800 0 UMA Kegs 384 190 3 190 0 30 74112 0 malloc-64 64 63 1071 2158 0 254 72576 0 ttyinq 160 345 105 555 0 62 72000 0 unpcb 256 22 248 5476 0 62 69120 0 malloc-64 64 33 1038 701 0 254 68544 0 malloc-32 32 218 1924 488 0 254 68544 0 malloc-32 32 570 1572 29733 0 254 68544 0 malloc-65536 65536 1 0 1 0 1 65536 0 malloc-65536 65536 1 0 1 0 1 65536 0 malloc-16384 16384 4 0 4 0 1 65536 0 ttyoutq 256 181 74 290 0 62 65280 0 SLEEPQUEUE 88 532 204 532 0 126 64768 0 malloc-32 32 60 1956 607 0 254 64512 0 malloc-8192 8192 7 0 7 0 1 57344 0 malloc-8192 8192 5 2 17 0 1 57344 0 malloc-1024 1024 16 40 368 0 16 57344 0 malloc-384 384 5 135 361 0 30 53760 0 malloc-32 32 8 1630 53 0 254 52416 0 malloc-16 16 479 2771 1045170 0 254 52000 0 malloc-8192 8192 5 1 11 0 1 49152 0 malloc-4096 4096 2 10 77 0 2 49152 0 udpcb 32 22 1490 1200 0 254 48384 0 malloc-16 16 186 2814 2782 0 254 48000 0 tcpcb 1048 12 32 17 0 8 46112 0 malloc-32 32 28 1358 449 0 254 44352 0 malloc-32 32 320 1066 680 0 254 44352 0 pcpu-8 8 3291 1829 3295 0 254 40960 0 malloc-16 16 124 2376 1000 0 254 40000 0 malloc-16 16 301 2199 29033 0 254 40000 0 cpuset 104 27 345 27 0 126 38688 0 malloc-384 384 54 46 54 0 30 38400 0 pcpu-64 64 426 150 426 0 254 36864 0 Mountpoints 2944 4 8 10 0 4 35328 0 malloc-32768 32768 1 0 1 0 1 32768 0 malloc-16384 16384 2 0 14 0 1 32768 0 malloc-16384 16384 2 0 8506 0 1 32768 0 rtentry 176 12 172 16 0 62 32384 0 swrbuf 984 0 30 110585 0 2 29520 0 malloc-4096 4096 6 1 14 0 2 28672 0 malloc-1024 1024 20 8 20 0 16 28672 0 malloc-64 64 15 426 96 0 254 28224 0 malloc-16 16 45 1705 310 0 254 28000 0 malloc-16 16 246 1504 246 0 254 28000 0 routing nhops 256 9 96 16 0 62 26880 0 malloc-384 384 22 48 22 0 30 26880 0 malloc-2048 2048 7 3 935 0 8 20480 0 malloc-512 512 17 23 40 0 30 20480 0 malloc-16 16 25 1225 25 0 254 20000 0 malloc-384 384 9 41 9 0 30 19200 0 malloc-8192 8192 2 0 3 0 1 16384 0 malloc-4096 4096 2 2 48 0 2 16384 0 malloc-4096 4096 2 2 46 0 2 16384 0 malloc-2048 2048 1 7 102 0 8 16384 0 malloc-2048 2048 5 3 5 0 8 16384 0 malloc-1024 1024 2 14 126 0 16 16384 0 malloc-512 512 0 32 971 0 30 16384 0 tcp_inpcb 488 12 20 17 0 30 15616 0 malloc-512 512 4 20 4 0 30 12288 0 pcpu-16 16 12 756 12 0 254 12288 0 fakepg 104 0 117 20 0 126 12168 0 malloc-384 384 4 26 4 0 30 11520 0 malloc-2048 2048 2 2 5731 0 8 8192 0 malloc-1024 1024 2 6 14 0 16 8192 0 malloc-512 512 3 13 21 0 30 8192 0 malloc-512 512 5 11 1046 0 30 8192 0 malloc-512 512 12 4 12 0 30 8192 0 FPU_save_area 832 1 8 1 0 16 7488 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 malloc-2048 2048 1 1 293 0 8 4096 0 malloc-2048 2048 2 0 5 0 8 4096 0 malloc-512 512 1 7 1 0 30 4096 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 ripcb 488 1 7 3 0 30 3904 0 UMA Slabs 1 176 9 13 9 0 62 3872 0 L VFS Cache 320 2 10 2 0 30 3840 0 KMAP ENTRY 96 27 12 27 0 0 3744 0 vmem 1856 1 1 1 0 8 3712 0 SMR CPU 32 2 61 2 0 254 2016 0 SMR SHARED 24 2 61 2 0 254 1512 0 FFS1 dinode 128 0 0 0 0 126 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 udplite_inpcb 488 0 0 0 0 30 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 30 0 0 tcpreass 48 0 0 0 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 hostcache 96 0 0 0 0 126 0 0 syncache 168 0 0 2 0 62 0 0 tcptw 88 0 0 0 0 126 0 0 ipq 56 0 0 0 0 254 0 0 KNOTE 160 0 0 0 0 62 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 272 0 0 0 0 30 0 0 AIOCB 744 0 0 0 0 16 0 0 AIOP 32 0 0 0 0 254 0 0 AIO 208 0 0 0 0 62 0 0 TMPFS node 224 0 0 0 0 62 0 0 NCLNODE 744 0 0 0 0 16 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 STS VFS Cache 144 0 0 0 0 62 0 0 crypto_session 72 0 0 0 0 126 0 0 cryptop 280 0 0 0 0 30 0 0 IOMMU_MAP_ENTRY 120 0 0 0 0 126 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 4 0 2 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 984 0 0 0 0 8 0 0 mdpbuf 984 0 0 0 0 0 0 0 nfspbuf 984 0 0 0 0 2 0 0 swwbuf 984 0 0 283668 0 0 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 kenv 258 0 0 21329 0 30 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-8192 8192 0 0 0 0 1 0 0 malloc-4096 4096 0 0 12 0 2 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 vm pgcache 4096 70062 1264 61298055 32 vm pgcache 4096 158174 4537 139232718 140 buf free cache 984 15479 4866 11828610 27 buffer arena-65 65536 0 0 0 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 692 1153 5075221 5 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 7 39 305475 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 kstack_cache 16384 504 2 514 1 db:0:pho> acttrace Tracing command egrep pid 88492 tid 100282 td 0xfffffe00e0df4700 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dc1de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dc1de10 trap() at trap+0x56/frame 0xfffffe003dc1df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dc1df20 --- trap 0x13, rip = 0xffffffff81012ed3, rsp = 0xfffffe00e0e81600, rbp = 0xfffffe00e0e81670 --- smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0x303/frame 0xfffffe00e0e81670 pmap_invalidate_all() at pmap_invalidate_all+0x139/frame 0xfffffe00e0e816e0 pmap_remove() at pmap_remove+0x5ab/frame 0xfffffe00e0e81760 vm_map_delete() at vm_map_delete+0x20f/frame 0xfffffe00e0e817c0 vm_map_remove() at vm_map_remove+0x81/frame 0xfffffe00e0e817f0 pipeclose() at pipeclose+0x2e0/frame 0xfffffe00e0e81830 pipe_close() at pipe_close+0x60/frame 0xfffffe00e0e81860 _fdrop() at _fdrop+0x1b/frame 0xfffffe00e0e81880 closef() at closef+0x1ea/frame 0xfffffe00e0e81910 fdescfree_fds() at fdescfree_fds+0x8c/frame 0xfffffe00e0e81970 fdescfree() at fdescfree+0x365/frame 0xfffffe00e0e81a40 exit1() at exit1+0x4b7/frame 0xfffffe00e0e81ab0 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00e0e81ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0e81bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0e81bf0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8003e5a2a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe4d0 --- Tracing command md10 pid 63183 tid 100433 td 0xfffffe00e2152000 (CPU 1) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe00ad7fc300 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81debf20 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81debf30 trap() at trap+0x56/frame 0xffffffff81dec040 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81dec040 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377aba50, rbp = 0xfffffe00377aba50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377aba50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377abaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377abac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377abae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377abbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377abbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377abbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe00ad7fb500 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dbe1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dbe1e10 trap() at trap+0x56/frame 0xfffffe003dbe1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dbe1f20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377b5a50, rbp = 0xfffffe00377b5a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377b5a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377b5aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377b5ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377b5ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377b5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe00ad7fae00 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dbede00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dbede10 trap() at trap+0x56/frame 0xfffffe003dbedf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dbedf20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377baa50, rbp = 0xfffffe00377baa50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377baa50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377baaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377baac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377baae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377babb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377babf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377babf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00ad7fa700 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dbf9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dbf9e10 trap() at trap+0x56/frame 0xfffffe003dbf9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dbf9f20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377bfa50, rbp = 0xfffffe00377bfa50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377bfa50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377bfaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377bfac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377bfae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377bfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377bfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377bfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe00ad7fa000 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dc05e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dc05e10 trap() at trap+0x56/frame 0xfffffe003dc05f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dc05f20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377c4a50, rbp = 0xfffffe00377c4a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377c4a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377c4aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377c4ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377c4ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377c4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe00ad7fd800 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dc11e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dc11e10 trap() at trap+0x56/frame 0xfffffe003dc11f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dc11f20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377c9a50, rbp = 0xfffffe00377c9a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377c9a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377c9aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377c9ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377c9ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377c9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe00ad802a00 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dc29e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dc29e10 trap() at trap+0x56/frame 0xfffffe003dc29f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dc29f20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377d3a50, rbp = 0xfffffe00377d3a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377d3a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377d3aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377d3ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377d3ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377d3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe00ad802300 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dc35e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dc35e10 trap() at trap+0x56/frame 0xfffffe003dc35f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dc35f20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377d8a50, rbp = 0xfffffe00377d8a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377d8a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377d8aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377d8ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377d8ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377d8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00ad801c00 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dc41e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dc41e10 trap() at trap+0x56/frame 0xfffffe003dc41f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dc41f20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377dda50, rbp = 0xfffffe00377dda50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377dda50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377ddaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377ddac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377ddae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377ddbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ddbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ddbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00ad801500 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dc4de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dc4de10 trap() at trap+0x56/frame 0xfffffe003dc4df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dc4df20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377e2a50, rbp = 0xfffffe00377e2a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377e2a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377e2aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377e2ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377e2ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377e2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 88492 88156 2993 0 RE CPU 7 egrep 88156 3026 2993 0 S wait 0xfffff80298abfa50 sh 84236 2452 2452 0 S+ nanslp 0xffffffff81cb1959 sleep 74739 2448 74739 0 D+ ufs 0xfffff801b3d537f0 umount 69211 45358 2909 0 D+ suspwt 0xfffffe00e010731c umount 69206 69205 2302 0 D ufs 0xfffff80694d8b570 ls 69205 2302 2302 0 S wait 0xfffff8030f6ae528 sh 66829 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66827 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66825 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66823 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66821 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66819 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66817 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66815 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66813 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66812 1 63189 2007 D+ suspfs 0xfffffe00e0107288 creat 66810 1 63189 2007 D+ suspfs 0xfffffe00e0107288 creat 66809 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66807 1 63189 2007 D+ suspfs 0xfffffe00e0107288 creat 66806 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66805 1 63189 2007 D+ suspfs 0xfffffe00e0107288 creat 66803 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66802 1 63189 2007 D+ suspfs 0xfffffe00e0107288 creat 66801 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66800 1 63189 2007 D+ suspfs 0xfffffe00e0107288 link 66799 1 63189 2007 D+ suspfs 0xfffffe00e0107288 creat 66798 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66797 1 63189 2007 D+ suspfs 0xfffffe00e0107288 link 66796 1 63189 2007 D+ suspfs 0xfffffe00e0107288 creat 66795 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66794 1 63189 2007 D+ suspfs 0xfffffe00e0107288 link 66793 1 63189 2007 D+ ufs 0xfffff80694d8b570 rename 66792 1 63189 2007 D+ suspfs 0xfffffe00e0107288 creat 66791 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66790 1 63189 2007 D+ suspfs 0xfffffe00e0107288 link 66789 1 63189 2007 D+ suspfs 0xfffffe00e0107288 creat 66788 1 63189 2007 D+ ufs 0xfffff80694d8b570 rename 66787 1 63189 2007 D+ suspfs 0xfffffe00e0107288 link 66786 1 63189 2007 D+ ufs 0xfffff80694d8b570 rename 66785 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66784 1 63189 2007 D+ suspfs 0xfffffe00e0107288 link 66783 1 63189 2007 D+ ufs 0xfffff80694d8b570 rename 66782 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66780 1 63189 2007 D+ suspfs 0xfffffe00e0107288 link 66779 1 63189 2007 D+ ufs 0xfffff80694d8b570 rename 66778 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf 66777 1 63189 2007 D+ suspfs 0xfffffe00e0107288 link 66776 1 63189 2007 D+ ufs 0xfffff80694d8b570 rename 66775 1 63189 2007 D+ suspfs 0xfffffe00e0107288 link 66774 1 63189 2007 D+ biowr 0xfffffe003d63ed00 rename 66772 1 63189 2007 D+ suspfs 0xfffffe00e0107288 link 66771 1 63189 2007 D+ ufs 0xfffff80694d8b570 rename 66770 1 63189 2007 D+ suspfs 0xfffffe00e0107288 link 66769 1 63189 2007 D+ ufs 0xfffff80694d8b570 rename 66768 1 63189 2007 D+ ufs 0xfffff80694d8b570 rename 66766 1 63189 2007 D+ ufs 0xfffff80694d8b570 rename 66764 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf2 66763 1 63189 2007 D+ suspfs 0xfffffe00e0107288 symlink 66762 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf2 66761 1 63189 2007 D+ suspfs 0xfffffe00e0107288 symlink 66760 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf2 66759 1 63189 2007 D+ suspfs 0xfffffe00e0107288 symlink 66758 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf2 66757 1 63189 2007 D+ suspfs 0xfffffe00e0107288 symlink 66756 1 63189 2007 D+ ufs 0xfffff80694d8b570 rw 66755 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf2 66754 1 63189 2007 D+ suspfs 0xfffffe00e0107288 symlink 66753 1 63189 2007 D+ ufs 0xfffff80694d8b570 rw 66752 1 63189 2007 D+ ufs 0xfffff80694d8b570 fts 66751 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf2 66750 1 63189 2007 D+ ufs 0xfffff80694d8b570 rw 66749 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf2 66748 1 63189 2007 D+ suspfs 0xfffffe00e0107288 symlink 66746 1 63189 2007 D+ ufs 0xfffff80694d8b570 rw 66745 1 63189 2007 D+ suspfs 0xfffffe00e0107288 symlink 66744 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf2 66742 1 63189 2007 D+ suspfs 0xfffffe00e0107288 symlink 66741 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf2 66740 1 63189 2007 D+ suspfs 0xfffffe00e0107288 symlink 66739 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf2 66738 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf2 66736 1 63189 2007 D+ getblk 0xfffffe003d63ed80 openat 66735 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf2 66734 1 63189 2007 D+ suspfs 0xfffffe00e0107288 openat 66733 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf2 66732 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf2 66730 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf2 66729 1 63189 2007 D+ ufs 0xfffff80694d8b570 lockf2 63183 0 0 0 RL CPU 1 [md10] 45358 45356 2909 0 S+ wait 0xfffff8012e9e9528 sh 45357 2909 2909 0 S+ piperd 0xfffff8011dede8b8 tee 45356 2909 2909 0 SW+ wait 0xfffff8045a7eea50 sh 41792 41791 41792 2006 Ss+ select 0xfffff803aa7cc440 bash 41791 41645 41645 2006 S select 0xfffff801c20480c0 sshd 41645 2415 41645 0 Ss select 0xfffff805347878c0 sshd 3029 2993 2993 0 S piperd 0xfffff8012e9068b8 sh 3027 2993 2993 0 S piperd 0xfffff801b36bc8b8 awk 3026 2993 2993 0 S wait 0xfffff8012e7eaa50 sh 2993 1 2993 0 SWs wait 0xfffff8028019f528 sh 2909 2470 2909 0 SW+ wait 0xfffff8012eaac000 sh 2470 2468 2470 0 SW+ wait 0xfffff80280228528 bash 2468 2467 2468 0 SW+ pause 0xfffff8012e91a0b0 csh 2467 2460 2467 2006 SW+ wait 0xfffff80280905a50 su 2460 2459 2460 2006 SWs+ wait 0xfffff802801b7528 bash 2459 2456 2456 2006 S select 0xfffff802801cd4c0 sshd 2456 2415 2456 0 Ss select 0xfffff80280346ec0 sshd 2452 2448 2452 0 S+ wait 0xfffff8012b062528 sh 2448 2447 2448 0 S+ pause 0xfffff8012e9e9b00 csh 2447 1 2447 0 SWs+ wait 0xfffff802803f5a50 login 2446 1 2446 0 Ss+ ttyin 0xfffff8012b0e58b0 getty 2445 1 2445 0 Ss+ ttyin 0xfffff8012e3788b0 getty 2444 1 2444 0 Ss+ ttyin 0xfffff8012e378cb0 getty 2443 1 2443 0 Ss+ ttyin 0xfffff8012e36f0b0 getty 2442 1 2442 0 Ss+ ttyin 0xfffff8012e36f4b0 getty 2441 1 2441 0 Ss+ ttyin 0xfffff8012e36f8b0 getty 2440 1 2440 0 Ss+ ttyin 0xfffff8012e36fcb0 getty 2439 1 2439 0 Ss+ ttyin 0xfffff8012e34b0b0 getty 2438 1 2438 0 Ss+ ttyin 0xfffff8012e34b4b0 getty 2427 1 2427 0 Ss select 0xfffff8012e85cb40 inetd 2424 1 2424 0 Ss nanslp 0xffffffff81cb1957 cron 2415 1 2415 0 Ss select 0xfffff8012ea0a4c0 sshd 2386 1 2386 0 Ss select 0xfffff801b3dc9040 powerd 2383 1 2383 123 Ss (threaded) ntpd 100221 S select 0xfffff801b3de7ac0 ntpd 100228 S usem 0xfffff802801cd580 ntpd 2344 1 2344 0 Ss rpcsvc 0xfffff801b3724a60 NLM: master 2341 1 2341 0 Ss select 0xfffff801b3e1fe40 rpc.statd 2319 1 2319 0 Ss select 0xfffff8012b0ac240 rpcbind 2302 1 2302 0 Ss wait 0xfffff8012e40f000 watchdogd 2287 1 2287 0 Ss select 0xfffff8012e917f40 syslogd 2108 1 2108 0 Ss select 0xfffff8012b0ac2c0 devd 2097 1 2097 65 Ss select 0xfffff8012e5299c0 dhclient 2021 1 2021 0 Ss select 0xfffff801b3de7bc0 dhclient 2018 1 2018 0 Ss select 0xfffff8012b0ac340 dhclient 33 0 0 0 DL vlruwt 0xfffff8012e3e7000 [vnlru] 32 0 0 0 DL idle 0xfffff8012e40f528 [enc_daemon1] 31 0 0 0 DL syncer 0xffffffff81d9e9b8 [syncer] 30 0 0 0 DL idle 0xfffff8012e40fa50 [enc_daemon0] 29 0 0 0 DL (threaded) [bufdaemon] 100129 D qsleep 0xffffffff81d9da80 [bufdaemon] 100130 D - 0xffffffff8180ac80 [bufspacedaemon-0] 100131 D - 0xffffffff81812f40 [bufspacedaemon-1] 100132 D - 0xffffffff8181b200 [bufspacedaemon-2] 100133 D - 0xffffffff818234c0 [bufspacedaemon-3] 100134 D - 0xffffffff8182b780 [bufspacedaemon-4] 100136 D - 0xffffffff81833a40 [bufspacedaemon-5] 100137 D - 0xffffffff8183bd00 [bufspacedaemon-6] 100152 D sdflush 0xfffff80003ad94e8 [/ worker] 100159 D sdflush 0xfffff8012e869ce8 [/tmp worker] 100514 D sdflush 0xfffff807cdf1d4e8 [/mnt worker] 28 0 0 0 DL psleep 0xffffffff81dc2e88 [vmdaemon] 27 0 0 0 DL (threaded) [pagedaemon] 100127 D psleep 0xffffffff81db72f8 [dom0] 100138 D launds 0xffffffff81db7304 [laundry: dom0] 100140 D umarcl 0xffffffff80ec36a0 [uma] 26 0 0 0 DL - 0xffffffff81ae5d78 [rand_harvestq] 25 0 0 0 DL - 0xffffffff81d9d39c [soaiod4] 24 0 0 0 DL - 0xffffffff81d9d39c [soaiod3] 23 0 0 0 DL - 0xffffffff81d9d39c [soaiod2] 22 0 0 0 DL - 0xffffffff81d9d39c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100098 D - 0xfffffe00d2cd8440 [usbus0] 100099 D - 0xfffffe00d2cd8498 [usbus0] 100100 D - 0xfffffe00d2cd84f0 [usbus0] 100101 D - 0xfffffe00d2cd8548 [usbus0] 100102 D - 0xfffffe00d2cd85a0 [usbus0] 100104 D - 0xfffffe00ad8e1cf0 [usbus1] 100105 D - 0xfffffe00ad8e1d48 [usbus1] 100106 D - 0xfffffe00ad8e1da0 [usbus1] 100107 D - 0xfffffe00ad8e1df8 [usbus1] 100108 D - 0xfffffe00ad8e1e50 [usbus1] 100109 D - 0xfffffe00d2f81cf0 [usbus2] 100110 D - 0xfffffe00d2f81d48 [usbus2] 100111 D - 0xfffffe00d2f81da0 [usbus2] 100112 D - 0xfffffe00d2f81df8 [usbus2] 100113 D - 0xfffffe00d2f81e50 [usbus2] 20 0 0 0 RL (threaded) [cam] 100092 D - 0xffffffff819bdac0 [doneq0] 100093 RunQ [doneq1] 100094 D - 0xffffffff819bdbc0 [doneq2] 100126 D - 0xffffffff819bd990 [scanner] 19 0 0 0 DL crypto_ 0xfffff8000395dc50 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff8000395dbf0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff8000395db90 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff8000395db30 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff8000395dad0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff8000395da70 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff8000395da10 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff8000395d9b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff8000395d950 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff8000395d8f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff8000395d890 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff8000395d830 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81db4830 [crypto] 14 0 0 0 DL seqstat 0xfffff80003934888 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100063 D - 0xffffffff81c911e0 [g_event] 100064 D - 0xffffffff81c911e8 [g_up] 100065 D - 0xffffffff81c911f0 [g_down] 12 0 0 0 WL (threaded) [intr] 100042 I [swi6: Giant taskq] 100044 I [swi5: fast taskq] 100047 I [swi6: task queue] 100048 I [swi3: vm] 100049 I [swi1: netisr 0] 100050 I [swi4: clock (0)] 100051 I [swi4: clock (1)] 100052 I [swi4: clock (2)] 100053 I [swi4: clock (3)] 100054 I [swi4: clock (4)] 100055 I [swi4: clock (5)] 100056 I [swi4: clock (6)] 100057 I [swi4: clock (7)] 100058 I [swi4: clock (8)] 100059 I [swi4: clock (9)] 100060 I [swi4: clock (10)] 100061 I [swi4: clock (11)] 100095 I [swi4: apei] 100096 I [irq56: ahci0] 100097 I [irq19: xhci0] 100103 I [irq18: ehci0 ehci1+] 100114 I [irq71: ahci1] 100115 I [swi0: uart uart] 100194 I [irq72: ioat0] 100195 I [irq73: ioat1] 100196 I [irq74: ioat2] 100197 I [irq75: ioat3] 100198 I [irq76: ioat4] 100199 I [irq77: ioat5] 100200 I [irq78: ioat6] 100201 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff80003816528 [init] 10 0 0 0 DL audit_w 0xffffffff81db4d18 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81c91770 [swapper] 100015 D - 0xfffff8000383de00 [softirq_0] 100016 D - 0xfffff8000383dd00 [softirq_1] 100017 D - 0xfffff8000383dc00 [softirq_2] 100018 D - 0xfffff8000383db00 [softirq_3] 100019 D - 0xfffff8000383da00 [softirq_4] 100020 D - 0xfffff8000383d900 [softirq_5] 100021 D - 0xfffff8000383d800 [softirq_6] 100022 D - 0xfffff8000383d700 [softirq_7] 100023 D - 0xfffff8000383d600 [softirq_8] 100024 D - 0xfffff8000383d500 [softirq_9] 100025 D - 0xfffff8000383d400 [softirq_10] 100026 D - 0xfffff8000383d300 [softirq_11] 100027 D - 0xfffff8000383d200 [if_io_tqg_0] 100028 D - 0xfffff8000383d100 [if_io_tqg_1] 100029 D - 0xfffff8000383d000 [if_io_tqg_2] 100030 D - 0xfffff80003846e00 [if_io_tqg_3] 100031 D - 0xfffff80003846d00 [if_io_tqg_4] 100032 D - 0xfffff80003846c00 [if_io_tqg_5] 100033 D - 0xfffff80003846b00 [if_io_tqg_6] 100034 D - 0xfffff80003846a00 [if_io_tqg_7] 100035 D - 0xfffff80003846900 [if_io_tqg_8] 100036 D - 0xfffff80003846800 [if_io_tqg_9] 100037 D - 0xfffff80003846700 [if_io_tqg_10] 100038 D - 0xfffff80003846600 [if_io_tqg_11] 100039 D - 0xfffff80003846500 [if_config_tqg_0] 100040 D - 0xfffff80003843200 [in6m_free taskq] 100041 D - 0xfffff80003843000 [aiod_kick taskq] 100043 D - 0xfffff8000384ab00 [thread taskq] 100045 D - 0xfffff8000384a700 [inm_free taskq] 100046 D - 0xfffff8000384a500 [kqueue_ctx taskq] 100062 D - 0xfffff80003892000 [firmware taskq] 100067 D - 0xfffff800038d7800 [crypto_0] 100068 D - 0xfffff800038d7800 [crypto_1] 100069 D - 0xfffff800038d7800 [crypto_2] 100070 D - 0xfffff800038d7800 [crypto_3] 100071 D - 0xfffff800038d7800 [crypto_4] 100072 D - 0xfffff800038d7800 [crypto_5] 100073 D - 0xfffff800038d7800 [crypto_6] 100074 D - 0xfffff800038d7800 [crypto_7] 100075 D - 0xfffff800038d7800 [crypto_8] 100076 D - 0xfffff800038d7800 [crypto_9] 100077 D - 0xfffff800038d7800 [crypto_10] 100078 D - 0xfffff800038d7800 [crypto_11] 100116 D - 0xfffff8012b114000 [mca taskq] 100121 D - 0xfffff8012e355200 [acpi_task_0] 100122 D - 0xfffff8012e355200 [acpi_task_1] 100123 D - 0xfffff8012e355200 [acpi_task_2] 100125 D - 0xfffff8000396fb00 [CAM taskq] 100513 D - 0xfffff80313f0a700 [/mnt trim] db:0:pho> allt Tracing command egrep pid 88492 tid 100282 td 0xfffffe00e0df4700 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dc1de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dc1de10 trap() at trap+0x56/frame 0xfffffe003dc1df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dc1df20 --- trap 0x13, rip = 0xffffffff81012ed3, rsp = 0xfffffe00e0e81600, rbp = 0xfffffe00e0e81670 --- smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0x303/frame 0xfffffe00e0e81670 pmap_invalidate_all() at pmap_invalidate_all+0x139/frame 0xfffffe00e0e816e0 pmap_remove() at pmap_remove+0x5ab/frame 0xfffffe00e0e81760 vm_map_delete() at vm_map_delete+0x20f/frame 0xfffffe00e0e817c0 vm_map_remove() at vm_map_remove+0x81/frame 0xfffffe00e0e817f0 pipeclose() at pipeclose+0x2e0/frame 0xfffffe00e0e81830 pipe_close() at pipe_close+0x60/frame 0xfffffe00e0e81860 _fdrop() at _fdrop+0x1b/frame 0xfffffe00e0e81880 closef() at closef+0x1ea/frame 0xfffffe00e0e81910 fdescfree_fds() at fdescfree_fds+0x8c/frame 0xfffffe00e0e81970 fdescfree() at fdescfree+0x365/frame 0xfffffe00e0e81a40 exit1() at exit1+0x4b7/frame 0xfffffe00e0e81ab0 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00e0e81ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0e81bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0e81bf0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8003e5a2a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe4d0 --- Tracing command sh pid 88156 tid 100423 td 0xfffffe00e2154a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e15446c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e15446e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e1544720 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00e1544770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1544780 _sleep() at _sleep+0x2aa/frame 0xfffffe00e1544830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e15448c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00e1544ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e1544bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e1544bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e4faa, rsp = 0x7fffffffe098, rbp = 0x7fffffffe140 --- Tracing command sleep pid 84236 tid 100207 td 0xfffffe00dede6e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00deefd860 mi_switch() at mi_switch+0x155/frame 0xfffffe00deefd880 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00deefd8c0 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00deefd910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00deefd950 _sleep() at _sleep+0x289/frame 0xfffffe00deefda00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe00deefda80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe00deefdac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00deefdbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00deefdbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800384cea, rsp = 0x7fffffffeab8, rbp = 0x7fffffffeb00 --- Tracing command umount pid 74739 tid 100378 td 0xfffffe00deb95000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e1463500 mi_switch() at mi_switch+0x155/frame 0xfffffe00e1463520 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e1463560 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e14635c0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e1463660 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e14636a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e14636c0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e1463720 vget_finish() at vget_finish+0x7a/frame 0xfffffe00e1463750 cache_lookup() at cache_lookup+0x3d2/frame 0xfffffe00e14637b0 vfs_cache_lookup() at vfs_cache_lookup+0x7b/frame 0xfffffe00e1463800 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe00e1463820 lookup() at lookup+0x441/frame 0xfffffe00e14638c0 namei() at namei+0x6f0/frame 0xfffffe00e1463980 kern_statfs() at kern_statfs+0xc8/frame 0xfffffe00e1463a90 sys_statfs() at sys_statfs+0x39/frame 0xfffffe00e1463ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e1463bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e1463bf0 --- syscall (555, FreeBSD ELF64, sys_statfs), rip = 0x800387b2a, rsp = 0x7fffffffda28, rbp = 0x7fffffffdc30 --- Tracing command umount pid 69211 tid 100247 td 0xfffffe00dede6000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00defd1720 mi_switch() at mi_switch+0x155/frame 0xfffffe00defd1740 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00defd1780 _sleep() at _sleep+0x2b4/frame 0xfffffe00defd1830 vfs_write_suspend() at vfs_write_suspend+0x13e/frame 0xfffffe00defd1880 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe00defd18b0 ffs_unmount() at ffs_unmount+0xb3/frame 0xfffffe00defd1930 dounmount() at dounmount+0x43b/frame 0xfffffe00defd19a0 kern_unmount() at kern_unmount+0x2fc/frame 0xfffffe00defd1ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00defd1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00defd1bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x800384e2a, rsp = 0x7fffffffd2b8, rbp = 0x7fffffffd7f0 --- Tracing command ls pid 69206 tid 100358 td 0xfffffe00df915700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0ffd420 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0ffd440 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0ffd480 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0ffd4e0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e0ffd580 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0ffd5c0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0ffd5e0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0ffd640 vget_finish() at vget_finish+0x7a/frame 0xfffffe00e0ffd670 cache_fplookup_final_child() at cache_fplookup_final_child+0x4a/frame 0xfffffe00e0ffd6a0 cache_fplookup() at cache_fplookup+0xbba/frame 0xfffffe00e0ffd7b0 namei() at namei+0x17f/frame 0xfffffe00e0ffd870 kern_statat() at kern_statat+0x130/frame 0xfffffe00e0ffd9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e0ffdac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0ffdbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0ffdbf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x800416aca, rsp = 0x7fffffffe298, rbp = 0x7fffffffe350 --- Tracing command sh pid 69205 tid 100458 td 0xfffffe00e4791100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e15ee6c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e15ee6e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e15ee720 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00e15ee770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e15ee780 _sleep() at _sleep+0x2aa/frame 0xfffffe00e15ee830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e15ee8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00e15eeac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e15eebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e15eebf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e4faa, rsp = 0x7fffffffe7a8, rbp = 0x7fffffffe850 --- Tracing command lockf pid 66829 tid 100298 td 0xfffffe00e100e700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0ed1480 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0ed14a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0ed14e0 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0ed1540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e0ed15e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0ed1620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0ed1640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0ed16a0 lookup() at lookup+0xd5/frame 0xfffffe00e0ed1740 namei() at namei+0x6f0/frame 0xfffffe00e0ed1800 vn_open_cred() at vn_open_cred+0x107/frame 0xfffffe00e0ed1960 kern_openat() at kern_openat+0x26a/frame 0xfffffe00e0ed1ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0ed1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0ed1bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80039fd2a, rsp = 0x7fffffffe398, rbp = 0x7fffffffe480 --- Tracing command lockf pid 66827 tid 100504 td 0xfffffe00e25f9800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e48d64d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48d64f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e48d6530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e48d6590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e48d6630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e48d6670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e48d6690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e48d66f0 lookup() at lookup+0xd5/frame 0xfffffe00e48d6790 namei() at namei+0x6f0/frame 0xfffffe00e48d6850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e48d6aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e48d6ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e48d6bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e48d6bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4b0 --- Tracing command lockf pid 66825 tid 100321 td 0xfffffe00e103fc00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0f444d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0f444f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0f44530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0f44590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e0f44630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0f44670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0f44690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0f446f0 lookup() at lookup+0xd5/frame 0xfffffe00e0f44790 namei() at namei+0x6f0/frame 0xfffffe00e0f44850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e0f44aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e0f44ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0f44bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0f44bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4b0 --- Tracing command lockf pid 66823 tid 100447 td 0xfffffe00e4778000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e15b7480 mi_switch() at mi_switch+0x155/frame 0xfffffe00e15b74a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e15b74e0 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e15b7540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e15b75e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e15b7620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e15b7640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e15b76a0 lookup() at lookup+0xd5/frame 0xfffffe00e15b7740 namei() at namei+0x6f0/frame 0xfffffe00e15b7800 vn_open_cred() at vn_open_cred+0x107/frame 0xfffffe00e15b7960 kern_openat() at kern_openat+0x26a/frame 0xfffffe00e15b7ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e15b7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e15b7bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80039fd2a, rsp = 0x7fffffffe398, rbp = 0x7fffffffe480 --- Tracing command lockf pid 66821 tid 100203 td 0xfffffe00dec05e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00deee9480 mi_switch() at mi_switch+0x155/frame 0xfffffe00deee94a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00deee94e0 sleeplk() at sleeplk+0xf2/frame 0xfffffe00deee9540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00deee95e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00deee9620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00deee9640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00deee96a0 lookup() at lookup+0xd5/frame 0xfffffe00deee9740 namei() at namei+0x6f0/frame 0xfffffe00deee9800 vn_open_cred() at vn_open_cred+0x107/frame 0xfffffe00deee9960 kern_openat() at kern_openat+0x26a/frame 0xfffffe00deee9ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00deee9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00deee9bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80039fd2a, rsp = 0x7fffffffe398, rbp = 0x7fffffffe480 --- Tracing command lockf pid 66819 tid 100497 td 0xfffffe00e2eb2a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e48b34d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48b34f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e48b3530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e48b3590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e48b3630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e48b3670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e48b3690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e48b36f0 lookup() at lookup+0xd5/frame 0xfffffe00e48b3790 namei() at namei+0x6f0/frame 0xfffffe00e48b3850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e48b3aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e48b3ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e48b3bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e48b3bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4b0 --- Tracing command lockf pid 66817 tid 100257 td 0xfffffe00e0def800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0e044d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0e044f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0e04530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0e04590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e0e04630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0e04670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0e04690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0e046f0 lookup() at lookup+0xd5/frame 0xfffffe00e0e04790 namei() at namei+0x6f0/frame 0xfffffe00e0e04850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e0e04aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e0e04ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0e04bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0e04bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4b0 --- Tracing command lockf pid 66815 tid 100267 td 0xfffffe00e0dec000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0e364d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0e364f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0e36530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0e36590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e0e36630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0e36670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0e36690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0e366f0 lookup() at lookup+0xd5/frame 0xfffffe00e0e36790 namei() at namei+0x6f0/frame 0xfffffe00e0e36850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e0e36aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e0e36ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0e36bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0e36bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4b0 --- Tracing command lockf pid 66813 tid 100364 td 0xfffffe00e10a8300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e141d4d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e141d4f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e141d530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e141d590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e141d630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e141d670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e141d690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e141d6f0 lookup() at lookup+0xd5/frame 0xfffffe00e141d790 namei() at namei+0x6f0/frame 0xfffffe00e141d850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e141daa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e141dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e141dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e141dbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4b0 --- Tracing command creat pid 66812 tid 100164 td 0xfffffe00deb97a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dee136a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dee136c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dee13700 _sleep() at _sleep+0x2b4/frame 0xfffffe00dee137b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00dee13800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00dee13850 kern_funlinkat() at kern_funlinkat+0x346/frame 0xfffffe00dee13aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00dee13ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dee13bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dee13bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command creat pid 66810 tid 100352 td 0xfffffe00e10a9800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0fdf6a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0fdf6c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0fdf700 _sleep() at _sleep+0x2b4/frame 0xfffffe00e0fdf7b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e0fdf800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e0fdf850 kern_funlinkat() at kern_funlinkat+0x346/frame 0xfffffe00e0fdfaa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e0fdfac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0fdfbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0fdfbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command lockf pid 66809 tid 100318 td 0xfffffe00e1041800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0f354d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0f354f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0f35530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0f35590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e0f35630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0f35670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0f35690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0f356f0 lookup() at lookup+0xd5/frame 0xfffffe00e0f35790 namei() at namei+0x6f0/frame 0xfffffe00e0f35850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e0f35aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e0f35ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0f35bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0f35bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4b0 --- Tracing command creat pid 66807 tid 100439 td 0xfffffe00e230d800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e158f6a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e158f6c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e158f700 _sleep() at _sleep+0x2b4/frame 0xfffffe00e158f7b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e158f800 vn_open_cred() at vn_open_cred+0x212/frame 0xfffffe00e158f960 kern_openat() at kern_openat+0x26a/frame 0xfffffe00e158fac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e158fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e158fbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80039fd2a, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command lockf pid 66806 tid 100496 td 0xfffffe00e2eb3100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e48ae480 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48ae4a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e48ae4e0 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e48ae540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e48ae5e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e48ae620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e48ae640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e48ae6a0 lookup() at lookup+0xd5/frame 0xfffffe00e48ae740 namei() at namei+0x6f0/frame 0xfffffe00e48ae800 vn_open_cred() at vn_open_cred+0x107/frame 0xfffffe00e48ae960 kern_openat() at kern_openat+0x26a/frame 0xfffffe00e48aeac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e48aebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e48aebf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80039fd2a, rsp = 0x7fffffffe398, rbp = 0x7fffffffe480 --- Tracing command creat pid 66805 tid 100246 td 0xfffffe00e0dd8000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00defcc6a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00defcc6c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00defcc700 _sleep() at _sleep+0x2b4/frame 0xfffffe00defcc7b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00defcc800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00defcc850 kern_funlinkat() at kern_funlinkat+0x346/frame 0xfffffe00defccaa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00defccac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00defccbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00defccbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command lockf pid 66803 tid 100445 td 0xfffffe00e4778e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e15ad4d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e15ad4f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e15ad530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e15ad590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e15ad630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e15ad670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e15ad690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e15ad6f0 lookup() at lookup+0xd5/frame 0xfffffe00e15ad790 namei() at namei+0x6f0/frame 0xfffffe00e15ad850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e15adaa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e15adac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e15adbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e15adbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4b0 --- Tracing command creat pid 66802 tid 100468 td 0xfffffe00e479ca00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e48226a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48226c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4822700 _sleep() at _sleep+0x2b4/frame 0xfffffe00e48227b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e4822800 vn_open_cred() at vn_open_cred+0x212/frame 0xfffffe00e4822960 kern_openat() at kern_openat+0x26a/frame 0xfffffe00e4822ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e4822bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e4822bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80039fd2a, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command lockf pid 66801 tid 100373 td 0xfffffe00df8d0c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e144a4d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e144a4f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e144a530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e144a590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e144a630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e144a670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e144a690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e144a6f0 lookup() at lookup+0xd5/frame 0xfffffe00e144a790 namei() at namei+0x6f0/frame 0xfffffe00e144a850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e144aaa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e144aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e144abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e144abf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4b0 --- Tracing command link pid 66800 tid 100312 td 0xfffffe00e1041100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0f176a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0f176c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0f17700 _sleep() at _sleep+0x2b4/frame 0xfffffe00e0f177b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e0f17800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e0f17850 kern_funlinkat() at kern_funlinkat+0x346/frame 0xfffffe00e0f17aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e0f17ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0f17bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0f17bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe378, rbp = 0x7fffffffe4b0 --- Tracing command creat pid 66799 tid 100205 td 0xfffffe00d665a500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00deef36a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00deef36c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00deef3700 _sleep() at _sleep+0x2b4/frame 0xfffffe00deef37b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00deef3800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00deef3850 kern_funlinkat() at kern_funlinkat+0x346/frame 0xfffffe00deef3aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00deef3ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00deef3bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00deef3bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command lockf pid 66798 tid 100287 td 0xfffffe00e1020300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0e9a4d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0e9a4f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0e9a530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0e9a590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e0e9a630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0e9a670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0e9a690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0e9a6f0 lookup() at lookup+0xd5/frame 0xfffffe00e0e9a790 namei() at namei+0x6f0/frame 0xfffffe00e0e9a850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e0e9aaa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e0e9aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0e9abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0e9abf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4b0 --- Tracing command link pid 66797 tid 100250 td 0xfffffe00d665d000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00defe0620 mi_switch() at mi_switch+0x155/frame 0xfffffe00defe0640 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00defe0680 _sleep() at _sleep+0x2b4/frame 0xfffffe00defe0730 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00defe0780 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00defe07d0 kern_linkat_vp() at kern_linkat_vp+0x302/frame 0xfffffe00defe09b0 sys_link() at sys_link+0xf4/frame 0xfffffe00defe0ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00defe0bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00defe0bf0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x80039ccea, rsp = 0x7fffffffe378, rbp = 0x7fffffffe4b0 --- Tracing command creat pid 66796 tid 100476 td 0xfffffe00e230bc00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e484a6a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e484a6c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e484a700 _sleep() at _sleep+0x2b4/frame 0xfffffe00e484a7b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e484a800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e484a850 kern_funlinkat() at kern_funlinkat+0x346/frame 0xfffffe00e484aaa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e484aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e484abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e484abf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command lockf pid 66795 tid 100429 td 0xfffffe00e2153500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e15624d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e15624f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e1562530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e1562590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e1562630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e1562670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e1562690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e15626f0 lookup() at lookup+0xd5/frame 0xfffffe00e1562790 namei() at namei+0x6f0/frame 0xfffffe00e1562850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e1562aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e1562ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e1562bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e1562bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4b0 --- Tracing command link pid 66794 tid 100464 td 0xfffffe00e478e700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e480e6a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e480e6c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e480e700 _sleep() at _sleep+0x2b4/frame 0xfffffe00e480e7b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e480e800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e480e850 kern_funlinkat() at kern_funlinkat+0x346/frame 0xfffffe00e480eaa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e480eac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e480ebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e480ebf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe378, rbp = 0x7fffffffe4b0 --- Tracing command rename pid 66793 tid 100281 td 0xfffffe00e0df4e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0e7c450 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0e7c470 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0e7c4b0 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0e7c510 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3f5/frame 0xfffffe00e0e7c5b0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0e7c5f0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0e7c610 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0e7c670 ufs_rename() at ufs_rename+0x80b/frame 0xfffffe00e0e7c850 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe00e0e7c870 kern_renameat() at kern_renameat+0x3ed/frame 0xfffffe00e0e7cac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0e7cbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0e7cbf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80039d52a, rsp = 0x7fffffffe368, rbp = 0x7fffffffe4a0 --- Tracing command creat pid 66792 tid 100457 td 0xfffffe00e4783800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e15e96a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e15e96c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e15e9700 _sleep() at _sleep+0x2b4/frame 0xfffffe00e15e97b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e15e9800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e15e9850 kern_funlinkat() at kern_funlinkat+0x346/frame 0xfffffe00e15e9aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e15e9ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e15e9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e15e9bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command lockf pid 66791 tid 100308 td 0xfffffe00e1039800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0f034d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0f034f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0f03530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0f03590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e0f03630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0f03670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0f03690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0f036f0 lookup() at lookup+0xd5/frame 0xfffffe00e0f03790 namei() at namei+0x6f0/frame 0xfffffe00e0f03850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e0f03aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e0f03ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0f03bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0f03bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4b0 --- Tracing command link pid 66790 tid 100185 td 0xfffffe00deb97300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dee77620 mi_switch() at mi_switch+0x155/frame 0xfffffe00dee77640 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dee77680 _sleep() at _sleep+0x2b4/frame 0xfffffe00dee77730 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00dee77780 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00dee777d0 kern_linkat_vp() at kern_linkat_vp+0x302/frame 0xfffffe00dee779b0 sys_link() at sys_link+0xf4/frame 0xfffffe00dee77ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dee77bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dee77bf0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x80039ccea, rsp = 0x7fffffffe378, rbp = 0x7fffffffe4b0 --- Tracing command creat pid 66789 tid 100279 td 0xfffffe00e1004300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0e726a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0e726c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0e72700 _sleep() at _sleep+0x2b4/frame 0xfffffe00e0e727b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e0e72800 vn_open_cred() at vn_open_cred+0x212/frame 0xfffffe00e0e72960 kern_openat() at kern_openat+0x26a/frame 0xfffffe00e0e72ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0e72bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0e72bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80039fd2a, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command rename pid 66788 tid 100409 td 0xfffffe00e1dbca00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e14fe480 mi_switch() at mi_switch+0x155/frame 0xfffffe00e14fe4a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e14fe4e0 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e14fe540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e14fe5e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e14fe620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e14fe640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e14fe6a0 lookup() at lookup+0xd5/frame 0xfffffe00e14fe740 namei() at namei+0x6f0/frame 0xfffffe00e14fe800 vn_open_cred() at vn_open_cred+0x107/frame 0xfffffe00e14fe960 kern_openat() at kern_openat+0x26a/frame 0xfffffe00e14feac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e14febf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e14febf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80039fd2a, rsp = 0x7fffffffe278, rbp = 0x7fffffffe360 --- Tracing command link pid 66787 tid 100274 td 0xfffffe00e1010300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0e59620 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0e59640 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0e59680 _sleep() at _sleep+0x2b4/frame 0xfffffe00e0e59730 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e0e59780 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e0e597d0 kern_linkat_vp() at kern_linkat_vp+0x302/frame 0xfffffe00e0e599b0 sys_link() at sys_link+0xf4/frame 0xfffffe00e0e59ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0e59bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0e59bf0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x80039ccea, rsp = 0x7fffffffe378, rbp = 0x7fffffffe4b0 --- Tracing command rename pid 66786 tid 100340 td 0xfffffe00e1058000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0fa3450 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0fa3470 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0fa34b0 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0fa3510 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3f5/frame 0xfffffe00e0fa35b0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0fa35f0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0fa3610 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0fa3670 ufs_rename() at ufs_rename+0x80b/frame 0xfffffe00e0fa3850 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe00e0fa3870 kern_renameat() at kern_renameat+0x3ed/frame 0xfffffe00e0fa3ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0fa3bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0fa3bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80039d52a, rsp = 0x7fffffffe368, rbp = 0x7fffffffe4a0 --- Tracing command lockf pid 66785 tid 100394 td 0xfffffe00e16d9c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e14b3480 mi_switch() at mi_switch+0x155/frame 0xfffffe00e14b34a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e14b34e0 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e14b3540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e14b35e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e14b3620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e14b3640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e14b36a0 lookup() at lookup+0xd5/frame 0xfffffe00e14b3740 namei() at namei+0x6f0/frame 0xfffffe00e14b3800 vn_open_cred() at vn_open_cred+0x107/frame 0xfffffe00e14b3960 kern_openat() at kern_openat+0x26a/frame 0xfffffe00e14b3ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e14b3bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e14b3bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80039fd2a, rsp = 0x7fffffffe398, rbp = 0x7fffffffe480 --- Tracing command link pid 66784 tid 100347 td 0xfffffe00e105d500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0fc6620 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0fc6640 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0fc6680 _sleep() at _sleep+0x2b4/frame 0xfffffe00e0fc6730 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e0fc6780 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e0fc67d0 kern_linkat_vp() at kern_linkat_vp+0x302/frame 0xfffffe00e0fc69b0 sys_link() at sys_link+0xf4/frame 0xfffffe00e0fc6ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0fc6bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0fc6bf0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x80039ccea, rsp = 0x7fffffffe378, rbp = 0x7fffffffe4b0 --- Tracing command rename pid 66783 tid 100386 td 0xfffffe00e1388a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e148b480 mi_switch() at mi_switch+0x155/frame 0xfffffe00e148b4a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e148b4e0 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e148b540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e148b5e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e148b620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e148b640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e148b6a0 lookup() at lookup+0xd5/frame 0xfffffe00e148b740 namei() at namei+0x6f0/frame 0xfffffe00e148b800 vn_open_cred() at vn_open_cred+0x107/frame 0xfffffe00e148b960 kern_openat() at kern_openat+0x26a/frame 0xfffffe00e148bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e148bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e148bbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80039fd2a, rsp = 0x7fffffffe278, rbp = 0x7fffffffe360 --- Tracing command lockf pid 66782 tid 100402 td 0xfffffe00e1db7100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e14db4d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e14db4f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e14db530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e14db590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e14db630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e14db670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e14db690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e14db6f0 lookup() at lookup+0xd5/frame 0xfffffe00e14db790 namei() at namei+0x6f0/frame 0xfffffe00e14db850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e14dbaa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e14dbac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e14dbbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e14dbbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4b0 --- Tracing command link pid 66780 tid 100290 td 0xfffffe00e100fc00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0ea96a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0ea96c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0ea9700 _sleep() at _sleep+0x2b4/frame 0xfffffe00e0ea97b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e0ea9800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e0ea9850 kern_funlinkat() at kern_funlinkat+0x346/frame 0xfffffe00e0ea9aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e0ea9ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0ea9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0ea9bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe378, rbp = 0x7fffffffe4b0 --- Tracing command rename pid 66779 tid 100326 td 0xfffffe00e105b800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0f5d480 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0f5d4a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0f5d4e0 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0f5d540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e0f5d5e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0f5d620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0f5d640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0f5d6a0 lookup() at lookup+0xd5/frame 0xfffffe00e0f5d740 namei() at namei+0x6f0/frame 0xfffffe00e0f5d800 vn_open_cred() at vn_open_cred+0x107/frame 0xfffffe00e0f5d960 kern_openat() at kern_openat+0x26a/frame 0xfffffe00e0f5dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0f5dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0f5dbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80039fd2a, rsp = 0x7fffffffe278, rbp = 0x7fffffffe360 --- Tracing command lockf pid 66778 tid 100368 td 0xfffffe00e0de4e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e14314d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e14314f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e1431530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e1431590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e1431630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e1431670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e1431690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e14316f0 lookup() at lookup+0xd5/frame 0xfffffe00e1431790 namei() at namei+0x6f0/frame 0xfffffe00e1431850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e1431aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e1431ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e1431bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e1431bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4b0 --- Tracing command link pid 66777 tid 100454 td 0xfffffe00e4780e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e15da6a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e15da6c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e15da700 _sleep() at _sleep+0x2b4/frame 0xfffffe00e15da7b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e15da800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e15da850 kern_funlinkat() at kern_funlinkat+0x346/frame 0xfffffe00e15daaa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e15daac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e15dabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e15dabf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe378, rbp = 0x7fffffffe4b0 --- Tracing command rename pid 66776 tid 100359 td 0xfffffe00e123d100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e1404480 mi_switch() at mi_switch+0x155/frame 0xfffffe00e14044a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e14044e0 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e1404540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e14045e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e1404620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e1404640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e14046a0 lookup() at lookup+0xd5/frame 0xfffffe00e1404740 namei() at namei+0x6f0/frame 0xfffffe00e1404800 vn_open_cred() at vn_open_cred+0x107/frame 0xfffffe00e1404960 kern_openat() at kern_openat+0x26a/frame 0xfffffe00e1404ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e1404bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e1404bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80039fd2a, rsp = 0x7fffffffe278, rbp = 0x7fffffffe360 --- Tracing command link pid 66775 tid 100248 td 0xfffffe00e0ddb800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00defd66a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00defd66c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00defd6700 _sleep() at _sleep+0x2b4/frame 0xfffffe00defd67b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00defd6800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00defd6850 kern_funlinkat() at kern_funlinkat+0x346/frame 0xfffffe00defd6aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00defd6ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00defd6bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00defd6bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe378, rbp = 0x7fffffffe4b0 --- Tracing command rename pid 66774 tid 100212 td 0xfffffe00df7ad100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00def162e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00def16300 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00def16340 _sleep() at _sleep+0x2b4/frame 0xfffffe00def163f0 bufwait() at bufwait+0xc4/frame 0xfffffe00def16430 bufwrite() at bufwrite+0x25a/frame 0xfffffe00def16480 ffs_update() at ffs_update+0x2fb/frame 0xfffffe00def164e0 ffs_syncvnode() at ffs_syncvnode+0x4da/frame 0xfffffe00def16570 ffs_fsync() at ffs_fsync+0x1f/frame 0xfffffe00def165a0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x59/frame 0xfffffe00def165c0 softdep_prerename_vnode() at softdep_prerename_vnode+0x56/frame 0xfffffe00def16600 softdep_prerename() at softdep_prerename+0x109/frame 0xfffffe00def16670 ufs_rename() at ufs_rename+0x3ee/frame 0xfffffe00def16850 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe00def16870 kern_renameat() at kern_renameat+0x3ed/frame 0xfffffe00def16ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00def16bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00def16bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80039d52a, rsp = 0x7fffffffe368, rbp = 0x7fffffffe4a0 --- Tracing command link pid 66772 tid 100398 td 0xfffffe00e103e700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e14c7620 mi_switch() at mi_switch+0x155/frame 0xfffffe00e14c7640 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e14c7680 _sleep() at _sleep+0x2b4/frame 0xfffffe00e14c7730 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e14c7780 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e14c77d0 kern_linkat_vp() at kern_linkat_vp+0x302/frame 0xfffffe00e14c79b0 sys_link() at sys_link+0xf4/frame 0xfffffe00e14c7ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e14c7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e14c7bf0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x80039ccea, rsp = 0x7fffffffe378, rbp = 0x7fffffffe4b0 --- Tracing command rename pid 66771 tid 100311 td 0xfffffe00df8d1300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0f12480 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0f124a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0f124e0 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0f12540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e0f125e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0f12620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0f12640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0f126a0 lookup() at lookup+0xd5/frame 0xfffffe00e0f12740 namei() at namei+0x6f0/frame 0xfffffe00e0f12800 vn_open_cred() at vn_open_cred+0x107/frame 0xfffffe00e0f12960 kern_openat() at kern_openat+0x26a/frame 0xfffffe00e0f12ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0f12bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0f12bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80039fd2a, rsp = 0x7fffffffe278, rbp = 0x7fffffffe360 --- Tracing command link pid 66770 tid 100455 td 0xfffffe00e4780700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e15df6a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e15df6c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e15df700 _sleep() at _sleep+0x2b4/frame 0xfffffe00e15df7b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e15df800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e15df850 kern_funlinkat() at kern_funlinkat+0x346/frame 0xfffffe00e15dfaa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e15dfac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e15dfbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e15dfbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe378, rbp = 0x7fffffffe4b0 --- Tracing command rename pid 66769 tid 100265 td 0xfffffe00e0dec700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0e2c480 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0e2c4a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0e2c4e0 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0e2c540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e0e2c5e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0e2c620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0e2c640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0e2c6a0 lookup() at lookup+0xd5/frame 0xfffffe00e0e2c740 namei() at namei+0x6f0/frame 0xfffffe00e0e2c800 vn_open_cred() at vn_open_cred+0x107/frame 0xfffffe00e0e2c960 kern_openat() at kern_openat+0x26a/frame 0xfffffe00e0e2cac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0e2cbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0e2cbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80039fd2a, rsp = 0x7fffffffe278, rbp = 0x7fffffffe360 --- Tracing command rename pid 66768 tid 100406 td 0xfffffe00e1dbd100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e14ef480 mi_switch() at mi_switch+0x155/frame 0xfffffe00e14ef4a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e14ef4e0 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e14ef540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e14ef5e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e14ef620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e14ef640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e14ef6a0 lookup() at lookup+0xd5/frame 0xfffffe00e14ef740 namei() at namei+0x6f0/frame 0xfffffe00e14ef800 vn_open_cred() at vn_open_cred+0x107/frame 0xfffffe00e14ef960 kern_openat() at kern_openat+0x26a/frame 0xfffffe00e14efac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e14efbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e14efbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80039fd2a, rsp = 0x7fffffffe278, rbp = 0x7fffffffe360 --- Tracing command rename pid 66766 tid 100405 td 0xfffffe00e1db7800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e14ea480 mi_switch() at mi_switch+0x155/frame 0xfffffe00e14ea4a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e14ea4e0 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e14ea540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e14ea5e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e14ea620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e14ea640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e14ea6a0 lookup() at lookup+0xd5/frame 0xfffffe00e14ea740 namei() at namei+0x6f0/frame 0xfffffe00e14ea800 vn_open_cred() at vn_open_cred+0x107/frame 0xfffffe00e14ea960 kern_openat() at kern_openat+0x26a/frame 0xfffffe00e14eaac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e14eabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e14eabf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80039fd2a, rsp = 0x7fffffffe278, rbp = 0x7fffffffe360 --- Tracing command lockf2 pid 66764 tid 100407 td 0xfffffe00e11a6e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e14f44d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e14f44f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e14f4530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e14f4590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e14f4630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e14f4670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e14f4690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e14f46f0 lookup() at lookup+0xd5/frame 0xfffffe00e14f4790 namei() at namei+0x6f0/frame 0xfffffe00e14f4850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e14f4aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e14f4ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e14f4bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e14f4bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4a0 --- Tracing command symlink pid 66763 tid 100241 td 0xfffffe00e0dda300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00defb36f0 mi_switch() at mi_switch+0x155/frame 0xfffffe00defb3710 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00defb3750 _sleep() at _sleep+0x2b4/frame 0xfffffe00defb3800 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00defb3850 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00defb38a0 kern_symlinkat() at kern_symlinkat+0xc3/frame 0xfffffe00defb3ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00defb3bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00defb3bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x80039d12a, rsp = 0x7fffffffe3f8, rbp = 0x7fffffffe4a0 --- Tracing command lockf2 pid 66762 tid 100412 td 0xfffffe00e1db6300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e150d4d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e150d4f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e150d530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e150d590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e150d630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e150d670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e150d690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e150d6f0 lookup() at lookup+0xd5/frame 0xfffffe00e150d790 namei() at namei+0x6f0/frame 0xfffffe00e150d850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e150daa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e150dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e150dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e150dbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4a0 --- Tracing command symlink pid 66761 tid 100397 td 0xfffffe00e105c700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e14c26a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e14c26c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e14c2700 _sleep() at _sleep+0x2b4/frame 0xfffffe00e14c27b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e14c2800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e14c2850 kern_funlinkat() at kern_funlinkat+0x346/frame 0xfffffe00e14c2aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e14c2ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e14c2bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e14c2bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe3f8, rbp = 0x7fffffffe4a0 --- Tracing command lockf2 pid 66760 tid 100353 td 0xfffffe00e11a9100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0fe44d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0fe44f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0fe4530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0fe4590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e0fe4630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0fe4670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0fe4690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0fe46f0 lookup() at lookup+0xd5/frame 0xfffffe00e0fe4790 namei() at namei+0x6f0/frame 0xfffffe00e0fe4850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e0fe4aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e0fe4ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0fe4bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0fe4bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4a0 --- Tracing command symlink pid 66759 tid 100400 td 0xfffffe00df8cf700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e14d16a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e14d16c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e14d1700 _sleep() at _sleep+0x2b4/frame 0xfffffe00e14d17b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e14d1800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e14d1850 kern_funlinkat() at kern_funlinkat+0x346/frame 0xfffffe00e14d1aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e14d1ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e14d1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e14d1bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe3f8, rbp = 0x7fffffffe4a0 --- Tracing command lockf2 pid 66758 tid 100506 td 0xfffffe00e25f8a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e48e04d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48e04f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e48e0530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e48e0590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e48e0630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e48e0670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e48e0690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e48e06f0 lookup() at lookup+0xd5/frame 0xfffffe00e48e0790 namei() at namei+0x6f0/frame 0xfffffe00e48e0850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e48e0aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e48e0ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e48e0bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e48e0bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4a0 --- Tracing command symlink pid 66757 tid 100441 td 0xfffffe00e477aa00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e15996f0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e1599710 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e1599750 _sleep() at _sleep+0x2b4/frame 0xfffffe00e1599800 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e1599850 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e15998a0 kern_symlinkat() at kern_symlinkat+0xc3/frame 0xfffffe00e1599ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e1599bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e1599bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x80039d12a, rsp = 0x7fffffffe3f8, rbp = 0x7fffffffe4a0 --- Tracing command rw pid 66756 tid 100278 td 0xfffffe00decdf000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0e6d5e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0e6d600 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0e6d640 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0e6d6a0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e0e6d740 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0e6d780 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0e6d7a0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0e6d800 lookup() at lookup+0xd5/frame 0xfffffe00e0e6d8a0 namei() at namei+0x6f0/frame 0xfffffe00e0e6d960 kern_frmdirat() at kern_frmdirat+0x2bf/frame 0xfffffe00e0e6dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0e6dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0e6dbf0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x80039d5ea, rsp = 0x7fffffffd1e8, rbp = 0x7fffffffd1f0 --- Tracing command lockf2 pid 66755 tid 100262 td 0xfffffe00e0df6a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0e1d4d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0e1d4f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0e1d530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0e1d590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e0e1d630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0e1d670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0e1d690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0e1d6f0 lookup() at lookup+0xd5/frame 0xfffffe00e0e1d790 namei() at namei+0x6f0/frame 0xfffffe00e0e1d850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e0e1daa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e0e1dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0e1dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0e1dbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4a0 --- Tracing command symlink pid 66754 tid 100325 td 0xfffffe00e105b100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0f586f0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0f58710 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0f58750 _sleep() at _sleep+0x2b4/frame 0xfffffe00e0f58800 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e0f58850 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e0f588a0 kern_symlinkat() at kern_symlinkat+0xc3/frame 0xfffffe00e0f58ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0f58bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0f58bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x80039d12a, rsp = 0x7fffffffe3f8, rbp = 0x7fffffffe4a0 --- Tracing command rw pid 66753 tid 100354 td 0xfffffe00e11a9800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0fe95e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0fe9600 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0fe9640 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0fe96a0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e0fe9740 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0fe9780 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0fe97a0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0fe9800 lookup() at lookup+0xd5/frame 0xfffffe00e0fe98a0 namei() at namei+0x6f0/frame 0xfffffe00e0fe9960 kern_frmdirat() at kern_frmdirat+0x2bf/frame 0xfffffe00e0fe9ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0fe9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0fe9bf0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x80039d5ea, rsp = 0x7fffffffd1e8, rbp = 0x7fffffffd1f0 --- Tracing command fts pid 66752 tid 100485 td 0xfffffe00e16d8700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e48774f0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4877510 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4877550 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e48775b0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e4877650 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e4877690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e48776b0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e4877710 lookup() at lookup+0xd5/frame 0xfffffe00e48777b0 namei() at namei+0x6f0/frame 0xfffffe00e4877870 kern_statat() at kern_statat+0x130/frame 0xfffffe00e48779c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e4877ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e4877bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e4877bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80039eaca, rsp = 0x7fffffffe188, rbp = 0x7fffffffe240 --- Tracing command lockf2 pid 66751 tid 100271 td 0xfffffe00e1005800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0e4a4d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0e4a4f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0e4a530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0e4a590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e0e4a630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0e4a670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0e4a690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0e4a6f0 lookup() at lookup+0xd5/frame 0xfffffe00e0e4a790 namei() at namei+0x6f0/frame 0xfffffe00e0e4a850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e0e4aaa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e0e4aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0e4abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0e4abf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4a0 --- Tracing command rw pid 66750 tid 100370 td 0xfffffe00e10a7c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e143b5e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e143b600 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e143b640 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e143b6a0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e143b740 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e143b780 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e143b7a0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e143b800 lookup() at lookup+0xd5/frame 0xfffffe00e143b8a0 namei() at namei+0x6f0/frame 0xfffffe00e143b960 kern_frmdirat() at kern_frmdirat+0x2bf/frame 0xfffffe00e143bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e143bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e143bbf0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x80039d5ea, rsp = 0x7fffffffd1e8, rbp = 0x7fffffffd1f0 --- Tracing command lockf2 pid 66749 tid 100467 td 0xfffffe00e479d100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e481d4d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e481d4f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e481d530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e481d590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e481d630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e481d670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e481d690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e481d6f0 lookup() at lookup+0xd5/frame 0xfffffe00e481d790 namei() at namei+0x6f0/frame 0xfffffe00e481d850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e481daa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e481dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e481dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e481dbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4a0 --- Tracing command symlink pid 66748 tid 100345 td 0xfffffe00e103f500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0fbc6f0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0fbc710 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0fbc750 _sleep() at _sleep+0x2b4/frame 0xfffffe00e0fbc800 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e0fbc850 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e0fbc8a0 kern_symlinkat() at kern_symlinkat+0xc3/frame 0xfffffe00e0fbcac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0fbcbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0fbcbf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x80039d12a, rsp = 0x7fffffffe3f8, rbp = 0x7fffffffe4a0 --- Tracing command rw pid 66746 tid 100317 td 0xfffffe00e1040300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0f305e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0f30600 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0f30640 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e0f306a0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e0f30740 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e0f30780 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e0f307a0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e0f30800 lookup() at lookup+0xd5/frame 0xfffffe00e0f308a0 namei() at namei+0x6f0/frame 0xfffffe00e0f30960 kern_frmdirat() at kern_frmdirat+0x2bf/frame 0xfffffe00e0f30ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0f30bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0f30bf0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x80039d5ea, rsp = 0x7fffffffd1e8, rbp = 0x7fffffffd1f0 --- Tracing command symlink pid 66745 tid 100264 td 0xfffffe00e0df6300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0e276a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0e276c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0e27700 _sleep() at _sleep+0x2b4/frame 0xfffffe00e0e277b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e0e27800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e0e27850 kern_funlinkat() at kern_funlinkat+0x346/frame 0xfffffe00e0e27aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e0e27ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0e27bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0e27bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe3f8, rbp = 0x7fffffffe4a0 --- Tracing command lockf2 pid 66744 tid 100369 td 0xfffffe00e0de4700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e14364d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e14364f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e1436530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e1436590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e1436630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e1436670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e1436690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e14366f0 lookup() at lookup+0xd5/frame 0xfffffe00e1436790 namei() at namei+0x6f0/frame 0xfffffe00e1436850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e1436aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e1436ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e1436bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e1436bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4a0 --- Tracing command symlink pid 66742 tid 100392 td 0xfffffe00e16db800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e14a96f0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e14a9710 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e14a9750 _sleep() at _sleep+0x2b4/frame 0xfffffe00e14a9800 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e14a9850 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e14a98a0 kern_symlinkat() at kern_symlinkat+0xc3/frame 0xfffffe00e14a9ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e14a9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e14a9bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x80039d12a, rsp = 0x7fffffffe3f8, rbp = 0x7fffffffe4a0 --- Tracing command lockf2 pid 66741 tid 100503 td 0xfffffe00e25f9100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e48d14d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48d14f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e48d1530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e48d1590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e48d1630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e48d1670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e48d1690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e48d16f0 lookup() at lookup+0xd5/frame 0xfffffe00e48d1790 namei() at namei+0x6f0/frame 0xfffffe00e48d1850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e48d1aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e48d1ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e48d1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e48d1bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4a0 --- Tracing command symlink pid 66740 tid 100403 td 0xfffffe00e1db6a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e14e06f0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e14e0710 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e14e0750 _sleep() at _sleep+0x2b4/frame 0xfffffe00e14e0800 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00e14e0850 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e14e08a0 kern_symlinkat() at kern_symlinkat+0xc3/frame 0xfffffe00e14e0ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e14e0bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e14e0bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x80039d12a, rsp = 0x7fffffffe3f8, rbp = 0x7fffffffe4a0 --- Tracing command lockf2 pid 66739 tid 100472 td 0xfffffe00e1386000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e48364d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48364f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4836530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e4836590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e4836630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e4836670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e4836690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e48366f0 lookup() at lookup+0xd5/frame 0xfffffe00e4836790 namei() at namei+0x6f0/frame 0xfffffe00e4836850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e4836aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e4836ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e4836bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e4836bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4a0 --- Tracing command lockf2 pid 66738 tid 100145 td 0xfffffe00ad893300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dcd9b4d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dcd9b4f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dcd9b530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00dcd9b590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00dcd9b630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00dcd9b670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00dcd9b690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00dcd9b6f0 lookup() at lookup+0xd5/frame 0xfffffe00dcd9b790 namei() at namei+0x6f0/frame 0xfffffe00dcd9b850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00dcd9baa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00dcd9bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dcd9bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dcd9bbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4a0 --- Tracing command openat pid 66736 tid 100253 td 0xfffffe00df862000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00defef0b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00defef0d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00defef110 sleeplk() at sleeplk+0xf2/frame 0xfffffe00defef170 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3f5/frame 0xfffffe00defef210 __lockmgr_args() at __lockmgr_args+0x625/frame 0xfffffe00defef2b0 getblkx() at getblkx+0x1a5/frame 0xfffffe00defef370 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00defef3d0 ffs_breadz() at ffs_breadz+0x5a/frame 0xfffffe00defef450 ffs_update() at ffs_update+0x139/frame 0xfffffe00defef4e0 ffs_syncvnode() at ffs_syncvnode+0x4da/frame 0xfffffe00defef570 ffs_fsync() at ffs_fsync+0x1f/frame 0xfffffe00defef5a0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x59/frame 0xfffffe00defef5c0 softdep_prerename_vnode() at softdep_prerename_vnode+0x56/frame 0xfffffe00defef600 softdep_prerename() at softdep_prerename+0x109/frame 0xfffffe00defef670 ufs_rename() at ufs_rename+0x3ee/frame 0xfffffe00defef850 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe00defef870 kern_renameat() at kern_renameat+0x3ed/frame 0xfffffe00defefac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00defefbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00defefbf0 --- syscall (501, FreeBSD ELF64, sys_renameat), rip = 0x80039f2aa, rsp = 0x7fffffffe368, rbp = 0x7fffffffe4a0 --- Tracing command lockf2 pid 66735 tid 100238 td 0xfffffe00df918800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00defa44d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00defa44f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00defa4530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00defa4590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00defa4630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00defa4670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00defa4690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00defa46f0 lookup() at lookup+0xd5/frame 0xfffffe00defa4790 namei() at namei+0x6f0/frame 0xfffffe00defa4850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00defa4aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00defa4ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00defa4bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00defa4bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4a0 --- Tracing command openat pid 66734 tid 100184 td 0xfffffe00dece2100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dee726a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dee726c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dee72700 _sleep() at _sleep+0x2b4/frame 0xfffffe00dee727b0 vn_start_write_refed() at vn_start_write_refed+0x1e0/frame 0xfffffe00dee72800 vn_open_cred() at vn_open_cred+0x212/frame 0xfffffe00dee72960 kern_openat() at kern_openat+0x26a/frame 0xfffffe00dee72ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dee72bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dee72bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80039fd2a, rsp = 0x7fffffffe278, rbp = 0x7fffffffe360 --- Tracing command lockf2 pid 66733 tid 100448 td 0xfffffe00e477b800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e15bc4d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e15bc4f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e15bc530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e15bc590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e15bc630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e15bc670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e15bc690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e15bc6f0 lookup() at lookup+0xd5/frame 0xfffffe00e15bc790 namei() at namei+0x6f0/frame 0xfffffe00e15bc850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e15bcaa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e15bcac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e15bcbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e15bcbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4a0 --- Tracing command lockf2 pid 66732 tid 100463 td 0xfffffe00e478ee00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e48094d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48094f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4809530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e4809590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e4809630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e4809670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e4809690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e48096f0 lookup() at lookup+0xd5/frame 0xfffffe00e4809790 namei() at namei+0x6f0/frame 0xfffffe00e4809850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e4809aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e4809ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e4809bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e4809bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4a0 --- Tracing command lockf2 pid 66730 tid 100489 td 0xfffffe00e214c700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e488b4d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e488b4f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e488b530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00e488b590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00e488b630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00e488b670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e488b690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e488b6f0 lookup() at lookup+0xd5/frame 0xfffffe00e488b790 namei() at namei+0x6f0/frame 0xfffffe00e488b850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00e488baa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e488bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e488bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e488bbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4a0 --- Tracing command lockf2 pid 66729 tid 100244 td 0xfffffe00e0dd8e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00defc24d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00defc24f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00defc2530 sleeplk() at sleeplk+0xf2/frame 0xfffffe00defc2590 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00defc2630 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe00defc2670 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00defc2690 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00defc26f0 lookup() at lookup+0xd5/frame 0xfffffe00defc2790 namei() at namei+0x6f0/frame 0xfffffe00defc2850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe00defc2aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00defc2ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00defc2bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00defc2bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80039cd0a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4a0 --- Tracing command md10 pid 63183 tid 100433 td 0xfffffe00e2152000 (CPU 1) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 45358 tid 100174 td 0xfffffe00ad892500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dee406c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dee406e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dee40720 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dee40770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dee40780 _sleep() at _sleep+0x2aa/frame 0xfffffe00dee40830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00dee408c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00dee40ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dee40bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dee40bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e4faa, rsp = 0x7fffffffe0a8, rbp = 0x7fffffffe150 --- Tracing command tee pid 45357 tid 100269 td 0xfffffe00e1005100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0e40830 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0e40850 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0e40890 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00e0e408e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e0e408f0 _sleep() at _sleep+0x2aa/frame 0xfffffe00e0e409a0 pipe_read() at pipe_read+0x4da/frame 0xfffffe00e0e40a00 dofileread() at dofileread+0x81/frame 0xfffffe00e0e40a50 sys_read() at sys_read+0xbc/frame 0xfffffe00e0e40ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0e40bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0e40bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800384dca, rsp = 0x7fffffffe648, rbp = 0x7fffffffe6a0 --- Tracing command sh pid 45356 tid 100408 td 0xfffffe00e105c000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e14f96c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e1575e90 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e1575ea0 trap() at trap+0x90/frame 0xfffffe00e1575fb0 calltrap() at calltrap+0x8/frame 0xfffffe00e1575fb0 --- trap 0xc, rip = 0xffffffff81002a40, rsp = 0xfffffe00e1576080, rbp = 0xfffffe00e1576110 --- db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00e1576110 db_get_value() at db_get_value+0x32/frame 0xfffffe00e1576150 db_backtrace() at db_backtrace+0x22e/frame 0xfffffe00e15761e0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e1576200 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e15762a0 db_command() at db_command+0x270/frame 0xfffffe00e1576370 db_script_exec() at db_script_exec+0x1b8/frame 0xfffffe00e1576420 db_command() at db_command+0x270/frame 0xfffffe00e15764f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e1576500 db_trap() at db_trap+0xe6/frame 0xfffffe00e1576590 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e1576600 trap() at trap+0x7be/frame 0xfffffe00e1576710 calltrap() at calltrap+0x8/frame 0xfffffe00e1576710 --- trap 0x3, rip = 0xffffffff80c2a307, rsp = 0xfffffe00e15767e0, rbp = 0xfffffe00e15767f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e14f96c8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e1576100 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e1576110 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e1576150 db_backtrace() at db_backtrace+0x22e/frame 0xfffffe00e15761e0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e1576200 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e15762a0 db_command() at db_command+0x270/frame 0xfffffe00e1576370 db_script_exec() at db_script_exec+0x1b8/frame 0xfffffe00e1576420 db_command() at db_command+0x270/frame 0xfffffe00e15764f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e1576500 db_trap() at db_trap+0xe6/frame 0xfffffe00e1576590 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e1576600 trap() at trap+0x7be/frame 0xfffffe00e1576710 calltrap() at calltrap+0x8/frame 0xfffffe00e1576710 --- trap 0x3, rip = 0xffffffff80c2a307, rsp = 0xfffffe00e15767e0, rbp = 0xfffffe00e15767f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 41792 tid 100283 td 0xfffffe00e0df4000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0e866f0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0e86710 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0e86750 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00e0e867a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e0e867b0 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00e0e86820 seltdwait() at seltdwait+0x88/frame 0xfffffe00e0e86860 kern_select() at kern_select+0x977/frame 0xfffffe00e0e86a40 sys_pselect() at sys_pselect+0x127/frame 0xfffffe00e0e86ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0e86bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0e86bf0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x80050dd8a, rsp = 0x7fffffffd6c8, rbp = 0x7fffffffd790 --- Tracing command sshd pid 41791 tid 100288 td 0xfffffe00e101fc00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e0e9f730 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0e9f750 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e0e9f790 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00e0e9f7e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e0e9f7f0 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00e0e9f860 seltdwait() at seltdwait+0x88/frame 0xfffffe00e0e9f8a0 kern_select() at kern_select+0x977/frame 0xfffffe00e0e9fa80 sys_select() at sys_select+0x56/frame 0xfffffe00e0e9fac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00e0e9fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0e9fbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800871e4a, rsp = 0x7fffffffa4e8, rbp = 0x7fffffffa520 --- Tracing command sshd pid 41645 tid 100232 td 0xfffffe00df917300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00def7a7a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00def7a7c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00def7a800 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00def7a850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00def7a860 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00def7a8d0 seltdwait() at seltdwait+0x88/frame 0xfffffe00def7a910 kern_poll() at kern_poll+0x527/frame 0xfffffe00def7aaa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00def7aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00def7abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00def7abf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800871d4a, rsp = 0x7fffffffe548, rbp = 0x7fffffffe580 --- Tracing command sh pid 3029 tid 100188 td 0xfffffe00dec07300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dee92830 mi_switch() at mi_switch+0x155/frame 0xfffffe00dee92850 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dee92890 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dee928e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dee928f0 _sleep() at _sleep+0x2aa/frame 0xfffffe00dee929a0 pipe_read() at pipe_read+0x4da/frame 0xfffffe00dee92a00 dofileread() at dofileread+0x81/frame 0xfffffe00dee92a50 sys_read() at sys_read+0xbc/frame 0xfffffe00dee92ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dee92bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dee92bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003e4dca, rsp = 0x7fffffffdd88, rbp = 0x7fffffffe2b0 --- Tracing command awk pid 3027 tid 100160 td 0xfffffe00d665b300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dcdfe830 mi_switch() at mi_switch+0x155/frame 0xfffffe00dcdfe850 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dcdfe890 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dcdfe8e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dcdfe8f0 _sleep() at _sleep+0x2aa/frame 0xfffffe00dcdfe9a0 pipe_read() at pipe_read+0x4da/frame 0xfffffe00dcdfea00 dofileread() at dofileread+0x81/frame 0xfffffe00dcdfea50 sys_read() at sys_read+0xbc/frame 0xfffffe00dcdfeac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dcdfebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dcdfebf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003e9dca, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe2d0 --- Tracing command sh pid 3026 tid 100151 td 0xfffffe00d6657300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dcdb96c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dcdb96e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dcdb9720 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dcdb9770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dcdb9780 _sleep() at _sleep+0x2aa/frame 0xfffffe00dcdb9830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00dcdb98c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00dcdb9ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dcdb9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dcdb9bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e4faa, rsp = 0x7fffffffe2d8, rbp = 0x7fffffffe380 --- Tracing command sh pid 2993 tid 100218 td 0xfffffe00debe1700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00def346c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e1575e90 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e1575ea0 trap() at trap+0x90/frame 0xfffffe00e1575fb0 calltrap() at calltrap+0x8/frame 0xfffffe00e1575fb0 --- trap 0xc, rip = 0xffffffff81002a40, rsp = 0xfffffe00e1576080, rbp = 0xfffffe00e1576110 --- db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00e1576110 db_get_value() at db_get_value+0x32/frame 0xfffffe00e1576150 db_backtrace() at db_backtrace+0x22e/frame 0xfffffe00e15761e0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e1576200 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e15762a0 db_command() at db_command+0x270/frame 0xfffffe00e1576370 db_script_exec() at db_script_exec+0x1b8/frame 0xfffffe00e1576420 db_command() at db_command+0x270/frame 0xfffffe00e15764f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e1576500 db_trap() at db_trap+0xe6/frame 0xfffffe00e1576590 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e1576600 trap() at trap+0x7be/frame 0xfffffe00e1576710 calltrap() at calltrap+0x8/frame 0xfffffe00e1576710 --- trap 0x3, rip = 0xffffffff80c2a307, rsp = 0xfffffe00e15767e0, rbp = 0xfffffe00e15767f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00def346c8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e1576100 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e1576110 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e1576150 db_backtrace() at db_backtrace+0x22e/frame 0xfffffe00e15761e0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e1576200 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e15762a0 db_command() at db_command+0x270/frame 0xfffffe00e1576370 db_script_exec() at db_script_exec+0x1b8/frame 0xfffffe00e1576420 db_command() at db_command+0x270/frame 0xfffffe00e15764f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e1576500 db_trap() at db_trap+0xe6/frame 0xfffffe00e1576590 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e1576600 trap() at trap+0x7be/frame 0xfffffe00e1576710 calltrap() at calltrap+0x8/frame 0xfffffe00e1576710 --- trap 0x3, rip = 0xffffffff80c2a307, rsp = 0xfffffe00e15767e0, rbp = 0xfffffe00e15767f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 2909 tid 100366 td 0xfffffe00deb95e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e14276c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e1575e90 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e1575ea0 trap() at trap+0x90/frame 0xfffffe00e1575fb0 calltrap() at calltrap+0x8/frame 0xfffffe00e1575fb0 --- trap 0xc, rip = 0xffffffff81002a40, rsp = 0xfffffe00e1576080, rbp = 0xfffffe00e1576110 --- db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00e1576110 db_get_value() at db_get_value+0x32/frame 0xfffffe00e1576150 db_backtrace() at db_backtrace+0x22e/frame 0xfffffe00e15761e0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e1576200 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e15762a0 db_command() at db_command+0x270/frame 0xfffffe00e1576370 db_script_exec() at db_script_exec+0x1b8/frame 0xfffffe00e1576420 db_command() at db_command+0x270/frame 0xfffffe00e15764f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e1576500 db_trap() at db_trap+0xe6/frame 0xfffffe00e1576590 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e1576600 trap() at trap+0x7be/frame 0xfffffe00e1576710 calltrap() at calltrap+0x8/frame 0xfffffe00e1576710 --- trap 0x3, rip = 0xffffffff80c2a307, rsp = 0xfffffe00e15767e0, rbp = 0xfffffe00e15767f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e14276c8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e1576100 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e1576110 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e1576150 db_backtrace() at db_backtrace+0x22e/frame 0xfffffe00e15761e0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e1576200 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e15762a0 db_command() at db_command+0x270/frame 0xfffffe00e1576370 db_script_exec() at db_script_exec+0x1b8/frame 0xfffffe00e1576420 db_command() at db_command+0x270/frame 0xfffffe00e15764f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e1576500 db_trap() at db_trap+0xe6/frame 0xfffffe00e1576590 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e1576600 trap() at trap+0x7be/frame 0xfffffe00e1576710 calltrap() at calltrap+0x8/frame 0xfffffe00e1576710 --- trap 0x3, rip = 0xffffffff80c2a307, rsp = 0xfffffe00e15767e0, rbp = 0xfffffe00e15767f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2470 tid 100233 td 0xfffffe00decdfe00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00def7f6c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e1575e90 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e1575ea0 trap() at trap+0x90/frame 0xfffffe00e1575fb0 calltrap() at calltrap+0x8/frame 0xfffffe00e1575fb0 --- trap 0xc, rip = 0xffffffff81002a40, rsp = 0xfffffe00e1576080, rbp = 0xfffffe00e1576110 --- db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00e1576110 db_get_value() at db_get_value+0x32/frame 0xfffffe00e1576150 db_backtrace() at db_backtrace+0x22e/frame 0xfffffe00e15761e0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e1576200 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e15762a0 db_command() at db_command+0x270/frame 0xfffffe00e1576370 db_script_exec() at db_script_exec+0x1b8/frame 0xfffffe00e1576420 db_command() at db_command+0x270/frame 0xfffffe00e15764f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e1576500 db_trap() at db_trap+0xe6/frame 0xfffffe00e1576590 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e1576600 trap() at trap+0x7be/frame 0xfffffe00e1576710 calltrap() at calltrap+0x8/frame 0xfffffe00e1576710 --- trap 0x3, rip = 0xffffffff80c2a307, rsp = 0xfffffe00e15767e0, rbp = 0xfffffe00e15767f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00def7f6c8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e1576100 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e1576110 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e1576150 db_backtrace() at db_backtrace+0x22e/frame 0xfffffe00e15761e0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e1576200 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e15762a0 db_command() at db_command+0x270/frame 0xfffffe00e1576370 db_script_exec() at db_script_exec+0x1b8/frame 0xfffffe00e1576420 db_command() at db_command+0x270/frame 0xfffffe00e15764f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e1576500 db_trap() at db_trap+0xe6/frame 0xfffffe00e1576590 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e1576600 trap() at trap+0x7be/frame 0xfffffe00e1576710 calltrap() at calltrap+0x8/frame 0xfffffe00e1576710 --- trap 0x3, rip = 0xffffffff80c2a307, rsp = 0xfffffe00e15767e0, rbp = 0xfffffe00e15767f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command csh pid 2468 tid 100180 td 0xfffffe00dec10c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dee5e8c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e1575e90 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e1575ea0 trap() at trap+0x90/frame 0xfffffe00e1575fb0 calltrap() at calltrap+0x8/frame 0xfffffe00e1575fb0 --- trap 0xc, rip = 0xffffffff81002a40, rsp = 0xfffffe00e1576080, rbp = 0xfffffe00e1576110 --- db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00e1576110 db_get_value() at db_get_value+0x32/frame 0xfffffe00e1576150 db_backtrace() at db_backtrace+0x22e/frame 0xfffffe00e15761e0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e1576200 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e15762a0 db_command() at db_command+0x270/frame 0xfffffe00e1576370 db_script_exec() at db_script_exec+0x1b8/frame 0xfffffe00e1576420 db_command() at db_command+0x270/frame 0xfffffe00e15764f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e1576500 db_trap() at db_trap+0xe6/frame 0xfffffe00e1576590 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e1576600 trap() at trap+0x7be/frame 0xfffffe00e1576710 calltrap() at calltrap+0x8/frame 0xfffffe00e1576710 --- trap 0x3, rip = 0xffffffff80c2a307, rsp = 0xfffffe00e15767e0, rbp = 0xfffffe00e15767f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00dee5e8c8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e1576100 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e1576110 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e1576150 db_backtrace() at db_backtrace+0x22e/frame 0xfffffe00e15761e0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e1576200 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e15762a0 db_command() at db_command+0x270/frame 0xfffffe00e1576370 db_script_exec() at db_script_exec+0x1b8/frame 0xfffffe00e1576420 db_command() at db_command+0x270/frame 0xfffffe00e15764f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e1576500 db_trap() at db_trap+0xe6/frame 0xfffffe00e1576590 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e1576600 trap() at trap+0x7be/frame 0xfffffe00e1576710 calltrap() at calltrap+0x8/frame 0xfffffe00e1576710 --- trap 0x3, rip = 0xffffffff80c2a307, rsp = 0xfffffe00e15767e0, rbp = 0xfffffe00e15767f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 2467 tid 100230 td 0xfffffe00df918100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00def706c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e1575e90 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e1575ea0 trap() at trap+0x90/frame 0xfffffe00e1575fb0 calltrap() at calltrap+0x8/frame 0xfffffe00e1575fb0 --- trap 0xc, rip = 0xffffffff81002a40, rsp = 0xfffffe00e1576080, rbp = 0xfffffe00e1576110 --- db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00e1576110 db_get_value() at db_get_value+0x32/frame 0xfffffe00e1576150 db_backtrace() at db_backtrace+0x22e/frame 0xfffffe00e15761e0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e1576200 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e15762a0 db_command() at db_command+0x270/frame 0xfffffe00e1576370 db_script_exec() at db_script_exec+0x1b8/frame 0xfffffe00e1576420 db_command() at db_command+0x270/frame 0xfffffe00e15764f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e1576500 db_trap() at db_trap+0xe6/frame 0xfffffe00e1576590 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e1576600 trap() at trap+0x7be/frame 0xfffffe00e1576710 calltrap() at calltrap+0x8/frame 0xfffffe00e1576710 --- trap 0x3, rip = 0xffffffff80c2a307, rsp = 0xfffffe00e15767e0, rbp = 0xfffffe00e15767f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00def706c8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e1576100 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e1576110 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e1576150 db_backtrace() at db_backtrace+0x22e/frame 0xfffffe00e15761e0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e1576200 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e15762a0 db_command() at db_command+0x270/frame 0xfffffe00e1576370 db_script_exec() at db_script_exec+0x1b8/frame 0xfffffe00e1576420 db_command() at db_command+0x270/frame 0xfffffe00e15764f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e1576500 db_trap() at db_trap+0xe6/frame 0xfffffe00e1576590 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e1576600 trap() at trap+0x7be/frame 0xfffffe00e1576710 calltrap() at calltrap+0x8/frame 0xfffffe00e1576710 --- trap 0x3, rip = 0xffffffff80c2a307, rsp = 0xfffffe00e15767e0, rbp = 0xfffffe00e15767f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2460 tid 100226 td 0xfffffe00df8d2100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00def5c6c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e1575e90 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e1575ea0 trap() at trap+0x90/frame 0xfffffe00e1575fb0 calltrap() at calltrap+0x8/frame 0xfffffe00e1575fb0 --- trap 0xc, rip = 0xffffffff81002a40, rsp = 0xfffffe00e1576080, rbp = 0xfffffe00e1576110 --- db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00e1576110 db_get_value() at db_get_value+0x32/frame 0xfffffe00e1576150 db_backtrace() at db_backtrace+0x22e/frame 0xfffffe00e15761e0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e1576200 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e15762a0 db_command() at db_command+0x270/frame 0xfffffe00e1576370 db_script_exec() at db_script_exec+0x1b8/frame 0xfffffe00e1576420 db_command() at db_command+0x270/frame 0xfffffe00e15764f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e1576500 db_trap() at db_trap+0xe6/frame 0xfffffe00e1576590 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e1576600 trap() at trap+0x7be/frame 0xfffffe00e1576710 calltrap() at calltrap+0x8/frame 0xfffffe00e1576710 --- trap 0x3, rip = 0xffffffff80c2a307, rsp = 0xfffffe00e15767e0, rbp = 0xfffffe00e15767f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00def5c6c8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e1576100 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e1576110 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e1576150 db_backtrace() at db_backtrace+0x22e/frame 0xfffffe00e15761e0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e1576200 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e15762a0 db_command() at db_command+0x270/frame 0xfffffe00e1576370 db_script_exec() at db_script_exec+0x1b8/frame 0xfffffe00e1576420 db_command() at db_command+0x270/frame 0xfffffe00e15764f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e1576500 db_trap() at db_trap+0xe6/frame 0xfffffe00e1576590 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e1576600 trap() at trap+0x7be/frame 0xfffffe00e1576710 calltrap() at calltrap+0x8/frame 0xfffffe00e1576710 --- trap 0x3, rip = 0xffffffff80c2a307, rsp = 0xfffffe00e15767e0, rbp = 0xfffffe00e15767f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2459 tid 100229 td 0xfffffe00debe1000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00def6b730 mi_switch() at mi_switch+0x155/frame 0xfffffe00def6b750 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00def6b790 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00def6b7e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00def6b7f0 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00def6b860 seltdwait() at seltdwait+0x88/frame 0xfffffe00def6b8a0 kern_select() at kern_select+0x977/frame 0xfffffe00def6ba80 sys_select() at sys_select+0x56/frame 0xfffffe00def6bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00def6bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00def6bbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800871e4a, rsp = 0x7fffffffa4e8, rbp = 0x7fffffffa520 --- Tracing command sshd pid 2456 tid 100224 td 0xfffffe00df864a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00def527a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00def527c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00def52800 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00def52850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00def52860 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00def528d0 seltdwait() at seltdwait+0x88/frame 0xfffffe00def52910 kern_poll() at kern_poll+0x527/frame 0xfffffe00def52aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00def52ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00def52bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00def52bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800871d4a, rsp = 0x7fffffffe548, rbp = 0x7fffffffe580 --- Tracing command sh pid 2452 tid 100144 td 0xfffffe00d2e62500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dcd966c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dcd966e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dcd96720 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dcd96770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dcd96780 _sleep() at _sleep+0x2aa/frame 0xfffffe00dcd96830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00dcd968c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00dcd96ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dcd96bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dcd96bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e4faa, rsp = 0x7fffffffe698, rbp = 0x7fffffffe740 --- Tracing command csh pid 2448 tid 100171 td 0xfffffe00dec12100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dcde88c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dcde88e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dcde8920 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dcde8970 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dcde8980 _sleep() at _sleep+0x2aa/frame 0xfffffe00dcde8a30 kern_sigsuspend() at kern_sigsuspend+0xec/frame 0xfffffe00dcde8a90 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe00dcde8ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dcde8bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dcde8bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80047bf0a, rsp = 0x7fffffffe088, rbp = 0x7fffffffe110 --- Tracing command login pid 2447 tid 100227 td 0xfffffe00d665de00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00def616c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e1575e90 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e1575ea0 trap() at trap+0x90/frame 0xfffffe00e1575fb0 calltrap() at calltrap+0x8/frame 0xfffffe00e1575fb0 --- trap 0xc, rip = 0xffffffff81002a40, rsp = 0xfffffe00e1576080, rbp = 0xfffffe00e1576110 --- db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00e1576110 db_get_value() at db_get_value+0x32/frame 0xfffffe00e1576150 db_backtrace() at db_backtrace+0x22e/frame 0xfffffe00e15761e0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e1576200 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e15762a0 db_command() at db_command+0x270/frame 0xfffffe00e1576370 db_script_exec() at db_script_exec+0x1b8/frame 0xfffffe00e1576420 db_command() at db_command+0x270/frame 0xfffffe00e15764f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e1576500 db_trap() at db_trap+0xe6/frame 0xfffffe00e1576590 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e1576600 trap() at trap+0x7be/frame 0xfffffe00e1576710 calltrap() at calltrap+0x8/frame 0xfffffe00e1576710 --- trap 0x3, rip = 0xffffffff80c2a307, rsp = 0xfffffe00e15767e0, rbp = 0xfffffe00e15767f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00def616c8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e1576100 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e1576110 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e1576150 db_backtrace() at db_backtrace+0x22e/frame 0xfffffe00e15761e0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e1576200 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e15762a0 db_command() at db_command+0x270/frame 0xfffffe00e1576370 db_script_exec() at db_script_exec+0x1b8/frame 0xfffffe00e1576420 db_command() at db_command+0x270/frame 0xfffffe00e15764f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e1576500 db_trap() at db_trap+0xe6/frame 0xfffffe00e1576590 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e1576600 trap() at trap+0x7be/frame 0xfffffe00e1576710 calltrap() at calltrap+0x8/frame 0xfffffe00e1576710 --- trap 0x3, rip = 0xffffffff80c2a307, rsp = 0xfffffe00e15767e0, rbp = 0xfffffe00e15767f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e15767f0 hardclock() at hardclock+0x1d0/frame 0xfffffe00e1576830 handleevents() at handleevents+0xb4/frame 0xfffffe00e1576870 timercb() at timercb+0x196/frame 0xfffffe00e15768c0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe00e15768f0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e15768f0 --- interrupt, rip = 0xffffffff8102e446, rsp = 0xfffffe00e15769c0, rbp = 0xfffffe00e15769c0 --- memmove_erms() at memmove_erms+0x116/frame 0xfffffe00e15769c0 uiomove_fromphys() at uiomove_fromphys+0x87/frame 0xfffffe00e1576a30 physcopyin() at physcopyin+0xb8/frame 0xfffffe00e1576ad0 mdstart_swap() at mdstart_swap+0x42c/frame 0xfffffe00e1576b50 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00e1576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command getty pid 2446 tid 100202 td 0xfffffe00d665e500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00deee47b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00deee47d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00deee4810 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00deee4860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00deee4870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00deee48e0 tty_wait() at tty_wait+0x42/frame 0xfffffe00deee4910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00deee4970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00deee49a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00deee4a00 dofileread() at dofileread+0x81/frame 0xfffffe00deee4a50 sys_read() at sys_read+0xbc/frame 0xfffffe00deee4ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00deee4bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00deee4bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a1dca, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command getty pid 2445 tid 100148 td 0xfffffe00d664f000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dcdaa7b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dcdaa7d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dcdaa810 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dcdaa860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dcdaa870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00dcdaa8e0 tty_wait() at tty_wait+0x42/frame 0xfffffe00dcdaa910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00dcdaa970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00dcdaa9a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00dcdaaa00 dofileread() at dofileread+0x81/frame 0xfffffe00dcdaaa50 sys_read() at sys_read+0xbc/frame 0xfffffe00dcdaaac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dcdaabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dcdaabf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a1dca, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command getty pid 2444 tid 100167 td 0xfffffe00dec11300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dee227b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dee227d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dee22810 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dee22860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dee22870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00dee228e0 tty_wait() at tty_wait+0x42/frame 0xfffffe00dee22910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00dee22970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00dee229a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00dee22a00 dofileread() at dofileread+0x81/frame 0xfffffe00dee22a50 sys_read() at sys_read+0xbc/frame 0xfffffe00dee22ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dee22bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dee22bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a1dca, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command getty pid 2443 tid 100178 td 0xfffffe00d6656c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dee547b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dee547d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dee54810 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dee54860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dee54870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00dee548e0 tty_wait() at tty_wait+0x42/frame 0xfffffe00dee54910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00dee54970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00dee549a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00dee54a00 dofileread() at dofileread+0x81/frame 0xfffffe00dee54a50 sys_read() at sys_read+0xbc/frame 0xfffffe00dee54ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dee54bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dee54bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a1dca, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command getty pid 2442 tid 100177 td 0xfffffe00dec07a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dee4f7b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dee4f7d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dee4f810 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dee4f860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dee4f870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00dee4f8e0 tty_wait() at tty_wait+0x42/frame 0xfffffe00dee4f910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00dee4f970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00dee4f9a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00dee4fa00 dofileread() at dofileread+0x81/frame 0xfffffe00dee4fa50 sys_read() at sys_read+0xbc/frame 0xfffffe00dee4fac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dee4fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dee4fbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a1dca, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command getty pid 2441 tid 100206 td 0xfffffe00dece1a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00deef87b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00deef87d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00deef8810 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00deef8860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00deef8870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00deef88e0 tty_wait() at tty_wait+0x42/frame 0xfffffe00deef8910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00deef8970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00deef89a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00deef8a00 dofileread() at dofileread+0x81/frame 0xfffffe00deef8a50 sys_read() at sys_read+0xbc/frame 0xfffffe00deef8ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00deef8bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00deef8bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a1dca, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command getty pid 2440 tid 100175 td 0xfffffe00debe3300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dee457b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dee457d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dee45810 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dee45860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dee45870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00dee458e0 tty_wait() at tty_wait+0x42/frame 0xfffffe00dee45910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00dee45970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00dee459a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00dee45a00 dofileread() at dofileread+0x81/frame 0xfffffe00dee45a50 sys_read() at sys_read+0xbc/frame 0xfffffe00dee45ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dee45bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dee45bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a1dca, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command getty pid 2439 tid 100213 td 0xfffffe00dece1300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00def1b7b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00def1b7d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00def1b810 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00def1b860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00def1b870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00def1b8e0 tty_wait() at tty_wait+0x42/frame 0xfffffe00def1b910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00def1b970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00def1b9a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00def1ba00 dofileread() at dofileread+0x81/frame 0xfffffe00def1ba50 sys_read() at sys_read+0xbc/frame 0xfffffe00def1bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00def1bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00def1bbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a1dca, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command getty pid 2438 tid 100143 td 0xfffffe00d664fe00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dcd917b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dcd917d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dcd91810 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dcd91860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dcd91870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00dcd918e0 tty_wait() at tty_wait+0x42/frame 0xfffffe00dcd91910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00dcd91970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00dcd919a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00dcd91a00 dofileread() at dofileread+0x81/frame 0xfffffe00dcd91a50 sys_read() at sys_read+0xbc/frame 0xfffffe00dcd91ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dcd91bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dcd91bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a1dca, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command inetd pid 2427 tid 100222 td 0xfffffe00df865800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00def48730 mi_switch() at mi_switch+0x155/frame 0xfffffe00def48750 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00def48790 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00def487e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00def487f0 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00def48860 seltdwait() at seltdwait+0x88/frame 0xfffffe00def488a0 kern_select() at kern_select+0x977/frame 0xfffffe00def48a80 sys_select() at sys_select+0x56/frame 0xfffffe00def48ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00def48bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00def48bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8003bce4a, rsp = 0x7fffffffdd88, rbp = 0x7fffffffec20 --- Tracing command cron pid 2424 tid 100172 td 0xfffffe00dec08100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dee36860 mi_switch() at mi_switch+0x155/frame 0xfffffe00dee36880 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dee368c0 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dee36910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00dee36950 _sleep() at _sleep+0x289/frame 0xfffffe00dee36a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe00dee36a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe00dee36ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dee36bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dee36bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003b5cea, rsp = 0x7fffffffea58, rbp = 0x7fffffffec30 --- Tracing command sshd pid 2415 tid 100189 td 0xfffffe00dec06c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dee97730 mi_switch() at mi_switch+0x155/frame 0xfffffe00dee97750 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dee97790 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dee977e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dee977f0 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00dee97860 seltdwait() at seltdwait+0x88/frame 0xfffffe00dee978a0 kern_select() at kern_select+0x977/frame 0xfffffe00dee97a80 sys_select() at sys_select+0x56/frame 0xfffffe00dee97ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dee97bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dee97bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800871e4a, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command powerd pid 2386 tid 100220 td 0xfffffe00dece0500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00def3e700 mi_switch() at mi_switch+0x155/frame 0xfffffe00def3e720 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00def3e760 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00def3e7b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00def3e7f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x18e/frame 0xfffffe00def3e860 seltdwait() at seltdwait+0x79/frame 0xfffffe00def3e8a0 kern_select() at kern_select+0x977/frame 0xfffffe00def3ea80 sys_select() at sys_select+0x56/frame 0xfffffe00def3eac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00def3ebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00def3ebf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80039ee4a, rsp = 0x7fffffffeaf8, rbp = 0x7fffffffec40 --- Tracing command ntpd pid 2383 tid 100221 td 0xfffffe00df865100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00def43730 mi_switch() at mi_switch+0x155/frame 0xfffffe00def43750 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00def43790 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00def437e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00def437f0 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00def43860 seltdwait() at seltdwait+0x88/frame 0xfffffe00def438a0 kern_select() at kern_select+0x977/frame 0xfffffe00def43a80 sys_select() at sys_select+0x56/frame 0xfffffe00def43ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00def43bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00def43bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8007a1e4a, rsp = 0x7fffffffde68, rbp = 0x7fffffffdea0 --- Tracing command ntpd pid 2383 tid 100228 td 0xfffffe00df8d2800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00def667f0 mi_switch() at mi_switch+0x155/frame 0xfffffe00def66810 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00def66850 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00def668a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00def668b0 _sleep() at _sleep+0x2aa/frame 0xfffffe00def66960 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe00def669c0 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x3f6/frame 0xfffffe00def66a80 sys__umtx_op() at sys__umtx_op+0x7a/frame 0xfffffe00def66ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00def66bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00def66bf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x8007a0d6a, rsp = 0x7fffdfffdee8, rbp = 0x7fffdfffdf60 --- Tracing command rpc.lockd pid 2344 tid 100214 td 0xfffffe00dece0c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00def20650 mi_switch() at mi_switch+0x155/frame 0xfffffe00def20670 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00def206b0 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00def20700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00def20740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x18e/frame 0xfffffe00def207b0 svc_run_internal() at svc_run_internal+0xac1/frame 0xfffffe00def208e0 svc_run() at svc_run+0x253/frame 0xfffffe00def20940 sys_nlm_syscall() at sys_nlm_syscall+0x74d/frame 0xfffffe00def20ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00def20bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00def20bf0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x80039c68a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffec30 --- Tracing command rpc.statd pid 2341 tid 100181 td 0xfffffe00dec10500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dee63700 mi_switch() at mi_switch+0x155/frame 0xfffffe00dee63720 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dee63760 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dee637b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00dee637f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x18e/frame 0xfffffe00dee63860 seltdwait() at seltdwait+0x79/frame 0xfffffe00dee638a0 kern_select() at kern_select+0x977/frame 0xfffffe00dee63a80 sys_select() at sys_select+0x56/frame 0xfffffe00dee63ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dee63bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dee63bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800393e4a, rsp = 0x7fffffffea18, rbp = 0x7fffffffeb60 --- Tracing command rpcbind pid 2319 tid 100219 td 0xfffffe00df7ad800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00def39770 mi_switch() at mi_switch+0x155/frame 0xfffffe00def39790 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00def397d0 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00def39820 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00def39860 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x18e/frame 0xfffffe00def398d0 seltdwait() at seltdwait+0x79/frame 0xfffffe00def39910 kern_poll() at kern_poll+0x527/frame 0xfffffe00def39aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00def39ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00def39bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00def39bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800399d4a, rsp = 0x7fffffffc9a8, rbp = 0x7fffffffebc0 --- Tracing command watchdogd pid 2302 tid 100150 td 0xfffffe00d665fa00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dcdb46c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dcdb46e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dcdb4720 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dcdb4770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dcdb4780 _sleep() at _sleep+0x2aa/frame 0xfffffe00dcdb4830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00dcdb48c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00dcdb4ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dcdb4bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dcdb4bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80039efaa, rsp = 0x7fffffffe998, rbp = 0x7fffffffea50 --- Tracing command syslogd pid 2287 tid 100157 td 0xfffffe00d6660800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dcdd7730 mi_switch() at mi_switch+0x155/frame 0xfffffe00dcdd7750 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dcdd7790 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dcdd77e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dcdd77f0 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00dcdd7860 seltdwait() at seltdwait+0x88/frame 0xfffffe00dcdd78a0 kern_select() at kern_select+0x977/frame 0xfffffe00dcdd7a80 sys_select() at sys_select+0x56/frame 0xfffffe00dcdd7ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dcdd7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dcdd7bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8003a7e4a, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffec30 --- Tracing command devd pid 2108 tid 100182 td 0xfffffe00d6655e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dee68700 mi_switch() at mi_switch+0x155/frame 0xfffffe00dee68720 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dee68760 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dee687b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00dee687f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x18e/frame 0xfffffe00dee68860 seltdwait() at seltdwait+0x79/frame 0xfffffe00dee688a0 kern_select() at kern_select+0x977/frame 0xfffffe00dee68a80 sys_select() at sys_select+0x56/frame 0xfffffe00dee68ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dee68bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dee68bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x28b4da, rsp = 0x7fffffffcab8, rbp = 0x7fffffffec50 --- Tracing command dhclient pid 2097 tid 100193 td 0xfffffe00dec06500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00deeb7770 mi_switch() at mi_switch+0x155/frame 0xfffffe00deeb7790 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00deeb77d0 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00deeb7820 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00deeb7860 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x18e/frame 0xfffffe00deeb78d0 seltdwait() at seltdwait+0x79/frame 0xfffffe00deeb7910 kern_poll() at kern_poll+0x527/frame 0xfffffe00deeb7aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00deeb7ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00deeb7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00deeb7bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003bed4a, rsp = 0x7fffffffeb98, rbp = 0x7fffffffebd0 --- Tracing command dhclient pid 2021 tid 100191 td 0xfffffe00d6655000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00deea17a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00deea17c0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00deea1800 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00deea1850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00deea1860 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00deea18d0 seltdwait() at seltdwait+0x88/frame 0xfffffe00deea1910 kern_poll() at kern_poll+0x527/frame 0xfffffe00deea1aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00deea1ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00deea1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00deea1bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003bed4a, rsp = 0x7fffffffeba8, rbp = 0x7fffffffebd0 --- Tracing command dhclient pid 2018 tid 100183 td 0xfffffe00d6655700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dee6d730 mi_switch() at mi_switch+0x155/frame 0xfffffe00dee6d750 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dee6d790 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00dee6d7e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dee6d7f0 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe00dee6d860 seltdwait() at seltdwait+0x88/frame 0xfffffe00dee6d8a0 kern_select() at kern_select+0x977/frame 0xfffffe00dee6da80 sys_select() at sys_select+0x56/frame 0xfffffe00dee6dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00dee6dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dee6dbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8003bee4a, rsp = 0x7fffffffe958, rbp = 0x7fffffffea10 --- Tracing command vnlru pid 33 tid 100141 td 0xfffffe00d665c100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dcd879c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dcd879e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dcd87a20 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dcd87a60 _sleep() at _sleep+0x29b/frame 0xfffffe00dcd87b10 vnlru_proc() at vnlru_proc+0xaac/frame 0xfffffe00dcd87bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dcd87bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dcd87bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 32 tid 100142 td 0xfffffe00d6660100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dcd8ca30 mi_switch() at mi_switch+0x155/frame 0xfffffe00dcd8ca50 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dcd8ca90 _sleep() at _sleep+0x2b4/frame 0xfffffe00dcd8cb40 enc_daemon() at enc_daemon+0xe4/frame 0xfffffe00dcd8cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dcd8cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dcd8cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 31 tid 100139 td 0xfffffe00d6658800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dcd7da10 mi_switch() at mi_switch+0x155/frame 0xfffffe00dcd7da30 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dcd7da70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dcd7dab0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x18e/frame 0xfffffe00dcd7db20 sched_sync() at sched_sync+0x67c/frame 0xfffffe00dcd7dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dcd7dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dcd7dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 30 tid 100135 td 0xfffffe00d6652800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00d6a2ea30 mi_switch() at mi_switch+0x155/frame 0xfffffe00d6a2ea50 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00d6a2ea90 _sleep() at _sleep+0x2b4/frame 0xfffffe00d6a2eb40 enc_daemon() at enc_daemon+0xe4/frame 0xfffffe00d6a2ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d6a2ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d6a2ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 29 tid 100129 td 0xfffffe00d64b4000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adbbda10 mi_switch() at mi_switch+0x155/frame 0xfffffe00adbbda30 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adbbda70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00adbbdab0 _sleep() at _sleep+0x29b/frame 0xfffffe00adbbdb60 buf_daemon() at buf_daemon+0x121/frame 0xfffffe00adbbdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adbbdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbbdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 29 tid 100130 td 0xfffffe00d320a000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00d6824a00 mi_switch() at mi_switch+0x155/frame 0xfffffe00d6824a20 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00d6824a60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d6824aa0 _sleep() at _sleep+0x29b/frame 0xfffffe00d6824b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d6824bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d6824bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d6824bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 29 tid 100131 td 0xfffffe00d64b7800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00d6889a00 mi_switch() at mi_switch+0x155/frame 0xfffffe00d6889a20 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00d6889a60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d6889aa0 _sleep() at _sleep+0x29b/frame 0xfffffe00d6889b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d6889bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d6889bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d6889bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 29 tid 100132 td 0xfffffe00d6652100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00d694ea00 mi_switch() at mi_switch+0x155/frame 0xfffffe00d694ea20 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00d694ea60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d694eaa0 _sleep() at _sleep+0x29b/frame 0xfffffe00d694eb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d694ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d694ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d694ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 29 tid 100133 td 0xfffffe00d6651a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00d69f3a00 mi_switch() at mi_switch+0x155/frame 0xfffffe00d69f3a20 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00d69f3a60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d69f3aa0 _sleep() at _sleep+0x29b/frame 0xfffffe00d69f3b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d69f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d69f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d69f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 29 tid 100134 td 0xfffffe00d6651300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00d6a24a00 mi_switch() at mi_switch+0x155/frame 0xfffffe00d6a24a20 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00d6a24a60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d6a24aa0 _sleep() at _sleep+0x29b/frame 0xfffffe00d6a24b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d6a24bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d6a24bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d6a24bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 29 tid 100136 td 0xfffffe00d6650c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00d6a29a00 mi_switch() at mi_switch+0x155/frame 0xfffffe00d6a29a20 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00d6a29a60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d6a29aa0 _sleep() at _sleep+0x29b/frame 0xfffffe00d6a29b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d6a29bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d6a29bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d6a29bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 29 tid 100137 td 0xfffffe00d6650500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00d6a33a00 mi_switch() at mi_switch+0x155/frame 0xfffffe00d6a33a20 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00d6a33a60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d6a33aa0 _sleep() at _sleep+0x29b/frame 0xfffffe00d6a33b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d6a33bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d6a33bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d6a33bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 29 tid 100152 td 0xfffffe003dbdbe00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dcdbea30 mi_switch() at mi_switch+0x155/frame 0xfffffe00dcdbea50 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dcdbea90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dcdbead0 _sleep() at _sleep+0x29b/frame 0xfffffe00dcdbeb80 softdep_flush() at softdep_flush+0x16b/frame 0xfffffe00dcdbebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dcdbebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dcdbebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 29 tid 100159 td 0xfffffe00dec12800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dcdeda30 mi_switch() at mi_switch+0x155/frame 0xfffffe00dcdeda50 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dcdeda90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dcdedad0 _sleep() at _sleep+0x29b/frame 0xfffffe00dcdedb80 softdep_flush() at softdep_flush+0x16b/frame 0xfffffe00dcdedbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dcdedbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dcdedbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 29 tid 100514 td 0xfffffe00e123a000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e14a4a30 mi_switch() at mi_switch+0x155/frame 0xfffffe00e14a4a50 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e14a4a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e14a4ad0 _sleep() at _sleep+0x29b/frame 0xfffffe00e14a4b80 softdep_flush() at softdep_flush+0x16b/frame 0xfffffe00e14a4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e14a4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e14a4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 28 tid 100128 td 0xfffffe00d64b4700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adbaca30 mi_switch() at mi_switch+0x155/frame 0xfffffe00adbaca50 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adbaca90 _sleep() at _sleep+0x2b4/frame 0xfffffe00adbacb40 vm_daemon() at vm_daemon+0x82/frame 0xfffffe00adbacbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adbacbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbacbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 27 tid 100127 td 0xfffffe00d64b4e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adba7760 mi_switch() at mi_switch+0x155/frame 0xfffffe00adba7780 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adba77c0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00adba7800 _sleep() at _sleep+0x29b/frame 0xfffffe00adba78b0 vm_pageout_worker() at vm_pageout_worker+0x28c/frame 0xfffffe00adba7b70 vm_pageout() at vm_pageout+0x21e/frame 0xfffffe00adba7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adba7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adba7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 27 tid 100138 td 0xfffffe00d6658100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00d7618820 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7618840 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00d7618880 _sleep() at _sleep+0x2b4/frame 0xfffffe00d7618930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xc3c/frame 0xfffffe00d7618bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7618bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7618bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 27 tid 100140 td 0xfffffe00d6657a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00dcd82a30 mi_switch() at mi_switch+0x155/frame 0xfffffe00dcd82a50 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00dcd82a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dcd82ad0 _sleep() at _sleep+0x29b/frame 0xfffffe00dcd82b80 uma_reclaim_worker() at uma_reclaim_worker+0xb8/frame 0xfffffe00dcd82bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dcd82bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dcd82bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 26 tid 100124 td 0xfffffe00d64b6300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb989d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb989f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb98a30 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00adb98a70 _sleep() at _sleep+0x29b/frame 0xfffffe00adb98b20 random_kthread() at random_kthread+0x67/frame 0xfffffe00adb98bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb98bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb98bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100120 td 0xfffffe003dbdc500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb78a20 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb78a40 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb78a80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00adb78ac0 _sleep() at _sleep+0x29b/frame 0xfffffe00adb78b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00adb78bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb78bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb78bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100119 td 0xfffffe003dbdcc00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb73a20 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb73a40 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb73a80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00adb73ac0 _sleep() at _sleep+0x29b/frame 0xfffffe00adb73b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00adb73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100118 td 0xfffffe003dbdd300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb6ea20 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb6ea40 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb6ea80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00adb6eac0 _sleep() at _sleep+0x29b/frame 0xfffffe00adb6eb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00adb6ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb6ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb6ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100117 td 0xfffffe003dbdda00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb69a20 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb69a40 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb69a80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00adb69ac0 _sleep() at _sleep+0x29b/frame 0xfffffe00adb69b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00adb69bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb69bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb69bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffffe00ad8fb300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adaf2ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adaf2ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adaf2b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00adaf2b80 usb_process() at usb_process+0xb3/frame 0xfffffe00adaf2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adaf2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adaf2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffffe00ad8fac00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adaf7ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adaf7ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adaf7b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00adaf7b80 usb_process() at usb_process+0xb3/frame 0xfffffe00adaf7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adaf7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adaf7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffffe00ad8fa500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adafcac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adafcae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adafcb20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00adafcb80 usb_process() at usb_process+0xb3/frame 0xfffffe00adafcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adafcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adafcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100101 td 0xfffffe00ad8f9e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb01ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb01ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb01b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00adb01b80 usb_process() at usb_process+0xb3/frame 0xfffffe00adb01bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb01bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb01bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffffe00ad8f9700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb06ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb06ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb06b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00adb06b80 usb_process() at usb_process+0xb3/frame 0xfffffe00adb06bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb06bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb06bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffffe00ad8fc800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb10ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb10ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb10b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00adb10b80 usb_process() at usb_process+0xb3/frame 0xfffffe00adb10bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb10bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb10bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffffe00d2e64100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb15ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb15ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb15b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00adb15b80 usb_process() at usb_process+0xb3/frame 0xfffffe00adb15bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb15bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb15bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffffe00d2e63a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb1aac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb1aae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb1ab20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00adb1ab80 usb_process() at usb_process+0xb3/frame 0xfffffe00adb1abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb1abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb1abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffffe00d2e63300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb1fac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb1fae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb1fb20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00adb1fb80 usb_process() at usb_process+0xb3/frame 0xfffffe00adb1fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb1fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb1fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffffe00d2e62c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb24ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb24ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb24b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00adb24b80 usb_process() at usb_process+0xb3/frame 0xfffffe00adb24bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb24bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb24bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffffe00d2e64800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb35ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb35ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb35b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00adb35b80 usb_process() at usb_process+0xb3/frame 0xfffffe00adb35bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb35bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb35bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffffe00d320d100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb3aac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb3aae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb3ab20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00adb3ab80 usb_process() at usb_process+0xb3/frame 0xfffffe00adb3abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb3abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb3abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffffe00d320ca00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb3fac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb3fae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb3fb20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00adb3fb80 usb_process() at usb_process+0xb3/frame 0xfffffe00adb3fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb3fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb3fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100112 td 0xfffffe00d320c300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb44ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb44ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb44b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00adb44b80 usb_process() at usb_process+0xb3/frame 0xfffffe00adb44bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb44bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb44bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100113 td 0xfffffe00d320bc00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb49ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb49ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb49b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00adb49b80 usb_process() at usb_process+0xb3/frame 0xfffffe00adb49bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb49bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb49bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffffe003dbf3000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adad4a50 mi_switch() at mi_switch+0x155/frame 0xfffffe00adad4a70 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adad4ab0 _sleep() at _sleep+0x2b4/frame 0xfffffe00adad4b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00adad4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adad4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adad4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffffe003dbf6800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adad9a50 mi_switch() at mi_switch+0x155/frame 0xfffffe00adad9a70 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adad9ab0 _sleep() at _sleep+0x2b4/frame 0xfffffe00adad9b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00adad9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adad9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adad9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100094 td 0xfffffe003dbde100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adadea50 mi_switch() at mi_switch+0x155/frame 0xfffffe00adadea70 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adadeab0 _sleep() at _sleep+0x2b4/frame 0xfffffe00adadeb60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00adadebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adadebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adadebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100126 td 0xfffffe00d64b5500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adba2a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00adba2a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adba2ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00adba2b80 xpt_scanner_thread() at xpt_scanner_thread+0x138/frame 0xfffffe00adba2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adba2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adba2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100091 td 0xfffffe003dbf3700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adacfa60 mi_switch() at mi_switch+0x155/frame 0xfffffe00adacfa80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adacfac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00adacfb70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00adacfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adacfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adacfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100090 td 0xfffffe003dbf3e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adacaa60 mi_switch() at mi_switch+0x155/frame 0xfffffe00adacaa80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adacaac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00adacab70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00adacabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adacabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adacabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100089 td 0xfffffe003dbf4500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adac5a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00adac5a80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adac5ac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00adac5b70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00adac5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adac5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adac5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100088 td 0xfffffe003dbf4c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adac0a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00adac0a80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adac0ac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00adac0b70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00adac0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adac0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adac0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100087 td 0xfffffe003dbf5300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adabba60 mi_switch() at mi_switch+0x155/frame 0xfffffe00adabba80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adabbac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00adabbb70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00adabbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adabbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adabbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100086 td 0xfffffe003dbf5a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adab6a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00adab6a80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adab6ac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00adab6b70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00adab6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adab6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adab6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100085 td 0xfffffe003dbf6100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adab1a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00adab1a80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adab1ac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00adab1b70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00adab1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adab1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adab1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100084 td 0xfffffe003dc0e800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adaaca60 mi_switch() at mi_switch+0x155/frame 0xfffffe00adaaca80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adaacac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00adaacb70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00adaacbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adaacbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adaacbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100083 td 0xfffffe003dc0b000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adaa7a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00adaa7a80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adaa7ac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00adaa7b70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00adaa7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adaa7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adaa7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100082 td 0xfffffe003dc0b700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adaa2a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00adaa2a80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adaa2ac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00adaa2b70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00adaa2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adaa2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adaa2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100081 td 0xfffffe003dc0be00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada9da60 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada9da80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada9dac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada9db70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00ada9dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada9dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada9dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100080 td 0xfffffe003dc0c500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada98a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada98a80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada98ac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada98b70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00ada98bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada98bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada98bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100079 td 0xfffffe003dc0cc00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada93a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada93a80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada93ac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada93b70 crypto_proc() at crypto_proc+0x27f/frame 0xfffffe00ada93bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada93bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada93bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100066 td 0xfffffe003dc3e800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada52a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada52a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada52ad0 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00ada52b30 seq_eventthread() at seq_eventthread+0x91/frame 0xfffffe00ada52bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada52bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada52bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffffe003dc3be00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada43a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada43a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada43ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada43b80 g_run_events() at g_run_events+0x54/frame 0xfffffe00ada43bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada43bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada43bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffffe003dc3b700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada48a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada48a80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada48ac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada48b70 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe00ada48ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00ada48bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada48bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada48bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100065 td 0xfffffe003dc3b000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada4da60 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada4da80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada4dac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada4db70 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe00ada4dba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe00ada4dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada4dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada4dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100042 td 0xfffffe00ad88be00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad59eb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad59eb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00ad59ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad59ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad59ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100044 td 0xfffffe00ad88b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffffe00ad893a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad5b7b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad5b7b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00ad5b7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad5b7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad5b7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffffe00ad894800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffffe003dc4a100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad5cdb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad5cdb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00ad5cdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad5cdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad5cdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffffe003dc49a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad5d2b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad5d2b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00ad5d2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad5d2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad5d2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100051 td 0xfffffe003dc49300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad5d7b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad5d7b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00ad5d7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad5d7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad5d7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100052 td 0xfffffe003dc48c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad5dcb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad5dcb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00ad5dcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad5dcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad5dcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100053 td 0xfffffe003dc48500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad5e1b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad5e1b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00ad5e1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad5e1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad5e1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100054 td 0xfffffe003dc47e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad5e6b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad5e6b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00ad5e6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad5e6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad5e6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100055 td 0xfffffe003dc47700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad5ebb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad5ebb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00ad5ebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad5ebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad5ebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100056 td 0xfffffe003dc47000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffffe003dc4a800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffffe003dc3e100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffffe003dc3da00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffffe003dc3d300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100061 td 0xfffffe003dc3cc00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100095 td 0xfffffe003dbde800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100096 td 0xfffffe00ad8fc100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adae8b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00adae8b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00adae8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adae8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adae8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100097 td 0xfffffe00ad8fba00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adaedb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00adaedb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00adaedbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adaedbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adaedbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100103 td 0xfffffe00ad8f9000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb0bb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb0bb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00adb0bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb0bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb0bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100114 td 0xfffffe00d320b500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100115 td 0xfffffe00d320ae00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb53b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb53b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00adb53bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb53bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb53bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100194 td 0xfffffe00ad891700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100195 td 0xfffffe00ad891000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100196 td 0xfffffe00dece2800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100197 td 0xfffffe00dede9100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100198 td 0xfffffe00dede8a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100199 td 0xfffffe00dede8300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100200 td 0xfffffe00dede7c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100201 td 0xfffffe00dede7500 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffffe00ad7fc300 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81debf20 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81debf30 trap() at trap+0x56/frame 0xffffffff81dec040 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81dec040 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377aba50, rbp = 0xfffffe00377aba50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377aba50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377abaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377abac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377abae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377abbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377abbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377abbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe00ad7fbc00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377b0ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377b0ae0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00377b0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe00ad7fb500 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dbe1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dbe1e10 trap() at trap+0x56/frame 0xfffffe003dbe1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dbe1f20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377b5a50, rbp = 0xfffffe00377b5a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377b5a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377b5aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377b5ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377b5ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377b5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe00ad7fae00 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dbede00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dbede10 trap() at trap+0x56/frame 0xfffffe003dbedf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dbedf20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377baa50, rbp = 0xfffffe00377baa50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377baa50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377baaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377baac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377baae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377babb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377babf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377babf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00ad7fa700 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dbf9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dbf9e10 trap() at trap+0x56/frame 0xfffffe003dbf9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dbf9f20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377bfa50, rbp = 0xfffffe00377bfa50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377bfa50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377bfaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377bfac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377bfae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377bfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377bfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377bfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe00ad7fa000 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dc05e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dc05e10 trap() at trap+0x56/frame 0xfffffe003dc05f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dc05f20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377c4a50, rbp = 0xfffffe00377c4a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377c4a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377c4aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377c4ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377c4ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377c4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe00ad7fd800 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dc11e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dc11e10 trap() at trap+0x56/frame 0xfffffe003dc11f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dc11f20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377c9a50, rbp = 0xfffffe00377c9a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377c9a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377c9aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377c9ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377c9ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377c9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe00ad803100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377ceac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377ceae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00377cebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377cebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377cebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe00ad802a00 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dc29e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dc29e10 trap() at trap+0x56/frame 0xfffffe003dc29f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dc29f20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377d3a50, rbp = 0xfffffe00377d3a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377d3a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377d3aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377d3ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377d3ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377d3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe00ad802300 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dc35e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dc35e10 trap() at trap+0x56/frame 0xfffffe003dc35f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dc35f20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377d8a50, rbp = 0xfffffe00377d8a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377d8a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377d8aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377d8ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377d8ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377d8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00ad801c00 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dc41e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dc41e10 trap() at trap+0x56/frame 0xfffffe003dc41f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dc41f20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377dda50, rbp = 0xfffffe00377dda50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377dda50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377ddaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377ddac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377ddae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377ddbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ddbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ddbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00ad801500 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003dc4de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003dc4de10 trap() at trap+0x56/frame 0xfffffe003dc4df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dc4df20 --- trap 0x13, rip = 0xffffffff80fef226, rsp = 0xfffffe00377e2a50, rbp = 0xfffffe00377e2a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377e2a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00377e2aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377e2ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377e2ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377e2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe00ad7fca00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377a66c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377a66e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377a6720 sleepq_catch_signals() at sleepq_catch_signals+0x262/frame 0xfffffe00377a6770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00377a6780 _sleep() at _sleep+0x2aa/frame 0xfffffe00377a6830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00377a68c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00377a6ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe00377a6bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00377a6bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x28d0da, rsp = 0x7fffffffe718, rbp = 0x7fffffffe780 --- Tracing command audit pid 10 tid 100001 td 0xfffffe00ad7fd100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377a1a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00377a1aa0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377a1ae0 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00377a1b40 audit_worker() at audit_worker+0x9f/frame 0xfffffe00377a1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81c91ca0 sched_switch() at sched_switch+0x5b3/frame 0xffffffff82126ab0 mi_switch() at mi_switch+0x155/frame 0xffffffff82126ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xffffffff82126b10 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82126b50 _sleep() at _sleep+0x29b/frame 0xffffffff82126c00 swapper() at swapper+0x75/frame 0xffffffff82126c60 mi_startup() at mi_startup+0x2ed/frame 0xffffffff82126cb0 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffffe00ad800e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377e7ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377e7ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377e7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377e7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00377e7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe00ad800700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377ecab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377ecad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377ecb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377ecb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00377ecbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ecbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ecbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffffe00ad800000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377f1ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377f1ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377f1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00377f1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe00ad803800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377f6ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377f6ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377f6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00377f6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe00ad884100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377fbab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377fbad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377fbb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377fbb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00377fbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377fbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377fbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe00ad883a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad530ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad530ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad530b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad530b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad530bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad530bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad530bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe00ad883300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad535ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad535ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad535b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad535b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad535bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad535bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad535bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe00ad882c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad53aab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad53aad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad53ab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad53ab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad53abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad53abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad53abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe00ad882500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad53fab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad53fad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad53fb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad53fb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad53fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad53fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad53fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe00ad881e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad544ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad544ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad544b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad544b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad544bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad544bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad544bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe00ad881700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad549ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad549ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad549b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad549b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad549bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad549bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad549bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe00ad881000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad54eab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad54ead0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad54eb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad54eb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad54ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad54ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad54ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe00ad884800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad553ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad553ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad553b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad553b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad553bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad553bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad553bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe00ad88a100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad558ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad558ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad558b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad558b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad558bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad558bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad558bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe00ad889a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad55dab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad55dad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad55db10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad55db80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad55dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad55dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad55dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe00ad889300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad562ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad562ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad562b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad562b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad562bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad562bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad562bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe00ad888c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad567ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad567ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad567b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad567b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad567bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad567bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad567bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe00ad888500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad56cab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad56cad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad56cb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad56cb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad56cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad56cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad56cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe00ad887e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad571ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad571ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad571b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad571b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad571bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad571bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad571bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe00ad887700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad576ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad576ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad576b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad576b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe00ad887000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad57bab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad57bad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad57bb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad57bb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad57bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad57bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad57bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe00ad88a800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad580ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad580ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad580b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad580b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad580bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad580bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad580bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe00ad88e100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad585ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad585ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad585b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad585b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad585bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad585bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad585bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe00ad88da00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad58aab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad58aad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad58ab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad58ab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad58abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad58abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad58abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe00ad88d300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad58fab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad58fad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad58fb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00ad58fb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00ad58fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad58fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad58fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe00ad88cc00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad594a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad594a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad594ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ad594b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ad594bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad594bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad594bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffffe00ad88c500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad599a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad599a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad599ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ad599b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ad599bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad599bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad599bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffffe00ad88b700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad5a3a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad5a3a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad5a3ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ad5a3b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ad5a3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad5a3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad5a3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffffe00ad88e800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad5ada70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad5ada90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad5adad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ad5adb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ad5adbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad5adbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad5adbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffffe00ad894100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ad5b2a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ad5b2a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ad5b2ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ad5b2b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ad5b2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ad5b2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad5b2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffffe003dc3c500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada3ea70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada3ea90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada3ead0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada3eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ada3ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada3ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada3ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe003dc1a100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada57a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada57a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada57ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada57b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ada57bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada57bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada57bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe003dc19a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada5ca70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada5ca90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada5cad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada5cb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ada5cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada5cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada5cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe003dc19300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada61a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada61a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada61ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada61b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ada61bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada61bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada61bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe003dc18c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada66a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada66a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada66ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada66b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ada66bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada66bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada66bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe003dc18500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada6ba70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada6ba90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada6bad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada6bb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ada6bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada6bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada6bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe003dc17e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada70a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada70a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada70ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada70b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ada70bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada70bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada70bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe003dc17700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada75a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada75a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada75ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada75b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ada75bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada75bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada75bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe003dc17000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada7aa70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada7aa90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada7aad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada7ab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ada7abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada7abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada7abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe003dc1a800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada7fa70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada7fa90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada7fad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada7fb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ada7fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada7fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada7fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe003dc0e100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada84a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada84a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada84ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada84b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ada84bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada84bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada84bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffffe003dc0da00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada89a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada89a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada89ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada89b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ada89bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada89bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada89bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100078 td 0xfffffe003dc0d300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00ada8ea70 mi_switch() at mi_switch+0x155/frame 0xfffffe00ada8ea90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ada8ead0 _sleep() at _sleep+0x2b4/frame 0xfffffe00ada8eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00ada8ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ada8ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ada8ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100116 td 0xfffffe00d320a700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb58ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb58ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb58b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adb58b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00adb58bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb58bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb58bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffffe00d320d800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb89ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb89ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb89b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adb89b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00adb89bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb89bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb89bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffffe00d64b7100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb8eab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb8ead0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb8eb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adb8eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00adb8ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb8ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb8ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffffe00d64b6a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb93ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb93ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb93b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adb93b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00adb93bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb93bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb93bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100125 td 0xfffffe00d64b5c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00adb9da70 mi_switch() at mi_switch+0x155/frame 0xfffffe00adb9da90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00adb9dad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00adb9db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00adb9dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adb9dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb9dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100513 td 0xfffffe00e123a700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e149fa70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e149fa90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e149fad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e149fb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e149fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e149fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e149fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db> Index: src/sys/kern/subr_param.c =================================================================== --- src/sys/kern/subr_param.c (revision 367980) +++ src/sys/kern/subr_param.c (working copy) @@ -51,6 +51,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include @@ -184,6 +185,10 @@ init_param1(void) */ ticks = INT_MAX - (hz * 10 * 60); + vn_lock_pair_pause_max = hz / 100; + if (vn_lock_pair_pause_max == 0) + vn_lock_pair_pause_max = 1; + #ifdef VM_SWZONE_SIZE_MAX maxswzone = VM_SWZONE_SIZE_MAX; #endif Index: src/sys/kern/vfs_vnops.c =================================================================== --- src/sys/kern/vfs_vnops.c (revision 367980) +++ src/sys/kern/vfs_vnops.c (working copy) @@ -3332,11 +3332,16 @@ SYSCTL_ULONG(_debug, OID_AUTO, vn_lock_pair_pause, &vn_lock_pair_pause_cnt, 0, "Count of vn_lock_pair deadlocks"); +u_int vn_lock_pair_pause_max; +SYSCTL_UINT(_debug, OID_AUTO, vn_lock_pair_pause_max, CTLFLAG_RD, + &vn_lock_pair_pause_max, 0, + "Max ticks for vn_lock_pair deadlock avoidance sleep"); + static void vn_lock_pair_pause(const char *wmesg) { atomic_add_long(&vn_lock_pair_pause_cnt, 1); - pause(wmesg, prng32_bounded(hz / 10)); + pause(wmesg, prng32_bounded(vn_lock_pair_pause_max)); } /* Index: src/sys/sys/vnode.h =================================================================== --- src/sys/sys/vnode.h (revision 367980) +++ src/sys/sys/vnode.h (working copy) @@ -448,6 +448,8 @@ extern u_long desiredvnodes; /* number of vnodes extern struct uma_zone *namei_zone; extern struct vattr va_null; /* predefined null vattr structure */ +extern u_int vn_lock_pair_pause_max; + #define VI_LOCK(vp) mtx_lock(&(vp)->v_interlock) #define VI_LOCK_FLAGS(vp, flags) mtx_lock_flags(&(vp)->v_interlock, (flags)) #define VI_TRYLOCK(vp) mtx_trylock(&(vp)->v_interlock) Index: src/sys/ufs/ffs/ffs_softdep.c =================================================================== --- src/sys/ufs/ffs/ffs_softdep.c (revision 367980) +++ src/sys/ufs/ffs/ffs_softdep.c (working copy) @@ -1409,6 +1409,29 @@ SYSCTL_INT(_debug_softdep, OID_AUTO, print_threads /* List of all filesystems mounted with soft updates */ static TAILQ_HEAD(, mount_softdeps) softdepmounts; +static void +get_parent_vp_unlock_bp(struct mount *mp, struct buf *bp, + struct diraddhd *diraddhdp, struct diraddhd *unfinishedp) +{ + struct diradd *dap; + + /* + * Requeue unfinished dependencies before + * unlocking buffer, which could make + * diraddhdp invalid. + */ + ACQUIRE_LOCK(VFSTOUFS(mp)); + while ((dap = LIST_FIRST(unfinishedp)) != NULL) { + LIST_REMOVE(dap, da_pdlist); + LIST_INSERT_HEAD(diraddhdp, dap, da_pdlist); + } + FREE_LOCK(VFSTOUFS(mp)); + + bp->b_vflags &= ~BV_SCANNED; + BUF_NOREC(bp); + BUF_UNLOCK(bp); +} + /* * This function fetches inode inum on mount point mp. We already * hold a locked vnode vp, and might have a locked buffer bp belonging @@ -1439,7 +1462,6 @@ get_parent_vp(struct vnode *vp, struct mount *mp, struct vnode **rvp) { struct vnode *pvp; - struct diradd *dap; int error; bool bplocked; @@ -1455,31 +1477,18 @@ get_parent_vp(struct vnode *vp, struct mount *mp, * restart the syscall. */ if (VTOI(pvp)->i_mode == 0 || !bplocked) { + if (bp != NULL && bplocked) + get_parent_vp_unlock_bp(mp, bp, + diraddhdp, unfinishedp); if (VTOI(pvp)->i_mode == 0) vgone(pvp); - vput(pvp); error = ERELOOKUP; - goto out; + goto out2; } - - error = 0; goto out1; } if (bp != NULL && bplocked) { - /* - * Requeue unfinished dependencies before - * unlocking buffer, which could make - * diraddhdp invalid. - */ - ACQUIRE_LOCK(VFSTOUFS(mp)); - while ((dap = LIST_FIRST(unfinishedp)) != NULL) { - LIST_REMOVE(dap, da_pdlist); - LIST_INSERT_HEAD(diraddhdp, dap, da_pdlist); - } - FREE_LOCK(VFSTOUFS(mp)); - bp->b_vflags &= ~BV_SCANNED; - BUF_NOREC(bp); - BUF_UNLOCK(bp); + get_parent_vp_unlock_bp(mp, bp, diraddhdp, unfinishedp); bplocked = false; } @@ -1528,6 +1537,7 @@ get_parent_vp(struct vnode *vp, struct mount *mp, MPASS(!bplocked); error = ERELOOKUP; } +out2: if (error != 0 && pvp != NULL) { vput(pvp); pvp = NULL; @@ -1534,7 +1544,6 @@ get_parent_vp(struct vnode *vp, struct mount *mp, } out1: *rvp = pvp; -out: ASSERT_VOP_ELOCKED(vp, "child vnode must be locked on return"); return (error); } -- Test scenario: misc/trim4.sh