panic: vref: vnode with usecount and VI_OWEINACT set, vmcore.76 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #0 r351623M: Fri Aug 30 11:36:44 CEST 2019 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 8.0.1 (tags/RELEASE_801/final 366581) (based on LLVM 8.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.06-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33160597504 (31624 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 10 5 8 11 2 6 7 4 3 9 Timecounter "TSC-low" frequency 1750032032 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 000.000054 [4254] netmap_init netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff811ccd70, 0) error 19 [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Uugen0.3: at usbus0 ukbd0 on uhub3 ukbd0: on usbus0 kbd2 at ukbd0 . lo0: linAutoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. if_delmulti_locked: detaching ifnet instance 0xfffff80006019000 DHCPDISCOVER on igb0 to 255.255.255.255 port 67 interval 7 DHCPOFFER from 192.168.5.1 DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192.168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 30 Aug 19:29:15 ntpdate[2072]: step time server 192.168.5.1 offset 0.037408 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. fscklock order reversal: 1st 0xfffff800047ee558 ufs (ufs) @ kern/vfs_mount.c:1354 2nd 0xfffff80007abe558 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1926 stack backtrace: #0 0xffffffff80c42b03 at witness_debugger+0x73 #1 0xffffffff80c4284e at witness_checkorder+0xa9e #2 0xffffffff80ba8929 at lockmgr_lock_fast_path+0x179 #3 0xffffffff81242e50 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cca995 at _vn_lock+0x65 #5 0xffffffff80ed4e2d at softdep_flushworklist+0x5d #6 0xffffffff80ef5f66 at ffs_sync+0x406 #7 0xffffffff80ca86f1 at dounmount+0x4f1 #8 0xffffffff80ca8149 at sys_unmount+0x339 #9 0xffffffff811a54b4 at amd64_syscall+0x2d4 #10 0xffffffff8117bfd0 at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 313 files, 5713 used, 1259694 free (126 frags, 157446 blocks, 0.0% fragmentation) ***** FILE SYSTEM MARKED CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Fri Aug 30 19:29 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Aug 30 19:29:53 mercat1 login[2352]: ROOT LOGIN (root) ON ttyu1 Last login: Fri Aug 30 12:10:05 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #0 r351623M: Fri Aug 30 11:36:44 CEST 2019 root@mercat1:~ # Aug 30 19:30:25 mercat1 su[2370]: pho to root on /dev/pts/0 20190830 19:31:10 all (1/586): 1st.sh 20190830 19:31:12 all (2/586): 256m.sh 20190830 19:31:14 all (3/586): advlock.sh 20190830 19:34:05 all (1/219): umount.sh freework leak: 10/17. 20190830 19:38:19 all (2/219): pthread6.sh 20190830 19:41:11 all (3/219): ptrace4.sh lock order reversal: (sleepable after non-sleepable) 1st 0xfffff800039f3c08 seqflq (seqflq) @ dev/sound/midi/sequencer.c:757 2nd 0xffffffff81cf2bc0 midistat lock (midistat lock) @ dev/sound/midi/midi.c:1491 stack backtrace: #0 0xffffffff80c42b03 at witness_debugger+0x73 #1 0xffffffff80c4284e at witness_checkorder+0xa9e #2 0xffffffff80bdf248 at _sx_xlock+0x68 #3 0xffffffff8098de12 at midimapper_open+0x22 #4 0xffffffff80990db4 at mseq_open+0xf4 #5 0xffffffff80a8bd35 at devfs_open+0x135 #6 0xffffffff81240712 at VOP_OPEN_APV+0x82 #7 0xffffffff80cca735 at vn_open_vnode+0x1b5 #8 0xffffffff80cca34c at vn_open_cred+0x35c #9 0xffffffff80cc1f93 at kern_openat+0x1f3 #10 0xffffffff811a54b4 at amd64_syscall+0x2d4 #11 0xffffffff8117bfd0 at fast_syscall_common+0x101 pts leak: 1/2 20190830 19:45:33 all (4/219): lockf4.sh 20190830 19:49:26 all (5/219): tmpfs9.sh Aug 30 19:50:55 mercat1 kernel: pid 5628 (swap), jid 0, uid 0, was killed: out of swap space 20190830 19:53:45 all (6/219): graid1_6.sh Aug 30 19:54:43 mercat1 kernel: pid 59166 (symlink), uid 2007 inumber 32802 on /mnt: out of inodes Aug 30 19:56:06 mercat1 kernel: pid 66699 (creat), uid 2007 inumber 32827 on /mnt: out of inodes Aug 30 19:56:07 mercat1 kernel: pid 66705 (rw), uid 2007 inumber 32770 on /mnt: out of inodes Aug 30 19:56:08 mercat1 kernel: pid 66672 (creat), uid 2007 inumber 32774 on /mnt: out of inodes Aug 30 19:56:09 mercat1 kernel: pid 66653 (rw), uid 2007 inumber 32786 on /mnt: out of inodes Aug 30 19:56:10 mercat1 kernel: pid 66692 (rw), uid 2007 inumber 32893 on /mnt: out of inodes Aug 30 19:56:11 mercat1 kernel: pid 66724 (creat), uid 2007 inumber 32829 on /mnt: out of inodes Aug 30 19:56:12 mercat1 kernel: pid 66657 (rw), uid 2007 inumber 32810 on /mnt: out of inodes Aug 30 19:56:46 mercat1 kernel: pid 66712 (rw), uid 2007 inumber 32775 on /mnt: filesystem full freework leak: 15/32. 20190830 19:58:12 all (7/219): crossmp9.sh VNASSERT failed 0xfffff80007280000: tag ufs, type VDIR usecount 1, writecount 0, refcount 4 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff800060bea00 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: UNLOCKED #0 0xffffffff80ba8ddb at lockmgr_slock_hard+0x36b #1 0xffffffff80ba9c78 at __lockmgr_args+0x788 #2 0xffffffff80ef77ac at ffs_lock+0x7c #3 0xffffffff81242e50 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cca995 at _vn_lock+0x65 #5 0xffffffff80cb26eb at vget_finish+0x19b #6 0xffffffff80c938a7 at cache_lookup+0x847 #7 0xffffffff80c98a12 at vfs_cache_lookup+0x122 #8 0xffffffff8123fec6 at VOP_LOOKUP_APV+0x86 #9 0xffffffff80ca41e1 at lookup+0x601 #10 0xffffffff80ca3672 at namei+0x502 #11 0xffffffff80cca230 at vn_open_cred+0x240 #12 0xffffffff80cc1f93 at kern_openat+0x1f3 #13 0xffffffff811a54b4 at amd64_syscall+0x2d4 #14 0xffffffff8117bfd0 at fast_syscall_common+0x101 nlink=5, effnlink=5, size=3072, extsize 0 generation=7a545701, uid=0, gid=0, flags=0x0 ino 56339712, on dev gpt/work panic: vref: vnode with usecount and VI_OWEINACT set cpuid = 2 time = 1567188140 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00ae85e430 vpanic() at vpanic+0x19d/frame 0xfffffe00ae85e480 panic() at panic+0x43/frame 0xfffffe00ae85e4e0 vref() at vref+0x105/frame 0xfffffe00ae85e510 vn_vptocnp() at vn_vptocnp+0x256/frame 0xfffffe00ae85e600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ae85e700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ae85e780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ae85e830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ae85e890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ae85e960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ae85e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae85eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae85eab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- KDB: enter: panic [ thread pid 23144 tid 100799 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 23144 tid 100799 td 0xfffff8021af6c5a0 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00ae85e430 vpanic() at vpanic+0x1ba/frame 0xfffffe00ae85e480 panic() at panic+0x43/frame 0xfffffe00ae85e4e0 vref() at vref+0x105/frame 0xfffffe00ae85e510 vn_vptocnp() at vn_vptocnp+0x256/frame 0xfffffe00ae85e600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ae85e700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ae85e780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ae85e830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ae85e890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ae85e960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ae85e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae85eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae85eab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- db:1:pho1> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0xb99400 curthread = 0xfffff80025f795a0: pid 23158 tid 101196 "df" curpcb = 0xfffffe00ae9efb80 fpcurthread = 0xfffff80025f795a0: pid 23158 "df" idlethread = 0xfffff800037ae000: tid 100003 "idle: cpu0" curpmap = 0xfffff8075d9b2130 tssp = 0xffffffff82007160 commontssp = 0xffffffff82007160 rsp0 = 0xfffffe00ae9efb80 gs32p = 0xffffffff8200d9a8 ldt = 0xffffffff8200d9e8 tss = 0xffffffff8200d9d8 tlb gen = 3998186 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe0084fec400 curthread = 0xfffff80025dd45a0: pid 23157 tid 101147 "df" curpcb = 0xfffffe00ac23db80 fpcurthread = 0xfffff80025dd45a0: pid 23157 "df" idlethread = 0xfffff800037af5a0: tid 100004 "idle: cpu1" curpmap = 0xfffff802386d7130 tssp = 0xffffffff820071c8 commontssp = 0xffffffff820071c8 rsp0 = 0xfffffe00ac23db80 gs32p = 0xffffffff8200da10 ldt = 0xffffffff8200da50 tss = 0xffffffff8200da40 tlb gen = 3998186 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe0084ff8400 curthread = 0xfffff8021af6c5a0: pid 23144 tid 100799 "df" curpcb = 0xfffffe00ae85eb80 fpcurthread = 0xfffff8021af6c5a0: pid 23144 "df" idlethread = 0xfffff800037af000: tid 100005 "idle: cpu2" curpmap = 0xfffff801cd305130 tssp = 0xffffffff82007230 commontssp = 0xffffffff82007230 rsp0 = 0xfffffe00ae85eb80 gs32p = 0xffffffff8200da78 ldt = 0xffffffff8200dab8 tss = 0xffffffff8200daa8 tlb gen = 3998186 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe0085004400 curthread = 0xfffff80530712000: pid 23147 tid 101219 "mount" curpcb = 0xfffffe00ae940b80 fpcurthread = 0xfffff80530712000: pid 23147 "mount" idlethread = 0xfffff800037b05a0: tid 100006 "idle: cpu3" curpmap = 0xfffff804e3482130 tssp = 0xffffffff82007298 commontssp = 0xffffffff82007298 rsp0 = 0xfffffe00ae940b80 gs32p = 0xffffffff8200dae0 ldt = 0xffffffff8200db20 tss = 0xffffffff8200db10 tlb gen = 3998186 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe0085010400 curthread = 0xfffff802b3647000: pid 23141 tid 100264 "df" curpcb = 0xfffffe00ac27eb80 fpcurthread = 0xfffff802b3647000: pid 23141 "df" idlethread = 0xfffff800037b0000: tid 100007 "idle: cpu4" curpmap = 0xfffff807f0c28130 tssp = 0xffffffff82007300 commontssp = 0xffffffff82007300 rsp0 = 0xfffffe00ac27eb80 gs32p = 0xffffffff8200db48 ldt = 0xffffffff8200db88 tss = 0xffffffff8200db78 tlb gen = 3998186 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe008501c400 curthread = 0xfffff802388a7000: pid 23145 tid 100272 "df" curpcb = 0xfffffe00ac2a6b80 fpcurthread = 0xfffff802388a7000: pid 23145 "df" idlethread = 0xfffff800037b15a0: tid 100008 "idle: cpu5" curpmap = 0xfffff80061312130 tssp = 0xffffffff82007368 commontssp = 0xffffffff82007368 rsp0 = 0xfffffe00ac2a6b80 gs32p = 0xffffffff8200dbb0 ldt = 0xffffffff8200dbf0 tss = 0xffffffff8200dbe0 tlb gen = 3998186 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe0085028400 curthread = 0xfffff802b36e35a0: pid 23146 tid 100688 "mount" curpcb = 0xfffffe00ac0edb80 fpcurthread = 0xfffff802b36e35a0: pid 23146 "mount" idlethread = 0xfffff800037b1000: tid 100009 "idle: cpu6" curpmap = 0xfffff80616189130 tssp = 0xffffffff820073d0 commontssp = 0xffffffff820073d0 rsp0 = 0xfffffe00ac0edb80 gs32p = 0xffffffff8200dc18 ldt = 0xffffffff8200dc58 tss = 0xffffffff8200dc48 tlb gen = 3998186 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe0085034400 curthread = 0xfffff802fcdc05a0: pid 23153 tid 100922 "mount" curpcb = 0xfffffe00ac350b80 fpcurthread = 0xfffff802fcdc05a0: pid 23153 "mount" idlethread = 0xfffff8000379c5a0: tid 100010 "idle: cpu7" curpmap = 0xfffff80238694130 tssp = 0xffffffff82007438 commontssp = 0xffffffff82007438 rsp0 = 0xfffffe00ac350b80 gs32p = 0xffffffff8200dc80 ldt = 0xffffffff8200dcc0 tss = 0xffffffff8200dcb0 tlb gen = 3998186 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe0085040400 curthread = 0xfffff807f02325a0: pid 23159 tid 100360 "mount" curpcb = 0xfffffe00ac238b80 fpcurthread = 0xfffff807f02325a0: pid 23159 "mount" idlethread = 0xfffff8000379c000: tid 100011 "idle: cpu8" curpmap = 0xfffff80025f45130 tssp = 0xffffffff820074a0 commontssp = 0xffffffff820074a0 rsp0 = 0xfffffe00ac238b80 gs32p = 0xffffffff8200dce8 ldt = 0xffffffff8200dd28 tss = 0xffffffff8200dd18 tlb gen = 3998186 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe008504c400 curthread = 0xfffff800252e35a0: pid 23149 tid 100342 "df" curpcb = 0xfffffe00ac3cdb80 fpcurthread = 0xfffff800252e35a0: pid 23149 "df" idlethread = 0xfffff8000379d5a0: tid 100012 "idle: cpu9" curpmap = 0xfffff805292ed130 tssp = 0xffffffff82007508 commontssp = 0xffffffff82007508 rsp0 = 0xfffffe00ac3cdb80 gs32p = 0xffffffff8200dd50 ldt = 0xffffffff8200dd90 tss = 0xffffffff8200dd80 tlb gen = 3998186 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe0085058400 curthread = 0xfffff8064d576000: pid 23151 tid 100677 "df" curpcb = 0xfffffe00767d6b80 fpcurthread = 0xfffff8064d576000: pid 23151 "df" idlethread = 0xfffff8000379d000: tid 100013 "idle: cpu10" curpmap = 0xfffff803d685f130 tssp = 0xffffffff82007570 commontssp = 0xffffffff82007570 rsp0 = 0xfffffe00767d6b80 gs32p = 0xffffffff8200ddb8 ldt = 0xffffffff8200ddf8 tss = 0xffffffff8200dde8 tlb gen = 3998186 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe0085064400 curthread = 0xfffff80007383000: pid 23148 tid 100171 "df" curpcb = 0xfffffe00ac05eb80 fpcurthread = 0xfffff80007383000: pid 23148 "df" idlethread = 0xfffff8000379e5a0: tid 100014 "idle: cpu11" curpmap = 0xfffff8081fa02130 tssp = 0xffffffff820075d8 commontssp = 0xffffffff820075d8 rsp0 = 0xfffffe00ac05eb80 gs32p = 0xffffffff8200de20 ldt = 0xffffffff8200de60 tss = 0xffffffff8200de50 tlb gen = 3998185 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 23156 (sh) thread 0xfffff80003eed000 (101455) shared lockmgr ufs (ufs) r = 0 (0xfffff800074fe2e0) locked @ kern/vfs_subr.c:2742 Process 23155 (sh) thread 0xfffff80003dd55a0 (100213) shared lockmgr ufs (ufs) r = 0 (0xfffff800074fe2e0) locked @ kern/vfs_subr.c:2742 Process 23144 (df) thread 0xfffff8021af6c5a0 (100799) exclusive sleep mutex ncvn (ncvn) r = 0 (0xfffffe009a64e800) locked @ kern/vfs_cache.c:2268 Process 23143 (umount) thread 0xfffff802fc43d000 (101062) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8075d638cc0) locked @ kern/vfs_mount.c:1354 Process 23138 (sh) thread 0xfffff80003eed5a0 (101454) exclusive rw vm object (vm object) r = 0 (0xfffff80792d24b00) locked @ vm/vm_fault.c:1352 shared sx vm map (user) (vm map (user)) r = 0 (0xfffff80003547898) locked @ vm/vm_map.c:4545 Process 23128 (mount) thread 0xfffff803ea4395a0 (101471) exclusive sx vm map (user) (vm map (user)) r = 0 (0xfffff806ae30c070) locked @ vm/vm_map.c:3650 Process 23113 (mount) thread 0xfffff8000602c000 (100253) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0006aac320) locked @ kern/vfs_bio.c:1661 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0006473ae8) locked @ kern/vfs_bio.c:1661 Process 83189 (sh) thread 0xfffff807f0217000 (100337) exclusive sx vm map (user) (vm map (user)) r = 0 (0xfffff806ae9f1070) locked @ vm/vm_map.c:3898 exclusive sx vm map (user) (vm map (user)) r = 0 (0xfffff8052909f070) locked @ vm/vm_map.c:3894 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff800074fe278: tag ufs, type VREG usecount 285, writecount -293, refcount 6 flags (VI_ACTIVE) v_object 0xfffff80007502400 ref 283 pages 30 cleanbuf 4 dirtybuf 0 lock type ufs: SHARED (count 2) #0 0xffffffff80ba8ddb at lockmgr_slock_hard+0x36b #1 0xffffffff80ba9c78 at __lockmgr_args+0x788 #2 0xffffffff80ef77ac at ffs_lock+0x7c #3 0xffffffff81242e50 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cca995 at _vn_lock+0x65 #5 0xffffffff80cb26eb at vget_finish+0x19b #6 0xffffffff80c938a7 at cache_lookup+0x847 #7 0xffffffff80c98a12 at vfs_cache_lookup+0x122 #8 0xffffffff8123fec6 at VOP_LOOKUP_APV+0x86 #9 0xffffffff80ca41e1 at lookup+0x601 #10 0xffffffff80ca3672 at namei+0x502 #11 0xffffffff80b64c8e at elf64_load_file+0xde #12 0xffffffff80b63ca4 at exec_elf64_imgact+0xfa4 #13 0xffffffff80b8b7c4 at kern_execve+0x604 #14 0xffffffff80b8ae3c at sys_execve+0x4c #15 0xffffffff811a54b4 at amd64_syscall+0x2d4 #16 0xffffffff8117bfd0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=121808, extsize 0 generation=1af74cfe, uid=0, gid=0, flags=0x20000 ino 14927621, on dev gpt/work vnode 0xfffff8075d638c58: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0xfffff800256f1000 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff802fc43d000 (pid 23143, umount, tid 101062) #0 0xffffffff80ba9302 at lockmgr_xlock_hard+0x432 #1 0xffffffff80ba9af5 at __lockmgr_args+0x605 #2 0xffffffff80ef77ac at ffs_lock+0x7c #3 0xffffffff81242e50 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cca995 at _vn_lock+0x65 #5 0xffffffff80ca826c at dounmount+0x6c #6 0xffffffff80ca8149 at sys_unmount+0x339 #7 0xffffffff811a54b4 at amd64_syscall+0x2d4 #8 0xffffffff8117bfd0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=14ec5c17, uid=0, gid=0, flags=0x0 ino 78891648, on dev gpt/work db:1:pho1> show allchains chain 1: thread 100328 (pid 23154, sh) blocked on sx "vm map (user)" SLOCK (count 1) chain 2: thread 101472 (pid 23152, grep) sleeping on 0xfffff807b96a48e8 "piperd" chain 3: thread 100344 (pid 23150, mount) blocked on lock 0xfffffe009a64e800 (sleep mutex) "ncvn" thread 100799 (pid 23144, df) running on CPU 2 chain 4: thread 100255 (pid 23137, grep) sleeping on 0xfffff803d69d1be0 "piperd" chain 5: thread 100535 (pid 23136, date) blocked on sx "vm map (user)" SLOCK (count 1) chain 6: thread 101181 (pid 23134, grep) blocked on sx "vm map (user)" SLOCK (count 1) chain 7: thread 100198 (pid 23133, mount) blocked on sx "vm map (user)" SLOCK (count 1) chain 8: thread 100301 (pid 23132, grep) blocked on sx "vm map (user)" SLOCK (count 1) chain 9: thread 101246 (pid 3865, sleep) sleeping on 0xffffffff81e90b52 "nanslp" chain 10: thread 101205 (pid 83214, sh) sleeping on 0xfffff8081f8f5a60 "wait" chain 11: thread 100904 (pid 83211, sh) sleeping on 0xfffff8081f6b28e8 "piperd" chain 12: thread 101202 (pid 83210, sh) sleeping on 0xfffff802fb1e3530 "wait" chain 13: thread 100178 (pid 83206, sh) sleeping on 0xfffff80025264a60 "wait" chain 14: thread 100316 (pid 83205, sh) sleeping on 0xfffff801cd0db4f0 "ppwait" chain 15: thread 100228 (pid 83193, sh) sleeping on 0xfffff800074bda60 "wait" chain 16: thread 100208 (pid 83190, sh) sleeping on 0xfffff802389bc530 "wait" chain 17: thread 100307 (pid 83186, sh) sleeping on 0xfffff802b34e6530 "wait" chain 18: thread 100346 (pid 83185, sh) sleeping on 0xfffff80735ba2be0 "piperd" chain 19: thread 101227 (pid 83181, sh) sleeping on 0xfffff8075dd78530 "wait" chain 20: thread 100150 (pid 83177, sh) sleeping on 0xfffff80006048530 "wait" chain 21: thread 100170 (pid 83175, sh) blocked on lockmgr `:EXCL thread 0 (pid -512, ) is inactive chain 22: thread 100248 (pid 83171, sh) blocked on sx "vm map (user)" SLOCK (count 1) chain 23: thread 100197 (pid 83166, sh) sleeping on 0xfffff80003ef3a60 "wait" chain 24: thread 101201 (pid 83164, sh) sleeping on 0xfffff803d69d15f0 "piperd" chain 25: thread 100373 (pid 83163, sh) sleeping on 0xfffff802fc5d9000 "wait" chain 26: thread 101250 (pid 83160, sh) blocked on sx "vm map (user)" SLOCK (count 1) chain 27: thread 100893 (pid 83157, sh) sleeping on 0xfffff80238a03000 "wait" chain 28: thread 101473 (pid 83152, sh) sleeping on 0xfffff805290af530 "wait" chain 29: thread 100214 (pid 83150, sh) sleeping on 0xfffff800078b9000 "wait" chain 30: thread 100281 (pid 83149, sh) sleeping on 0xfffff802b30a9000 "wait" chain 31: thread 101182 (pid 83146, sh) sleeping on 0xfffff80722493000 "wait" chain 32: thread 100631 (pid 83143, sh) sleeping on 0xfffff80003ef2a60 "wait" chain 33: thread 100358 (pid 83142, sh) sleeping on 0xfffff807f05e0530 "wait" chain 34: thread 100835 (pid 83141, sh) sleeping on 0xfffff80025c99530 "wait" chain 35: thread 100254 (pid 83140, sh) sleeping on 0xfffff802b30a8530 "wait" chain 36: thread 100323 (pid 83139, sh) sleeping on 0xfffff80717d87a60 "wait" chain 37: thread 100164 (pid 83138, sh) sleeping on 0xfffff800078b9a20 "ppwait" chain 38: thread 101232 (pid 83137, sh) sleeping on 0xfffff803d6ecf000 "wait" chain 39: thread 100329 (pid 83133, md24) sleeping on 0xfffff80169c50000 "mdwait" chain 40: thread 101174 (pid 83123, md23) sleeping on 0xfffff800612a6000 "mdwait" chain 41: thread 100325 (pid 83113, md22) blocked on lockmgrKDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00ae85d960 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00ae85d970 trap() at trap+0x59/frame 0xfffffe00ae85da80 calltrap() at calltrap+0x8/frame 0xfffffe00ae85da80 --- trap 0xc, rip = 0xffffffff80cd477f, rsp = 0xfffffe00ae85db50, rbp = 0xfffffe00ae85db50 --- strlen() at strlen+0x1f/frame 0xfffffe00ae85db50 kvprintf() at kvprintf+0xf79/frame 0xfffffe00ae85dc70 db_printf() at db_printf+0x5d/frame 0xfffffe00ae85dcf0 lockmgr_chain() at lockmgr_chain+0x3e/frame 0xfffffe00ae85dd10 print_lockchain() at print_lockchain+0x89/frame 0xfffffe00ae85dd40 db_show_allchains() at db_show_allchains+0x80/frame 0xfffffe00ae85dd70 db_command() at db_command+0x279/frame 0xfffffe00ae85de40 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00ae85dee0 db_command() at db_command+0x279/frame 0xfffffe00ae85dfb0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00ae85e050 db_command() at db_command+0x279/frame 0xfffffe00ae85e120 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00ae85e130 db_trap() at db_trap+0xef/frame 0xfffffe00ae85e1c0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00ae85e240 trap() at trap+0x80f/frame 0xfffffe00ae85e350 calltrap() at calltrap+0x8/frame 0xfffffe00ae85e350 --- trap 0x3, rip = 0xffffffff80c20adb, rsp = 0xfffffe00ae85e420, rbp = 0xfffffe00ae85e430 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00ae85e430 vpanic() at vpanic+0x1ba/frame 0xfffffe00ae85e480 panic() at panic+0x43/frame 0xfffffe00ae85e4e0 vref() at vref+0x105/frame 0xfffffe00ae85e510 vn_vptocnp() at vn_vptocnp+0x256/frame 0xfffffe00ae85e600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ae85e700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ae85e780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ae85e830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ae85e890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ae85e960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ae85e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae85eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae85eab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Script command 'show allchains' returned error db:1:pho1> show mount 0xfffff80003718000 /dev/gpt/work on / (ufs) 0xfffff80003717000 devfs on /dev (devfs) 0xfffff80025eeb000 /dev/gpt/tmp on /tmp (ufs) 0xfffff8059407d000 /dev/md21a on /mnt21 (ufs) 0xfffff800256f1000 /dev/md23a on /mnt23 (ufs) 0xfffff8081fb2b000 /dev/md17a on /mnt17 (ufs) 0xfffff8081fb2a000 /dev/md20a on /mnt20 (ufs) 0xfffff80530e32000 /dev/md19a on /mnt19 (ufs) 0xfffff8081fc9f000 /dev/md18a on /mnt18 (ufs) 0xfffff80594181000 /dev/md11a on /mnt11 (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 84499 Buf domain 0 freebufs 13598 lofreebufs 219 hifreebufs 329 bufspace 47575040 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1512 (47058944) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 3, 3, 1, 1, 1, 4, 1, 2, 1, 0, 5, Locked buffers: 0 space 0 Total buffers: 2244 space 47575040 Buf domain 1 freebufs 15003 lofreebufs 219 hifreebufs 329 bufspace 3719168 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 19 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 54 (1368064) dirtyq count 19 (593920) wakeup 0 lim 25 CPU 1, 7, 9, 4, 3, 6, 9, 2, 7, 1, 5, 3, Locked buffers: 0 space 0 Total buffers: 17620 space 3719168 Buf domain 2 freebufs 14975 lofreebufs 219 hifreebufs 329 bufspace 2756608 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 152 (2703360) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 0, 0, 0, 0, 0, 1, 0, 1, 1, 0, 0, Locked buffers: 2 space 8192 Total buffers: 1321 space 2756608 Buf domain 3 freebufs 14500 lofreebufs 219 hifreebufs 329 bufspace 18051072 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 627 (17997824) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 0, 0, 0, 1, 0, 1, 0, 1, 1, 1, 1, Locked buffers: 0 space 0 Total buffers: 2797 space 18051072 Buf domain 4 freebufs 15089 lofreebufs 219 hifreebufs 329 bufspace 630784 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 38 (544768) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 0, 1, 0, 2, 2, 0, 0, 1, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 13273 space 630784 Buf domain 5 freebufs 14835 lofreebufs 219 hifreebufs 329 bufspace 7233536 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 291 (7127040) dirtyq count 0 (0) wakeup 0 lim 25 CPU 2, 1, 0, 0, 0, 0, 0, 0, 1, 1, 1, 1, Locked buffers: 0 space 0 Total buffers: 2465 space 7233536 Buf domain 6 freebufs 14961 lofreebufs 219 hifreebufs 329 bufspace 3239936 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 172 (3239936) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 66211 space 3239936 db:1:pho1> show page vm_cnt.v_free_count: 7887257 vm_cnt.v_inactive_count: 3211 vm_cnt.v_active_count: 5935 vm_cnt.v_laundry_count: 19 vm_cnt.v_wire_count: 220493 vm_cnt.v_free_reserved: 10642 vm_cnt.v_free_min: 51256 vm_cnt.v_free_target: 173098 vm_cnt.v_inactive_target: 259647 db:1:pho1> show pageq pq_free 7887257 dom 0 page_cnt 8123034 free 7887257 pq_act 5935 pq_inact 3211 pq_laund 19 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 001341 | 000000 11 (008192K) | 000462 | 000000 10 (004096K) | 000596 | 000000 09 (002048K) | 000522 | 000000 08 (001024K) | 000568 | 000002 07 (000512K) | 000746 | 000003 06 (000256K) | 001053 | 000019 05 (000128K) | 001466 | 000066 04 (000064K) | 002374 | 000177 03 (000032K) | 003817 | 000447 02 (000016K) | 005366 | 000798 01 (000008K) | 010204 | 000550 00 (000004K) | 007732 | 000225 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000001 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket XFree mqnotifier 216 0 0 0 0 61 0 mvdata 64 0 0 0 0 253 0 mqueue 264 0 0 0 0 29 0 mqnode 416 3 15 3 0 29 0 FFS2 dinode 256 1273 50702 1455747 0 70 0 FFS1 dinode 128 0 0 0 0 125 0 FFS inode 160 1273 50639 1455747 0 65 0 swblk 136 1580 135880 371834 0 61 0 swpctrie 144 213 11181 28981 0 61 0 selfd 64 107 3055 6190891 0 253 0 rtentry 208 12 102 16 0 61 0 IPsec SA lft_c 16 0 0 0 0 253 0 ripcb 488 1 7 5 0 29 0 udplite_inpcb 488 0 0 0 0 29 0 sctp_asconf_ack 48 0 0 0 0 253 0 sctp_asconf 40 0 0 0 0 253 0 sctp_stream_msg_out 112 0 0 0 0 125 0 sctp_readq 152 0 0 0 0 61 0 sctp_chunk 152 0 0 0 0 61 0 sctp_raddr 736 0 0 0 0 13 0 sctp_laddr 48 0 0 4 0 253 0 sctp_asoc 2408 0 0 0 0 3 0 sctp_ep 1280 0 0 0 0 9 0 tcp_log_node 120 0 0 0 0 125 0 tcp_log_bucket 144 0 0 0 0 61 0 tcp_log 408 0 0 0 0 29 0 tcpreass 48 0 0 0 0 253 0 tfo_ccache_entries 80 0 0 0 0 125 0 tfo 4 0 0 0 0 253 0 sackhole 32 0 0 0 0 253 0 hostcache 96 0 0 0 0 125 0 syncache 168 0 0 2 0 61 0 tcptw 88 0 0 0 0 125 0 tcpcb 976 10 14 15 0 13 0 tcp_inpcb 488 10 30 15 0 29 0 udpcb 32 20 1344 307 0 253 0 udp_inpcb 488 20 180 307 0 29 0 ipq 56 0 0 0 0 253 0 unpcb 256 22 248 5135 0 61 0 socket 904 55 2981 5480 0 13 0 KNOTE 160 0 0 0 0 61 0 itimer 352 0 0 0 0 29 0 ksiginfo 112 332 1663 3714 0 125 0 AIOLIO 280 0 0 0 0 29 0 AIOCB 752 0 0 0 0 13 0 AIOP 32 0 0 0 0 253 0 AIO 208 0 0 0 0 61 0 Mountpoints 2896 11 80 44484 0 4 0 procdesc 136 1 28 14 0 61 0 pipe 760 18 237 308396 0 13 0 DIRHASH 1024 73 955 93841 0 14 0 NCLNODE 744 0 0 0 0 13 0 LTS VFS Cache 368 0 0 0 0 29 0 L VFS Cache 328 0 0 0 0 29 0 STS VFS Cache 148 0 0 0 0 61 0 S VFS Cache 108 1370 5490 442010 0 126 0 rentr 24 0 3154 43295 0 253 0 NAMEI 1024 2 490 24910242 0 17 0 BUF TRIE 144 406 105542 2144958 0 61 0 VNODEPOLL 120 0 0 0 0 125 0 VNODE 632 1478 50134 1500448 0 46 0 vtnet_tx_hdr 24 0 0 0 0 253 0 crypto_session 24 0 0 0 0 253 0 cryptodesc 120 0 0 0 0 125 0 cryptop 128 0 0 0 0 125 0 nvme_request 128 0 0 0 0 125 0 g_bio 408 0 2070 16052800 0 40 0 FPU_save_area 832 0 0 0 0 13 0 DMAR_MAP_ENTRY 120 0 0 0 0 125 0 ttyoutq 256 181 119 290 0 61 0 ttyinq 160 345 207 555 0 61 0 epoch_record pcpu 256 4 12 4 0 61 0 mbuf_extpgs 256 0 0 0 0 61 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 mbuf_jumbo_page 4096 0 0 4 0 1 0 mbuf_cluster 2048 9754 30 16981 0 5 0 mbuf 256 5761 3871 1445088 0 253 0 mbuf_packet 256 2 4046 1425851 0 253 0 audit_record 1280 0 0 0 0 9 0 domainset 40 0 0 0 0 253 0 cpuset 104 27 345 27 0 125 0 THREAD 1440 482 142 48006 0 9 0 PROC 1328 150 207 1121929 0 10 0 MAC labels 40 0 0 0 0 253 0 pbuf 984 0 833 0 0 1 0 vnpbuf 984 0 0 0 0 13 0 clpbuf 984 0 128 185107 54992 5 0 mdpbuf 984 0 0 38 0 1 0 nfspbuf 984 0 0 0 0 5 0 swwbuf 984 0 0 221057 0 1 0 swrbuf 984 0 50 95182 0 5 0 umtx_shm 88 0 0 0 0 125 0 umtx pi 96 0 0 0 0 125 0 TURNSTILE 136 625 315 625 0 61 0 rangeset pctrie nodes 144 0 0 0 0 61 0 rl_entry 40 363 3003 363 0 253 0 filedesc0 1104 149 418 1121929 0 14 0 Files 80 231 2023 8067893 0 125 0 SLEEPQUEUE 88 625 584 625 0 125 0 65536 65536 2 0 2 0 1 0 65536 65536 0 0 0 0 1 0 65536 65536 1 13 536 0 1 0 65536 65536 3 0 3 0 1 0 65536 65536 4 6 2193 0 1 0 65536 65536 0 0 0 0 1 0 65536 65536 1 0 1 0 1 0 65536 65536 2 0 2 0 1 0 32768 32768 1 0 9 0 1 0 32768 32768 1 0 2 0 1 0 32768 32768 3 12 97617 0 1 0 32768 32768 12 0 12 0 1 0 32768 32768 9 18 2701 0 1 0 32768 32768 12 0 12 0 1 0 32768 32768 1 1 2 0 1 0 32768 32768 1 0 1 0 1 0 16384 16384 0 0 12 0 1 0 16384 16384 0 0 0 0 1 0 16384 16384 40 16 764 0 1 0 16384 16384 10 0 24 0 1 0 16384 16384 15 0 2844 0 1 0 16384 16384 0 0 0 0 1 0 16384 16384 0 0 1 0 1 0 16384 16384 0 0 0 0 1 0 8192 8192 15 23 534595 0 1 0 8192 8192 20 54 88964 0 2 0 8192 8192 21 47 44636 0 2 0 8192 8192 86 0 120 0 1 0 8192 8192 13 0 1673 0 1 0 8192 8192 12 0 12 0 1 0 8192 8192 5 0 6 0 1 0 8192 8192 1 0 1 0 1 0 4096 4096 16 21 89174 0 1 0 4096 4096 13 52 306328 0 2 0 4096 4096 49 18 90544 0 1 0 4096 4096 3 2 53 0 1 0 4096 4096 18 0 2028 0 1 0 4096 4096 510 131 1924818 0 6 0 4096 4096 2 0 3 0 1 0 4096 4096 7 0 7 0 1 0 2048 2048 2 90 133682 0 5 0 2048 2048 3 3 3 0 5 0 2048 2048 116 108 2612513 0 5 0 2048 2048 2 2 2 0 5 0 2048 2048 12 4 510 0 5 0 2048 2048 0 0 0 0 5 0 2048 2048 1 5 3 0 5 0 2048 2048 0 6 1 0 5 0 1024 1024 3 197 44854 0 13 0 1024 1024 0 0 0 0 13 0 1024 1024 70 194 3509798 0 13 0 1024 1024 36 20 36 0 13 0 1024 1024 221 203 52705 0 13 0 1024 1024 4 132 156215 0 13 0 1024 1024 2 66 1050 0 13 0 1024 1024 3 29 7 0 13 0 512 512 1 65666 2641424 0 30 0 512 512 103 422 89046 0 29 0 512 512 148 356 995417 0 29 0 512 512 13 267 192 0 29 0 512 512 37 236 6319 0 29 0 512 512 358 132 358 0 29 0 512 512 16 47 39 0 29 0 512 512 28 427 18630 0 29 0 256 256 162 2118 942699 0 61 0 256 256 12 10068 375911 0 61 0 256 256 706 2054 1781058 0 61 0 256 256 300 32715 2188247 0 61 0 256 256 266 889 56909 0 61 0 256 256 11 244 529 0 61 0 256 256 62 928 1963711 0 61 0 256 256 104 556 176 0 61 0 128 128 172 1657 446140 0 125 0 128 128 4 89 4 0 125 0 128 128 894 62222 10137362 0 125 0 128 128 1796 51803 5331161 0 126 0 128 128 14564 9461 153277662 0 127 0 128 128 35 895 859 0 125 0 128 128 2445 1647 136484 0 125 0 128 128 98 1390 3827 0 125 0 64 64 67 3529 126411306 0 253 0 64 64 60 374 70 0 253 0 64 64 9529 4358 1655919 0 253 0 64 64 188 3408 1169957 0 253 0 64 64 9335 3313 78035320 0 253 0 64 64 48 3052 46968 0 253 0 64 64 521 595 524 0 253 0 64 64 224 3062 11234 0 253 0 32 32 648 3568 134309 0 253 0 32 32 168 2808 183158 0 253 0 32 32 286 3806 768564 0 253 0 32 32 60 2792 6051 0 253 0 32 32 568 796 24100 0 253 0 32 32 137 3335 1008446 0 253 0 32 32 3508 3064 137253 0 253 0 32 32 38 3062 11129 0 253 0 16 16 90 3396 357962 0 253 0 16 16 29 1465 39 0 253 0 16 16 638 3844 2340625 0 253 0 16 16 3 2238 97 0 253 0 16 16 510 1980 850358 0 253 0 16 16 4 992 19 0 253 0 16 16 2830 2150 3014 0 253 0 16 16 37 3200 11363 0 253 0 mt_zone 24 430 400 433 0 253 0 mt_stats_zone 64 430 210 433 0 253 0 64 pcpu 8 3008 1856 3394 0 253 0 fakepg 104 0 1254 156 0 125 0 VMSPACE 2552 102 207 1121874 0 12 0 MAP ENTRY 112 3480 5690 50466809 0 253 0 KMAP ENTRY 112 8 235 10 0 125 0 MAP 232 2 65 2 0 61 0 RADIX NODE 144 11696 528292 36528906 0 253 0 VM OBJECT 256 2917 50303 15334628 0 90 0 vmem btag 56 14833 1975 24869 0 253 0 vmem 1856 0 1 0 0 5 0 256 Bucket 2048 3019 2460 154567 0 253 0 128 Bucket 1024 2000 1784 76353 0 95 0 64 Bucket 512 2644 898 131087 0 30 0 32 Bucket 256 764 1200 95725 0 75 0 16 Bucket 128 427 1773 59150 0 125 0 12 Bucket 96 316 1365 72618 0 126 0 8 Bucket 64 155 3192 227536 0 253 0 6 Bucket 48 112 2959 93678 0 253 0 4 Bucket 32 195 3525 243601 0 253 0 UMA Hash 256 1 10 7 0 0 0 UMA Slabs 112 11239 20 159095 0 0 0 UMA Zones 1960 87 3 89 0 0 0 UMA Kegs 216 79 17 81 0 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket kstack_cache 16384 355 18 47879 1 vm pgcache 104 75006 3065 25260698 253 vm pgcache 104 19693 3198 75169472 253 buf free cache 984 -10870 18462 2237481 15 buffer arena-65 65536 0 0 189861 1 buffer arena-61 61440 0 0 189861 1 buffer arena-57 57344 0 0 189861 1 buffer arena-53 53248 0 0 189861 1 buffer arena-49 49152 0 0 189861 1 buffer arena-45 45056 0 0 189861 1 buffer arena-40 40960 0 0 189861 1 buffer arena-36 36864 0 0 189861 1 buffer arena-32 32768 2356 2258 487964 6 buffer arena-28 28672 0 0 189861 1 buffer arena-24 24576 0 0 189861 1 buffer arena-20 20480 0 0 189861 1 buffer arena-16 16384 23 55 368348 3 buffer arena-12 12288 0 0 189861 1 buffer arena-81 8192 0 0 189861 1 buffer arena-40 4096 0 0 189861 1 db:0:pho> acttrace Tracing command mount pid 23159 tid 100360 td 0xfffff807f02325a0 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bc7e10 trap() at trap+0x46/frame 0xfffffe0006bc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc7f20 --- trap 0x13, rip = 0xffffffff80c22122, rsp = 0xfffffe00ac238420, rbp = 0xfffffe00ac238430 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00ac238430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ac2384c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ac238510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ac238600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ac238700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ac238780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ac238830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ac238890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ac238960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ac238980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac238ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac238ab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x8002201da, rsp = 0x7fffffffcc48, rbp = 0x7fffffffcda0 --- Tracing command df pid 23158 tid 101196 td 0xfffff80025f795a0 (CPU 0) cpustop_handler() at cpustop_handler+0x2d/frame 0xffffffff81f9f710 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xffffffff81f9f730 trap() at trap+0x46/frame 0xffffffff81f9f840 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81f9f840 --- trap 0x13, rip = 0xffffffff80c22122, rsp = 0xfffffe00ae9ef420, rbp = 0xfffffe00ae9ef430 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00ae9ef430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ae9ef4c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ae9ef510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ae9ef600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ae9ef700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ae9ef780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ae9ef830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ae9ef890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ae9ef960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ae9ef980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae9efab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae9efab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command df pid 23157 tid 101147 td 0xfffff80025dd45a0 (CPU 1) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b73df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b73e10 trap() at trap+0x46/frame 0xfffffe0006b73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b73f20 --- trap 0x13, rip = 0xffffffff80c22120, rsp = 0xfffffe00ac23d420, rbp = 0xfffffe00ac23d430 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00ac23d430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ac23d4c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ac23d510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ac23d600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ac23d700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ac23d780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ac23d830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ac23d890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ac23d960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ac23d980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac23dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac23dab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command mount pid 23153 tid 100922 td 0xfffff802fcdc05a0 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bbbe10 trap() at trap+0x46/frame 0xfffffe0006bbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bbbf20 --- trap 0x13, rip = 0xffffffff80c22120, rsp = 0xfffffe00ac350420, rbp = 0xfffffe00ac350430 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00ac350430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ac3504c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ac350510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ac350600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ac350700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ac350780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ac350830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ac350890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ac350960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ac350980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac350ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac350ab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x8002201da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command df pid 23151 tid 100677 td 0xfffff8064d576000 (CPU 10) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bdfe10 trap() at trap+0x46/frame 0xfffffe0006bdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdff20 --- trap 0x13, rip = 0xffffffff80c22120, rsp = 0xfffffe00767d6420, rbp = 0xfffffe00767d6430 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00767d6430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00767d64c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00767d6510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00767d6600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00767d6700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00767d6780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00767d6830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00767d6890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00767d6960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00767d6980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00767d6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00767d6ab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command df pid 23149 tid 100342 td 0xfffff800252e35a0 (CPU 9) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bd3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bd3e10 trap() at trap+0x46/frame 0xfffffe0006bd3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd3f20 --- trap 0x13, rip = 0xffffffff80c22120, rsp = 0xfffffe00ac3cd420, rbp = 0xfffffe00ac3cd430 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00ac3cd430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ac3cd4c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ac3cd510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ac3cd600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ac3cd700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ac3cd780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ac3cd830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ac3cd890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ac3cd960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ac3cd980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac3cdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac3cdab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command df pid 23148 tid 100171 td 0xfffff80007383000 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bebe10 trap() at trap+0x46/frame 0xfffffe0006bebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bebf20 --- trap 0x13, rip = 0xffffffff80c22122, rsp = 0xfffffe00ac05e420, rbp = 0xfffffe00ac05e430 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00ac05e430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ac05e4c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ac05e510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ac05e600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ac05e700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ac05e780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ac05e830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ac05e890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ac05e960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ac05e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac05eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac05eab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command mount pid 23147 tid 101219 td 0xfffff80530712000 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b8bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b8be10 trap() at trap+0x46/frame 0xfffffe0006b8bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b8bf20 --- trap 0x13, rip = 0xffffffff80c22120, rsp = 0xfffffe00ae940420, rbp = 0xfffffe00ae940430 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00ae940430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ae9404c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ae940510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ae940600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ae940700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ae940780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ae940830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ae940890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ae940960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ae940980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae940ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae940ab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x8002201da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command mount pid 23146 tid 100688 td 0xfffff802b36e35a0 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bafe10 trap() at trap+0x46/frame 0xfffffe0006baff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006baff20 --- trap 0x13, rip = 0xffffffff80c22120, rsp = 0xfffffe00ac0ed420, rbp = 0xfffffe00ac0ed430 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00ac0ed430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ac0ed4c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ac0ed510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ac0ed600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ac0ed700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ac0ed780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ac0ed830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ac0ed890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ac0ed960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ac0ed980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac0edab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac0edab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x8002201da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command df pid 23145 tid 100272 td 0xfffff802388a7000 (CPU 5) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006ba3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006ba3e10 trap() at trap+0x46/frame 0xfffffe0006ba3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006ba3f20 --- trap 0x13, rip = 0xffffffff80c22120, rsp = 0xfffffe00ac2a6420, rbp = 0xfffffe00ac2a6430 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00ac2a6430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ac2a64c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ac2a6510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ac2a6600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ac2a6700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ac2a6780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ac2a6830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ac2a6890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ac2a6960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ac2a6980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac2a6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac2a6ab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command df pid 23144 tid 100799 td 0xfffff8021af6c5a0 (CPU 2) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00ae85e430 vpanic() at vpanic+0x1ba/frame 0xfffffe00ae85e480 panic() at panic+0x43/frame 0xfffffe00ae85e4e0 vref() at vref+0x105/frame 0xfffffe00ae85e510 vn_vptocnp() at vn_vptocnp+0x256/frame 0xfffffe00ae85e600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ae85e700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ae85e780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ae85e830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ae85e890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ae85e960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ae85e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae85eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae85eab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command df pid 23141 tid 100264 td 0xfffff802b3647000 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b97df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b97e10 trap() at trap+0x46/frame 0xfffffe0006b97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b97f20 --- trap 0x13, rip = 0xffffffff80c22120, rsp = 0xfffffe00ac27e420, rbp = 0xfffffe00ac27e430 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00ac27e430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ac27e4c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ac27e510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ac27e600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ac27e700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ac27e780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ac27e830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ac27e890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ac27e960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ac27e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac27eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac27eab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 23160 83186 10726 0 R+ df 23159 83152 10726 0 R+ CPU 8 mount 23158 83150 10726 0 R+ CPU 0 df 23157 83210 10726 0 R+ CPU 1 df 23156 83205 10726 0 RV+ sh 23155 83138 10726 0 RV+ sh 23154 83185 10726 0 D+ vm map 0xfffff80003547898 sh 23153 83181 10726 0 R+ CPU 7 mount 23152 83137 10726 0 S+ piperd 0xfffff807b96a48e8 grep 23151 83214 10726 0 R+ CPU 10 df 23150 83166 10726 0 L+ *ncvn 0xfffff807f0df7180 mount 23149 83163 10726 0 R+ CPU 9 df 23148 83175 10726 0 R+ CPU 11 df 23147 83137 10726 0 R+ CPU 3 mount 23146 83146 10726 0 R+ CPU 6 mount 23145 83157 10726 0 R+ CPU 5 df 23144 83142 10726 0 R+ CPU 2 df 23143 83206 10726 0 R+ umount 23141 83190 10726 0 R+ CPU 4 df 23138 83164 10726 0 R+ sh 23137 83141 10726 0 S+ piperd 0xfffff803d69d1be0 grep 23136 83211 10726 0 D+ vm map 0xfffff80003547898 date 23134 83177 10726 0 DE+ vm map 0xfffff80003547898 grep 23133 83141 10726 0 D+ vm map 0xfffff80003547898 mount 23132 83193 10726 0 DE+ vm map 0xfffff80003547898 grep 23128 83140 10726 0 RE+ mount 23113 83143 10726 0 R+ mount 23103 83139 10726 0 R+ mount 23080 83149 10726 0 R+ umount 3865 11706 11697 0 S nanslp 0xffffffff81e90b52 sleep 83214 82978 10726 0 S+ wait 0xfffff8081f8f5a60 sh 83211 82978 10726 0 S+ piperd 0xfffff8081f6b28e8 sh 83210 82978 10726 0 S+ wait 0xfffff802fb1e3530 sh 83206 82978 10726 0 S+ wait 0xfffff80025264a60 sh 83205 82978 10726 0 D+ ppwait 0xfffff801cd0db4f0 sh 83193 82978 10726 0 S+ wait 0xfffff800074bda60 sh 83190 82978 10726 0 S+ wait 0xfffff802389bc530 sh 83189 82978 10726 0 R+ sh 83186 82978 10726 0 S+ wait 0xfffff802b34e6530 sh 83185 82978 10726 0 S+ piperd 0xfffff80735ba2be0 sh 83181 82978 10726 0 S+ wait 0xfffff8075dd78530 sh 83177 82978 10726 0 S+ wait 0xfffff80006048530 sh 83175 82978 10726 0 S+ wait 0xfffff80003ef2000 sh 83171 82978 10726 0 D+ vm map 0xfffff80003547898 sh 83166 82978 10726 0 S+ wait 0xfffff80003ef3a60 sh 83164 82978 10726 0 S+ piperd 0xfffff803d69d15f0 sh 83163 82978 10726 0 S+ wait 0xfffff802fc5d9000 sh 83160 82978 10726 0 D+ vm map 0xfffff80003547898 sh 83157 82978 10726 0 S+ wait 0xfffff80238a03000 sh 83152 82978 10726 0 S+ wait 0xfffff805290af530 sh 83150 82978 10726 0 S+ wait 0xfffff800078b9000 sh 83149 82978 10726 0 S+ wait 0xfffff802b30a9000 sh 83146 82978 10726 0 S+ wait 0xfffff80722493000 sh 83143 82978 10726 0 S+ wait 0xfffff80003ef2a60 sh 83142 82978 10726 0 S+ wait 0xfffff807f05e0530 sh 83141 82978 10726 0 S+ wait 0xfffff80025c99530 sh 83140 82978 10726 0 S+ wait 0xfffff802b30a8530 sh 83139 82978 10726 0 S+ wait 0xfffff80717d87a60 sh 83138 82978 10726 0 D+ ppwait 0xfffff800078b9a20 sh 83137 82978 10726 0 S+ wait 0xfffff803d6ecf000 sh 83133 0 0 0 DL mdwait 0xfffff80169c50000 [md24] 83123 0 0 0 DL mdwait 0xfffff800612a6000 [md23] 83113 0 0 0 DL mdwait 0xfffff806ae1a3000 [md22] 83103 0 0 0 DL mdwait 0xfffff80356a1d000 [md21] 83093 0 0 0 DL mdwait 0xfffff804af1bf000 [md20] 83083 0 0 0 DL mdwait 0xfffff80530e50000 [md19] 83073 0 0 0 DL mdwait 0xfffff8081feeb000 [md18] 83063 0 0 0 DL mdwait 0xfffff8061c4b6000 [md17] 83053 0 0 0 DL mdwait 0xfffff8038c485000 [md16] 83043 0 0 0 DL mdwait 0xfffff801cd420000 [md15] 83033 0 0 0 DL mdwait 0xfffff8072af84000 [md14] 83023 0 0 0 DL mdwait 0xfffff80483255000 [md13] 83013 0 0 0 DL mdwait 0xfffff80792dc4000 [md12] 83003 0 0 0 DL mdwait 0xfffff8059408c000 [md11] 82993 0 0 0 DL mdwait 0xfffff807924b1000 [md10] 82978 82976 10726 0 S+ pause 0xfffff800252640a8 sh 82977 10726 10726 0 S+ piperd 0xfffff803d60bd000 tee 82976 10726 10726 0 S+ wait 0xfffff8002507d000 sh 56573 56569 56573 2006 Ss+ select 0xfffff802b35117c0 bash 56569 56543 56543 2006 S select 0xfffff800047b1f40 sshd 56543 2293 56543 0 Ss select 0xfffff80311e78040 sshd 11709 11697 11697 0 S piperd 0xfffff800075b02f8 sh 11707 11697 11697 0 S piperd 0xfffff802b34982f8 awk 11706 11697 11697 0 S wait 0xfffff8000415a530 sh 11697 1 11697 0 SWs wait 0xfffff80025dbea60 sh 10726 2372 10726 0 S+ wait 0xfffff800074bd000 sh 2372 2370 2372 0 SW+ wait 0xfffff8000479e000 bash 2370 2369 2370 0 SW+ pause 0xfffff800078b1b08 csh 2369 2365 2369 2006 SW+ wait 0xfffff800075e6530 su 2365 2364 2365 2006 SWs+ wait 0xfffff800252e1000 bash 2364 2361 2361 2006 S select 0xfffff80003d487c0 sshd 2361 2293 2361 0 Ss select 0xfffff8000386c7c0 sshd 2353 2352 2353 0 S+ ttyin 0xfffff8000610b8b0 csh 2352 1 2352 0 SWs+ wait 0xfffff80004799000 login 2351 1 2351 0 Ss+ ttyin 0xfffff8000610bcb0 getty 2350 1 2350 0 Ss+ ttyin 0xfffff800042418b0 getty 2349 1 2349 0 Ss+ ttyin 0xfffff80004241cb0 getty 2348 1 2348 0 Ss+ ttyin 0xfffff800042400b0 getty 2347 1 2347 0 Ss+ ttyin 0xfffff800042404b0 getty 2346 1 2346 0 Ss+ ttyin 0xfffff800042408b0 getty 2345 1 2345 0 Ss+ ttyin 0xfffff80004240cb0 getty 2344 1 2344 0 Ss+ ttyin 0xfffff8000423f0b0 getty 2343 1 2343 0 Ss+ ttyin 0xfffff8000423f4b0 getty 2297 1 2297 0 Ss nanslp 0xffffffff81e90b57 cron 2293 1 2293 0 Ss select 0xfffff80003e389c0 sshd 2264 1 2264 123 Ss (threaded) ntpd 100206 S select 0xfffff80003e38ac0 ntpd 101043 S usem 0xfffff800669f9980 ntpd 2203 1 2203 0 Ss rpcsvc 0xfffff80006102960 NLM: master 2200 1 2200 0 Ss select 0xfffff80003f73540 rpc.statd 2154 1 2154 0 Ss nanslp 0xffffffff81e90b55 watchdogd 2075 1 2075 0 Ss select 0xfffff8000386c9c0 rpcbind 2065 1 2065 0 Ss select 0xfffff80003f73640 syslogd 1994 1 1994 0 Ss select 0xfffff8000386cac0 devd 1989 1 1989 65 Ss select 0xfffff8000615d9c0 dhclient 1928 1 1928 0 Ss select 0xfffff8000386cbc0 dhclient 1925 1 1925 0 Ss select 0xfffff80003f736c0 dhclient 34 0 0 0 DL vlruwt 0xfffff80003fd1a60 [vnlru] 33 0 0 0 DL syncer 0xffffffff81f67000 [syncer] 32 0 0 0 RL (threaded) [bufdaemon] 100130 RunQ [bufdaemon] 100131 D - 0xffffffff81a0a880 [bufspacedaemon-0] 100132 D - 0xffffffff81a12b40 [bufspacedaemon-1] 100133 D - 0xffffffff81a1ae00 [bufspacedaemon-2] 100135 D - 0xffffffff81a230c0 [bufspacedaemon-3] 100136 D - 0xffffffff81a2b380 [bufspacedaemon-4] 100137 D - 0xffffffff81a33640 [bufspacedaemon-5] 100139 D - 0xffffffff81a3b900 [bufspacedaemon-6] 100151 D sdflush 0xfffff800077926e8 [/ worker] 100205 D sdflush 0xfffff80025db30e8 [/tmp worker] 100242 D sdflush 0xfffff80025139ae8 [/mnt21 worker] 100290 D sdflush 0xfffff800038fd8e8 [/mnt20 worker] 101153 D sdflush 0xfffff8002543b6e8 [/mnt17 worker] 101154 D sdflush 0xfffff806c88c9ce8 [/mnt19 worker] 100400 D sdflush 0xfffff800256c84e8 [/mnt18 worker] 101155 D sdflush 0xfffff80408efa6e8 [/mnt11 worker] 101156 D sdflush 0xfffff801892658e8 [/mnt13 worker] 31 0 0 0 DL psleep 0xffffffff81f80788 [vmdaemon] 30 0 0 0 RL (threaded) [pagedaemon] 100128 RunQ [dom0] 100134 D launds 0xffffffff81fea524 [laundry: dom0] 100138 D umarcl 0xffffffff80f15c20 [uma] 29 0 0 0 DL idle 0xfffff80004155000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff80004155530 [enc_daemon0] 27 0 0 0 RL [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff81fe8c30 [sctp_iterator] 25 0 0 0 DL - 0xffffffff81f65e9c [soaiod4] 24 0 0 0 DL - 0xffffffff81f65e9c [soaiod3] 23 0 0 0 DL - 0xffffffff81f65e9c [soaiod2] 22 0 0 0 DL - 0xffffffff81f65e9c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe009a1aa460 [usbus0] 100097 D - 0xfffffe009a1aa4b8 [usbus0] 100098 D - 0xfffffe009a1aa510 [usbus0] 100099 D - 0xfffffe009a1aa568 [usbus0] 100100 D - 0xfffffe009a1aa5c0 [usbus0] 100102 D - 0xfffffe0006de6d10 [usbus1] 100103 D - 0xfffffe0006de6d68 [usbus1] 100104 D - 0xfffffe0006de6dc0 [usbus1] 100105 D - 0xfffffe0006de6e18 [usbus1] 100106 D - 0xfffffe0006de6e70 [usbus1] 100107 D - 0xfffffe009a63fd10 [usbus2] 100108 D - 0xfffffe009a63fd68 [usbus2] 100109 D - 0xfffffe009a63fdc0 [usbus2] 100110 D - 0xfffffe009a63fe18 [usbus2] 100111 D - 0xfffffe009a63fe70 [usbus2] 20 0 0 0 DL (threaded) [cam] 100091 D - 0xffffffff81bc8c40 [doneq0] 100092 D - 0xffffffff81bc8cc0 [doneq1] 100093 D - 0xffffffff81bc8d40 [doneq2] 100125 D - 0xffffffff81bc8b08 [scanner] 19 0 0 0 DL crypto_ 0xfffff80004231450 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff800042313f0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80004231390 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80004231330 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff800042312d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80004231270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80004231210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff800042311b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80004231150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff800042310f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80004231090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80004231030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81f7ade8 [crypto] 14 0 0 0 DL seqstat 0xfffff800039f3c88 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff81fb90c0 [g_event] 100063 D - 0xffffffff81fb90d0 [g_up] 100064 D - 0xffffffff81fb90b8 [g_down] 12 0 0 0 WL (threaded) [intr] 100015 I [swi6: task queue] 100016 I [swi6: Giant taskq] 100018 I [swi5: fast taskq] 100047 I [swi4: clock (0)] 100048 I [swi4: clock (1)] 100049 I [swi4: clock (2)] 100050 I [swi4: clock (3)] 100051 I [swi4: clock (4)] 100052 I [swi4: clock (5)] 100053 I [swi4: clock (6)] 100054 I [swi4: clock (7)] 100055 I [swi4: clock (8)] 100056 I [swi4: clock (9)] 100057 I [swi4: clock (10)] 100058 I [swi4: clock (11)] 100059 I [swi3: vm] 100060 I [swi1: netisr 0] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100180 I [irq72: ioat0] 100181 I [irq73: ioat1] 100182 I [irq74: ioat2] 100183 I [irq75: ioat3] 100184 I [irq76: ioat4] 100185 I [irq77: ioat5] 100186 I [irq78: ioat6] 100187 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800037b2530 [init] 10 0 0 0 DL audit_w 0xffffffff81fe9940 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81fb9100 [swapper] 100017 D - 0xfffff8000369bc00 [thread taskq] 100019 D - 0xfffff8000369ba00 [config_0] 100020 D - 0xfffff8000369b900 [kqueue_ctx taskq] 100021 D - 0xfffff8000369b800 [aiod_kick taskq] 100022 D - 0xfffff8000369b700 [softirq_0] 100023 D - 0xfffff8000369b600 [softirq_1] 100024 D - 0xfffff8000369b500 [softirq_2] 100025 D - 0xfffff8000369b400 [softirq_3] 100026 D - 0xfffff8000369b300 [softirq_4] 100027 D - 0xfffff8000369b200 [softirq_5] 100028 D - 0xfffff8000369b100 [softirq_6] 100029 D - 0xfffff8000369b000 [softirq_7] 100030 D - 0xfffff8000369ae00 [softirq_8] 100031 D - 0xfffff8000369ad00 [softirq_9] 100032 D - 0xfffff8000369ac00 [softirq_10] 100033 D - 0xfffff8000369ab00 [softirq_11] 100034 D - 0xfffff8000369aa00 [if_io_tqg_0] 100035 D - 0xfffff8000369a900 [if_io_tqg_1] 100036 D - 0xfffff8000369a800 [if_io_tqg_2] 100037 D - 0xfffff80003895100 [if_io_tqg_3] 100038 D - 0xfffff80003895000 [if_io_tqg_4] 100039 D - 0xfffff80003896e00 [if_io_tqg_5] 100040 D - 0xfffff80003896d00 [if_io_tqg_6] 100041 D - 0xfffff80003896c00 [if_io_tqg_7] 100042 D - 0xfffff80003896b00 [if_io_tqg_8] 100043 D - 0xfffff80003896a00 [if_io_tqg_9] 100044 D - 0xfffff80003896900 [if_io_tqg_10] 100045 D - 0xfffff80003896800 [if_io_tqg_11] 100046 D - 0xfffff80003aa6200 [if_config_tqg_0] 100061 D - 0xfffff80003aa6100 [firmware taskq] 100066 D - 0xfffff80003aa6000 [crypto_0] 100067 D - 0xfffff80003aa6000 [crypto_1] 100068 D - 0xfffff80003aa6000 [crypto_2] 100069 D - 0xfffff80003aa6000 [crypto_3] 100070 D - 0xfffff80003aa6000 [crypto_4] 100071 D - 0xfffff80003aa6000 [crypto_5] 100072 D - 0xfffff80003aa6000 [crypto_6] 100073 D - 0xfffff80003aa6000 [crypto_7] 100074 D - 0xfffff80003aa6000 [crypto_8] 100075 D - 0xfffff80003aa6000 [crypto_9] 100076 D - 0xfffff80003aa6000 [crypto_10] 100077 D - 0xfffff80003aa6000 [crypto_11] 100114 D - 0xfffff80006436300 [mca taskq] 100121 D - 0xfffff8000742f400 [acpi_task_0] 100122 D - 0xfffff8000742f400 [acpi_task_1] 100123 D - 0xfffff8000742f400 [acpi_task_2] 100124 D - 0xfffff80003aa7e00 [CAM taskq] db:0:pho> allt Tracing command df pid 23160 tid 101187 td 0xfffff8021a9bd5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae84fa40 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae84fa70 ast() at ast+0x28b/frame 0xfffffe00ae84fab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe0d0 Tracing command mount pid 23159 tid 100360 td 0xfffff807f02325a0 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bc7e10 trap() at trap+0x46/frame 0xfffffe0006bc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc7f20 --- trap 0x13, rip = 0xffffffff80c22122, rsp = 0xfffffe00ac238420, rbp = 0xfffffe00ac238430 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00ac238430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ac2384c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ac238510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ac238600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ac238700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ac238780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ac238830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ac238890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ac238960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ac238980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac238ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac238ab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x8002201da, rsp = 0x7fffffffcc48, rbp = 0x7fffffffcda0 --- Tracing command df pid 23158 tid 101196 td 0xfffff80025f795a0 (CPU 0) cpustop_handler() at cpustop_handler+0x2d/frame 0xffffffff81f9f710 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xffffffff81f9f730 trap() at trap+0x46/frame 0xffffffff81f9f840 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81f9f840 --- trap 0x13, rip = 0xffffffff80c22122, rsp = 0xfffffe00ae9ef420, rbp = 0xfffffe00ae9ef430 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00ae9ef430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ae9ef4c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ae9ef510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ae9ef600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ae9ef700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ae9ef780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ae9ef830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ae9ef890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ae9ef960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ae9ef980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae9efab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae9efab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command df pid 23157 tid 101147 td 0xfffff80025dd45a0 (CPU 1) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b73df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b73e10 trap() at trap+0x46/frame 0xfffffe0006b73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b73f20 --- trap 0x13, rip = 0xffffffff80c22120, rsp = 0xfffffe00ac23d420, rbp = 0xfffffe00ac23d430 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00ac23d430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ac23d4c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ac23d510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ac23d600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ac23d700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ac23d780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ac23d830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ac23d890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ac23d960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ac23d980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac23dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac23dab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command sh pid 23156 tid 101455 td 0xfffff80003eed000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aea94220 mi_switch() at mi_switch+0x172/frame 0xfffffe00aea94250 turnstile_wait() at turnstile_wait+0x3ac/frame 0xfffffe00aea942a0 __rw_wlock_hard() at __rw_wlock_hard+0x104/frame 0xfffffe00aea94350 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00aea94390 exec_map_first_page() at exec_map_first_page+0xb3/frame 0xfffffe00aea94460 elf64_load_file() at elf64_load_file+0x128/frame 0xfffffe00aea944c0 exec_elf64_imgact() at exec_elf64_imgact+0xfa4/frame 0xfffffe00aea945b0 kern_execve() at kern_execve+0x604/frame 0xfffffe00aea94900 sys_execve() at sys_execve+0x4c/frame 0xfffffe00aea94980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00aea94ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aea94ab0 --- syscall (59, FreeBSD ELF64, sys_execve), rip = 0x8003e522a, rsp = 0x7fffffffdf88, rbp = 0x7fffffffe0d0 --- Tracing command sh pid 23155 tid 100213 td 0xfffff80003dd55a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac184220 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac184250 turnstile_wait() at turnstile_wait+0x3ac/frame 0xfffffe00ac1842a0 __rw_wlock_hard() at __rw_wlock_hard+0x104/frame 0xfffffe00ac184350 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00ac184390 exec_map_first_page() at exec_map_first_page+0xb3/frame 0xfffffe00ac184460 elf64_load_file() at elf64_load_file+0x128/frame 0xfffffe00ac1844c0 exec_elf64_imgact() at exec_elf64_imgact+0xfa4/frame 0xfffffe00ac1845b0 kern_execve() at kern_execve+0x604/frame 0xfffffe00ac184900 sys_execve() at sys_execve+0x4c/frame 0xfffffe00ac184980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac184ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac184ab0 --- syscall (59, FreeBSD ELF64, sys_execve), rip = 0x8003e522a, rsp = 0x7fffffffdf88, rbp = 0x7fffffffe0d0 --- Tracing command sh pid 23154 tid 100328 td 0xfffff807f02155a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac3875f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac387620 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac387660 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac387690 _sx_xlock_hard() at _sx_xlock_hard+0x46a/frame 0xfffffe00ac387740 _sx_xlock() at _sx_xlock+0xc1/frame 0xfffffe00ac387780 vm_map_find() at vm_map_find+0x15c/frame 0xfffffe00ac387850 pipespace_new() at pipespace_new+0x9d/frame 0xfffffe00ac3878b0 pipe_paircreate() at pipe_paircreate+0xa9/frame 0xfffffe00ac3878e0 kern_pipe() at kern_pipe+0x2b/frame 0xfffffe00ac387950 sys_pipe2() at sys_pipe2+0x2f/frame 0xfffffe00ac387980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac387ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac387ab0 --- syscall (542, FreeBSD ELF64, sys_pipe2), rip = 0x80036a52a, rsp = 0x7fffffffd7e8, rbp = 0x7fffffffd950 --- Tracing command mount pid 23153 tid 100922 td 0xfffff802fcdc05a0 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bbbe10 trap() at trap+0x46/frame 0xfffffe0006bbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bbbf20 --- trap 0x13, rip = 0xffffffff80c22120, rsp = 0xfffffe00ac350420, rbp = 0xfffffe00ac350430 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00ac350430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ac3504c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ac350510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ac350600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ac350700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ac350780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ac350830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ac350890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ac350960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ac350980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac350ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac350ab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x8002201da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command grep pid 23152 tid 101472 td 0xfffff803ea439000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aea1c6a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00aea1c6d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aea1c710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aea1c770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aea1c7a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00aea1c840 pipe_read() at pipe_read+0x348/frame 0xfffffe00aea1c8a0 dofileread() at dofileread+0x81/frame 0xfffffe00aea1c8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00aea1c930 sys_read() at sys_read+0x84/frame 0xfffffe00aea1c980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00aea1cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aea1cab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004741fa, rsp = 0x7fffffffe528, rbp = 0x7fffffffe580 --- Tracing command df pid 23151 tid 100677 td 0xfffff8064d576000 (CPU 10) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bdfe10 trap() at trap+0x46/frame 0xfffffe0006bdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdff20 --- trap 0x13, rip = 0xffffffff80c22120, rsp = 0xfffffe00767d6420, rbp = 0xfffffe00767d6430 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00767d6430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00767d64c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00767d6510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00767d6600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00767d6700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00767d6780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00767d6830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00767d6890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00767d6960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00767d6980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00767d6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00767d6ab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command mount pid 23150 tid 100344 td 0xfffff8023889d5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac3d73b0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac3d73e0 turnstile_wait() at turnstile_wait+0x3ac/frame 0xfffffe00ac3d7430 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f8/frame 0xfffffe00ac3d74c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ac3d7510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ac3d7600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ac3d7700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ac3d7780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ac3d7830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ac3d7890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ac3d7960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ac3d7980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac3d7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac3d7ab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x8002201da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command df pid 23149 tid 100342 td 0xfffff800252e35a0 (CPU 9) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bd3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bd3e10 trap() at trap+0x46/frame 0xfffffe0006bd3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd3f20 --- trap 0x13, rip = 0xffffffff80c22120, rsp = 0xfffffe00ac3cd420, rbp = 0xfffffe00ac3cd430 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00ac3cd430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ac3cd4c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ac3cd510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ac3cd600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ac3cd700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ac3cd780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ac3cd830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ac3cd890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ac3cd960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ac3cd980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac3cdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac3cdab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command df pid 23148 tid 100171 td 0xfffff80007383000 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bebe10 trap() at trap+0x46/frame 0xfffffe0006bebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bebf20 --- trap 0x13, rip = 0xffffffff80c22122, rsp = 0xfffffe00ac05e420, rbp = 0xfffffe00ac05e430 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00ac05e430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ac05e4c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ac05e510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ac05e600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ac05e700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ac05e780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ac05e830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ac05e890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ac05e960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ac05e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac05eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac05eab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command mount pid 23147 tid 101219 td 0xfffff80530712000 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b8bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b8be10 trap() at trap+0x46/frame 0xfffffe0006b8bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b8bf20 --- trap 0x13, rip = 0xffffffff80c22120, rsp = 0xfffffe00ae940420, rbp = 0xfffffe00ae940430 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00ae940430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ae9404c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ae940510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ae940600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ae940700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ae940780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ae940830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ae940890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ae940960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ae940980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae940ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae940ab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x8002201da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command mount pid 23146 tid 100688 td 0xfffff802b36e35a0 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bafe10 trap() at trap+0x46/frame 0xfffffe0006baff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006baff20 --- trap 0x13, rip = 0xffffffff80c22120, rsp = 0xfffffe00ac0ed420, rbp = 0xfffffe00ac0ed430 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00ac0ed430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ac0ed4c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ac0ed510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ac0ed600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ac0ed700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ac0ed780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ac0ed830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ac0ed890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ac0ed960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ac0ed980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac0edab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac0edab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x8002201da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command df pid 23145 tid 100272 td 0xfffff802388a7000 (CPU 5) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006ba3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006ba3e10 trap() at trap+0x46/frame 0xfffffe0006ba3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006ba3f20 --- trap 0x13, rip = 0xffffffff80c22120, rsp = 0xfffffe00ac2a6420, rbp = 0xfffffe00ac2a6430 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00ac2a6430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ac2a64c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ac2a6510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ac2a6600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ac2a6700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ac2a6780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ac2a6830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ac2a6890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ac2a6960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ac2a6980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac2a6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac2a6ab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command df pid 23144 tid 100799 td 0xfffff8021af6c5a0 (CPU 2) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00ae85e430 vpanic() at vpanic+0x1ba/frame 0xfffffe00ae85e480 panic() at panic+0x43/frame 0xfffffe00ae85e4e0 vref() at vref+0x105/frame 0xfffffe00ae85e510 vn_vptocnp() at vn_vptocnp+0x256/frame 0xfffffe00ae85e600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ae85e700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ae85e780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ae85e830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ae85e890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ae85e960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ae85e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae85eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae85eab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command umount pid 23143 tid 101062 td 0xfffff802fc43d000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767ef5f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00767ef620 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767ef660 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767ef690 _sleep() at _sleep+0x2da/frame 0xfffffe00767ef730 softdep_unmount() at softdep_unmount+0x165/frame 0xfffffe00767ef770 ffs_unmount() at ffs_unmount+0x18d/frame 0xfffffe00767ef7f0 dounmount() at dounmount+0x4e0/frame 0xfffffe00767ef850 sys_unmount() at sys_unmount+0x339/frame 0xfffffe00767ef980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00767efab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00767efab0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002d99aa, rsp = 0x7fffffffd2e8, rbp = 0x7fffffffd820 --- Tracing command df pid 23141 tid 100264 td 0xfffff802b3647000 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b97df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b97e10 trap() at trap+0x46/frame 0xfffffe0006b97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b97f20 --- trap 0x13, rip = 0xffffffff80c22120, rsp = 0xfffffe00ac27e420, rbp = 0xfffffe00ac27e430 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00ac27e430 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00ac27e4c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ac27e510 vn_vptocnp() at vn_vptocnp+0x50/frame 0xfffffe00ac27e600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ac27e700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ac27e780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ac27e830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ac27e890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ac27e960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ac27e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac27eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac27eab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command sh pid 23138 tid 101454 td 0xfffff80003eed5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae909280 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae9092b0 turnstile_wait() at turnstile_wait+0x3ac/frame 0xfffffe00ae909300 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f8/frame 0xfffffe00ae909390 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00ae9093e0 vm_fault_hold() at vm_fault_hold+0x19fd/frame 0xfffffe00ae909530 vm_fault() at vm_fault+0x60/frame 0xfffffe00ae909570 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00ae9095c0 trap() at trap+0x2b2/frame 0xfffffe00ae9096d0 calltrap() at calltrap+0x8/frame 0xfffffe00ae9096d0 --- trap 0xc, rip = 0xffffffff811a17ae, rsp = 0xfffffe00ae9097a0, rbp = 0xfffffe00ae9097a0 --- copyin_nosmap_erms() at copyin_nosmap_erms+0x11e/frame 0xfffffe00ae9097a0 uiomove_faultflag() at uiomove_faultflag+0x10e/frame 0xfffffe00ae9097e0 pipe_write() at pipe_write+0x8d6/frame 0xfffffe00ae9098a0 dofilewrite() at dofilewrite+0x91/frame 0xfffffe00ae9098f0 kern_writev() at kern_writev+0x49/frame 0xfffffe00ae909930 sys_write() at sys_write+0x84/frame 0xfffffe00ae909980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae909ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae909ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8004761ba, rsp = 0x7fffffffdd58, rbp = 0x7fffffffdd90 --- Tracing command grep pid 23137 tid 100255 td 0xfffff802b30a5000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac2516a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac2516d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac251710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac251770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac2517a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac251840 pipe_read() at pipe_read+0x348/frame 0xfffffe00ac2518a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac2518f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac251930 sys_read() at sys_read+0x84/frame 0xfffffe00ac251980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac251ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac251ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004741fa, rsp = 0x7fffffffe528, rbp = 0x7fffffffe580 --- Tracing command date pid 23136 tid 100535 td 0xfffff80654a03000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae91d170 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae91d1a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ae91d1e0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ae91d210 _sx_slock_hard() at _sx_slock_hard+0x2c9/frame 0xfffffe00ae91d2a0 _sx_slock_int() at _sx_slock_int+0xb5/frame 0xfffffe00ae91d2e0 vm_map_lookup() at vm_map_lookup+0x97/frame 0xfffffe00ae91d3d0 vm_fault_hold() at vm_fault_hold+0x77/frame 0xfffffe00ae91d530 vm_fault() at vm_fault+0x60/frame 0xfffffe00ae91d570 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00ae91d5c0 trap() at trap+0x2b2/frame 0xfffffe00ae91d6d0 calltrap() at calltrap+0x8/frame 0xfffffe00ae91d6d0 --- trap 0xc, rip = 0xffffffff811a176d, rsp = 0xfffffe00ae91d7a0, rbp = 0xfffffe00ae91d7a0 --- copyin_nosmap_erms() at copyin_nosmap_erms+0xdd/frame 0xfffffe00ae91d7a0 uiomove_faultflag() at uiomove_faultflag+0x10e/frame 0xfffffe00ae91d7e0 pipe_write() at pipe_write+0x8d6/frame 0xfffffe00ae91d8a0 dofilewrite() at dofilewrite+0x91/frame 0xfffffe00ae91d8f0 kern_writev() at kern_writev+0x49/frame 0xfffffe00ae91d930 sys_write() at sys_write+0x84/frame 0xfffffe00ae91d980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae91dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae91dab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8004181ba, rsp = 0x7fffffffe0e8, rbp = 0x7fffffffe110 --- Tracing command grep pid 23134 tid 101181 td 0xfffff802b307a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae936510 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae936540 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ae936580 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ae9365b0 _sx_xlock_hard() at _sx_xlock_hard+0x46a/frame 0xfffffe00ae936660 _sx_xlock() at _sx_xlock+0xc1/frame 0xfffffe00ae9366a0 vm_map_remove() at vm_map_remove+0x4f/frame 0xfffffe00ae9366d0 pipeclose() at pipeclose+0x2e1/frame 0xfffffe00ae936710 pipe_close() at pipe_close+0x60/frame 0xfffffe00ae936740 _fdrop() at _fdrop+0x1a/frame 0xfffffe00ae936760 closef() at closef+0x202/frame 0xfffffe00ae9367f0 fdescfree_fds() at fdescfree_fds+0xbc/frame 0xfffffe00ae936840 fdescfree() at fdescfree+0x465/frame 0xfffffe00ae936900 exit1() at exit1+0x4f2/frame 0xfffffe00ae936970 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00ae936980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae936ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae936ab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x80040379a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe530 --- Tracing command mount pid 23133 tid 100198 td 0xfffff80003ede000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac12d170 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac12d1a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac12d1e0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac12d210 _sx_slock_hard() at _sx_slock_hard+0x2c9/frame 0xfffffe00ac12d2a0 _sx_slock_int() at _sx_slock_int+0xb5/frame 0xfffffe00ac12d2e0 vm_map_lookup() at vm_map_lookup+0x97/frame 0xfffffe00ac12d3d0 vm_fault_hold() at vm_fault_hold+0x77/frame 0xfffffe00ac12d530 vm_fault() at vm_fault+0x60/frame 0xfffffe00ac12d570 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00ac12d5c0 trap() at trap+0x2b2/frame 0xfffffe00ac12d6d0 calltrap() at calltrap+0x8/frame 0xfffffe00ac12d6d0 --- trap 0xc, rip = 0xffffffff811a17e6, rsp = 0xfffffe00ac12d7a0, rbp = 0xfffffe00ac12d7a0 --- copyin_nosmap_erms() at copyin_nosmap_erms+0x156/frame 0xfffffe00ac12d7a0 uiomove_faultflag() at uiomove_faultflag+0x10e/frame 0xfffffe00ac12d7e0 pipe_write() at pipe_write+0x8d6/frame 0xfffffe00ac12d8a0 dofilewrite() at dofilewrite+0x91/frame 0xfffffe00ac12d8f0 kern_writev() at kern_writev+0x49/frame 0xfffffe00ac12d930 sys_write() at sys_write+0x84/frame 0xfffffe00ac12d980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac12dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac12dab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8004311ba, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe600 --- Tracing command grep pid 23132 tid 100301 td 0xfffff802b38b15a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac2e2510 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac2e2540 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac2e2580 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac2e25b0 _sx_xlock_hard() at _sx_xlock_hard+0x46a/frame 0xfffffe00ac2e2660 _sx_xlock() at _sx_xlock+0xc1/frame 0xfffffe00ac2e26a0 vm_map_remove() at vm_map_remove+0x4f/frame 0xfffffe00ac2e26d0 pipeclose() at pipeclose+0x2e1/frame 0xfffffe00ac2e2710 pipe_close() at pipe_close+0x60/frame 0xfffffe00ac2e2740 _fdrop() at _fdrop+0x1a/frame 0xfffffe00ac2e2760 closef() at closef+0x202/frame 0xfffffe00ac2e27f0 fdescfree_fds() at fdescfree_fds+0xbc/frame 0xfffffe00ac2e2840 fdescfree() at fdescfree+0x465/frame 0xfffffe00ac2e2900 exit1() at exit1+0x4f2/frame 0xfffffe00ac2e2970 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00ac2e2980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac2e2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac2e2ab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x80040379a, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe5f0 --- Tracing command mount pid 23128 tid 101471 td 0xfffff803ea4395a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aea35660 mi_switch() at mi_switch+0x172/frame 0xfffffe00aea35690 turnstile_wait() at turnstile_wait+0x3ac/frame 0xfffffe00aea356e0 __rw_wlock_hard() at __rw_wlock_hard+0x104/frame 0xfffffe00aea35790 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00aea357d0 vm_map_entry_delete() at vm_map_entry_delete+0xad/frame 0xfffffe00aea35820 vm_map_delete() at vm_map_delete+0x185/frame 0xfffffe00aea35890 vm_map_remove() at vm_map_remove+0x81/frame 0xfffffe00aea358c0 vmspace_exit() at vmspace_exit+0xd3/frame 0xfffffe00aea35900 exit1() at exit1+0x59d/frame 0xfffffe00aea35970 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00aea35980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00aea35ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aea35ab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8003c079a, rsp = 0x7fffffffe678, rbp = 0x7fffffffe690 --- Tracing command mount pid 23113 tid 100253 td 0xfffff8000602c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac247260 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac247290 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac2472d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac247300 _sleep() at _sleep+0x2da/frame 0xfffffe00ac2473a0 bufwait() at bufwait+0xc4/frame 0xfffffe00ac2473e0 bufwrite() at bufwrite+0x25b/frame 0xfffffe00ac247430 ffs_use_bwrite() at ffs_use_bwrite+0xb4/frame 0xfffffe00ac247470 ffs_sbput() at ffs_sbput+0xaa/frame 0xfffffe00ac2474c0 ffs_mount() at ffs_mount+0x1c2a/frame 0xfffffe00ac247670 vfs_domount() at vfs_domount+0x748/frame 0xfffffe00ac2478a0 vfs_donmount() at vfs_donmount+0x7be/frame 0xfffffe00ac247940 sys_nmount() at sys_nmount+0x69/frame 0xfffffe00ac247980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac247ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac247ab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x8002f1a4a, rsp = 0x7fffffffcf98, rbp = 0x7fffffffd500 --- Tracing command mount pid 23103 tid 100347 td 0xfffff802b3471000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac3e67b0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac3e67e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac3e6820 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00ac3e6860 _sleep() at _sleep+0x279/frame 0xfffffe00ac3e6900 g_waitidle() at g_waitidle+0xa1/frame 0xfffffe00ac3e6920 userret() at userret+0x331/frame 0xfffffe00ac3e6980 amd64_syscall() at amd64_syscall+0x573/frame 0xfffffe00ac3e6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac3e6ab0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x8002f1a4a, rsp = 0x7fffffffcf98, rbp = 0x7fffffffd500 --- Tracing command umount pid 23080 tid 100327 td 0xfffff807f0214000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac3827b0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac3827e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac382820 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00ac382860 _sleep() at _sleep+0x279/frame 0xfffffe00ac382900 g_waitidle() at g_waitidle+0xa1/frame 0xfffffe00ac382920 userret() at userret+0x331/frame 0xfffffe00ac382980 amd64_syscall() at amd64_syscall+0x573/frame 0xfffffe00ac382ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac382ab0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x8002d99aa, rsp = 0x7fffffffd2e8, rbp = 0x7fffffffd820 --- Tracing command sleep pid 3865 tid 101246 td 0xfffff806ffbf0000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae95e710 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae95e740 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ae95e780 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ae95e7e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ae95e820 _sleep() at _sleep+0x265/frame 0xfffffe00ae95e8c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00ae95e940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00ae95e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae95eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae95eab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003a4a0a, rsp = 0x7fffffffe688, rbp = 0x7fffffffe6d0 --- Tracing command sh pid 83214 tid 101205 td 0xfffff802b3733000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aea9e560 mi_switch() at mi_switch+0x172/frame 0xfffffe00aea9e590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aea9e5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aea9e630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aea9e660 _sleep() at _sleep+0x2d0/frame 0xfffffe00aea9e700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00aea9e790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00aea9e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00aea9eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aea9eab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe0d8, rbp = 0x7fffffffe190 --- Tracing command sh pid 83211 tid 100904 td 0xfffff802b3014000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767e56a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00767e56d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767e5710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00767e5770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00767e57a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00767e5840 pipe_read() at pipe_read+0x348/frame 0xfffffe00767e58a0 dofileread() at dofileread+0x81/frame 0xfffffe00767e58f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00767e5930 sys_read() at sys_read+0x84/frame 0xfffffe00767e5980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00767e5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00767e5ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004761fa, rsp = 0x7fffffffe028, rbp = 0x7fffffffe170 --- Tracing command sh pid 83210 tid 101202 td 0xfffff800255ff5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae8b8560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae8b8590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ae8b85d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ae8b8630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ae8b8660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ae8b8700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ae8b8790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ae8b8980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae8b8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae8b8ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe0d8, rbp = 0x7fffffffe190 --- Tracing command sh pid 83206 tid 100178 td 0xfffff800045bf5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac081560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac081590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac0815d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac081630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac081660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac081700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ac081790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ac081980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac081ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac081ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe188, rbp = 0x7fffffffe240 --- Tracing command sh pid 83205 tid 100316 td 0xfffff80717d8a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac34b810 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac34b840 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac34b880 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00ac34b8c0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x185/frame 0xfffffe00ac34b930 fork_rfppwait() at fork_rfppwait+0x14a/frame 0xfffffe00ac34b980 amd64_syscall() at amd64_syscall+0x837/frame 0xfffffe00ac34bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac34bab0 --- syscall (23156), rip = 0x8003e494d, rsp = 0x7fffffffe130, rbp = 0x7fffffffe1d0 --- Tracing command sh pid 83193 tid 100228 td 0xfffff800074b75a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac1cf560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac1cf590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac1cf5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac1cf630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac1cf660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac1cf700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ac1cf790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ac1cf980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac1cfab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac1cfab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe3b0 --- Tracing command sh pid 83190 tid 100208 td 0xfffff8023893d5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac16b560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac16b590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac16b5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac16b630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac16b660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac16b700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ac16b790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ac16b980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac16bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac16bab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe0d8, rbp = 0x7fffffffe190 --- Tracing command sh pid 83189 tid 100337 td 0xfffff807f0217000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac3b46b0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac3b46e0 turnstile_wait() at turnstile_wait+0x3ac/frame 0xfffffe00ac3b4730 __rw_wlock_hard() at __rw_wlock_hard+0x104/frame 0xfffffe00ac3b47e0 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00ac3b4820 vmspace_fork() at vmspace_fork+0x77c/frame 0xfffffe00ac3b4880 fork1() at fork1+0x340/frame 0xfffffe00ac3b4930 sys_fork() at sys_fork+0x4c/frame 0xfffffe00ac3b4980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac3b4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac3b4ab0 --- syscall (2, FreeBSD ELF64, sys_fork), rip = 0x800405a4a, rsp = 0x7fffffffe248, rbp = 0x7fffffffe280 --- Tracing command sh pid 83186 tid 100307 td 0xfffff80238c835a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac31e560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac31e590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac31e5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac31e630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac31e660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac31e700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ac31e790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ac31e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac31eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac31eab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe0d8, rbp = 0x7fffffffe190 --- Tracing command sh pid 83185 tid 100346 td 0xfffff802b34715a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac3e16a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac3e16d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac3e1710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac3e1770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac3e17a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac3e1840 pipe_read() at pipe_read+0x348/frame 0xfffffe00ac3e18a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac3e18f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac3e1930 sys_read() at sys_read+0x84/frame 0xfffffe00ac3e1980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac3e1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac3e1ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004761fa, rsp = 0x7fffffffe058, rbp = 0x7fffffffe1a0 --- Tracing command sh pid 83181 tid 101227 td 0xfffff80075be65a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae9bd560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae9bd590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ae9bd5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ae9bd630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ae9bd660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ae9bd700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ae9bd790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ae9bd980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae9bdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae9bdab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe168, rbp = 0x7fffffffe220 --- Tracing command sh pid 83177 tid 100150 td 0xfffff8000602a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aa7f1560 mi_switch() at mi_switch+0x172/frame 0xfffffe00aa7f1590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa7f15d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aa7f1630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa7f1660 _sleep() at _sleep+0x2d0/frame 0xfffffe00aa7f1700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00aa7f1790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00aa7f1980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00aa7f1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa7f1ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe3b0 --- Tracing command sh pid 83175 tid 100170 td 0xfffff80003edd000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac059560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac059590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac0595d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac059630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac059660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac059700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ac059790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ac059980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac059ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac059ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe0d8, rbp = 0x7fffffffe190 --- Tracing command sh pid 83171 tid 100248 td 0xfffff802388a85a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac22e5f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac22e620 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac22e660 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac22e690 _sx_xlock_hard() at _sx_xlock_hard+0x46a/frame 0xfffffe00ac22e740 _sx_xlock() at _sx_xlock+0xc1/frame 0xfffffe00ac22e780 vm_map_find() at vm_map_find+0x15c/frame 0xfffffe00ac22e850 pipespace_new() at pipespace_new+0x9d/frame 0xfffffe00ac22e8b0 pipe_paircreate() at pipe_paircreate+0xa9/frame 0xfffffe00ac22e8e0 kern_pipe() at kern_pipe+0x2b/frame 0xfffffe00ac22e950 sys_pipe2() at sys_pipe2+0x2f/frame 0xfffffe00ac22e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac22eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac22eab0 --- syscall (542, FreeBSD ELF64, sys_pipe2), rip = 0x80036a52a, rsp = 0x7fffffffe3f8, rbp = 0x7fffffffe480 --- Tracing command sh pid 83166 tid 100197 td 0xfffff80003ede5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac128560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac128590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac1285d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac128630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac128660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac128700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ac128790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ac128980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac128ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac128ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe168, rbp = 0x7fffffffe220 --- Tracing command sh pid 83164 tid 101201 td 0xfffff80238c275a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aea806a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00aea806d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aea80710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aea80770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aea807a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00aea80840 pipe_read() at pipe_read+0x348/frame 0xfffffe00aea808a0 dofileread() at dofileread+0x81/frame 0xfffffe00aea808f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00aea80930 sys_read() at sys_read+0x84/frame 0xfffffe00aea80980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00aea80ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aea80ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004761fa, rsp = 0x7fffffffe058, rbp = 0x7fffffffe1a0 --- Tracing command sh pid 83163 tid 100373 td 0xfffff802fc7675a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae868560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae868590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ae8685d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ae868630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ae868660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ae868700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ae868790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ae868980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae868ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae868ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe0d8, rbp = 0x7fffffffe190 --- Tracing command sh pid 83160 tid 101250 td 0xfffff8021af6c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae9225f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae922620 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ae922660 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ae922690 _sx_xlock_hard() at _sx_xlock_hard+0x46a/frame 0xfffffe00ae922740 _sx_xlock() at _sx_xlock+0xc1/frame 0xfffffe00ae922780 vm_map_find() at vm_map_find+0x15c/frame 0xfffffe00ae922850 pipespace_new() at pipespace_new+0x9d/frame 0xfffffe00ae9228b0 pipe_paircreate() at pipe_paircreate+0xa9/frame 0xfffffe00ae9228e0 kern_pipe() at kern_pipe+0x2b/frame 0xfffffe00ae922950 sys_pipe2() at sys_pipe2+0x2f/frame 0xfffffe00ae922980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae922ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae922ab0 --- syscall (542, FreeBSD ELF64, sys_pipe2), rip = 0x80036a52a, rsp = 0x7fffffffe3f8, rbp = 0x7fffffffe480 --- Tracing command sh pid 83157 tid 100893 td 0xfffff802fc5fa000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac30f560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac30f590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac30f5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac30f630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac30f660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac30f700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ac30f790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ac30f980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac30fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac30fab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe0d8, rbp = 0x7fffffffe190 --- Tracing command sh pid 83152 tid 101473 td 0xfffff8061cac35a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae981560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae981590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ae9815d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ae981630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ae981660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ae981700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ae981790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ae981980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae981ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae981ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe188, rbp = 0x7fffffffe240 --- Tracing command sh pid 83150 tid 100214 td 0xfffff80003dd5000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac189560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac189590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac1895d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac189630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac189660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac189700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ac189790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ac189980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac189ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac189ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe0d8, rbp = 0x7fffffffe190 --- Tracing command sh pid 83149 tid 100281 td 0xfffff80025cac5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac2d3560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac2d3590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac2d35d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac2d3630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac2d3660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac2d3700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ac2d3790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ac2d3980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac2d3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac2d3ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe188, rbp = 0x7fffffffe240 --- Tracing command sh pid 83146 tid 101182 td 0xfffff802b31f95a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae9fe560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae9fe590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ae9fe5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ae9fe630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ae9fe660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ae9fe700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ae9fe790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ae9fe980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae9feab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae9feab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe168, rbp = 0x7fffffffe220 --- Tracing command sh pid 83143 tid 100631 td 0xfffff802b36a95a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac37d560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac37d590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac37d5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac37d630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac37d660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac37d700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ac37d790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ac37d980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac37dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac37dab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe188, rbp = 0x7fffffffe240 --- Tracing command sh pid 83142 tid 100358 td 0xfffff807f0960000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae81d560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae81d590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ae81d5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ae81d630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ae81d660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ae81d700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ae81d790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ae81d980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae81dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae81dab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe0d8, rbp = 0x7fffffffe190 --- Tracing command sh pid 83141 tid 100835 td 0xfffff802b3b725a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac072560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac072590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac0725d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac072630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac072660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac072700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ac072790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ac072980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac072ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac072ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe3b0 --- Tracing command sh pid 83140 tid 100254 td 0xfffff802b30a55a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac24c560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac24c590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac24c5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac24c630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac24c660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac24c700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ac24c790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ac24c980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac24cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac24cab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe168, rbp = 0x7fffffffe220 --- Tracing command sh pid 83139 tid 100323 td 0xfffff807172265a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac36e560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac36e590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac36e5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac36e630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac36e660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac36e700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ac36e790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ac36e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac36eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac36eab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe188, rbp = 0x7fffffffe240 --- Tracing command sh pid 83138 tid 100164 td 0xfffff80007382000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac03b810 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac03b840 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac03b880 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00ac03b8c0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x185/frame 0xfffffe00ac03b930 fork_rfppwait() at fork_rfppwait+0x14a/frame 0xfffffe00ac03b980 amd64_syscall() at amd64_syscall+0x837/frame 0xfffffe00ac03bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac03bab0 --- syscall (23155), rip = 0x8003e494d, rsp = 0x7fffffffe130, rbp = 0x7fffffffe1d0 --- Tracing command sh pid 83137 tid 101232 td 0xfffff80238810000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aea8a560 mi_switch() at mi_switch+0x172/frame 0xfffffe00aea8a590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aea8a5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aea8a630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aea8a660 _sleep() at _sleep+0x2d0/frame 0xfffffe00aea8a700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00aea8a790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00aea8a980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00aea8aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aea8aab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe3b0 --- Tracing command md24 pid 83133 tid 100329 td 0xfffff807f0215000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac38c8d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac38c900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac38c940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac38c970 _sleep() at _sleep+0x2da/frame 0xfffffe00ac38ca10 md_kthread() at md_kthread+0x1f5/frame 0xfffffe00ac38ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ac38cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ac38cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md23 pid 83123 tid 101174 td 0xfffff802b38b05a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae9b88d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae9b8900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ae9b8940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ae9b8970 _sleep() at _sleep+0x2da/frame 0xfffffe00ae9b8a10 md_kthread() at md_kthread+0x1f5/frame 0xfffffe00ae9b8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ae9b8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ae9b8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md22 pid 83113 tid 100325 td 0xfffff807f0235000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac3788d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac378900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac378940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac378970 _sleep() at _sleep+0x2da/frame 0xfffffe00ac378a10 md_kthread() at md_kthread+0x1f5/frame 0xfffffe00ac378a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ac378ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ac378ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md21 pid 83103 tid 100235 td 0xfffff80025f7e000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac1f28d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac1f2900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac1f2940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac1f2970 _sleep() at _sleep+0x2da/frame 0xfffffe00ac1f2a10 md_kthread() at md_kthread+0x1f5/frame 0xfffffe00ac1f2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ac1f2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ac1f2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md20 pid 83093 tid 101458 td 0xfffff8021abd25a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac0138d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac013900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac013940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac013970 _sleep() at _sleep+0x2da/frame 0xfffffe00ac013a10 md_kthread() at md_kthread+0x1f5/frame 0xfffffe00ac013a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ac013ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ac013ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md19 pid 83083 tid 100274 td 0xfffff8023889e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac2b08d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac2b0900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac2b0940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac2b0970 _sleep() at _sleep+0x2da/frame 0xfffffe00ac2b0a10 md_kthread() at md_kthread+0x1f5/frame 0xfffffe00ac2b0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ac2b0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ac2b0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md18 pid 83073 tid 101223 td 0xfffff802fc767000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac09f8d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac09f900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac09f940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac09f970 _sleep() at _sleep+0x2da/frame 0xfffffe00ac09fa10 md_kthread() at md_kthread+0x1f5/frame 0xfffffe00ac09fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ac09fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ac09fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md17 pid 83063 tid 100613 td 0xfffff80075be7000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac2158d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac215900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac215940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac215970 _sleep() at _sleep+0x2da/frame 0xfffffe00ac215a10 md_kthread() at md_kthread+0x1f5/frame 0xfffffe00ac215a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ac215ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ac215ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md16 pid 83053 tid 101185 td 0xfffff807f0dfc5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac2ab8d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac2ab900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac2ab940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac2ab970 _sleep() at _sleep+0x2da/frame 0xfffffe00ac2aba10 md_kthread() at md_kthread+0x1f5/frame 0xfffffe00ac2aba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ac2abab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ac2abab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md15 pid 83043 tid 100201 td 0xfffff800075c6000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac1488d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac148900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac148940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac148970 _sleep() at _sleep+0x2da/frame 0xfffffe00ac148a10 md_kthread() at md_kthread+0x1f5/frame 0xfffffe00ac148a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ac148ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ac148ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md14 pid 83033 tid 100322 td 0xfffff80717d8a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac3698d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac369900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac369940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac369970 _sleep() at _sleep+0x2da/frame 0xfffffe00ac369a10 md_kthread() at md_kthread+0x1f5/frame 0xfffffe00ac369a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ac369ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ac369ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md13 pid 83023 tid 100157 td 0xfffff800075c5000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac0188d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac018900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac018940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac018970 _sleep() at _sleep+0x2da/frame 0xfffffe00ac018a10 md_kthread() at md_kthread+0x1f5/frame 0xfffffe00ac018a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ac018ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ac018ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md12 pid 83013 tid 100207 td 0xfffff800045ba5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac1668d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac166900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac166940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac166970 _sleep() at _sleep+0x2da/frame 0xfffffe00ac166a10 md_kthread() at md_kthread+0x1f5/frame 0xfffffe00ac166a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ac166ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ac166ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md11 pid 83003 tid 100359 td 0xfffff807f09615a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae8228d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae822900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ae822940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ae822970 _sleep() at _sleep+0x2da/frame 0xfffffe00ae822a10 md_kthread() at md_kthread+0x1f5/frame 0xfffffe00ae822a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ae822ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ae822ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md10 pid 82993 tid 100598 td 0xfffff802b342b000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac0958d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac095900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac095940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ac095970 _sleep() at _sleep+0x2da/frame 0xfffffe00ac095a10 md_kthread() at md_kthread+0x1f5/frame 0xfffffe00ac095a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ac095ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ac095ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 82978 tid 100233 td 0xfffff800045c05a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac1e8750 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac1e8780 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac1e87c0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac1e8820 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac1e8850 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac1e88f0 kern_sigsuspend() at kern_sigsuspend+0xb4/frame 0xfffffe00ac1e8950 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe00ac1e8980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac1e8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac1e8ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80040592a, rsp = 0x7fffffffe2d8, rbp = 0x7fffffffe390 --- Tracing command tee pid 82977 tid 100361 td 0xfffff802b3d4d5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae82c6a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae82c6d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ae82c710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ae82c770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ae82c7a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00ae82c840 pipe_read() at pipe_read+0x348/frame 0xfffffe00ae82c8a0 dofileread() at dofileread+0x81/frame 0xfffffe00ae82c8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ae82c930 sys_read() at sys_read+0x84/frame 0xfffffe00ae82c980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae82cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae82cab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004151fa, rsp = 0x7fffffffe698, rbp = 0x7fffffffe6e0 --- Tracing command sh pid 82976 tid 100302 td 0xfffff80238c28000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac2dd560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac2dd590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac2dd5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac2dd630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac2dd660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac2dd700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ac2dd790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ac2dd980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac2ddab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac2ddab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffcc88, rbp = 0x7fffffffcd40 --- Tracing command bash pid 56573 tid 101171 td 0xfffff802387025a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac2ce580 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac2ce5b0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac2ce5f0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac2ce650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac2ce680 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac2ce6e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ac2ce720 kern_select() at kern_select+0x95a/frame 0xfffffe00ac2ce900 sys_pselect() at sys_pselect+0x127/frame 0xfffffe00ac2ce980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac2ceab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac2ceab0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x8005159ca, rsp = 0x7fffffffd788, rbp = 0x7fffffffd850 --- Tracing command sshd pid 56569 tid 101198 td 0xfffff802385a25a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae8905c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae8905f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ae890630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ae890690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ae8906c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ae890720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ae890760 kern_select() at kern_select+0x95a/frame 0xfffffe00ae890940 sys_select() at sys_select+0x56/frame 0xfffffe00ae890980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae890ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae890ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8009021da, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 56543 tid 100146 td 0xfffff800045be5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aa7dd640 mi_switch() at mi_switch+0x172/frame 0xfffffe00aa7dd670 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa7dd6b0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aa7dd710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa7dd740 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa7dd7a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aa7dd7e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00aa7dd960 sys_poll() at sys_poll+0x50/frame 0xfffffe00aa7dd980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00aa7ddab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa7ddab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8008a41fa, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command sh pid 11709 tid 100277 td 0xfffff80238c1e000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac2bf6a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac2bf6d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac2bf710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac2bf770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac2bf7a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac2bf840 pipe_read() at pipe_read+0x348/frame 0xfffffe00ac2bf8a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac2bf8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac2bf930 sys_read() at sys_read+0x84/frame 0xfffffe00ac2bf980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac2bfab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac2bfab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004761fa, rsp = 0x7fffffffe208, rbp = 0x7fffffffe310 --- Tracing command awk pid 11707 tid 100249 td 0xfffff800251115a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac2336a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac2336d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac233710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac233770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac2337a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac233840 pipe_read() at pipe_read+0x348/frame 0xfffffe00ac2338a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac2338f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac233930 sys_read() at sys_read+0x84/frame 0xfffffe00ac233980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac233ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac233ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004791fa, rsp = 0x7fffffffe308, rbp = 0x7fffffffe320 --- Tracing command sh pid 11706 tid 100161 td 0xfffff8000414f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac02c560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac02c590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac02c5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac02c630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac02c660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac02c700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ac02c790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ac02c980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac02cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac02cab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe218, rbp = 0x7fffffffe2d0 --- Tracing command sh pid 11697 tid 100204 td 0xfffff80025dd55a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00ae85dc40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00ae85dc50 trap() at trap+0x59/frame 0xfffffe00ae85dd60 calltrap() at calltrap+0x8/frame 0xfffffe00ae85dd60 --- trap 0xc, rip = 0xffffffff811793b6, rsp = 0xfffffe00ae85de30, rbp = 0xfffffe00ae85de40 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00ae85de40 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00ae85dee0 db_command() at db_command+0x279/frame 0xfffffe00ae85dfb0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00ae85e050 db_command() at db_command+0x279/frame 0xfffffe00ae85e120 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00ae85e130 db_trap() at db_trap+0xef/frame 0xfffffe00ae85e1c0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00ae85e240 trap() at trap+0x80f/frame 0xfffffe00ae85e350 calltrap() at calltrap+0x8/frame 0xfffffe00ae85e350 --- trap 0x3, rip = 0xffffffff80c20adb, rsp = 0xfffffe00ae85e420, rbp = 0xfffffe00ae85e430 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00ae85e430 vpanic() at vpanic+0x1ba/frame 0xfffffe00ae85e480 panic() at panic+0x43/frame 0xfffffe00ae85e4e0 vref() at vref+0x105/frame 0xfffffe00ae85e510 vn_vptocnp() at vn_vptocnp+0x256/frame 0xfffffe00ae85e600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ae85e700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ae85e780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ae85e830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ae85e890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ae85e960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ae85e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae85eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae85eab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command sh pid 10726 tid 100262 td 0xfffff80003edc5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac274560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac274590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac2745d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac274630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac274660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac274700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ac274790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ac274980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac274ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac274ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffcfa8, rbp = 0x7fffffffd060 --- Tracing command bash pid 2372 tid 100222 td 0xfffff800074975a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00ae85dc40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00ae85dc50 trap() at trap+0x59/frame 0xfffffe00ae85dd60 calltrap() at calltrap+0x8/frame 0xfffffe00ae85dd60 --- trap 0xc, rip = 0xffffffff811793b6, rsp = 0xfffffe00ae85de30, rbp = 0xfffffe00ae85de40 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00ae85de40 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00ae85dee0 db_command() at db_command+0x279/frame 0xfffffe00ae85dfb0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00ae85e050 db_command() at db_command+0x279/frame 0xfffffe00ae85e120 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00ae85e130 db_trap() at db_trap+0xef/frame 0xfffffe00ae85e1c0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00ae85e240 trap() at trap+0x80f/frame 0xfffffe00ae85e350 calltrap() at calltrap+0x8/frame 0xfffffe00ae85e350 --- trap 0x3, rip = 0xffffffff80c20adb, rsp = 0xfffffe00ae85e420, rbp = 0xfffffe00ae85e430 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00ae85e430 vpanic() at vpanic+0x1ba/frame 0xfffffe00ae85e480 panic() at panic+0x43/frame 0xfffffe00ae85e4e0 vref() at vref+0x105/frame 0xfffffe00ae85e510 vn_vptocnp() at vn_vptocnp+0x256/frame 0xfffffe00ae85e600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ae85e700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ae85e780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ae85e830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ae85e890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ae85e960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ae85e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae85eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae85eab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command csh pid 2370 tid 100215 td 0xfffff800073805a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00ae85dc40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00ae85dc50 trap() at trap+0x59/frame 0xfffffe00ae85dd60 calltrap() at calltrap+0x8/frame 0xfffffe00ae85dd60 --- trap 0xc, rip = 0xffffffff811793b6, rsp = 0xfffffe00ae85de30, rbp = 0xfffffe00ae85de40 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00ae85de40 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00ae85dee0 db_command() at db_command+0x279/frame 0xfffffe00ae85dfb0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00ae85e050 db_command() at db_command+0x279/frame 0xfffffe00ae85e120 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00ae85e130 db_trap() at db_trap+0xef/frame 0xfffffe00ae85e1c0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00ae85e240 trap() at trap+0x80f/frame 0xfffffe00ae85e350 calltrap() at calltrap+0x8/frame 0xfffffe00ae85e350 --- trap 0x3, rip = 0xffffffff80c20adb, rsp = 0xfffffe00ae85e420, rbp = 0xfffffe00ae85e430 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00ae85e430 vpanic() at vpanic+0x1ba/frame 0xfffffe00ae85e480 panic() at panic+0x43/frame 0xfffffe00ae85e4e0 vref() at vref+0x105/frame 0xfffffe00ae85e510 vn_vptocnp() at vn_vptocnp+0x256/frame 0xfffffe00ae85e600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ae85e700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ae85e780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ae85e830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ae85e890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ae85e960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ae85e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae85eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae85eab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command su pid 2369 tid 100143 td 0xfffff800075c45a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00ae85dc40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00ae85dc50 trap() at trap+0x59/frame 0xfffffe00ae85dd60 calltrap() at calltrap+0x8/frame 0xfffffe00ae85dd60 --- trap 0xc, rip = 0xffffffff811793b6, rsp = 0xfffffe00ae85de30, rbp = 0xfffffe00ae85de40 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00ae85de40 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00ae85dee0 db_command() at db_command+0x279/frame 0xfffffe00ae85dfb0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00ae85e050 db_command() at db_command+0x279/frame 0xfffffe00ae85e120 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00ae85e130 db_trap() at db_trap+0xef/frame 0xfffffe00ae85e1c0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00ae85e240 trap() at trap+0x80f/frame 0xfffffe00ae85e350 calltrap() at calltrap+0x8/frame 0xfffffe00ae85e350 --- trap 0x3, rip = 0xffffffff80c20adb, rsp = 0xfffffe00ae85e420, rbp = 0xfffffe00ae85e430 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00ae85e430 vpanic() at vpanic+0x1ba/frame 0xfffffe00ae85e480 panic() at panic+0x43/frame 0xfffffe00ae85e4e0 vref() at vref+0x105/frame 0xfffffe00ae85e510 vn_vptocnp() at vn_vptocnp+0x256/frame 0xfffffe00ae85e600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ae85e700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ae85e780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ae85e830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ae85e890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ae85e960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ae85e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae85eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae85eab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command bash pid 2365 tid 100220 td 0xfffff80025f79000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00ae85dc40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00ae85dc50 trap() at trap+0x59/frame 0xfffffe00ae85dd60 calltrap() at calltrap+0x8/frame 0xfffffe00ae85dd60 --- trap 0xc, rip = 0xffffffff811793b6, rsp = 0xfffffe00ae85de30, rbp = 0xfffffe00ae85de40 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00ae85de40 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00ae85dee0 db_command() at db_command+0x279/frame 0xfffffe00ae85dfb0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00ae85e050 db_command() at db_command+0x279/frame 0xfffffe00ae85e120 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00ae85e130 db_trap() at db_trap+0xef/frame 0xfffffe00ae85e1c0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00ae85e240 trap() at trap+0x80f/frame 0xfffffe00ae85e350 calltrap() at calltrap+0x8/frame 0xfffffe00ae85e350 --- trap 0x3, rip = 0xffffffff80c20adb, rsp = 0xfffffe00ae85e420, rbp = 0xfffffe00ae85e430 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00ae85e430 vpanic() at vpanic+0x1ba/frame 0xfffffe00ae85e480 panic() at panic+0x43/frame 0xfffffe00ae85e4e0 vref() at vref+0x105/frame 0xfffffe00ae85e510 vn_vptocnp() at vn_vptocnp+0x256/frame 0xfffffe00ae85e600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ae85e700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ae85e780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ae85e830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ae85e890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ae85e960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ae85e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae85eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae85eab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command sshd pid 2364 tid 100169 td 0xfffff800253005a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac0545c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac0545f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac054630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac054690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac0546c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac054720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ac054760 kern_select() at kern_select+0x95a/frame 0xfffffe00ac054940 sys_select() at sys_select+0x56/frame 0xfffffe00ac054980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac054ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac054ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8009021da, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 2361 tid 100216 td 0xfffff80025cac000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac193640 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac193670 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac1936b0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac193710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac193740 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac1937a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ac1937e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00ac193960 sys_poll() at sys_poll+0x50/frame 0xfffffe00ac193980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac193ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac193ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8008a41fa, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command csh pid 2353 tid 100209 td 0xfffff8000749f5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac170620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac170650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac170690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac1706f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac170720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac170780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ac1707b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ac170810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ac170840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ac1708a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac1708f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac170930 sys_read() at sys_read+0x84/frame 0xfffffe00ac170980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac170ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac170ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004fa1fa, rsp = 0x7fffffffe1f8, rbp = 0x7fffffffe220 --- Tracing command login pid 2352 tid 100192 td 0xfffff80007ba35a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00ae85dc40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00ae85dc50 trap() at trap+0x59/frame 0xfffffe00ae85dd60 calltrap() at calltrap+0x8/frame 0xfffffe00ae85dd60 --- trap 0xc, rip = 0xffffffff811793b6, rsp = 0xfffffe00ae85de30, rbp = 0xfffffe00ae85de40 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00ae85de40 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00ae85dee0 db_command() at db_command+0x279/frame 0xfffffe00ae85dfb0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00ae85e050 db_command() at db_command+0x279/frame 0xfffffe00ae85e120 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00ae85e130 db_trap() at db_trap+0xef/frame 0xfffffe00ae85e1c0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00ae85e240 trap() at trap+0x80f/frame 0xfffffe00ae85e350 calltrap() at calltrap+0x8/frame 0xfffffe00ae85e350 --- trap 0x3, rip = 0xffffffff80c20adb, rsp = 0xfffffe00ae85e420, rbp = 0xfffffe00ae85e430 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00ae85e430 vpanic() at vpanic+0x1ba/frame 0xfffffe00ae85e480 panic() at panic+0x43/frame 0xfffffe00ae85e4e0 vref() at vref+0x105/frame 0xfffffe00ae85e510 vn_vptocnp() at vn_vptocnp+0x256/frame 0xfffffe00ae85e600 vn_fullpath1() at vn_fullpath1+0xfd/frame 0xfffffe00ae85e700 vn_fullpath() at vn_fullpath+0x128/frame 0xfffffe00ae85e780 pmc_hook_handler() at pmc_hook_handler+0x9d8/frame 0xfffffe00ae85e830 vn_mmap() at vn_mmap+0x1c5/frame 0xfffffe00ae85e890 kern_mmap() at kern_mmap+0x50c/frame 0xfffffe00ae85e960 sys_mmap() at sys_mmap+0x2a/frame 0xfffffe00ae85e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ae85eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ae85eab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x80021e1da, rsp = 0x7fffffffcc68, rbp = 0x7fffffffcdc0 --- Tracing command getty pid 2351 tid 100218 td 0xfffff8000748f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac19d620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac19d650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac19d690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac19d6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac19d720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac19d780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ac19d7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ac19d810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ac19d840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ac19d8a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac19d8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac19d930 sys_read() at sys_read+0x84/frame 0xfffffe00ac19d980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac19dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac19dab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2350 tid 100217 td 0xfffff8000748f5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac198620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac198650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac198690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac1986f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac198720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac198780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ac1987b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ac198810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ac198840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ac1988a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac1988f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac198930 sys_read() at sys_read+0x84/frame 0xfffffe00ac198980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac198ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac198ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2349 tid 100189 td 0xfffff80007493000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac0e8620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac0e8650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac0e8690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac0e86f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac0e8720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac0e8780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ac0e87b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ac0e8810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ac0e8840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ac0e88a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac0e88f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac0e8930 sys_read() at sys_read+0x84/frame 0xfffffe00ac0e8980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac0e8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac0e8ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2348 tid 100166 td 0xfffff80007ba6000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac045620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac045650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac045690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac0456f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac045720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac045780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ac0457b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ac045810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ac045840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ac0458a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac0458f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac045930 sys_read() at sys_read+0x84/frame 0xfffffe00ac045980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac045ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac045ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2347 tid 100148 td 0xfffff80007497000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aa7e7620 mi_switch() at mi_switch+0x172/frame 0xfffffe00aa7e7650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa7e7690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aa7e76f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa7e7720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa7e7780 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa7e77b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa7e7810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa7e7840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa7e78a0 dofileread() at dofileread+0x81/frame 0xfffffe00aa7e78f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00aa7e7930 sys_read() at sys_read+0x84/frame 0xfffffe00aa7e7980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00aa7e7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa7e7ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2346 tid 100160 td 0xfffff80007ba65a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac027620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac027650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac027690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac0276f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac027720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac027780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ac0277b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ac027810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ac027840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ac0278a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac0278f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac027930 sys_read() at sys_read+0x84/frame 0xfffffe00ac027980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac027ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac027ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2345 tid 100203 td 0xfffff800075c75a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac152620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac152650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac152690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac1526f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac152720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac152780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ac1527b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ac152810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ac152840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ac1528a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac1528f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac152930 sys_read() at sys_read+0x84/frame 0xfffffe00ac152980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac152ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac152ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2344 tid 100202 td 0xfffff80004795000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac14d620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac14d650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac14d690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac14d6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac14d720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac14d780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ac14d7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ac14d810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ac14d840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ac14d8a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac14d8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac14d930 sys_read() at sys_read+0x84/frame 0xfffffe00ac14d980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac14dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac14dab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2343 tid 100142 td 0xfffff800060285a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aa7c9620 mi_switch() at mi_switch+0x172/frame 0xfffffe00aa7c9650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa7c9690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aa7c96f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa7c9720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa7c9780 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa7c97b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa7c9810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa7c9840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa7c98a0 dofileread() at dofileread+0x81/frame 0xfffffe00aa7c98f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00aa7c9930 sys_read() at sys_read+0x84/frame 0xfffffe00aa7c9980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00aa7c9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa7c9ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2297 tid 100188 td 0xfffff80007ddb5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac0e3710 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac0e3740 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac0e3780 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac0e37e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ac0e3820 _sleep() at _sleep+0x265/frame 0xfffffe00ac0e38c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00ac0e3940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00ac0e3980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac0e3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac0e3ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d4a0a, rsp = 0x7fffffffead8, rbp = 0x7fffffffecc0 --- Tracing command sshd pid 2293 tid 100210 td 0xfffff8000749f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac1755c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac1755f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac175630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac175690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac1756c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac175720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ac175760 kern_select() at kern_select+0x95a/frame 0xfffffe00ac175940 sys_select() at sys_select+0x56/frame 0xfffffe00ac175980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac175ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac175ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8009021da, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6a0 --- Tracing command ntpd pid 2264 tid 100206 td 0xfffff800075c7000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac1615c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac1615f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac161630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac161690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac1616c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac161720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ac161760 kern_select() at kern_select+0x95a/frame 0xfffffe00ac161940 sys_select() at sys_select+0x56/frame 0xfffffe00ac161980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac161ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac161ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80082e1da, rsp = 0x7fffffffdf18, rbp = 0x7fffffffdf50 --- Tracing command ntpd pid 2264 tid 101043 td 0xfffff807fd7fc5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aea7b6b0 mi_switch() at mi_switch+0x172/frame 0xfffffe00aea7b6e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aea7b720 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aea7b780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aea7b7b0 _sleep() at _sleep+0x2d0/frame 0xfffffe00aea7b850 umtxq_sleep() at umtxq_sleep+0x153/frame 0xfffffe00aea7b8b0 do_sem2_wait() at do_sem2_wait+0x41c/frame 0xfffffe00aea7b930 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x76/frame 0xfffffe00aea7b980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00aea7bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aea7bab0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x8007225aa, rsp = 0x7fffdff7bed8, rbp = 0x7fffdff7bf50 --- Tracing command rpc.lockd pid 2203 tid 100145 td 0xfffff8000749e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aa7d84e0 mi_switch() at mi_switch+0x172/frame 0xfffffe00aa7d8510 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa7d8550 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aa7d85b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa7d85f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aa7d8660 svc_run_internal() at svc_run_internal+0xa90/frame 0xfffffe00aa7d87a0 svc_run() at svc_run+0x24e/frame 0xfffffe00aa7d8800 sys_nlm_syscall() at sys_nlm_syscall+0x763/frame 0xfffffe00aa7d8980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00aa7d8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa7d8ab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f062a, rsp = 0x7fffffffec08, rbp = 0x7fffffffecc0 --- Tracing command rpc.statd pid 2200 tid 100153 td 0xfffff800075c4000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac0045a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac0045d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac004610 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac004670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ac0046b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00ac004720 seltdwait() at seltdwait+0x6b/frame 0xfffffe00ac004760 kern_select() at kern_select+0x95a/frame 0xfffffe00ac004940 sys_select() at sys_select+0x56/frame 0xfffffe00ac004980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac004ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac004ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004251da, rsp = 0x7fffffffea98, rbp = 0x7fffffffebe0 --- Tracing command watchdogd pid 2154 tid 100191 td 0xfffff800075c65a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac0f2710 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac0f2740 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac0f2780 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac0f27e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ac0f2820 _sleep() at _sleep+0x265/frame 0xfffffe00ac0f28c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00ac0f2940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00ac0f2980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac0f2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac0f2ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003bda0a, rsp = 0x7fffffffea98, rbp = 0x7fffffffeae0 --- Tracing command rpcbind pid 2075 tid 100158 td 0xfffff800074935a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac01d620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac01d650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac01d690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac01d6f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ac01d730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00ac01d7a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00ac01d7e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00ac01d960 sys_poll() at sys_poll+0x50/frame 0xfffffe00ac01d980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac01dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac01dab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003cc1fa, rsp = 0x7fffffffca38, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2065 tid 100194 td 0xfffff80007ddb000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac10d5c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac10d5f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac10d630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac10d690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac10d6c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac10d720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ac10d760 kern_select() at kern_select+0x95a/frame 0xfffffe00ac10d940 sys_select() at sys_select+0x56/frame 0xfffffe00ac10d980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac10dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac10dab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004361da, rsp = 0x7fffffffe748, rbp = 0x7fffffffecc0 --- Tracing command devd pid 1994 tid 100176 td 0xfffff80025dd4000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac0775a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac0775d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac077610 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac077670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ac0776b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00ac077720 seltdwait() at seltdwait+0x6b/frame 0xfffffe00ac077760 kern_select() at kern_select+0x95a/frame 0xfffffe00ac077940 sys_select() at sys_select+0x56/frame 0xfffffe00ac077980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac077ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac077ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f533a, rsp = 0x7fffffffcb48, rbp = 0x7fffffffece0 --- Tracing command dhclient pid 1989 tid 100199 td 0xfffff80007ba2000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac132620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac132650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac132690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac1326f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ac132730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00ac1327a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00ac1327e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00ac132960 sys_poll() at sys_poll+0x50/frame 0xfffffe00ac132980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac132ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac132ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003ef1fa, rsp = 0x7fffffffec28, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1928 tid 100193 td 0xfffff80007ba3000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac0fc640 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac0fc670 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac0fc6b0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac0fc710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac0fc740 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac0fc7a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ac0fc7e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00ac0fc960 sys_poll() at sys_poll+0x50/frame 0xfffffe00ac0fc980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac0fcab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac0fcab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003ef1fa, rsp = 0x7fffffffec38, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1925 tid 100168 td 0xfffff800250fd000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac04f5c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac04f5f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac04f630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac04f690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac04f6c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac04f720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ac04f760 kern_select() at kern_select+0x95a/frame 0xfffffe00ac04f940 sys_select() at sys_select+0x56/frame 0xfffffe00ac04f980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac04fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac04fab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80044d1da, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffeaa0 --- Tracing command vnlru pid 34 tid 100141 td 0xfffff80007381000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aa7c4880 mi_switch() at mi_switch+0x172/frame 0xfffffe00aa7c48b0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa7c48f0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aa7c4930 _sleep() at _sleep+0x279/frame 0xfffffe00aa7c49d0 vnlru_proc() at vnlru_proc+0x16f/frame 0xfffffe00aa7c4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00aa7c4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00aa7c4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100140 td 0xfffff800073815a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a2ffd8b0 mi_switch() at mi_switch+0x172/frame 0xfffffe00a2ffd8e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2ffd920 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a2ffd960 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x185/frame 0xfffffe00a2ffd9d0 sched_sync() at sched_sync+0x617/frame 0xfffffe00a2ffda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2ffdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2ffdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffff80007380000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006f2b8d0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006f2b900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f2b940 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f2b980 _sleep() at _sleep+0x279/frame 0xfffffe0006f2ba20 buf_daemon() at buf_daemon+0xc8/frame 0xfffffe0006f2ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f2bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f2bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100131 td 0xfffff800042c25a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ff08c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ff08f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ff0930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ff0970 _sleep() at _sleep+0x279/frame 0xfffffe0006ff0a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006ff0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ff0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ff0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100132 td 0xfffff800042c2000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ff58c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ff58f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ff5930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ff5970 _sleep() at _sleep+0x279/frame 0xfffffe0006ff5a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006ff5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ff5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ff5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100133 td 0xfffff800042c35a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ffa8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ffa8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ffa930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ffa970 _sleep() at _sleep+0x279/frame 0xfffffe0006ffaa10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006ffaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ffaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ffaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff800042c3000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006fff8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006fff8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006fff930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006fff970 _sleep() at _sleep+0x279/frame 0xfffffe0006fffa10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006fffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006fffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006fffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff800042c45a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a2f248c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00a2f248f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2f24930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a2f24970 _sleep() at _sleep+0x279/frame 0xfffffe00a2f24a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a2f24a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2f24ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2f24ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffff800042c4000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a2fa98c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00a2fa98f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2fa9930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a2fa9970 _sleep() at _sleep+0x279/frame 0xfffffe00a2fa9a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a2fa9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2fa9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2fa9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffff800045ba000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a2ff88c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00a2ff88f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2ff8930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a2ff8970 _sleep() at _sleep+0x279/frame 0xfffffe00a2ff8a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a2ff8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2ff8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2ff8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100151 td 0xfffff800073825a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aa7f68f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00aa7f6920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa7f6960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aa7f69a0 _sleep() at _sleep+0x279/frame 0xfffffe00aa7f6a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00aa7f6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00aa7f6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00aa7f6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100205 td 0xfffff80003edf5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac15c8f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac15c920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac15c960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00ac15c9a0 _sleep() at _sleep+0x279/frame 0xfffffe00ac15ca40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00ac15ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ac15cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ac15cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100242 td 0xfffff807bcb3b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae9318f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae931920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ae931960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00ae9319a0 _sleep() at _sleep+0x279/frame 0xfffffe00ae931a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00ae931a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ae931ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ae931ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100290 td 0xfffff802b3656000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae97c8f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae97c920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ae97c960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00ae97c9a0 _sleep() at _sleep+0x279/frame 0xfffffe00ae97ca40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00ae97ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ae97cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ae97cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 101153 td 0xfffff807f015c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ae98b8f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ae98b920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ae98b960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00ae98b9a0 _sleep() at _sleep+0x279/frame 0xfffffe00ae98ba40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00ae98ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ae98bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ae98bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 101154 td 0xfffff80238ae4000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aeacf8f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00aeacf920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aeacf960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aeacf9a0 _sleep() at _sleep+0x279/frame 0xfffffe00aeacfa40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00aeacfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00aeacfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00aeacfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100400 td 0xfffff803ea43b000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac35a8f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac35a920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac35a960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00ac35a9a0 _sleep() at _sleep+0x279/frame 0xfffffe00ac35aa40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00ac35aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ac35aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ac35aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 101155 td 0xfffff802fc7b9000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aeae38f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00aeae3920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aeae3960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aeae39a0 _sleep() at _sleep+0x279/frame 0xfffffe00aeae3a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00aeae3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00aeae3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00aeae3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 101156 td 0xfffff805300be000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aeae88f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00aeae8920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aeae8960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aeae89a0 _sleep() at _sleep+0x279/frame 0xfffffe00aeae8a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00aeae8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00aeae8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00aeae8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff8000413a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006f1a8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006f1a8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f1a930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f1a960 _sleep() at _sleep+0x2da/frame 0xfffffe0006f1aa00 vm_daemon() at vm_daemon+0xabf/frame 0xfffffe0006f1aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f1aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f1aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff80003fc6000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006f15520 mi_switch() at mi_switch+0x172/frame 0xfffffe0006f15550 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f15590 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f155d0 _sleep() at _sleep+0x279/frame 0xfffffe0006f15670 vm_pageout_worker() at vm_pageout_worker+0x26b/frame 0xfffffe0006f15a30 vm_pageout() at vm_pageout+0x176/frame 0xfffffe0006f15a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f15ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f15ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100134 td 0xfffff80003dc55a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a2fee6b0 mi_switch() at mi_switch+0x172/frame 0xfffffe00a2fee6e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2fee720 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a2fee750 _sleep() at _sleep+0x2da/frame 0xfffffe00a2fee7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xb9b/frame 0xfffffe00a2feea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2feeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2feeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100138 td 0xfffff80003dc5000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a2ff38f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00a2ff3920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2ff3960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a2ff39a0 _sleep() at _sleep+0x279/frame 0xfffffe00a2ff3a40 uma_reclaim_worker() at uma_reclaim_worker+0xda/frame 0xfffffe00a2ff3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2ff3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2ff3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff8000413d5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006f108b0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006f108e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f10920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f10950 _sleep() at _sleep+0x2da/frame 0xfffffe0006f109f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006f10a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f10ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f10ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff8000413c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006f0b8b0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006f0b8e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f0b920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f0b950 _sleep() at _sleep+0x2da/frame 0xfffffe0006f0b9f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006f0ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f0bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f0bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100120 td 0xfffff80003fb6000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006eed8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006eed8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006eed930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006eed970 _sleep() at _sleep+0x279/frame 0xfffffe0006eeda10 random_kthread() at random_kthread+0x26a/frame 0xfffffe0006eeda70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eedab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eedab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff80003fb65a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006edc910 mi_switch() at mi_switch+0x172/frame 0xfffffe0006edc940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006edc980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006edc9b0 _sleep() at _sleep+0x2da/frame 0xfffffe0006edca50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0006edca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006edcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006edcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff8000413c5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ecb8e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ecb910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ecb950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ecb990 _sleep() at _sleep+0x279/frame 0xfffffe0006ecba30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ecba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ecbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ecbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff8000413b000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ec68e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ec6910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ec6950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ec6990 _sleep() at _sleep+0x279/frame 0xfffffe0006ec6a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ec6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff8000413b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ec18e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ec1910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ec1950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ec1990 _sleep() at _sleep+0x279/frame 0xfffffe0006ec1a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ec1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff8000413a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ebc8e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ebc910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ebc950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ebc990 _sleep() at _sleep+0x279/frame 0xfffffe0006ebca30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ebca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ebcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ebcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff800037e75a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e45930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e45960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e459a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e459d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e45a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e45a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e45ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e45ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff800037e7000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e4a930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e4a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e4a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4a9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e4aa30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e4aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff800037e85a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e4f930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e4f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e4f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4f9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e4fa30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e4fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff800037e8000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e54930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e54960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e549a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e549d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e54a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e54a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e54ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e54ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff800037e95a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e59930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e59960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e599a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e599d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e59a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e59a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e59ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e59ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff800042c05a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e63930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e63960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e639a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e639d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e63a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e63a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e63ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e63ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff80006028000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e68930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e68960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e689a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e689d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e68a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e68a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e68ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e68ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff800060295a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e6d930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e6d960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e6d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e6d9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e6da30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e6da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e6dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e6dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff80006029000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e72930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e72960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e729a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e729d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e72a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e72a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e72ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e72ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff8000602a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e77930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e77960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e779a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e779d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e77a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e77a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e77ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e77ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff800060c05a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e94930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e94960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e949d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e94a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e94a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e94ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e94ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff800060c0000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e99930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e99960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e999d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e99a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e99a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e99ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e99ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff800060c15a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e9e930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e9e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e9e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e9e9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e9ea30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e9ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e9eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e9eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff800060c1000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ea3930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ea3960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ea39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ea39d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006ea3a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006ea3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff800060c25a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ea8930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ea8960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ea89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ea89d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006ea8a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006ea8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff800042c0000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e2c8e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e2c910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e2c950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e2c980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e2ca20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e2ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e2cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff800042c15a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e318e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e31910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e31950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e31980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e31a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e31a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e31ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff800042c1000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e368e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e36910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e36950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e36980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e36a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e36a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e36ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff80003fc65a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006f068d0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006f06900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f06940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f06970 _sleep() at _sleep+0x2da/frame 0xfffffe0006f06a10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe0006f06a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f06ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f06ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffff800042395a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e278c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e278f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e27930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e27960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e27a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e27a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e27ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e27ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffff8000422d000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e228c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e228f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e22930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e22960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e22a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e22a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e22ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e22ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffff8000422d5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e1d8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e1d8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e1d930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e1d960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e1da00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e1dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffff8000422c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e188c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e188f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e18930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e18960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e18a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e18a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e18ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffff8000422c5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e138c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e138f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e13930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e13960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e13a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e13a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e13ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffff8000422b000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e0e8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e0e8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e0e930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e0e960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e0ea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e0ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e0eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffff8000422b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e098c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e098f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e09930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e09960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e09a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e09ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffff8000422a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e048c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e048f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e04930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e04960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e04a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e04a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e04ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffff8000422a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005fd8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00005fd8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005fd930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005fd960 _sleep() at _sleep+0x2da/frame 0xfffffe00005fda00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffff8000423d000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005f88c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00005f88f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005f8930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f8960 _sleep() at _sleep+0x2da/frame 0xfffffe00005f8a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffff8000423d5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005f38c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00005f38f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005f3930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f3960 _sleep() at _sleep+0x2da/frame 0xfffffe00005f3a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffff8000423c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005ee8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00005ee8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ee930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ee960 _sleep() at _sleep+0x2da/frame 0xfffffe00005eea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffff8000423c5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005e98f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00005e9920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005e9960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e9990 _sleep() at _sleep+0x2da/frame 0xfffffe00005e9a30 crypto_proc() at crypto_proc+0x2c4/frame 0xfffffe00005e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffff800039dd000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005a88f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00005a8920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005a8960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a8990 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005a89f0 seq_eventthread() at seq_eventthread+0xdc/frame 0xfffffe00005a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff80003a7f5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000058d8f0 mi_switch() at mi_switch+0x172/frame 0xfffffe000058d920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000058d960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000058d990 _sleep() at _sleep+0x2da/frame 0xfffffe000058da30 g_run_events() at g_run_events+0x4f/frame 0xfffffe000058da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff80003a7f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005928f0 mi_switch() at mi_switch+0x172/frame 0xfffffe0000592920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000592960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000592990 _sleep() at _sleep+0x2da/frame 0xfffffe0000592a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0000592a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe0000592a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000592ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000592ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffff800039dd5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005978f0 mi_switch() at mi_switch+0x172/frame 0xfffffe0000597920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000597960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000597990 _sleep() at _sleep+0x2da/frame 0xfffffe0000597a30 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe0000597a60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe0000597a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000597ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000597ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100015 td 0xfffff8000379e000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767ae9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe00767aea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00767aea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767aeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767aeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100016 td 0xfffff8000379f5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767b39e0 mi_switch() at mi_switch+0x172/frame 0xfffffe00767b3a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00767b3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767b3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767b3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100018 td 0xfffff800037ad5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff80003a92000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004ee9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe00004eea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00004eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff80003a935a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff80003a93000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff80003a945a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff80003a94000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff80003aa25a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff80003aa2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff8000387f5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff80003a7b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff80003a7c5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff80003a7c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff80003a7d5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff80003a7d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffff80003a7e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000052f9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe000052fa10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe000052fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000052fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000052fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffff800037e65a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e3b9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e3ba10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e3ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e3bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e3bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff800037e6000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e409e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e40a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e40a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e40ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e40ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff800037e9000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e5e9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e5ea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e5ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e5eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e5eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff800060c2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff800060cc5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006eb29e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006eb2a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006eb2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100180 td 0xfffff80025300000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffff800253075a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffff80025307000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffff800253045a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffff80025304000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffff800252fd5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffff800252fd000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffff80007dd6000 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff800037ae000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0076766970 mi_switch() at mi_switch+0x172/frame 0xfffffe00767669a0 sched_idletd() at sched_idletd+0x490/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800037af5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe007676b970 mi_switch() at mi_switch+0x172/frame 0xfffffe007676b9a0 sched_idletd() at sched_idletd+0x490/frame 0xfffffe007676ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007676bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007676bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800037af000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0076770970 mi_switch() at mi_switch+0x172/frame 0xfffffe00767709a0 sched_idletd() at sched_idletd+0x490/frame 0xfffffe0076770a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076770ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076770ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800037b05a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0076775970 mi_switch() at mi_switch+0x172/frame 0xfffffe00767759a0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe0076775a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076775ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076775ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800037b0000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe007677a970 mi_switch() at mi_switch+0x172/frame 0xfffffe007677a9a0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe007677aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800037b15a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe007677f970 mi_switch() at mi_switch+0x172/frame 0xfffffe007677f9a0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe007677fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800037b1000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0076784970 mi_switch() at mi_switch+0x172/frame 0xfffffe00767849a0 sched_idletd() at sched_idletd+0x490/frame 0xfffffe0076784a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076784ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076784ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff8000379c5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0076789970 mi_switch() at mi_switch+0x172/frame 0xfffffe00767899a0 sched_idletd() at sched_idletd+0x490/frame 0xfffffe0076789a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076789ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076789ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff8000379c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe007678e970 mi_switch() at mi_switch+0x172/frame 0xfffffe007678e9a0 sched_idletd() at sched_idletd+0x490/frame 0xfffffe007678ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007678eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007678eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff8000379d5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0076793970 mi_switch() at mi_switch+0x172/frame 0xfffffe00767939a0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe0076793a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076793ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076793ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000379d000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0076798970 mi_switch() at mi_switch+0x172/frame 0xfffffe00767989a0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe0076798a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076798ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076798ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000379e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe007679d970 mi_switch() at mi_switch+0x172/frame 0xfffffe007679d9a0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe007679da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007679dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007679dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800037ae5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0076761560 mi_switch() at mi_switch+0x172/frame 0xfffffe0076761590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767615d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe0076761630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0076761660 _sleep() at _sleep+0x2d0/frame 0xfffffe0076761700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe0076761790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0076761980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe0076761ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0076761ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b0f8a, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffff800037ad000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe007675c910 mi_switch() at mi_switch+0x172/frame 0xfffffe007675c940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe007675c980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe007675c9b0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe007675ca10 audit_worker() at audit_worker+0x93/frame 0xfffffe007675ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007675cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007675cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81fb9640 sched_switch() at sched_switch+0x3f0/frame 0xffffffff82721980 mi_switch() at mi_switch+0x172/frame 0xffffffff827219b0 sleepq_switch() at sleepq_switch+0x110/frame 0xffffffff827219f0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xffffffff82721a30 _sleep() at _sleep+0x279/frame 0xffffffff82721ad0 swapper() at swapper+0x77/frame 0xffffffff82721b20 mi_startup() at mi_startup+0x2ee/frame 0xffffffff82721b70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100017 td 0xfffff8000379f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767b8900 mi_switch() at mi_switch+0x172/frame 0xfffffe00767b8930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767b8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767b89a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767b8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767b8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767b8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767b8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff80003756000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767c2930 mi_switch() at mi_switch+0x172/frame 0xfffffe00767c2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767c29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767c29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00767c2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00767c2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767c2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767c2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff800037575a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767c7900 mi_switch() at mi_switch+0x172/frame 0xfffffe00767c7930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767c7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767c79a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767c7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767c7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767c7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767c7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff80003757000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767cc900 mi_switch() at mi_switch+0x172/frame 0xfffffe00767cc930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767cc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767cc9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767cca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767cca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767ccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767ccab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff800037585a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000471930 mi_switch() at mi_switch+0x172/frame 0xfffffe0000471960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004719a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004719d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000471a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000471a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000471ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000471ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff80003758000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000476930 mi_switch() at mi_switch+0x172/frame 0xfffffe0000476960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004769a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004769d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000476a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000476a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000476ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000476ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff800037595a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000047b930 mi_switch() at mi_switch+0x172/frame 0xfffffe000047b960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000047b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000047b9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000047ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000047ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000047bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000047bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003759000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000480930 mi_switch() at mi_switch+0x172/frame 0xfffffe0000480960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004809a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004809d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000480a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000480a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000480ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000480ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff8000375a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000485930 mi_switch() at mi_switch+0x172/frame 0xfffffe0000485960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004859a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004859d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000485a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000485a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000485ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000485ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff8000375a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000048a930 mi_switch() at mi_switch+0x172/frame 0xfffffe000048a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000048a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048a9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000048aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff800037215a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000048f930 mi_switch() at mi_switch+0x172/frame 0xfffffe000048f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000048f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048f9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000048fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003721000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000494930 mi_switch() at mi_switch+0x172/frame 0xfffffe0000494960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004949d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000494a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000494a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000494ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000494ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff800037225a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000499930 mi_switch() at mi_switch+0x172/frame 0xfffffe0000499960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004999d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000499a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000499a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000499ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000499ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003722000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000049e930 mi_switch() at mi_switch+0x172/frame 0xfffffe000049e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000049e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000049e9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000049ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000049ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000049eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000049eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff800037235a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004a3930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004a3960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004a39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a39d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004a3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80003723000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004a8930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004a8960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004a89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a89d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004a8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff800037245a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004ad930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004ad960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004ad9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004ad9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004ada40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff80003724000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004b2930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004b2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004b29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004b2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff800037565a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004b7930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004b7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004b79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004b7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff8000387f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004bc930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004bc960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004bc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004bc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004bca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800038805a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004c1930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004c1960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004c19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c19d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004c1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80003880000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004c6930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004c6960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004c69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c69d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004c6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800038815a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004cb930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004cb960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004cb9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004cb9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004cba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff80003881000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004d0930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004d0960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004d09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d09d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004d0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff800038825a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004d5930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004d5960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004d59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d59d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004d5a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff80003882000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004da930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004da960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004da9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004da9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004daa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff800038905a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004df930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004df960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004df9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004df9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004dfa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff80003890000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004e4930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004e4960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004e49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e49d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004e4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff80003a925a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004e9930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004e9960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004e99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e99d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004e9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80003a7e000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000588900 mi_switch() at mi_switch+0x172/frame 0xfffffe0000588930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000588970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005889a0 _sleep() at _sleep+0x2da/frame 0xfffffe0000588a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000588a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000588ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000588ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff800039de5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005ad900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005ad930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ad970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ad9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005ada40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff800039de000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005b2900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005b2930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005b2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b29a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005b2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff800039df5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005b7900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005b7930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005b7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b79a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005b7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff800039df000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005bc900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005bc930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005bc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005bc9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005bca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff800039e05a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005c1900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005c1930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005c1970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c19a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005c1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff800039e0000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005c6900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005c6930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005c6970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c69a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005c6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff80003a7b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005cb900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005cb930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005cb970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005cb9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005cba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80004239000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005d0900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005d0930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005d0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d09a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff8000423a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005d5900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005d5930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005d5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d59a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff8000423a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005da900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005da930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005da970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005da9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005daa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff8000423b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005df900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005df930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005df970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005df9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005dfa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff8000423b000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005e4900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005e4930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005e4970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e49a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005e4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff800060cc000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006eb7930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006eb7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006eb79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eb79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006eb7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006eb7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff80003fb75a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ef2930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ef2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ef29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ef29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006ef2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ef2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ef2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ef2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff80003fb7000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ef7930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ef7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ef79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ef79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006ef7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ef7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ef7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ef7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffff80003fb85a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006efc930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006efc960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006efc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006efc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006efca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006efca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006efcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006efcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff80003fb8000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006f01900 mi_switch() at mi_switch+0x172/frame 0xfffffe0006f01930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f01970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f019a0 _sleep() at _sleep+0x2da/frame 0xfffffe0006f01a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0006f01a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f01ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f01ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 1698 out of 32622 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db> (kgdb) bt #0 doadump (textdump=0x0) at include/pcpu_aux.h:55 #1 0xffffffff804a1eab in db_dump (dummy=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #2 0xffffffff804a1c79 in db_command (cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #3 0xffffffff804a6be8 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #4 0xffffffff804a1c79 in db_command (cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:482 #5 0xffffffff804a19f4 in db_command_loop () at ../../../ddb/db_command.c:535 #6 0xffffffff804a4b9f in db_trap (type=, code=) at ../../../ddb/db_main.c:252 #7 0xffffffff80c213cc in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:692 #8 0xffffffff811a451f in trap (frame=0xfffffe00ae85e360) at ../../../amd64/amd64/trap.c:621 #9 0xffffffff8117b6ac in calltrap () at ../../../amd64/amd64/exception.S:289 #10 0xffffffff80c20adb in kdb_enter (why=0xffffffff81350022 "panic", msg=) at include/cpufunc.h:65 #11 0xffffffff80bd5e4a in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:894 #12 0xffffffff80bd5bc3 in panic (fmt=) at ../../../kern/kern_shutdown.c:832 #13 0xffffffff80cb2ff5 in vref (vp=0xfffff80007280000) at ../../../kern/vfs_subr.c:2819 #14 0xffffffff80c99916 in vn_vptocnp (vp=0xfffffe00ae85e6e8, cred=0xfffff80003d03000, buf=0xfffff800075c1000 ""..., buflen=0xfffffe00ae85e6cc) at ../../../kern/vfs_cache.c:2289 #15 0xffffffff80c98f0d in vn_fullpath1 (td=0xfffff8021af6c5a0, vp=0xfffff80007280000, rdir=0xfffff80003716768, buf=0xfffff800075c1000 ""..., retbuf=0xfffffe00ae85e7f0, buflen=0x3f3) at ../../../kern/vfs_cache.c:2343 #16 0xffffffff80c99588 in vn_fullpath (td=0xfffff8021af6c5a0, vn=0xfffff8000392c000, retbuf=0xfffffe00ae85e7f0, freebuf=0xfffffe00ae85e7e0) at ../../../kern/vfs_cache.c:2223 #17 0xffffffff82628d18 in pmc_hook_handler (td=0xfffff8021af6c5a0, function=, arg=0xfffffe00ae85e840) at /usr/src/sys/dev/hwpmc/hwpmc_mod.c:833 #18 0xffffffff80cc9fc5 in vn_mmap (fp=, map=, addr=0xfffffe00ae85e918, size=0xb000, prot=, cap_maxprot=, flags=, foff=, td=0xfffff8021af6c5a0) at ../../../kern/vfs_vnops.c:2514 #19 0xffffffff80f2977c in kern_mmap (td=, addr0=, len=, prot=0x5, flags=, fd=, pos=0x8000) at file.h:418 #20 0xffffffff80f2926a in sys_mmap (td=, uap=) at ../../../vm/vm_mmap.c:181 #21 0xffffffff811a54b4 in amd64_syscall (td=0xfffff8021af6c5a0, traced=0x0) at subr_syscall.c:144 #22 0xffffffff8117bfd0 in fast_syscall_common () at ../../../amd64/amd64/exception.S:581 #23 0x000000080021e1da in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xffffffff80cb2ff5 in vref (vp=0xfffff80007280000) at ../../../kern/vfs_subr.c:2819 2819 VNASSERT((vp->v_iflag & VI_OWEINACT) == 0, vp, (kgdb) l 2814 if (vp->v_type != VCHR && 2815 refcount_acquire_if_not_zero(&vp->v_usecount)) { 2816 VNODE_REFCOUNT_FENCE_ACQ(); 2817 VNASSERT(vp->v_holdcnt > 0, vp, 2818 ("%s: active vnode not held", __func__)); 2819 VNASSERT((vp->v_iflag & VI_OWEINACT) == 0, vp, 2820 ("%s: vnode with usecount and VI_OWEINACT set", __func__)); 2821 return; 2822 } 2823 VI_LOCK(vp); (kgdb) info loc No locals. (kgdb) p *vp $1 = {v_tag = 0xffffffff8126c233 "ufs", v_op = 0xffffffff81b58338, v_data = 0xfffff80007626c80, v_mount = 0xfffff80003718000, v_nmntvnodes = {tqe_next = 0xfffff80007281c58, tqe_prev = 0xfffff80007280510}, {v_mountedhere = 0x0, v_unpcb = 0x0, v_rdev = 0x0, v_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xfffffe009b3bedf8}, v_cache_src = {lh_first = 0xfffff80007ab70e0}, v_cache_dst = {tqh_first = 0xfffff8000762b540, tqh_last = 0xfffff8000762b560}, v_cache_dd = 0xfffff8000762b540, v_lock = {lock_object = { lo_name = 0xffffffff8126c233 "ufs", lo_flags = 0x6fb0000, lo_data = 0x0, lo_witness = 0xfffff8087fd78880}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0xf, pcs = 0xfffff800072800a0}}, v_interlock = {lock_object = { lo_name = 0xffffffff81395783 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd6b600}, mtx_lock = 0x0}, v_vnlock = 0xfffff80007280068, v_actfreelist = {tqe_next = 0xfffff800072804f0, tqe_prev = 0xfffff80007281db0}, v_bufobj = { bo_lock = {lock_object = {lo_name = 0xffffffff81355ac1 "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffff8087fd75a00}, rw_lock = 0x1}, bo_ops = 0xffffffff81b1db40, bo_object = 0xfffff800060bea00, bo_synclist = {le_next = 0x0, le_prev = 0x0}, bo_private = 0xfffff80007280000, bo_clean = {bv_hd = {tqh_first = 0xfffffe000080a548, tqh_last = 0xfffffe000080a5a8}, bv_root = {pt_root = 0xfffffe000080a6b1}, bv_cnt = 0x1}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff800072801d0}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_domain = 0x6, bo_bsize = 0x8000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffff80007280220}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x4, v_usecount = 0x1, v_iflag = 0x200, v_vflag = 0x0, v_mflag = 0x0, v_writecount = 0x0, v_hash = 0x35bad00, v_type = VDIR} (kgdb) f 14 #14 0xffffffff80c99916 in vn_vptocnp (vp=0xfffffe00ae85e6e8, cred=0xfffff80003d03000, buf=0xfffff800075c1000 ""..., buflen=0xfffffe00ae85e6cc) at ../../../kern/vfs_cache.c:2289 2289 vref(*vp); (kgdb) l 2284 memcpy(buf + *buflen, ncp->nc_name, ncp->nc_nlen); 2285 SDT_PROBE3(vfs, namecache, fullpath, hit, ncp->nc_dvp, 2286 ncp->nc_name, vp); 2287 dvp = *vp; 2288 *vp = ncp->nc_dvp; 2289 vref(*vp); 2290 mtx_unlock(vlp); 2291 vrele(dvp); 2292 return (0); 2293 } (kgdb) info loc dvp = (struct vnode *) 0xfffff8000392c000 ncp = (struct namecache *) 0xfffff800074d6c40 vlp = (struct mtx *) 0xfffffe009a64e800 error = 0x66 (kgdb) p *ncp $1 = {nc_hash = {le_next = 0x0, le_prev = 0xfffffe009b8365b0}, nc_src = {le_next = 0xfffff800074d6a10, le_prev = 0xfffff8000762ce10}, nc_dst = {tqe_next = 0x0, tqe_prev = 0xfffff8000392c050}, nc_dvp = 0xfffff80007280000, n_un = {nu_vp = 0xfffff8000392c000, nu_neghits = 0x392c000}, nc_flag = 0x0, nc_nlen = 0xc, nc_name = 0xfffff800074d6c82 "libutil.so.9"} (kgdb) Index: src/sys/cddl/contrib/opensolaris/uts/common/fs/vnode.c =================================================================== --- src/sys/cddl/contrib/opensolaris/uts/common/fs/vnode.c (revision 351623) +++ src/sys/cddl/contrib/opensolaris/uts/common/fs/vnode.c (working copy) @@ -87,7 +87,6 @@ vn_rele_async(vnode_t *vp, taskq_t *taskq) { VERIFY(vp->v_count > 0); if (refcount_release_if_not_last(&vp->v_usecount)) { - vdrop(vp); return; } VERIFY(taskq_dispatch((taskq_t *)taskq, Index: src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_ctldir.c =================================================================== --- src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_ctldir.c (revision 351623) +++ src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_ctldir.c (working copy) @@ -1196,7 +1196,7 @@ zfsctl_snapshot_vptocnp(struct vop_vptocnp_args *a vnode_t *vp; sfs_node_t *node; size_t len; - int locked; + int locked, vget_flags; int error; vp = ap->a_vp; @@ -1224,7 +1224,7 @@ zfsctl_snapshot_vptocnp(struct vop_vptocnp_args *a * before we can lock the vnode again. */ locked = VOP_ISLOCKED(vp); - vhold(vp); + vget_flags = vget_prep(vp); vput(vp); /* Look up .zfs/snapshot, our parent. */ @@ -1236,7 +1236,7 @@ zfsctl_snapshot_vptocnp(struct vop_vptocnp_args *a bcopy(node->sn_name, ap->a_buf + *ap->a_buflen, len); } vfs_unbusy(mp); - vget(vp, locked | LK_VNHELD | LK_RETRY, curthread); + vget(vp, vget_flags | locked | LK_RETRY, curthread); return (error); } Index: src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c =================================================================== --- src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c (revision 351623) +++ src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c (working copy) @@ -5916,7 +5916,7 @@ zfs_vptocnp(struct vop_vptocnp_args *ap) vnode_t *vp = ap->a_vp;; zfsvfs_t *zfsvfs = vp->v_vfsp->vfs_data; znode_t *zp = VTOZ(vp); - int ltype; + int ltype, vget_flags; int error; ZFS_ENTER(zfsvfs); @@ -5948,10 +5948,10 @@ zfs_vptocnp(struct vop_vptocnp_args *ap) ZFS_EXIT(zfsvfs); covered_vp = vp->v_mount->mnt_vnodecovered; - vhold(covered_vp); + vget_flags = vget_prep(covered_vp); ltype = VOP_ISLOCKED(vp); VOP_UNLOCK(vp, 0); - error = vget(covered_vp, LK_SHARED | LK_VNHELD, curthread); + error = vget_finish(covered_vp, vget_flags | LK_SHARED); if (error == 0) { error = VOP_VPTOCNP(covered_vp, ap->a_vpp, ap->a_cred, ap->a_buf, ap->a_buflen); Index: src/sys/kern/vfs_cache.c =================================================================== --- src/sys/kern/vfs_cache.c (revision 351623) +++ src/sys/kern/vfs_cache.c (working copy) @@ -1255,7 +1255,7 @@ cache_lookup(struct vnode *dvp, struct vnode **vpp struct rwlock *blp; struct mtx *dvlp; uint32_t hash; - int error, ltype; + int error, ltype, vget_flags; if (__predict_false(!doingcache)) { cnp->cn_flags &= ~MAKEENTRY; @@ -1369,9 +1369,9 @@ success: ltype = VOP_ISLOCKED(dvp); VOP_UNLOCK(dvp, 0); } - vhold(*vpp); + vget_flags = vget_prep(*vpp); cache_lookup_unlock(blp, dvlp); - error = vget(*vpp, cnp->cn_lkflags | LK_VNHELD, cnp->cn_thread); + error = vget_finish(*vpp, vget_flags | cnp->cn_lkflags); if (cnp->cn_flags & ISDOTDOT) { vn_lock(dvp, ltype | LK_RETRY); if (dvp->v_iflag & VI_DOOMED) { @@ -2430,6 +2430,7 @@ vn_dir_dd_ino(struct vnode *vp) struct namecache *ncp; struct vnode *ddvp; struct mtx *vlp; + int vget_flags; ASSERT_VOP_LOCKED(vp, "vn_dir_dd_ino"); vlp = VP2VNODELOCK(vp); @@ -2438,9 +2439,9 @@ vn_dir_dd_ino(struct vnode *vp) if ((ncp->nc_flag & NCF_ISDOTDOT) != 0) continue; ddvp = ncp->nc_dvp; - vhold(ddvp); + vget_flags = vget_prep(ddvp); mtx_unlock(vlp); - if (vget(ddvp, LK_SHARED | LK_NOWAIT | LK_VNHELD, curthread)) + if (vget_finish(ddvp, vget_flags | LK_SHARED | LK_NOWAIT)) return (NULL); return (ddvp); } Index: src/sys/kern/vfs_hash.c =================================================================== --- src/sys/kern/vfs_hash.c (revision 351623) +++ src/sys/kern/vfs_hash.c (working copy) @@ -76,7 +76,7 @@ vfs_hash_get(const struct mount *mp, u_int hash, i struct vnode **vpp, vfs_hash_cmp_t *fn, void *arg) { struct vnode *vp; - int error; + int error, vget_flags; while (1) { rw_rlock(&vfs_hash_lock); @@ -87,9 +87,9 @@ vfs_hash_get(const struct mount *mp, u_int hash, i continue; if (fn != NULL && fn(vp, arg)) continue; - vhold(vp); + vget_flags = vget_prep(vp); rw_runlock(&vfs_hash_lock); - error = vget(vp, flags | LK_VNHELD, td); + error = vget_finish(vp, vget_flags | flags); if (error == ENOENT && (flags & LK_NOWAIT) == 0) break; if (error) @@ -149,7 +149,7 @@ vfs_hash_insert(struct vnode *vp, u_int hash, int struct vnode **vpp, vfs_hash_cmp_t *fn, void *arg) { struct vnode *vp2; - int error; + int error, vget_flags; *vpp = NULL; while (1) { @@ -162,9 +162,9 @@ vfs_hash_insert(struct vnode *vp, u_int hash, int continue; if (fn != NULL && fn(vp2, arg)) continue; - vhold(vp2); + vget_flags = vget_prep(vp2); rw_wunlock(&vfs_hash_lock); - error = vget(vp2, flags | LK_VNHELD, td); + error = vget_finish(vp2, vget_flags | flags); if (error == ENOENT && (flags & LK_NOWAIT) == 0) break; rw_wlock(&vfs_hash_lock); Index: src/sys/kern/vfs_subr.c =================================================================== --- src/sys/kern/vfs_subr.c (revision 351623) +++ src/sys/kern/vfs_subr.c (working copy) @@ -107,8 +107,6 @@ static int flushbuflist(struct bufv *bufv, int fla static void syncer_shutdown(void *arg, int howto); static int vtryrecycle(struct vnode *vp); static void v_init_counters(struct vnode *); -static void v_incr_usecount(struct vnode *); -static void v_incr_usecount_locked(struct vnode *); static void v_incr_devcount(struct vnode *); static void v_decr_devcount(struct vnode *); static void vgonel(struct vnode *); @@ -2632,44 +2630,7 @@ v_init_counters(struct vnode *vp) refcount_init(&vp->v_usecount, 1); } -static void -v_incr_usecount_locked(struct vnode *vp) -{ - - ASSERT_VI_LOCKED(vp, __func__); - if ((vp->v_iflag & VI_OWEINACT) != 0) { - VNASSERT(vp->v_usecount == 0, vp, - ("vnode with usecount and VI_OWEINACT set")); - vp->v_iflag &= ~VI_OWEINACT; - } - refcount_acquire(&vp->v_usecount); - v_incr_devcount(vp); -} - /* - * Increment the use count on the vnode, taking care to reference - * the driver's usecount if this is a chardev. - */ -static void -v_incr_usecount(struct vnode *vp) -{ - - ASSERT_VI_UNLOCKED(vp, __func__); - CTR2(KTR_VFS, "%s: vp %p", __func__, vp); - - if (vp->v_type != VCHR && - refcount_acquire_if_not_zero(&vp->v_usecount)) { - VNODE_REFCOUNT_FENCE_ACQ(); - VNASSERT((vp->v_iflag & VI_OWEINACT) == 0, vp, - ("vnode with usecount and VI_OWEINACT set")); - } else { - VI_LOCK(vp); - v_incr_usecount_locked(vp); - VI_UNLOCK(vp); - } -} - -/* * Increment si_usecount of the associated device, if any. */ static void @@ -2713,36 +2674,107 @@ v_decr_devcount(struct vnode *vp) * with atomic operations. Otherwise the interlock is taken covering * both the atomic and additional actions. */ +static int +_vget_prep(struct vnode *vp, bool interlock) +{ + int rv; + + if (__predict_true(vp->v_type != VCHR)) { + if (refcount_acquire_if_not_zero(&vp->v_usecount)) { + rv = LK_VNUSED; + } else { + _vhold(vp, interlock); + rv = LK_VNHELD; + } + } else { + if (!interlock) { + VI_LOCK(vp); + interlock = true; + } + if (vp->v_usecount == 0) { + vholdl(vp); + rv = LK_VNHELD; + } else { + v_incr_devcount(vp); + refcount_acquire(&vp->v_usecount); + rv = LK_VNUSED; + } + } + if (interlock) + VI_UNLOCK(vp); + return (rv); +} + int +vget_prep(struct vnode *vp) +{ + + return (_vget_prep(vp, false)); +} + +int vget(struct vnode *vp, int flags, struct thread *td) { - int error, oweinact; - VNASSERT((flags & LK_TYPE_MASK) != 0, vp, - ("vget: invalid lock operation")); + MPASS(td == curthread); - if ((flags & LK_INTERLOCK) != 0) - ASSERT_VI_LOCKED(vp, __func__); - else - ASSERT_VI_UNLOCKED(vp, __func__); - if ((flags & LK_VNHELD) != 0) - VNASSERT((vp->v_holdcnt > 0), vp, - ("vget: LK_VNHELD passed but vnode not held")); + flags |= _vget_prep(vp, (flags & LK_INTERLOCK) != 0); + return (vget_finish(vp, flags & ~LK_INTERLOCK)); +} - CTR3(KTR_VFS, "%s: vp %p with flags %d", __func__, vp, flags); +int +vget_finish(struct vnode *vp, int flags) +{ + int error, oweinact; - if ((flags & LK_VNHELD) == 0) - _vhold(vp, (flags & LK_INTERLOCK) != 0); + VNASSERT((flags & LK_TYPE_MASK) != 0, vp, + ("%s: invalid lock operation", __func__)); + KASSERT(((flags & LK_INTERLOCK) == 0), + ("%s: LK_INTERLOCK passed\n", __func__)); + ASSERT_VI_UNLOCKED(vp, __func__); + VNASSERT(vp->v_holdcnt > 0, vp, ("%s: vnode not held", __func__)); + if (flags & LK_VNUSED) { + VNASSERT(vp->v_usecount > 0, vp, + ("%s: vnode without usecount when LK_VNUSED was set", + __func__)); + } if ((error = vn_lock(vp, flags)) != 0) { - vdrop(vp); + if (flags & LK_VNUSED) + vrele(vp); + else + vdrop(vp); CTR2(KTR_VFS, "%s: impossible to lock vnode %p", __func__, vp); return (error); } - if (vp->v_iflag & VI_DOOMED && (flags & LK_RETRY) == 0) - panic("vget: vn_lock failed to return ENOENT\n"); + + if (flags & LK_VNUSED) { + VNASSERT((vp->v_iflag & VI_OWEINACT) == 0, vp, + ("%s: vnode with usecount and VI_OWEINACT set", __func__)); + return (0); + } + /* + * We hold the vnode. If the usecount is 0 it will be utilized to keep + * the vnode around. Otherwise someone else lended their hold count and + * we have to drop ours. + */ + if (vp->v_type != VCHR && + refcount_acquire_if_not_zero(&vp->v_usecount)) { +#ifdef INVARIANTS + int old = atomic_fetchadd_int(&vp->v_holdcnt, -1) - 1; + VNASSERT(old > 0, vp, ("%s: wrong hold count", __func__)); +#else + refcount_release(&vp->v_holdcnt); +#endif + VNODE_REFCOUNT_FENCE_ACQ(); + VNASSERT((vp->v_iflag & VI_OWEINACT) == 0, vp, + ("%s: vnode with usecount and VI_OWEINACT set", __func__)); + return (0); + } + + /* * We don't guarantee that any particular close will * trigger inactive processing so just make a best effort * here at preventing a reference to a removed file. If @@ -2750,23 +2782,22 @@ vget(struct vnode *vp, int flags, struct thread *t * * Upgrade our holdcnt to a usecount. */ - if (vp->v_type == VCHR || - !refcount_acquire_if_not_zero(&vp->v_usecount)) { - VI_LOCK(vp); - if ((vp->v_iflag & VI_OWEINACT) == 0) { - oweinact = 0; - } else { - oweinact = 1; - vp->v_iflag &= ~VI_OWEINACT; - VNODE_REFCOUNT_FENCE_REL(); - } - refcount_acquire(&vp->v_usecount); - v_incr_devcount(vp); - if (oweinact && VOP_ISLOCKED(vp) == LK_EXCLUSIVE && - (flags & LK_NOWAIT) == 0) - vinactive(vp, td); - VI_UNLOCK(vp); + VI_LOCK(vp); + if ((vp->v_iflag & VI_OWEINACT) == 0) { + oweinact = 0; + } else { + oweinact = 1; + vp->v_iflag &= ~VI_OWEINACT; + VNODE_REFCOUNT_FENCE_REL(); } + if (vp->v_usecount > 0) + refcount_release(&vp->v_holdcnt); + v_incr_devcount(vp); + refcount_acquire(&vp->v_usecount); + if (oweinact && VOP_ISLOCKED(vp) == LK_EXCLUSIVE && + (flags & LK_NOWAIT) == 0) + vinactive(vp, curthread); + VI_UNLOCK(vp); return (0); } @@ -2780,8 +2811,18 @@ vref(struct vnode *vp) ASSERT_VI_UNLOCKED(vp, __func__); CTR2(KTR_VFS, "%s: vp %p", __func__, vp); - _vhold(vp, false); - v_incr_usecount(vp); + if (vp->v_type != VCHR && + refcount_acquire_if_not_zero(&vp->v_usecount)) { + VNODE_REFCOUNT_FENCE_ACQ(); + VNASSERT(vp->v_holdcnt > 0, vp, + ("%s: active vnode not held", __func__)); + VNASSERT((vp->v_iflag & VI_OWEINACT) == 0, vp, + ("%s: vnode with usecount and VI_OWEINACT set", __func__)); + return; + } + VI_LOCK(vp); + vrefl(vp); + VI_UNLOCK(vp); } void @@ -2790,8 +2831,12 @@ vrefl(struct vnode *vp) ASSERT_VI_LOCKED(vp, __func__); CTR2(KTR_VFS, "%s: vp %p", __func__, vp); - _vhold(vp, true); - v_incr_usecount_locked(vp); + if (vp->v_usecount == 0) + vholdl(vp); + v_incr_devcount(vp); + refcount_acquire(&vp->v_usecount); + if ((vp->v_iflag & VI_OWEINACT) != 0) + vp->v_iflag &= ~VI_OWEINACT; } void @@ -2806,12 +2851,9 @@ vrefact(struct vnode *vp) return; } #ifdef INVARIANTS - int old = atomic_fetchadd_int(&vp->v_holdcnt, 1); - VNASSERT(old > 0, vp, ("%s: wrong hold count", __func__)); - old = atomic_fetchadd_int(&vp->v_usecount, 1); + int old = atomic_fetchadd_int(&vp->v_usecount, 1); VNASSERT(old > 0, vp, ("%s: wrong use count", __func__)); #else - refcount_acquire(&vp->v_holdcnt); refcount_acquire(&vp->v_usecount); #endif } @@ -2856,16 +2898,14 @@ vputx(struct vnode *vp, int func) ASSERT_VI_UNLOCKED(vp, __func__); VNASSERT(vp->v_holdcnt > 0 && vp->v_usecount > 0, vp, ("%s: wrong ref counts", __func__)); - CTR2(KTR_VFS, "%s: vp %p", __func__, vp); + if (func == VPUTX_VPUT) + VOP_UNLOCK(vp, 0); + if (vp->v_type != VCHR && - refcount_release_if_not_last(&vp->v_usecount)) { - if (func == VPUTX_VPUT) - VOP_UNLOCK(vp, 0); - vdrop(vp); + refcount_release_if_not_last(&vp->v_usecount)) return; - } VI_LOCK(vp); @@ -2874,17 +2914,16 @@ vputx(struct vnode *vp, int func) * prevent vgone() races. We drop the use count here and the * hold count below when we're done. */ - if (!refcount_release(&vp->v_usecount) || - (vp->v_iflag & VI_DOINGINACT)) { - if (func == VPUTX_VPUT) - VOP_UNLOCK(vp, 0); - v_decr_devcount(vp); + v_decr_devcount(vp); + if (!refcount_release(&vp->v_usecount)) { + VI_UNLOCK(vp); + return; + } + if (vp->v_iflag & VI_DOINGINACT) { vdropl(vp); return; } - v_decr_devcount(vp); - error = 0; if (vp->v_usecount != 0) { @@ -2903,8 +2942,6 @@ vputx(struct vnode *vp, int func) */ if (__predict_false(vp->v_iflag & VI_DOOMED) || VOP_NEED_INACTIVE(vp) == 0) { - if (func == VPUTX_VPUT) - VOP_UNLOCK(vp, 0); vdropl(vp); return; } @@ -2920,11 +2957,8 @@ vputx(struct vnode *vp, int func) VI_LOCK(vp); break; case VPUTX_VPUT: - if (VOP_ISLOCKED(vp) != LK_EXCLUSIVE) { - error = VOP_LOCK(vp, LK_UPGRADE | LK_INTERLOCK | - LK_NOWAIT); - VI_LOCK(vp); - } + error = VOP_LOCK(vp, LK_EXCLUSIVE | LK_INTERLOCK | LK_NOWAIT); + VI_LOCK(vp); break; case VPUTX_VUNREF: if (VOP_ISLOCKED(vp) != LK_EXCLUSIVE) { Index: src/sys/sys/lockmgr.h =================================================================== --- src/sys/sys/lockmgr.h (revision 351623) +++ src/sys/sys/lockmgr.h (working copy) @@ -165,6 +165,7 @@ _lockmgr_args_rw(struct lock *lk, u_int flags, str #define LK_TIMELOCK 0x001000 #define LK_NODDLKTREAT 0x002000 #define LK_VNHELD 0x004000 +#define LK_VNUSED 0x008000 /* * Operations for lockmgr(). Index: src/sys/sys/vnode.h =================================================================== --- src/sys/sys/vnode.h (revision 351623) +++ src/sys/sys/vnode.h (working copy) @@ -653,6 +653,8 @@ int vcount(struct vnode *vp); void _vdrop(struct vnode *, bool); int vflush(struct mount *mp, int rootrefs, int flags, struct thread *td); int vget(struct vnode *vp, int lockflag, struct thread *td); +int vget_prep(struct vnode *vp); +int vget_finish(struct vnode *vp, int lockflag); void vgone(struct vnode *vp); #define vhold(vp) _vhold((vp), 0) #define vholdl(vp) _vhold((vp), 1) -- Test scenario: misc/crossmp9.sh