umount stuck in "vmopar", vmcore.185 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2020 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #2 r359962M: Thu Apr 16 08:53:18 CEST 2020 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 10.0.0 (git@github.com:llvm/llvm-project.git llvmorg-10.0.0-0-gd32170dbd5b) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33163632640 (31627 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 2 9 11 6 10 7 8 5 3 4 Timecounter "TSC-low" frequency 1750037850 Hz quality 1000 random: entropy device external interface WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 13.0. kbd1 at kbdmux0 000.000052 [4342] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 aStarting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 igb0: flags=8863 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:da inet6 fe80::ec4:7aff:fea8:cdda%igb0 prefixlen 64 scopeid 0x1 media: Ethernet autoselect status: no carrier nd6 options=21 igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Starting devd. igb0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192.168.5.1 if_delmulti_locked: detaching ifnet instance 0xfffff8000414c800 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 16 Apr 08:57:17 ntpdate[2073]: step time server 192.168.5.1 offset +0.172335 sec Starting rpcbind. NFS access cache time=60 Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. Recovering vi editor sessions:. fsckumount: unmount of /tmp failed: Device busy ** /dev/gpt/tmp (NO WRITE) ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 431 files, 8052 used, 1257355 free (139 frags, 157152 blocks, 0.0% fragmentation) mount: /dev/gpt/tmp: Device busy Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Thu Apr 16 08:57 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Apr 16 09:03:55 mercat1 login[2431]: ROOT LOGIN (root) ON ttyu1 Last login: Thu Apr 16 07:28:11 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #2 r359962M: Thu Apr 16 08:53:18 CEST 2020 root@mercat1:~ # Apr 16 09:04:11 mercat1 su[2480]: pho to root on /dev/pts/0 20200416 09:04:29 all (1/1): sendfile21b.sh Apr 16 09:05:19 mercat1 kernel: pid 3742 (swap), jid 0, uid 0, was killed: out of swap space root@mercat1:~ # ps -lUroot UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 0 0 0 -16 0 0 768 swapin DLs - 0:00.77 [kernel] 0 1 0 0 52 0 10060 928 wait ILs - 0:00.02 /sbin/init 0 2 0 0 -16 0 0 16 crypto_w DL - 0:00.00 [crypto] 0 3 0 0 -16 0 0 16 crypto_r DL - 0:00.00 [crypto returns 0] 0 4 0 0 -16 0 0 16 crypto_r DL - 0:00.00 [crypto returns 1] 0 5 0 0 -16 0 0 16 crypto_r DL - 0:00.00 [crypto returns 2] 0 6 0 0 -16 0 0 16 crypto_r DL - 0:00.00 [crypto returns 3] 0 7 0 0 -16 0 0 16 crypto_r DL - 0:00.00 [crypto returns 4] 0 8 0 0 -16 0 0 16 crypto_r DL - 0:00.00 [crypto returns 5] 0 9 0 0 -16 0 0 16 crypto_r DL - 0:00.00 [crypto returns 6] 0 10 0 0 -16 0 0 16 audit_wo DL - 0:00.00 [audit] 0 11 0 0 155 0 0 192 - RNL - 390:44.78 [idle] 0 12 0 0 -56 0 0 480 - WL - 0:06.10 [intr] 0 13 0 0 -8 0 0 48 - DL - 0:00.05 [geom] 0 14 0 0 -16 0 0 16 seqstate DL - 0:00.00 [sequencer 00] 0 15 0 0 -16 0 0 16 crypto_r DL - 0:00.00 [crypto returns 7] 0 16 0 0 -16 0 0 16 crypto_r DL - 0:00.00 [crypto returns 8] 0 17 0 0 -16 0 0 16 crypto_r DL - 0:00.00 [crypto returns 9] 0 18 0 0 -16 0 0 16 crypto_r DL - 0:00.00 [crypto returns 10] 0 19 0 0 -16 0 0 16 crypto_r DL - 0:00.00 [crypto returns 11] 0 20 0 0 -16 0 0 64 - DL - 0:15.96 [cam] 0 21 0 0 -68 0 0 240 - DL - 0:00.65 [usb] 0 22 0 0 -16 0 0 16 - DL - 0:00.00 [soaiod1] 0 23 0 0 -16 0 0 16 - DL - 0:00.00 [soaiod2] 0 24 0 0 -16 0 0 16 - DL - 0:00.00 [soaiod3] 0 25 0 0 -16 0 0 16 - DL - 0:00.00 [soaiod4] 0 26 0 0 -16 0 0 16 waiting_ DL - 0:00.00 [sctp_iterator] 0 27 0 0 -16 0 0 16 - DL - 0:00.50 [rand_harvestq] 0 28 0 0 -16 0 0 16 idle DL - 0:00.03 [enc_daemon0] 0 29 0 0 -16 0 0 16 idle DL - 0:00.02 [enc_daemon1] 0 30 0 0 -16 0 0 48 psleep DL - 1:33.53 [pagedaemon] 0 31 0 0 -16 0 0 16 psleep DL - 0:01.52 [vmdaemon] 0 32 0 0 -16 0 0 160 qsleep DL - 0:00.23 [bufdaemon] 0 33 0 0 -16 0 0 16 vlruwt DL - 0:00.01 [vnlru] 0 34 0 0 16 0 0 16 syncer DL - 0:00.08 [syncer] 0 1928 1 0 20 0 11492 2380 select Is - 0:00.01 dhclient: system.syslog (dhclient) 0 1931 1 0 45 0 11688 2356 select Is - 0:00.01 dhclient: igb0 [priv] (dhclient) 0 1995 1 0 20 0 13576 1192 select Ss - 0:00.00 /sbin/devd 0 2066 1 0 20 0 11544 2192 select Is - 0:00.02 /usr/sbin/syslogd -s 0 2076 1 0 20 0 11352 2000 select Ss - 0:00.01 /usr/sbin/rpcbind 0 2224 1 0 -52 0 10928 10996 wait I /dev/null; true -s 60 0 2270 1 0 20 0 285692 2200 select Ss - 0:00.00 /usr/sbin/rpc.statd 0 2273 1 0 52 0 23572 2188 rpcsvc Ss - 0:00.01 /usr/sbin/rpc.lockd 0 2341 1 0 20 0 10940 2196 select Ss - 0:02.58 /usr/sbin/powerd 0 2369 1 0 20 0 19640 6524 select Is - 0:00.00 /usr/sbin/sshd 0 2373 1 0 20 0 11524 1000 nanslp Is - 0:00.02 /usr/sbin/cron -s 0 2470 2369 0 24 0 20204 7400 select Is - 0:00.03 sshd: pho [priv] (sshd) 0 2568 1 0 52 0 11856 0 wait IWs - 0:00.00 /bin/sh ../tools/vmstat.sh 0 2615 2568 0 52 0 11856 1004 wait S - 0:00.25 /bin/sh ../tools/vmstat.sh 0 2616 2568 0 20 0 11808 2796 piperd S - 0:00.62 awk -F, awk 0 2618 2568 0 52 0 11856 2860 piperd I - 0:00.00 /bin/sh ../tools/vmstat.sh 0 3666 2369 0 23 0 20204 7452 select Is - 0:00.01 sshd: pho [priv] (sshd) 0 3727 0 0 -8 0 0 16 mdwait DL - 0:00.00 [md10] 0 4745 2224 0 -52 0 11724 3200 wait I< - 0:00.01 sh -c ls -l /tmp /dev /mnt* /media > /dev/null; true 0 4746 4745 0 -52 0 11424 3000 ufs D< - 0:00.01 ls -l /tmp /dev /mnt /media 0 62525 2615 0 52 0 11856 1428 wait S - 0:00.04 /bin/sh ../tools/vmstat.sh 0 62844 62525 0 72 0 4984 2540 - R - 0:00.00 [egrep] 0 2430 1 0 52 0 10968 2184 ttyin Is+ u0 0:00.00 /usr/libexec/getty 3wire ttyu0 0 2431 1 0 20 0 12112 0 wait IWs u1 0:00.00 login [pam] (login) 0 2466 2431 0 20 0 13308 3928 pause S u1 0:00.02 -csh (csh) 0 62842 2466 0 20 0 12032 3312 - R+ u1 0:00.00 ps -lUroot 0 2422 1 0 52 0 10980 2184 ttyin Is+ v0 0:00.00 /usr/libexec/getty Pc ttyv0 0 2423 1 0 52 0 10980 2184 ttyin Is+ v1 0:00.00 /usr/libexec/getty Pc ttyv1 0 2424 1 0 52 0 10980 2184 ttyin Is+ v2 0:00.00 /usr/libexec/getty Pc ttyv2 0 2425 1 0 52 0 10980 2184 ttyin Is+ v3 0:00.00 /usr/libexec/getty Pc ttyv3 0 2426 1 0 52 0 10980 2184 ttyin Is+ v4 0:00.00 /usr/libexec/getty Pc ttyv4 0 2427 1 0 52 0 10980 2184 ttyin Is+ v5 0:00.00 /usr/libexec/getty Pc ttyv5 0 2428 1 0 52 0 10980 2184 ttyin Is+ v6 0:00.00 /usr/libexec/getty Pc ttyv6 0 2429 1 0 52 0 10980 2184 ttyin Is+ v7 0:00.00 /usr/libexec/getty Pc ttyv7 0 2479 2474 0 23 0 12216 0 wait IW 0 0:00.00 su 0 2480 2479 0 22 0 13336 0 pause IW 0 0:00.00 _su (csh) 0 2482 2480 0 20 0 14544 0 wait IW 0 0:00.00 bash 0 2485 2482 0 52 0 12432 0 wait IW+ 0 0:00.00 /bin/sh ./all.sh -m 120 sendfile21b.sh 0 3703 2485 0 52 0 12432 0 wait IW+ 0 0:00.00 /bin/sh ./all.sh -m 120 sendfile21b.sh 0 3704 3703 0 20 0 11780 212 wait I+ 0 0:00.01 /bin/sh ./sendfile21b.sh 0 3705 2485 0 52 0 10856 2088 piperd IC+ 0 0:00.00 tee /tmp/stress2.d/output 0 3974 3704 0 23 0 10908 2424 vmopar D+ 0 0:00.01 umount /mnt root@mercat1:~ # procstat -k 3974 PID TID COMM TDNAME KSTACK 3974 100279 umount - mi_switch sleepq_switch _vm_page_busy_sleep vm_page_sleep_if_busy vm_object_page_remove bufobj_invalbuf vgonel vflush ffs_flushfiles ffs_unmount dounmount kern_unmount amd64_syscall fast_syscall_common root@mercat1:~ # KDB: enter: Break to debugger [ thread pid 11 tid 100003 ] Stopped at kdb_alt_break_internal+0x155: movq $0,0x10c9398(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 1487 out of 32626 MB:..2%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 11 tid 100003 td 0xfffffe003e3e0300 kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x97cb80 curthread = 0xfffffe003e3e0300: pid 11 tid 100003 critnest 2 "idle: cpu0" curpcb = 0xfffffe003e3e0810 fpcurthread = none idlethread = 0xfffffe003e3e0300: tid 100003 "idle: cpu0" self = 0xffffffff82410000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82410384 rsp0 = 0xfffffe00add46cc0 kcr3 = 0x800000000230e002 ucr3 = 0xffffffffffffffff scr3 = 0x68c2ec0e gs32p = 0xffffffff82410404 ldt = 0xffffffff82410444 tss = 0xffffffff82410434 tlb gen = 505663 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bc7f3b80 curthread = 0xfffffe003e3dfc00: pid 11 tid 100004 critnest 1 "idle: cpu1" curpcb = 0xfffffe003e3e0110 fpcurthread = none idlethread = 0xfffffe003e3dfc00: tid 100004 "idle: cpu1" self = 0xffffffff82411000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82411384 rsp0 = 0xfffffe00add4bcc0 kcr3 = 0x800000000230e002 ucr3 = 0xffffffffffffffff scr3 = 0x6626dba5c gs32p = 0xffffffff82411404 ldt = 0xffffffff82411444 tss = 0xffffffff82411434 tlb gen = 505663 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bc7ffb80 curthread = 0xfffffe003e3df500: pid 11 tid 100005 critnest 1 "idle: cpu2" curpcb = 0xfffffe003e3dfa10 fpcurthread = none idlethread = 0xfffffe003e3df500: tid 100005 "idle: cpu2" self = 0xffffffff82412000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82412384 rsp0 = 0xfffffe00add50cc0 kcr3 = 0x800000000230e002 ucr3 = 0xffffffffffffffff scr3 = 0x57b16c951 gs32p = 0xffffffff82412404 ldt = 0xffffffff82412444 tss = 0xffffffff82412434 tlb gen = 505663 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bc80bb80 curthread = 0xfffffe003e3dee00: pid 11 tid 100006 critnest 1 "idle: cpu3" curpcb = 0xfffffe003e3df310 fpcurthread = none idlethread = 0xfffffe003e3dee00: tid 100006 "idle: cpu3" self = 0xffffffff82413000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82413384 rsp0 = 0xfffffe00add55cc0 kcr3 = 0x800000000230e002 ucr3 = 0xffffffffffffffff scr3 = 0x3aa8a3bb4 gs32p = 0xffffffff82413404 ldt = 0xffffffff82413444 tss = 0xffffffff82413434 tlb gen = 505663 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bc817b80 curthread = 0xfffffe003e3de700: pid 11 tid 100007 critnest 1 "idle: cpu4" curpcb = 0xfffffe003e3dec10 fpcurthread = none idlethread = 0xfffffe003e3de700: tid 100007 "idle: cpu4" self = 0xffffffff82414000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82414384 rsp0 = 0xfffffe00add5acc0 kcr3 = 0x800000000230e002 ucr3 = 0xffffffffffffffff scr3 = 0x3aa620c22 gs32p = 0xffffffff82414404 ldt = 0xffffffff82414444 tss = 0xffffffff82414434 tlb gen = 505662 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bc823b80 curthread = 0xfffffe003e3de000: pid 11 tid 100008 critnest 1 "idle: cpu5" curpcb = 0xfffffe003e3de510 fpcurthread = none idlethread = 0xfffffe003e3de000: tid 100008 "idle: cpu5" self = 0xffffffff82415000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82415384 rsp0 = 0xfffffe00add5fcc0 kcr3 = 0x800000000230e002 ucr3 = 0xffffffffffffffff scr3 = 0x68625ed1 gs32p = 0xffffffff82415404 ldt = 0xffffffff82415444 tss = 0xffffffff82415434 tlb gen = 505663 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bc82fb80 curthread = 0xfffffe003e3e8a00: pid 11 tid 100009 critnest 1 "idle: cpu6" curpcb = 0xfffffe003e3e8f10 fpcurthread = none idlethread = 0xfffffe003e3e8a00: tid 100009 "idle: cpu6" self = 0xffffffff82416000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82416384 rsp0 = 0xfffffe00add64cc0 kcr3 = 0x800000000230e002 ucr3 = 0xffffffffffffffff scr3 = 0x57b1c7b65 gs32p = 0xffffffff82416404 ldt = 0xffffffff82416444 tss = 0xffffffff82416434 tlb gen = 505663 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bc83bb80 curthread = 0xfffffe003e3e8300: pid 11 tid 100010 critnest 1 "idle: cpu7" curpcb = 0xfffffe003e3e8810 fpcurthread = none idlethread = 0xfffffe003e3e8300: tid 100010 "idle: cpu7" self = 0xffffffff82417000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82417384 rsp0 = 0xfffffe00add69cc0 kcr3 = 0x800000000230e002 ucr3 = 0xffffffffffffffff scr3 = 0x3aa7dff64 gs32p = 0xffffffff82417404 ldt = 0xffffffff82417444 tss = 0xffffffff82417434 tlb gen = 505663 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bc847b80 curthread = 0xfffffe003e3e7c00: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffffe003e3e8110 fpcurthread = none idlethread = 0xfffffe003e3e7c00: tid 100011 "idle: cpu8" self = 0xffffffff82418000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82418384 rsp0 = 0xfffffe00add6ecc0 kcr3 = 0x800000000230e002 ucr3 = 0xffffffffffffffff scr3 = 0x48fa80da2 gs32p = 0xffffffff82418404 ldt = 0xffffffff82418444 tss = 0xffffffff82418434 tlb gen = 505663 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bc853b80 curthread = 0xfffffe003e3e7500: pid 11 tid 100012 critnest 1 "idle: cpu9" curpcb = 0xfffffe003e3e7a10 fpcurthread = none idlethread = 0xfffffe003e3e7500: tid 100012 "idle: cpu9" self = 0xffffffff82419000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82419384 rsp0 = 0xfffffe00add73cc0 kcr3 = 0x800000000230e002 ucr3 = 0xffffffffffffffff scr3 = 0x74a8ae834 gs32p = 0xffffffff82419404 ldt = 0xffffffff82419444 tss = 0xffffffff82419434 tlb gen = 505663 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bc85fb80 curthread = 0xfffffe003e3e6e00: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffffe003e3e7310 fpcurthread = none idlethread = 0xfffffe003e3e6e00: tid 100013 "idle: cpu10" self = 0xffffffff8241a000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff8241a384 rsp0 = 0xfffffe00add78cc0 kcr3 = 0x800000000230e002 ucr3 = 0xffffffffffffffff scr3 = 0x662881ca5 gs32p = 0xffffffff8241a404 ldt = 0xffffffff8241a444 tss = 0xffffffff8241a434 tlb gen = 505663 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bc86bb80 curthread = 0xfffffe003e3e6700: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffffe003e3e6c10 fpcurthread = none idlethread = 0xfffffe003e3e6700: tid 100014 "idle: cpu11" self = 0xffffffff8241b000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff8241b384 rsp0 = 0xfffffe00add7dcc0 kcr3 = 0x800000000230e002 ucr3 = 0xffffffffffffffff scr3 = 0x68c62cc8 gs32p = 0xffffffff8241b404 ldt = 0xffffffff8241b444 tss = 0xffffffff8241b434 tlb gen = 505663 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 4746 (ls) thread 0xfffffe00e671c500 (100189) shared lockmgr ufs (ufs) r = 0 (0xfffff80021333568) locked @ kern/vfs_lookup.c:737 Process 3974 (umount) thread 0xfffffe00e671da00 (100279) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8017e8c9a68) locked @ kern/vfs_subr.c:3706 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8003fedb068) locked @ kern/vfs_mount.c:1631 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff80021333500: type VDIR usecount 35, writecount 0, refcount 4 mountedhere 0 flags (VV_ROOT|VMP_LAZYLIST) v_object 0xfffff80003abf948 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80b95e75 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee9b4d at ffs_lock+0x6d #2 0xffffffff810f0b10 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cb4fe4 at _vn_lock+0x54 #4 0xffffffff80c91fdd at lookup+0xdd #5 0xffffffff80c91a03 at namei+0x553 #6 0xffffffff80cae36f at kern_statat+0x7f #7 0xffffffff80caeb2f at sys_fstatat+0x2f #8 0xffffffff81073cf9 at amd64_syscall+0x159 #9 0xffffffff81049970 at fast_syscall_common+0x101 nlink=29, effnlink=29, size=2048, extsize 0 generation=56909bb9, uid=0, gid=0, flags=0x0 ino 2, on dev gpt/work vnode 0xfffff8003fedb000: type VDIR usecount 2, writecount 0, refcount 1 mountedhere 0xfffffe00e64ee280 flags () v_object 0xfffff80068317b58 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00e671da00 (pid 3974, umount, tid 100279) with shared waiters pending #0 0xffffffff80b95e75 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee9b4d at ffs_lock+0x6d #2 0xffffffff810f0b10 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cb4fe4 at _vn_lock+0x54 #4 0xffffffff80c96e57 at dounmount+0x67 #5 0xffffffff80c96d99 at kern_unmount+0x2b9 #6 0xffffffff81073cf9 at amd64_syscall+0x159 #7 0xffffffff81049970 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=74d5cf41, uid=0, gid=0, flags=0x0 ino 37078272, on dev gpt/work vnode 0xfffff8017e8c9a00: type VREG usecount 0, writecount 0, refcount 2 flags (VIRF_DOOMED) v_object 0xfffff8006897ad68 ref 0 pages 4 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00e671da00 (pid 3974, umount, tid 100279) #0 0xffffffff80b95e75 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee9b4d at ffs_lock+0x6d #2 0xffffffff810f0b10 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cb4fe4 at _vn_lock+0x54 #4 0xffffffff80ca0c00 at vflush+0xd0 #5 0xffffffff80ee5145 at ffs_flushfiles+0x175 #6 0xffffffff80ee7962 at ffs_unmount+0xd2 #7 0xffffffff80c97213 at dounmount+0x423 #8 0xffffffff80c96d99 at kern_unmount+0x2b9 #9 0xffffffff81073cf9 at amd64_syscall+0x159 #10 0xffffffff81049970 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=409600, extsize 0 generation=40ac71e8, uid=0, gid=0, flags=0x0 ino 3, on dev md10 db:1:pho1> show mount 0xfffffe00d39dc700 /dev/gpt/work on / (ufs) 0xfffffe00d39dd280 devfs on /dev (devfs) 0xfffffe00dd3e8280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe00e64ee280 /dev/md10 on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 101549 Buf domain 0 freebufs 14850 lofreebufs 219 hifreebufs 329 bufspace 3280896 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 150 (1544192) dirtyq count 0 (0) wakeup 0 lim 25 CPU 11, 23, 16, 4, 12, 9, 2, 14, 24, 7, 3, 8, Locked buffers: 0 space 0 Total buffers: 306 space 3280896 Buf domain 1 freebufs 13595 lofreebufs 219 hifreebufs 329 bufspace 44548096 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1425 (42020864) dirtyq count 0 (0) wakeup 0 lim 25 CPU 15, 10, 13, 1, 12, 21, 4, 2, 4, 11, 13, 7, Locked buffers: 0 space 0 Total buffers: 1540 space 44548096 Buf domain 2 freebufs 14257 lofreebufs 219 hifreebufs 329 bufspace 22753280 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 792 (20910080) dirtyq count 0 (0) wakeup 0 lim 25 CPU 16, 1, 9, 6, 5, 7, 12, 1, 0, 10, 1, 16, Locked buffers: 0 space 0 Total buffers: 877 space 22753280 Buf domain 3 freebufs 14832 lofreebufs 219 hifreebufs 329 bufspace 3895296 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 185 (2113536) dirtyq count 1 (28672) wakeup 0 lim 25 CPU 15, 1, 10, 0, 7, 12, 5, 12, 17, 13, 12, 11, Locked buffers: 0 space 0 Total buffers: 316 space 3895296 Buf domain 4 freebufs 14840 lofreebufs 219 hifreebufs 329 bufspace 3760128 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 199 (2490368) dirtyq count 0 (0) wakeup 0 lim 25 CPU 12, 3, 11, 4, 4, 0, 3, 10, 18, 12, 12, 5, Locked buffers: 0 space 0 Total buffers: 296 space 3760128 Buf domain 5 freebufs 14848 lofreebufs 219 hifreebufs 329 bufspace 3514368 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 175 (1449984) dirtyq count 0 (0) wakeup 0 lim 25 CPU 22, 4, 14, 1, 8, 6, 1, 15, 0, 11, 9, 19, Locked buffers: 0 space 0 Total buffers: 302 space 3514368 Buf domain 6 freebufs 14464 lofreebufs 219 hifreebufs 329 bufspace 16072704 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 603 (14450688) dirtyq count 0 (0) wakeup 0 lim 25 CPU 5, 0, 0, 20, 3, 0, 1, 0, 23, 1, 7, 6, Locked buffers: 0 space 0 Total buffers: 670 space 16072704 db:1:pho1> show page vm_cnt.v_free_count: 7954627 vm_cnt.v_inactive_count: 921 vm_cnt.v_active_count: 1311 vm_cnt.v_laundry_count: 154 vm_cnt.v_wire_count: 163793 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51264 vm_cnt.v_free_target: 173124 vm_cnt.v_inactive_target: 259686 db:1:pho1> show pageq pq_free 7954627 dom 0 page_cnt 8124099 free 7954627 pq_act 1311 pq_inact 921 pq_laund 154 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 001423 | 000002 11 (008192K) | 000339 | 000002 10 (004096K) | 000510 | 000003 09 (002048K) | 000712 | 000001 08 (001024K) | 000771 | 000003 07 (000512K) | 000918 | 000004 06 (000256K) | 001068 | 000011 05 (000128K) | 001349 | 000035 04 (000064K) | 001639 | 000079 03 (000032K) | 002108 | 000253 02 (000016K) | 002224 | 000702 01 (000008K) | 005202 | 002639 00 (000004K) | 009871 | 006011 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000002 | 000000 04 (000064K) | 000003 | 000000 03 (000032K) | 000001 | 000000 02 (000016K) | 000002 | 000000 01 (000008K) | 000001 | 000000 00 (000004K) | 000002 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree RADIX NODE 144 9192 540242 3936378 0 64 79118496 0 mbuf_cluster 2048 14830 36 17397 0 8 30445568 0 BUF TRIE 144 538 105414 2193 0 62 15257088 0 swblk 136 1590 102375 250369 0 62 14139240 0 VNODE 640 8540 124 8964 0 16 5544960 0 mbuf 256 16458 3034 28413 0 254 4989952 0 socket 904 55 2996 5454 0 16 2758104 0 FFS2 dinode 256 8415 495 8833 0 62 2280960 0 128 128 14349 903 928382 0 126 1952256 0 4096 4096 351 0 613 0 2 1437696 0 64 Bucket 512 2030 762 86882 0 30 1429504 0 FFS inode 160 8415 510 8833 0 62 1428000 0 128 128 10581 269 10707 0 126 1388800 0 swpctrie 144 255 8061 39355 0 62 1197504 0 16384 16384 11 61 283508 0 1 1179648 0 UMA Slabs 0 112 9725 34 13593 0 126 1093008 0 S VFS Cache 108 8819 1009 9769 0 126 1061424 0 32768 32768 9 23 241 0 1 1048576 0 VM OBJECT 264 2975 715 2544460 0 30 974160 0 256 Bucket 2048 352 74 23096 0 8 872448 0 8192 8192 105 0 105 0 1 860160 0 vmem btag 56 13330 1777 13374 0 254 845992 0 32768 32768 25 0 27 0 1 819200 0 64 64 9489 3048 557887 0 254 802368 0 65536 65536 3 9 54 0 1 786432 0 pbuf 984 0 774 0 0 0 761616 0 128 Bucket 1024 512 187 72785 0 16 715776 0 THREAD 1792 333 54 353 0 8 693504 0 mbuf_packet 256 15 2528 357 0 254 651008 0 16384 16384 36 0 36 0 1 589824 0 64 64 8634 312 8718 0 254 572544 0 4096 4096 83 56 164045 0 2 569344 0 65536 65536 2 6 72 0 1 524288 0 MAP ENTRY 96 2144 2770 8297461 0 126 471744 0 1024 1024 247 193 266420 0 16 450560 0 256 256 685 770 166620 0 62 372480 0 VMSPACE 2536 46 92 164009 0 4 349968 0 2048 2048 19 139 149306 0 8 323584 0 g_bio 408 0 750 599125 0 30 306000 0 128 128 1419 875 1428 0 126 293632 0 PROC 1312 80 136 164042 0 8 283392 0 filedesc0 1088 81 178 164043 0 8 281792 0 64 64 723 3624 203658 0 254 278208 0 256 256 441 624 7029 0 62 272640 0 65536 65536 4 0 2171 0 1 262144 0 512 512 149 363 73209 0 30 262144 0 32 32 6713 1351 6772 0 254 258048 0 128 128 494 1521 75280 0 126 257920 0 32 Bucket 256 148 856 184511 0 62 257024 0 pipe 760 9 326 94691 0 16 254600 0 ksiginfo 112 190 2078 2653 0 126 254016 0 16 16 13656 2094 13872 0 254 252000 0 64 64 2998 656 3028 0 254 233856 0 128 128 226 1510 29837 0 126 222208 0 2048 2048 96 8 388 0 8 212992 0 128 128 106 1537 8338 0 126 210304 0 64 64 119 3094 164252 0 254 205632 0 1024 1024 5 195 533 0 16 204800 0 Files 80 135 2415 1087800 0 126 204000 0 256 256 37 758 1327 0 62 203520 0 4096 4096 49 0 66 0 2 200704 0 NAMEI 1024 1 191 1181718 0 16 196608 0 16384 16384 12 0 2670 0 1 196608 0 udp_inpcb 488 20 364 322 0 30 187392 0 128 128 667 759 2684 0 126 182528 0 UMA Zones 2048 85 3 85 0 8 180224 0 8 Bucket 80 128 2122 135357 0 126 180000 0 selfd 64 129 2580 36035 0 254 173376 0 512 512 231 97 281 0 30 167936 0 1024 1024 7 145 58 0 16 155648 0 256 256 78 507 9670 0 62 149760 0 4 Bucket 48 30 3078 94408 0 254 149184 0 512 512 54 210 226 0 30 135168 0 256 256 29 496 199 0 62 134400 0 65536 65536 2 0 7 0 1 131072 0 65536 65536 2 0 2 0 1 131072 0 256 256 3 507 77 0 62 130560 0 rl_entry 40 188 3044 188 0 254 129280 0 256 256 56 439 671 0 62 126720 0 32 32 306 3600 44769 0 254 124992 0 2 Bucket 32 167 3613 212263 0 254 120960 0 16 Bucket 144 186 653 184029 0 62 120816 0 unpcb 256 22 443 5095 0 62 119040 0 SLEEPQUEUE 88 388 956 388 0 126 118272 0 128 128 2 897 74 0 126 115072 0 TURNSTILE 136 388 431 388 0 62 111384 0 PWD 32 19 3383 2887 0 254 108864 0 256 256 44 376 273 0 62 107520 0 32 32 139 3137 4316 0 254 104832 0 32 32 121 3155 3697 0 254 104832 0 64 64 58 1579 556 0 254 104768 0 4096 4096 21 4 91980 0 2 102400 0 32 32 84 3066 556 0 254 100800 0 ttyinq 160 345 255 555 0 62 96000 0 udpcb 32 20 2878 322 0 254 92736 0 ttyoutq 256 181 179 290 0 62 92160 0 8192 8192 10 0 1670 0 1 81920 0 8192 8192 9 0 9 0 1 73728 0 512 512 63 73 63 0 30 69632 0 64 64 161 910 194 0 254 68544 0 32768 32768 2 0 2 0 1 65536 0 4096 4096 16 0 23 0 2 65536 0 cpuset 104 27 500 27 0 126 54808 0 1024 1024 28 24 3573 0 16 53248 0 16 16 27 3223 833 0 254 52000 0 16 16 25 3225 26 0 254 52000 0 DIRHASH 1024 23 25 173 0 16 49152 0 32 32 576 936 22877 0 254 48384 0 16 16 295 2705 20566 0 254 48000 0 Mountpoints 2944 4 12 5 0 4 47104 0 32 32 268 1118 413 0 254 44352 0 8192 8192 5 0 5 0 1 40960 0 64 pcpu 8 3326 1794 3619 0 254 40960 0 16 16 314 2186 394 0 254 40000 0 swrbuf 984 0 38 56434 0 2 37392 0 512 512 31 41 32 0 30 36864 0 mt_stats_zone 64 433 143 433 0 254 36864 0 32768 32768 1 0 2 0 1 32768 0 32768 32768 1 0 2330 0 1 32768 0 16384 16384 2 0 2 0 1 32768 0 16384 16384 2 0 5 0 1 32768 0 16384 16384 2 0 2 0 1 32768 0 8192 8192 4 0 4 0 1 32768 0 16 16 266 1734 551 0 254 32000 0 UMA Kegs 384 74 0 74 0 30 28416 0 KMAP ENTRY 96 18 273 18 0 126 27936 0 512 512 14 34 31 0 30 24576 0 tcpcb 1016 10 14 18 0 16 24384 0 mt_zone 24 433 569 433 0 254 24048 0 16 16 16 1484 17 0 254 24000 0 tcp_inpcb 488 10 38 18 0 30 23424 0 64 64 8 307 17 0 254 20160 0 16 16 494 756 901411 0 254 20000 0 rtentry 216 12 78 15 0 62 19440 0 16384 16384 1 0 1 0 1 16384 0 2048 2048 5 3 5639 0 8 16384 0 fakepg 104 0 156 4 0 126 16224 0 MAP 216 2 69 2 0 62 15336 0 2048 2048 3 3 4 0 8 12288 0 2048 2048 4 2 4 0 8 12288 0 2048 2048 4 2 4 0 8 12288 0 1024 1024 7 5 7 0 16 12288 0 1024 1024 6 6 6 0 16 12288 0 512 512 8 16 6247 0 30 12288 0 L VFS Cache 328 17 19 19 0 30 11808 0 routing nhops 256 7 38 15 0 62 11520 0 8192 8192 1 0 1 0 1 8192 0 2048 2048 3 1 667 0 8 8192 0 1024 1024 4 4 7 0 16 8192 0 32 32 16 236 17 0 254 8064 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 4096 4096 1 0 2 0 2 4096 0 4096 4096 1 0 13 0 2 4096 0 1024 1024 1 3 1 0 16 4096 0 int pcpu 4 66 958 66 0 254 4096 0 tcptw 88 0 46 1 0 126 4048 0 hostcache 96 1 41 1 0 126 4032 0 procdesc 136 1 28 50 0 62 3944 0 ripcb 488 1 7 3 0 30 3904 0 vmem 1856 1 1 1 0 8 3712 0 UMA Slabs 1 176 9 11 9 0 62 3520 0 SMR CPU 32 1 62 1 0 254 2016 0 SMR SHARED 24 1 62 1 0 254 1512 0 FFS1 dinode 128 0 0 0 0 126 0 0 udplite_inpcb 488 0 0 0 0 30 0 0 sctp_asconf_ack 48 0 0 0 0 254 0 0 sctp_asconf 40 0 0 0 0 254 0 0 sctp_stream_msg_out 112 0 0 0 0 126 0 0 sctp_readq 152 0 0 0 0 62 0 0 sctp_chunk 152 0 0 0 0 62 0 0 sctp_raddr 736 0 0 0 0 16 0 0 sctp_laddr 48 0 0 4 0 254 0 0 sctp_asoc 2288 0 0 0 0 4 0 0 sctp_ep 1280 0 0 0 0 8 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 184 0 0 0 0 62 0 0 tcp_log 408 0 0 0 0 30 0 0 tcpreass 48 0 0 0 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 syncache 168 0 0 3 0 62 0 0 ipq 56 0 0 0 0 254 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 KNOTE 160 0 0 0 0 62 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 280 0 0 0 0 30 0 0 AIOCB 752 0 0 0 0 16 0 0 AIOP 32 0 0 0 0 254 0 0 AIO 208 0 0 0 0 62 0 0 NCLNODE 744 0 0 0 0 16 0 0 LTS VFS Cache 368 0 0 0 0 30 0 0 STS VFS Cache 148 0 0 0 0 62 0 0 rentr 24 0 0 2 0 254 0 0 VNODEPOLL 120 0 0 0 0 126 0 0 vtnet_tx_hdr 24 0 0 0 0 254 0 0 crypto_session 72 0 0 0 0 126 0 0 cryptop 240 0 0 0 0 62 0 0 nvme_request 128 0 0 0 0 126 0 0 FPU_save_area 832 0 0 0 0 16 0 0 DMAR_MAP_ENTRY 128 0 0 0 0 126 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 4 0 2 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 clpbuf 984 0 0 15 0 2 0 0 vnpbuf 984 0 0 4 0 8 0 0 mdpbuf 984 0 0 0 0 0 0 0 nfspbuf 984 0 0 0 0 2 0 0 swwbuf 984 0 0 83381 0 0 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 65536 65536 0 0 0 0 1 0 0 65536 65536 0 0 0 0 1 0 0 65536 65536 0 0 0 0 1 0 0 32768 32768 0 0 8 0 1 0 0 32768 32768 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 16384 16384 0 0 12 0 1 0 0 8192 8192 0 0 83 0 1 0 0 8192 8192 0 0 1 0 1 0 0 4096 4096 0 0 6 0 2 0 0 2048 2048 0 0 23 0 8 0 0 512 512 0 0 246 0 30 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 kstack_cache 16384 206 6 226 1 vm pgcache 4096 43124 339 4064170 15 vm pgcache 4096 15252 2816 10832251 63 buf free cache 984 4245 137 4409 16 buffer arena-65 65536 0 0 0 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 1199 19 1295 1 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 6 0 12 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 db:0:pho> acttrace Tracing command idle pid 11 tid 100003 td 0xfffffe003e3e0300 (CPU 0) kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe003e3dfc00 (CPU 1) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e17de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e17de10 trap() at trap+0x56/frame 0xfffffe003e17df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17df20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add4ba50, rbp = 0xfffffe00add4ba50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add4ba50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add4baa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add4bac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add4bae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add4bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add4bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add4bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe003e3df500 (CPU 2) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e189e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e189e10 trap() at trap+0x56/frame 0xfffffe003e189f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e189f20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add50a50, rbp = 0xfffffe00add50a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add50a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add50aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add50ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add50ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add50bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add50bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add50bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe003e3dee00 (CPU 3) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e195e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e195e10 trap() at trap+0x56/frame 0xfffffe003e195f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e195f20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add55a50, rbp = 0xfffffe00add55a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add55a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add55aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add55ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add55ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add55bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add55bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add55bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe003e3de700 (CPU 4) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1a1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1a1e10 trap() at trap+0x56/frame 0xfffffe003e1a1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a1f20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add5aa50, rbp = 0xfffffe00add5aa50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add5aa50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add5aaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add5aac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add5aae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add5abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add5abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add5abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe003e3de000 (CPU 5) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1ade00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1ade10 trap() at trap+0x56/frame 0xfffffe003e1adf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1adf20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add5fa50, rbp = 0xfffffe00add5fa50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add5fa50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add5faa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add5fac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add5fae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add5fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add5fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add5fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe003e3e8a00 (CPU 6) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1b9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1b9e10 trap() at trap+0x56/frame 0xfffffe003e1b9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1b9f20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add64a50, rbp = 0xfffffe00add64a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add64a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add64aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add64ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add64ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add64bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add64bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add64bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe003e3e8300 (CPU 7) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1c5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1c5e10 trap() at trap+0x56/frame 0xfffffe003e1c5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c5f20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add69a50, rbp = 0xfffffe00add69a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add69a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add69aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add69ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add69ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add69bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add69bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add69bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe003e3e7c00 (CPU 8) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1d1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1d1e10 trap() at trap+0x56/frame 0xfffffe003e1d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d1f20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add6ea50, rbp = 0xfffffe00add6ea50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add6ea50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add6eaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add6eac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add6eae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add6ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add6ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add6ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe003e3e7500 (CPU 9) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1dde00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1dde10 trap() at trap+0x56/frame 0xfffffe003e1ddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ddf20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add73a50, rbp = 0xfffffe00add73a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add73a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add73aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add73ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add73ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe003e3e6e00 (CPU 10) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1e9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1e9e10 trap() at trap+0x56/frame 0xfffffe003e1e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1e9f20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add78a50, rbp = 0xfffffe00add78a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add78a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add78aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add78ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add78ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add78bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add78bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add78bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe003e3e6700 (CPU 11) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1f5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1f5e10 trap() at trap+0x56/frame 0xfffffe003e1f5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f5f20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add7da50, rbp = 0xfffffe00add7da50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7da50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add7daa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7dac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7dae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add7dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 64120 2615 2568 0 S nanslp 0xffffffff81cadcd4 sleep 4746 4745 2224 0 D ufs 0xfffff8003fedb068 ls 4745 2224 2224 0 S wait 0xfffff8017e8c6a40 sh 3974 3704 2485 0 D+ vmopar 0xfffffe0017206200 umount 3727 0 0 0 DL mdwait 0xfffff80068042000 [md10] 3715 3714 3715 2006 Ss+ select 0xfffff800214d2240 bash 3714 3666 3666 2006 S select 0xfffff8003f8247c0 sshd 3705 2485 2485 0 S+ piperd 0xfffff8017e943000 tee 3704 3703 2485 0 S+ wait 0xfffff800218cba40 sh 3703 2485 2485 0 SW+ wait 0xfffff800218f2a40 sh 3666 2369 3666 0 Ss select 0xfffff80021502240 sshd 2618 2568 2568 0 S piperd 0xfffff800217f82f8 sh 2616 2568 2568 0 S piperd 0xfffff80021898be0 awk 2615 2568 2568 0 S wait 0xfffff80021f22520 sh 2568 1 2568 0 SWs wait 0xfffff800216cfa40 sh 2485 2482 2485 0 SW+ wait 0xfffff800216cf000 sh 2482 2480 2482 0 SW+ wait 0xfffff800218f4a40 bash 2480 2479 2480 0 SW+ pause 0xfffff80021a9fae8 csh 2479 2474 2479 2006 SW+ wait 0xfffff800216cf520 su 2474 2473 2474 2006 SWs+ wait 0xfffff80004111520 bash 2473 2470 2470 2006 S select 0xfffff8003f83e840 sshd 2470 2369 2470 0 Ss select 0xfffff800215023c0 sshd 2466 2431 2466 0 S+ ttyin 0xfffff8001c0748b0 csh 2431 1 2431 0 SWs+ wait 0xfffff800216b4000 login 2430 1 2430 0 Ss+ ttyin 0xfffff8001c05b4b0 getty 2429 1 2429 0 Ss+ ttyin 0xfffff8002114f4b0 getty 2428 1 2428 0 Ss+ ttyin 0xfffff8002114fcb0 getty 2427 1 2427 0 Ss+ ttyin 0xfffff800210744b0 getty 2426 1 2426 0 Ss+ ttyin 0xfffff80021074cb0 getty 2425 1 2425 0 Ss+ ttyin 0xfffff800210734b0 getty 2424 1 2424 0 Ss+ ttyin 0xfffff80021073cb0 getty 2423 1 2423 0 Ss+ ttyin 0xfffff800210764b0 getty 2422 1 2422 0 Ss+ ttyin 0xfffff80021076cb0 getty 2373 1 2373 0 Ss nanslp 0xffffffff81cadcd5 cron 2369 1 2369 0 Ss select 0xfffff800031c8640 sshd 2341 1 2341 0 Ss select 0xfffff800219bc2c0 powerd 2338 1 2338 123 Ss (threaded) ntpd 100210 S select 0xfffff8002130b340 ntpd 100353 S usem 0xfffff800214ac380 ntpd 2273 1 2273 0 Ss rpcsvc 0xfffff80021945060 NLM: master 2270 1 2270 0 Ss select 0xfffff80021b2e440 rpc.statd 2224 1 2224 0 Ss wait 0xfffff8006819a520 watchdogd 2076 1 2076 0 Ss select 0xfffff800212fc1c0 rpcbind 2066 1 2066 0 Ss select 0xfffff800219bc840 syslogd 1995 1 1995 0 Ss select 0xfffff8003f8248c0 devd 1990 1 1990 65 Ss select 0xfffff800212fc040 dhclient 1931 1 1931 0 Ss select 0xfffff8002130e340 dhclient 1928 1 1928 0 Ss select 0xfffff800219bc7c0 dhclient 34 0 0 0 DL syncer 0xffffffff81d99898 [syncer] 33 0 0 0 DL vlruwt 0xfffff800210e2000 [vnlru] 32 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff81d98bc0 [bufdaemon] 100131 D - 0xffffffff8180aa00 [bufspacedaemon-0] 100134 D - 0xffffffff81812cc0 [bufspacedaemon-1] 100135 D - 0xffffffff8181af80 [bufspacedaemon-2] 100138 D - 0xffffffff81823240 [bufspacedaemon-3] 100139 D - 0xffffffff8182b500 [bufspacedaemon-4] 100140 D - 0xffffffff818337c0 [bufspacedaemon-5] 100141 D - 0xffffffff8183ba80 [bufspacedaemon-6] 100154 D sdflush 0xfffff8001c0728e8 [/ worker] 100157 D sdflush 0xfffff800215910e8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff81dbdac8 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff81db2098 [dom0] 100132 D launds 0xffffffff81db20a4 [laundry: dom0] 100137 D umarcl 0xffffffff80f08770 [uma] 29 0 0 0 DL idle 0xfffff80003f0b520 [enc_daemon1] 28 0 0 0 DL idle 0xfffff80003f0ba40 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81ae18a0 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff81d9c010 [sctp_iterator] 25 0 0 0 DL - 0xffffffff81d984ec [soaiod4] 24 0 0 0 DL - 0xffffffff81d984ec [soaiod3] 23 0 0 0 DL - 0xffffffff81d984ec [soaiod2] 22 0 0 0 DL - 0xffffffff81d984ec [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe00d2d84440 [usbus0] 100097 D - 0xfffffe00d2d84498 [usbus0] 100098 D - 0xfffffe00d2d844f0 [usbus0] 100099 D - 0xfffffe00d2d84548 [usbus0] 100100 D - 0xfffffe00d2d845a0 [usbus0] 100102 D - 0xfffffe003e4a2cf0 [usbus1] 100103 D - 0xfffffe003e4a2d48 [usbus1] 100104 D - 0xfffffe003e4a2da0 [usbus1] 100105 D - 0xfffffe003e4a2df8 [usbus1] 100106 D - 0xfffffe003e4a2e50 [usbus1] 100107 D - 0xfffffe00d2e23cf0 [usbus2] 100108 D - 0xfffffe00d2e23d48 [usbus2] 100109 D - 0xfffffe00d2e23da0 [usbus2] 100110 D - 0xfffffe00d2e23df8 [usbus2] 100111 D - 0xfffffe00d2e23e50 [usbus2] 20 0 0 0 RL (threaded) [cam] 100091 D - 0xffffffff819b95c0 [doneq0] 100092 RunQ [doneq1] 100093 D - 0xffffffff819b96c0 [doneq2] 100125 D - 0xffffffff819b9490 [scanner] 19 0 0 0 DL crypto_ 0xfffff80003ab0c50 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff80003ab0bf0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003ab0b90 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003ab0b30 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff80003ab0ad0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003ab0a70 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003ab0a10 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff80003ab09b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003ab0950 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff80003ab08f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003ab0890 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003ab0830 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81daf7c0 [crypto] 14 0 0 0 DL seqstat 0xfffff80003a0a488 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff81c8cc80 [g_event] 100063 D - 0xffffffff81c8cc88 [g_up] 100064 D - 0xffffffff81c8cc90 [g_down] 12 0 0 0 WL (threaded) [intr] 100041 I [swi5: fast taskq] 100045 I [swi6: task queue] 100046 I [swi6: Giant taskq] 100047 I [swi1: netisr 0] 100048 I [swi3: vm] 100049 I [swi4: clock (0)] 100050 I [swi4: clock (1)] 100051 I [swi4: clock (2)] 100052 I [swi4: clock (3)] 100053 I [swi4: clock (4)] 100054 I [swi4: clock (5)] 100055 I [swi4: clock (6)] 100056 I [swi4: clock (7)] 100057 I [swi4: clock (8)] 100058 I [swi4: clock (9)] 100059 I [swi4: clock (10)] 100060 I [swi4: clock (11)] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100172 I [irq72: ioat0] 100173 I [irq73: ioat1] 100174 I [irq74: ioat2] 100175 I [irq75: ioat3] 100176 I [irq76: ioat4] 100177 I [irq77: ioat5] 100178 I [irq78: ioat6] 100179 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800038f8000 [init] 10 0 0 0 DL audit_w 0xffffffff81dafc98 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81c8d210 [swapper] 100015 D - 0xfffff8000391c100 [if_io_tqg_0] 100016 D - 0xfffff8000391c000 [if_io_tqg_1] 100017 D - 0xfffff80003919e00 [if_io_tqg_2] 100018 D - 0xfffff80003919d00 [if_io_tqg_3] 100019 D - 0xfffff80003919c00 [if_io_tqg_4] 100020 D - 0xfffff80003919b00 [if_io_tqg_5] 100021 D - 0xfffff80003919a00 [if_io_tqg_6] 100022 D - 0xfffff80003919900 [if_io_tqg_7] 100023 D - 0xfffff80003919800 [if_io_tqg_8] 100024 D - 0xfffff80003919700 [if_io_tqg_9] 100025 D - 0xfffff80003919600 [if_io_tqg_10] 100026 D - 0xfffff80003919500 [if_io_tqg_11] 100027 D - 0xfffff80003919400 [if_config_tqg_0] 100028 D - 0xfffff80003919300 [softirq_0] 100029 D - 0xfffff80003919200 [softirq_1] 100030 D - 0xfffff80003919100 [softirq_2] 100031 D - 0xfffff80003919000 [softirq_3] 100032 D - 0xfffff8000391ae00 [softirq_4] 100033 D - 0xfffff8000391ad00 [softirq_5] 100034 D - 0xfffff8000391ac00 [softirq_6] 100035 D - 0xfffff8000391ab00 [softirq_7] 100036 D - 0xfffff8000391aa00 [softirq_8] 100037 D - 0xfffff8000391a900 [softirq_9] 100038 D - 0xfffff8000391a800 [softirq_10] 100039 D - 0xfffff8000391a700 [softirq_11] 100040 D - 0xfffff8000393c100 [thread taskq] 100042 D - 0xfffff80003939e00 [aiod_kick taskq] 100043 D - 0xfffff80003939d00 [in6m_free taskq] 100044 D - 0xfffff80003939c00 [kqueue_ctx taskq] 100061 D - 0xfffff80003939900 [firmware taskq] 100066 D - 0xfffff80003939800 [crypto_0] 100067 D - 0xfffff80003939800 [crypto_1] 100068 D - 0xfffff80003939800 [crypto_2] 100069 D - 0xfffff80003939800 [crypto_3] 100070 D - 0xfffff80003939800 [crypto_4] 100071 D - 0xfffff80003939800 [crypto_5] 100072 D - 0xfffff80003939800 [crypto_6] 100073 D - 0xfffff80003939800 [crypto_7] 100074 D - 0xfffff80003939800 [crypto_8] 100075 D - 0xfffff80003939800 [crypto_9] 100076 D - 0xfffff80003939800 [crypto_10] 100077 D - 0xfffff80003939800 [crypto_11] 100114 D - 0xfffff8001c0e0300 [mca taskq] 100120 D - 0xfffff80021127500 [acpi_task_0] 100121 D - 0xfffff80021127500 [acpi_task_1] 100122 D - 0xfffff80021127500 [acpi_task_2] 100124 D - 0xfffff80003939700 [CAM taskq] db:0:pho> allt Tracing command sleep pid 64120 tid 100294 td 0xfffffe00e6693000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3969870 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3969890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39698d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3969930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e3969970 _sleep() at _sleep+0x258/frame 0xfffffe00e3969a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e3969a90 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe00e3969ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3969bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3969bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffe6f0 --- Tracing command ls pid 4746 tid 100189 td 0xfffffe00e671c500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39263b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39263d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3926410 sleeplk() at sleeplk+0x106/frame 0xfffffe00e3926470 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d0/frame 0xfffffe00e3926500 ffs_lock() at ffs_lock+0x6d/frame 0xfffffe00e3926540 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e3926560 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e39265c0 vget_finish() at vget_finish+0x6c/frame 0xfffffe00e39265f0 cache_lookup() at cache_lookup+0x57c/frame 0xfffffe00e39266b0 vfs_cache_lookup() at vfs_cache_lookup+0x7d/frame 0xfffffe00e3926700 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe00e3926720 lookup() at lookup+0x601/frame 0xfffffe00e39267c0 namei() at namei+0x553/frame 0xfffffe00e39268b0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e39269d0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e3926ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3926bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3926bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x8004a89fa, rsp = 0x7fffffffe388, rbp = 0x7fffffffe440 --- Tracing command sh pid 4745 tid 100232 td 0xfffffe00e64b4000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e68406e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e6840700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6840740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e68407a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e68407b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e6840850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e68408e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e6840ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e6840bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6840bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe828, rbp = 0x7fffffffe8e0 --- Tracing command umount pid 3974 tid 100279 td 0xfffffe00e671da00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e689a4c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e689a4e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e689a520 _vm_page_busy_sleep() at _vm_page_busy_sleep+0x2ff/frame 0xfffffe00e689a5c0 vm_page_sleep_if_busy() at vm_page_sleep_if_busy+0x8f/frame 0xfffffe00e689a610 vm_object_page_remove() at vm_object_page_remove+0x14f/frame 0xfffffe00e689a660 bufobj_invalbuf() at bufobj_invalbuf+0x1c5/frame 0xfffffe00e689a6c0 vgonel() at vgonel+0x2de/frame 0xfffffe00e689a720 vflush() at vflush+0x303/frame 0xfffffe00e689a860 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe00e689a8d0 ffs_unmount() at ffs_unmount+0xd2/frame 0xfffffe00e689a940 dounmount() at dounmount+0x423/frame 0xfffffe00e689a9a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe00e689aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e689abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e689abf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd318, rbp = 0x7fffffffd850 --- Tracing command md10 pid 3727 tid 100238 td 0xfffffe00e59c3500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e685ea50 mi_switch() at mi_switch+0x155/frame 0xfffffe00e685ea70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e685eab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e685eb50 md_kthread() at md_kthread+0xe3/frame 0xfffffe00e685ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e685ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e685ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 3715 tid 100233 td 0xfffffe00e6429800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e6845700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e6845720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6845760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e68457c0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e68457d0 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e6845830 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e6845870 kern_select() at kern_select+0x87a/frame 0xfffffe00e6845a50 sys_pselect() at sys_pselect+0x127/frame 0xfffffe00e6845ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e6845bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6845bf0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x800534b6a, rsp = 0x7fffffffd728, rbp = 0x7fffffffd7f0 --- Tracing command sshd pid 3714 tid 100185 td 0xfffffe00e6695300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3912740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3912760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39127a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3912800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3912810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3912870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e39128b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e3912a90 sys_select() at sys_select+0x56/frame 0xfffffe00e3912ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3912bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3912bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008e17fa, rsp = 0x7fffffffa548, rbp = 0x7fffffffa580 --- Tracing command tee pid 3705 tid 100147 td 0xfffffe00d31a5500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3818840 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3818860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38188a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3818900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3818910 _sleep() at _sleep+0x2c3/frame 0xfffffe00e38189b0 pipe_read() at pipe_read+0x42b/frame 0xfffffe00e3818a10 dofileread() at dofileread+0x81/frame 0xfffffe00e3818a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e3818ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3818bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3818bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80041a81a, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffe700 --- Tracing command sh pid 3704 tid 100204 td 0xfffffe00dd3c6700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39ad6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39ad700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39ad740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39ad7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39ad7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e39ad850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e39ad8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e39adad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39adbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39adbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe238, rbp = 0x7fffffffe2f0 --- Tracing command sh pid 3703 tid 100223 td 0xfffffe00dd3d1100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e68186e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add45f20 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add45f30 trap() at trap+0x6c/frame 0xfffffe00add46040 calltrap() at calltrap+0x8/frame 0xfffffe00add46040 --- trap 0xc, rip = 0xffffffff81046350, rsp = 0xfffffe00add46110, rbp = 0xfffffe00add461a0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00add461a0 db_get_value() at db_get_value+0x32/frame 0xfffffe00add461e0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add46270 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add46290 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add46330 db_command() at db_command+0x25c/frame 0xfffffe00add46400 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add464a0 db_command() at db_command+0x25c/frame 0xfffffe00add46570 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add46580 db_trap() at db_trap+0xe8/frame 0xfffffe00add46610 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00add46680 trap() at trap+0x7b8/frame 0xfffffe00add46790 calltrap() at calltrap+0x8/frame 0xfffffe00add46790 --- trap 0x3, rip = 0xffffffff80c0ff85, rsp = 0xfffffe00add46860, rbp = 0xfffffe00add46880 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e68186e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add46190 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add461a0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00add461e0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add46270 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add46290 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add46330 db_command() at db_command+0x25c/frame 0xfffffe00add46400 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add464a0 db_command() at db_command+0x25c/frame 0xfffffe00add46570 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add46580 db_trap() at db_trap+0xe8/frame 0xfffffe00add46610 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00add46680 trap() at trap+0x7b8/frame 0xfffffe00add46790 calltrap() at calltrap+0x8/frame 0xfffffe00add46790 --- trap 0x3, rip = 0xffffffff80c0ff85, rsp = 0xfffffe00add46860, rbp = 0xfffffe00add46880 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 3666 tid 100194 td 0xfffffe00dd3f8c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e394b7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e394b7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e394b820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e394b880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e394b890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e394b8f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e394b930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e394bab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e394bad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e394bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e394bbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80088500a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe5e0 --- Tracing command sh pid 2618 tid 100235 td 0xfffffe00e671b700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e684f840 mi_switch() at mi_switch+0x155/frame 0xfffffe00e684f860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e684f8a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e684f900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e684f910 _sleep() at _sleep+0x2c3/frame 0xfffffe00e684f9b0 pipe_read() at pipe_read+0x42b/frame 0xfffffe00e684fa10 dofileread() at dofileread+0x81/frame 0xfffffe00e684fa60 sys_read() at sys_read+0xc0/frame 0xfffffe00e684fad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684fbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047a81a, rsp = 0x7fffffffde08, rbp = 0x7fffffffe330 --- Tracing command awk pid 2616 tid 100196 td 0xfffffe00e6768500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3985840 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3985860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39858a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3985900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3985910 _sleep() at _sleep+0x2c3/frame 0xfffffe00e39859b0 pipe_read() at pipe_read+0x42b/frame 0xfffffe00e3985a10 dofileread() at dofileread+0x81/frame 0xfffffe00e3985a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e3985ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3985bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3985bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047e81a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe340 --- Tracing command sh pid 2615 tid 100234 td 0xfffffe00e671be00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e684a6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e684a700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e684a740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e684a7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e684a7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e684a850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e684a8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe238, rbp = 0x7fffffffe2f0 --- Tracing command sh pid 2568 tid 100230 td 0xfffffe00dd3cfc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e68366e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add45f20 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add45f30 trap() at trap+0x6c/frame 0xfffffe00add46040 calltrap() at calltrap+0x8/frame 0xfffffe00add46040 --- trap 0xc, rip = 0xffffffff81046350, rsp = 0xfffffe00add46110, rbp = 0xfffffe00add461a0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00add461a0 db_get_value() at db_get_value+0x32/frame 0xfffffe00add461e0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add46270 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add46290 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add46330 db_command() at db_command+0x25c/frame 0xfffffe00add46400 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add464a0 db_command() at db_command+0x25c/frame 0xfffffe00add46570 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add46580 db_trap() at db_trap+0xe8/frame 0xfffffe00add46610 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00add46680 trap() at trap+0x7b8/frame 0xfffffe00add46790 calltrap() at calltrap+0x8/frame 0xfffffe00add46790 --- trap 0x3, rip = 0xffffffff80c0ff85, rsp = 0xfffffe00add46860, rbp = 0xfffffe00add46880 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e68366e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add46190 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add461a0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00add461e0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add46270 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add46290 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add46330 db_command() at db_command+0x25c/frame 0xfffffe00add46400 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add464a0 db_command() at db_command+0x25c/frame 0xfffffe00add46570 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add46580 db_trap() at db_trap+0xe8/frame 0xfffffe00add46610 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00add46680 trap() at trap+0x7b8/frame 0xfffffe00add46790 calltrap() at calltrap+0x8/frame 0xfffffe00add46790 --- trap 0x3, rip = 0xffffffff80c0ff85, rsp = 0xfffffe00add46860, rbp = 0xfffffe00add46880 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 2485 tid 100166 td 0xfffffe00dd3cee00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38836e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add45f20 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add45f30 trap() at trap+0x6c/frame 0xfffffe00add46040 calltrap() at calltrap+0x8/frame 0xfffffe00add46040 --- trap 0xc, rip = 0xffffffff81046350, rsp = 0xfffffe00add46110, rbp = 0xfffffe00add461a0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00add461a0 db_get_value() at db_get_value+0x32/frame 0xfffffe00add461e0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add46270 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add46290 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add46330 db_command() at db_command+0x25c/frame 0xfffffe00add46400 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add464a0 db_command() at db_command+0x25c/frame 0xfffffe00add46570 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add46580 db_trap() at db_trap+0xe8/frame 0xfffffe00add46610 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00add46680 trap() at trap+0x7b8/frame 0xfffffe00add46790 calltrap() at calltrap+0x8/frame 0xfffffe00add46790 --- trap 0x3, rip = 0xffffffff80c0ff85, rsp = 0xfffffe00add46860, rbp = 0xfffffe00add46880 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e38836e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add46190 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add461a0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00add461e0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add46270 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add46290 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add46330 db_command() at db_command+0x25c/frame 0xfffffe00add46400 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add464a0 db_command() at db_command+0x25c/frame 0xfffffe00add46570 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add46580 db_trap() at db_trap+0xe8/frame 0xfffffe00add46610 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00add46680 trap() at trap+0x7b8/frame 0xfffffe00add46790 calltrap() at calltrap+0x8/frame 0xfffffe00add46790 --- trap 0x3, rip = 0xffffffff80c0ff85, rsp = 0xfffffe00add46860, rbp = 0xfffffe00add46880 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2482 tid 100208 td 0xfffffe00dd3d5c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39c16e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add45f20 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add45f30 trap() at trap+0x6c/frame 0xfffffe00add46040 calltrap() at calltrap+0x8/frame 0xfffffe00add46040 --- trap 0xc, rip = 0xffffffff81046350, rsp = 0xfffffe00add46110, rbp = 0xfffffe00add461a0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00add461a0 db_get_value() at db_get_value+0x32/frame 0xfffffe00add461e0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add46270 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add46290 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add46330 db_command() at db_command+0x25c/frame 0xfffffe00add46400 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add464a0 db_command() at db_command+0x25c/frame 0xfffffe00add46570 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add46580 db_trap() at db_trap+0xe8/frame 0xfffffe00add46610 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00add46680 trap() at trap+0x7b8/frame 0xfffffe00add46790 calltrap() at calltrap+0x8/frame 0xfffffe00add46790 --- trap 0x3, rip = 0xffffffff80c0ff85, rsp = 0xfffffe00add46860, rbp = 0xfffffe00add46880 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e39c16e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add46190 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add461a0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00add461e0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add46270 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add46290 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add46330 db_command() at db_command+0x25c/frame 0xfffffe00add46400 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add464a0 db_command() at db_command+0x25c/frame 0xfffffe00add46570 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add46580 db_trap() at db_trap+0xe8/frame 0xfffffe00add46610 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00add46680 trap() at trap+0x7b8/frame 0xfffffe00add46790 calltrap() at calltrap+0x8/frame 0xfffffe00add46790 --- trap 0x3, rip = 0xffffffff80c0ff85, rsp = 0xfffffe00add46860, rbp = 0xfffffe00add46880 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command csh pid 2480 tid 100197 td 0xfffffe00e6767e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e398a8d0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add45f20 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add45f30 trap() at trap+0x6c/frame 0xfffffe00add46040 calltrap() at calltrap+0x8/frame 0xfffffe00add46040 --- trap 0xc, rip = 0xffffffff81046350, rsp = 0xfffffe00add46110, rbp = 0xfffffe00add461a0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00add461a0 db_get_value() at db_get_value+0x32/frame 0xfffffe00add461e0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add46270 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add46290 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add46330 db_command() at db_command+0x25c/frame 0xfffffe00add46400 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add464a0 db_command() at db_command+0x25c/frame 0xfffffe00add46570 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add46580 db_trap() at db_trap+0xe8/frame 0xfffffe00add46610 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00add46680 trap() at trap+0x7b8/frame 0xfffffe00add46790 calltrap() at calltrap+0x8/frame 0xfffffe00add46790 --- trap 0x3, rip = 0xffffffff80c0ff85, rsp = 0xfffffe00add46860, rbp = 0xfffffe00add46880 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e398a8d8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add46190 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add461a0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00add461e0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add46270 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add46290 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add46330 db_command() at db_command+0x25c/frame 0xfffffe00add46400 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add464a0 db_command() at db_command+0x25c/frame 0xfffffe00add46570 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add46580 db_trap() at db_trap+0xe8/frame 0xfffffe00add46610 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00add46680 trap() at trap+0x7b8/frame 0xfffffe00add46790 calltrap() at calltrap+0x8/frame 0xfffffe00add46790 --- trap 0x3, rip = 0xffffffff80c0ff85, rsp = 0xfffffe00add46860, rbp = 0xfffffe00add46880 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 2479 tid 100149 td 0xfffffe00dd3cf500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38226e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add45f20 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add45f30 trap() at trap+0x6c/frame 0xfffffe00add46040 calltrap() at calltrap+0x8/frame 0xfffffe00add46040 --- trap 0xc, rip = 0xffffffff81046350, rsp = 0xfffffe00add46110, rbp = 0xfffffe00add461a0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00add461a0 db_get_value() at db_get_value+0x32/frame 0xfffffe00add461e0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add46270 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add46290 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add46330 db_command() at db_command+0x25c/frame 0xfffffe00add46400 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add464a0 db_command() at db_command+0x25c/frame 0xfffffe00add46570 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add46580 db_trap() at db_trap+0xe8/frame 0xfffffe00add46610 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00add46680 trap() at trap+0x7b8/frame 0xfffffe00add46790 calltrap() at calltrap+0x8/frame 0xfffffe00add46790 --- trap 0x3, rip = 0xffffffff80c0ff85, rsp = 0xfffffe00add46860, rbp = 0xfffffe00add46880 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e38226e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add46190 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add461a0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00add461e0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add46270 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add46290 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add46330 db_command() at db_command+0x25c/frame 0xfffffe00add46400 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add464a0 db_command() at db_command+0x25c/frame 0xfffffe00add46570 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add46580 db_trap() at db_trap+0xe8/frame 0xfffffe00add46610 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00add46680 trap() at trap+0x7b8/frame 0xfffffe00add46790 calltrap() at calltrap+0x8/frame 0xfffffe00add46790 --- trap 0x3, rip = 0xffffffff80c0ff85, rsp = 0xfffffe00add46860, rbp = 0xfffffe00add46880 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2474 tid 100168 td 0xfffffe003e4b6300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e388d6e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add45f20 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add45f30 trap() at trap+0x6c/frame 0xfffffe00add46040 calltrap() at calltrap+0x8/frame 0xfffffe00add46040 --- trap 0xc, rip = 0xffffffff81046350, rsp = 0xfffffe00add46110, rbp = 0xfffffe00add461a0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00add461a0 db_get_value() at db_get_value+0x32/frame 0xfffffe00add461e0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add46270 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add46290 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add46330 db_command() at db_command+0x25c/frame 0xfffffe00add46400 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add464a0 db_command() at db_command+0x25c/frame 0xfffffe00add46570 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add46580 db_trap() at db_trap+0xe8/frame 0xfffffe00add46610 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00add46680 trap() at trap+0x7b8/frame 0xfffffe00add46790 calltrap() at calltrap+0x8/frame 0xfffffe00add46790 --- trap 0x3, rip = 0xffffffff80c0ff85, rsp = 0xfffffe00add46860, rbp = 0xfffffe00add46880 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e388d6e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add46190 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add461a0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00add461e0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add46270 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add46290 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add46330 db_command() at db_command+0x25c/frame 0xfffffe00add46400 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add464a0 db_command() at db_command+0x25c/frame 0xfffffe00add46570 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add46580 db_trap() at db_trap+0xe8/frame 0xfffffe00add46610 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00add46680 trap() at trap+0x7b8/frame 0xfffffe00add46790 calltrap() at calltrap+0x8/frame 0xfffffe00add46790 --- trap 0x3, rip = 0xffffffff80c0ff85, rsp = 0xfffffe00add46860, rbp = 0xfffffe00add46880 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2473 tid 100192 td 0xfffffe00dd3d4000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3935740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3935760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39357a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3935800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3935810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3935870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e39358b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e3935a90 sys_select() at sys_select+0x56/frame 0xfffffe00e3935ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3935bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3935bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008e17fa, rsp = 0x7fffffffa548, rbp = 0x7fffffffa580 --- Tracing command sshd pid 2470 tid 100211 td 0xfffffe00dd3d1800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39dc7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39dc7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39dc820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39dc880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39dc890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39dc8f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e39dc930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e39dcab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e39dcad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39dcbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39dcbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80088500a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe5e0 --- Tracing command csh pid 2466 tid 100171 td 0xfffffe00e5918a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e389c7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e389c7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e389c820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e389c880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e389c890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e389c8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e389c920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e389c980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e389c9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e389ca10 dofileread() at dofileread+0x81/frame 0xfffffe00e389ca60 sys_read() at sys_read+0xc0/frame 0xfffffe00e389cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e389cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e389cbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80051081a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe210 --- Tracing command login pid 2431 tid 100218 td 0xfffffe00e6420700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39ff6e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add45f20 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add45f30 trap() at trap+0x6c/frame 0xfffffe00add46040 calltrap() at calltrap+0x8/frame 0xfffffe00add46040 --- trap 0xc, rip = 0xffffffff81046350, rsp = 0xfffffe00add46110, rbp = 0xfffffe00add461a0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00add461a0 db_get_value() at db_get_value+0x32/frame 0xfffffe00add461e0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add46270 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add46290 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add46330 db_command() at db_command+0x25c/frame 0xfffffe00add46400 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add464a0 db_command() at db_command+0x25c/frame 0xfffffe00add46570 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add46580 db_trap() at db_trap+0xe8/frame 0xfffffe00add46610 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00add46680 trap() at trap+0x7b8/frame 0xfffffe00add46790 calltrap() at calltrap+0x8/frame 0xfffffe00add46790 --- trap 0x3, rip = 0xffffffff80c0ff85, rsp = 0xfffffe00add46860, rbp = 0xfffffe00add46880 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e39ff6e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add46190 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add461a0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00add461e0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add46270 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add46290 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add46330 db_command() at db_command+0x25c/frame 0xfffffe00add46400 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add464a0 db_command() at db_command+0x25c/frame 0xfffffe00add46570 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add46580 db_trap() at db_trap+0xe8/frame 0xfffffe00add46610 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00add46680 trap() at trap+0x7b8/frame 0xfffffe00add46790 calltrap() at calltrap+0x8/frame 0xfffffe00add46790 --- trap 0x3, rip = 0xffffffff80c0ff85, rsp = 0xfffffe00add46860, rbp = 0xfffffe00add46880 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command getty pid 2430 tid 100217 td 0xfffffe00e6420e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39fa7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39fa7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39fa820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39fa880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39fa890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39fa8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e39fa920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e39fa980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39fa9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e39faa10 dofileread() at dofileread+0x81/frame 0xfffffe00e39faa60 sys_read() at sys_read+0xc0/frame 0xfffffe00e39faad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39fabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39fabf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2429 tid 100216 td 0xfffffe00d39e1800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39f57c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39f57e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39f5820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39f5880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39f5890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39f58f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e39f5920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e39f5980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39f59b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e39f5a10 dofileread() at dofileread+0x81/frame 0xfffffe00e39f5a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e39f5ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39f5bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39f5bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2428 tid 100215 td 0xfffffe00d39e2000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39f07c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39f07e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39f0820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39f0880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39f0890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39f08f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e39f0920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e39f0980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39f09b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e39f0a10 dofileread() at dofileread+0x81/frame 0xfffffe00e39f0a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e39f0ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39f0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39f0bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2427 tid 100180 td 0xfffffe00d39e2700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38f97c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38f97e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38f9820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e38f9880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e38f9890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e38f98f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e38f9920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e38f9980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e38f99b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e38f9a10 dofileread() at dofileread+0x81/frame 0xfffffe00e38f9a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e38f9ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e38f9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e38f9bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2426 tid 100162 td 0xfffffe00d39e2e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38637c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38637e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3863820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3863880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3863890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e38638f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3863920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3863980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e38639b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3863a10 dofileread() at dofileread+0x81/frame 0xfffffe00e3863a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e3863ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3863bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3863bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2425 tid 100199 td 0xfffffe00e6694500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39947c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39947e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3994820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3994880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3994890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39948f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3994920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3994980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39949b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3994a10 dofileread() at dofileread+0x81/frame 0xfffffe00e3994a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e3994ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3994bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3994bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2424 tid 100156 td 0xfffffe00dd3bd500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38457c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38457e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3845820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3845880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3845890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e38458f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3845920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3845980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e38459b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3845a10 dofileread() at dofileread+0x81/frame 0xfffffe00e3845a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e3845ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3845bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3845bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2423 tid 100182 td 0xfffffe00dd3c7500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39037c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39037e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3903820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3903880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3903890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39038f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3903920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3903980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39039b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3903a10 dofileread() at dofileread+0x81/frame 0xfffffe00e3903a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e3903ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3903bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3903bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2422 tid 100142 td 0xfffffe003e1a7000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37fd7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37fd7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37fd820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37fd880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e37fd890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e37fd8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e37fd920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e37fd980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e37fd9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e37fda10 dofileread() at dofileread+0x81/frame 0xfffffe00e37fda60 sys_read() at sys_read+0xc0/frame 0xfffffe00e37fdad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e37fdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37fdbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2373 tid 100213 td 0xfffffe00dd3bf100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39e6870 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39e6890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39e68d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39e6930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e39e6970 _sleep() at _sleep+0x258/frame 0xfffffe00e39e6a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e39e6a90 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe00e39e6ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39e6bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39e6bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003dcbaa, rsp = 0x7fffffffeaa8, rbp = 0x7fffffffec90 --- Tracing command sshd pid 2369 tid 100181 td 0xfffffe00dd3d7800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38fe740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38fe760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38fe7a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e38fe800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e38fe810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e38fe870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e38fe8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e38fea90 sys_select() at sys_select+0x56/frame 0xfffffe00e38fead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e38febf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e38febf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008e17fa, rsp = 0x7fffffffe638, rbp = 0x7fffffffe670 --- Tracing command powerd pid 2341 tid 100167 td 0xfffffe00d39de000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3888700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3888720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3888760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e38887c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e3888800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e3888870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e38888b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e3888a90 sys_select() at sys_select+0x56/frame 0xfffffe00e3888ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3888bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3888bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004347fa, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeca0 --- Tracing command ntpd pid 2338 tid 100210 td 0xfffffe00d39e5800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39d7740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39d7760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39d77a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39d7800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39d7810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39d7870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e39d78b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e39d7a90 sys_select() at sys_select+0x56/frame 0xfffffe00e39d7ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39d7bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39d7bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80080f7fa, rsp = 0x7fffffffdec8, rbp = 0x7fffffffdf00 --- Tracing command ntpd pid 2338 tid 100353 td 0xfffffe00e64b4700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e69a3820 mi_switch() at mi_switch+0x155/frame 0xfffffe00e69a3840 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e69a3880 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e69a38e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e69a38f0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e69a3990 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe00e69a39f0 do_sem2_wait() at do_sem2_wait+0x38f/frame 0xfffffe00e69a3a80 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x76/frame 0xfffffe00e69a3ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e69a3bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e69a3bf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x800706a6a, rsp = 0x7fffdff3aee8, rbp = 0x7fffdff3af60 --- Tracing command rpc.lockd pid 2273 tid 100183 td 0xfffffe003e1b6100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3908640 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3908660 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39086a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3908700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e3908740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e39087b0 svc_run_internal() at svc_run_internal+0xafe/frame 0xfffffe00e39088f0 svc_run() at svc_run+0x253/frame 0xfffffe00e3908950 sys_nlm_syscall() at sys_nlm_syscall+0x74d/frame 0xfffffe00e3908ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3908bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3908bf0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f9b5a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec90 --- Tracing command rpc.statd pid 2270 tid 100209 td 0xfffffe00dd3d5500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39c6700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39c6720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39c6760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39c67c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e39c6800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e39c6870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e39c68b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e39c6a90 sys_select() at sys_select+0x56/frame 0xfffffe00e39c6ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39c6bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39c6bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042a7fa, rsp = 0x7fffffffea68, rbp = 0x7fffffffebb0 --- Tracing command watchdogd pid 2224 tid 100200 td 0xfffffe00e6693e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39996e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3999700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3999740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39997a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39997b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e3999850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e39998e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e3999ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3999bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3999bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003c5a4a, rsp = 0x7fffffffe9f8, rbp = 0x7fffffffeab0 --- Tracing command rpcbind pid 2076 tid 100146 td 0xfffffe00dd3be300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3813780 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38137a0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38137e0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3813840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e3813880 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e38138f0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e3813930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e3813ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3813ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3813bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3813bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003d300a, rsp = 0x7fffffffca08, rbp = 0x7fffffffec20 --- Tracing command syslogd pid 2066 tid 100161 td 0xfffffe003e4b6a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e385e740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e385e760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e385e7a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e385e800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e385e810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e385e870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e385e8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e385ea90 sys_select() at sys_select+0x56/frame 0xfffffe00e385ead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e385ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e385ebf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043d7fa, rsp = 0x7fffffffe718, rbp = 0x7fffffffec90 --- Tracing command devd pid 1995 tid 100169 td 0xfffffe00e5919100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3892700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3892720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3892760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e38927c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e3892800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e3892870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e38928b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e3892a90 sys_select() at sys_select+0x56/frame 0xfffffe00e3892ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3892bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3892bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f63aa, rsp = 0x7fffffffcb18, rbp = 0x7fffffffecb0 --- Tracing command dhclient pid 1990 tid 100193 td 0xfffffe00dd3f9300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e393a780 mi_switch() at mi_switch+0x155/frame 0xfffffe00e393a7a0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e393a7e0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e393a840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e393a880 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e393a8f0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e393a930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e393aab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e393aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e393abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e393abf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f800a, rsp = 0x7fffffffebf8, rbp = 0x7fffffffec30 --- Tracing command dhclient pid 1931 tid 100184 td 0xfffffe00e59c3c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e390d7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e390d7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e390d820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e390d880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e390d890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e390d8f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e390d930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e390dab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e390dad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e390dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e390dbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f800a, rsp = 0x7fffffffec08, rbp = 0x7fffffffec30 --- Tracing command dhclient pid 1928 tid 100164 td 0xfffffe00dd3fa800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3879740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3879760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38797a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3879800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3879810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3879870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e38798b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e3879a90 sys_select() at sys_select+0x56/frame 0xfffffe00e3879ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3879bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3879bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004547fa, rsp = 0x7fffffffe9b8, rbp = 0x7fffffffea70 --- Tracing command syncer pid 34 tid 100136 td 0xfffffe00d61fe300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00de3fda10 mi_switch() at mi_switch+0x155/frame 0xfffffe00de3fda30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de3fda70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de3fdab0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x184/frame 0xfffffe00de3fdb20 sched_sync() at sched_sync+0x68b/frame 0xfffffe00de3fdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de3fdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de3fdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 33 tid 100133 td 0xfffffe00d61fea00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00de3ee9d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00de3ee9f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de3eea30 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de3eea70 _sleep() at _sleep+0x26c/frame 0xfffffe00de3eeb10 vnlru_proc() at vnlru_proc+0xaac/frame 0xfffffe00de3eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de3eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de3eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffffe00d61ff100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d743da20 mi_switch() at mi_switch+0x155/frame 0xfffffe00d743da40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d743da80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d743dac0 _sleep() at _sleep+0x26c/frame 0xfffffe00d743db60 buf_daemon() at buf_daemon+0x112/frame 0xfffffe00d743dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d743dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d743dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100131 td 0xfffffe00d39e1100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00de2c4a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00de2c4a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de2c4a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de2c4ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00de2c4b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00de2c4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de2c4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de2c4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffffe00d39e0a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00de3f3a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00de3f3a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de3f3a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de3f3ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00de3f3b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00de3f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de3f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de3f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffffe00d39e0300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00de3f8a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00de3f8a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de3f8a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de3f8ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00de3f8b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00de3f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de3f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de3f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffffe00d39dfc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37e9a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37e9a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37e9a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37e9ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37e9b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e37e9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37e9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37e9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffffe00d39df500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37eea10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37eea30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37eea70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37eeab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37eeb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e37eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100140 td 0xfffffe00d39dee00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37f3a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37f3a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37f3a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37f3ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37f3b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100141 td 0xfffffe00d39de700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37f8a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37f8a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37f8a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37f8ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37f8b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e37f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100154 td 0xfffffe00dd3bdc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e383ba40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e383ba60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e383baa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e383bae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e383bb80 softdep_flush() at softdep_flush+0x16e/frame 0xfffffe00e383bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e383bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e383bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100157 td 0xfffffe00dd3bce00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e384aa40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e384aa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e384aaa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e384aae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e384ab80 softdep_flush() at softdep_flush+0x16e/frame 0xfffffe00e384abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e384abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e384abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffffe00d61ff800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7438a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7438a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7438aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d7438b40 vm_daemon() at vm_daemon+0x82/frame 0xfffffe00d7438bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7438bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7438bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffffe00d6097e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7433670 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7433690 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d74336d0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d7433710 _sleep() at _sleep+0x26c/frame 0xfffffe00d74337b0 vm_pageout_worker() at vm_pageout_worker+0x279/frame 0xfffffe00d7433b70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe00d7433bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7433bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7433bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100132 td 0xfffffe00d39e4a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00de3e9830 mi_switch() at mi_switch+0x155/frame 0xfffffe00de3e9850 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de3e9890 _sleep() at _sleep+0x2cd/frame 0xfffffe00de3e9930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xc21/frame 0xfffffe00de3e9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de3e9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de3e9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100137 td 0xfffffe00d39e4300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37e4a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37e4a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37e4aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37e4ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37e4b80 uma_reclaim_worker() at uma_reclaim_worker+0xb8/frame 0xfffffe00e37e4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37e4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37e4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffffe00d31a6300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d742ea40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d742ea60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d742eaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d742eb40 enc_daemon() at enc_daemon+0xe4/frame 0xfffffe00d742ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d742ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d742ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffffe00d31a6a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7429a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7429a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7429aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d7429b40 enc_daemon() at enc_daemon+0xe4/frame 0xfffffe00d7429bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7429bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7429bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100123 td 0xfffffe00d6099300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d741a9f0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d741aa10 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d741aa50 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d741aa90 _sleep() at _sleep+0x26c/frame 0xfffffe00d741ab30 random_kthread() at random_kthread+0x67/frame 0xfffffe00d741abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d741abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d741abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffffe00d61fc000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bf6a90 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bf6ab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bf6af0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bf6b90 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0037bf6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bf6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bf6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffffe00d31a7100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bf1a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bf1a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bf1a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bf1ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bf1b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037bf1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bf1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bf1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffffe00d31a7800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037beca30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037beca50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037beca90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037becad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037becb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037becbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037becbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037becbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffffe00d6097000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037be7a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037be7a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037be7a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037be7ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037be7b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037be7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037be7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037be7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffffe00d6097700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037be2a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037be2a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037be2a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037be2ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037be2b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037be2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037be2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037be2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffffe003e4b4e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b77ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b77ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b77b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b77b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffffe003e4b4700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b7cab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b7cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b7cb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b7cb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b7cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b7cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b7cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffffe003e4b4000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b81ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b81ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b81b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b81b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b81bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b81bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b81bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffffe003e1aa800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b86ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b86ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b86b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b86b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b86bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b86bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b86bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffffe003e1aa100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b8bab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b8bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b8bb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b8bb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b8bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b8bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b8bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffffe00d2e1a500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b95ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b95ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b95b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b95b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b95bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b95bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b95bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffffe00d2e19e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b9aab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b9aad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b9ab10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b9ab70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b9abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b9abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b9abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffffe00d2e19700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b9fab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b9fad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b9fb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b9fb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b9fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b9fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b9fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffffe00d2e19000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ba4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ba4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba4b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037ba4b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037ba4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffffe003e4b7800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ba9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ba9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba9b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037ba9b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037ba9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffffe00d31a4e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bbaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bbaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bbab10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bbab70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bbabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bbabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bbabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffffe00d31a4700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bbfab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bbfad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bbfb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bbfb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bbfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bbfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bbfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffffe00d31a4000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bc4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bc4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc4b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bc4b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bc4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffffe00d2e1c800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bc9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bc9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc9b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bc9b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bc9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffffe00d2e1c100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bceab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bcead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bceb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bceb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bcebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bcebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bcebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffffe003e1a8500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b5ea60 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b5ea80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b5eac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b5eb60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0037b5ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b5ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b5ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffffe003e1a7e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b63a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b63a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b63ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b63b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0037b63bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b63bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b63bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffffe003e1a7700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b68a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b68a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b68ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b68b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0037b68bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b68bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b68bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffffe00d6098500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7424a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7424a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7424ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d7424b70 xpt_scanner_thread() at xpt_scanner_thread+0x68/frame 0xfffffe00d7424bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7424bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7424bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffffe003e1a8c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b59a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b59a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b59aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b59b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b59bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b59bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b59bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffffe003e1a9300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b54a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b54a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b54aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b54b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b54bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b54bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b54bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffffe003e1ce800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b4fa40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b4fa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4faa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b4fb40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b4fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffffe003e1b3000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b4aa40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b4aa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4aaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b4ab40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b4abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffffe003e1b3700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b45a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b45a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b45aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b45b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b45bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b45bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b45bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffffe003e1b3e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b40a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b40a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b40aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b40b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b40bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b40bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b40bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffffe003e1b4500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b3ba40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b3ba60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b3baa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b3bb40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b3bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b3bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b3bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffffe003e1b4c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b36a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b36a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b36aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b36b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b36bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b36bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b36bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffffe003e1b5300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b31a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b31a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b31aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b31b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b31bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b31bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b31bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffffe003e1b5a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b2ca40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b2ca60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b2caa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b2cb40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b2cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b2cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b2cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffffe003e1cb000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b27a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b27a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b27aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b27b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b27bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b27bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b27bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffffe003e1cb700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b22a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b22a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b22aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b22b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b22bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b22bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b22bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffffe003e1cbe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b1da70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b1da90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b1dad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b1db70 crypto_proc() at crypto_proc+0x25b/frame 0xfffffe0037b1dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b1dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b1dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffffe003e1e6800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037adca70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037adca90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037adcad0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037adcb30 seq_eventthread() at seq_eventthread+0x91/frame 0xfffffe0037adcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037adcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037adcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffffe003e1f0c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ac1a70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ac1a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ac1ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ac1b70 g_run_events() at g_run_events+0x64/frame 0xfffffe0037ac1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ac1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ac1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffffe003e1f0500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ac6a70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ac6a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ac6ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ac6b70 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe0037ac6ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037ac6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ac6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ac6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffffe003e1efe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037acba70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037acba90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037acbad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037acbb70 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe0037acbba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe0037acbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037acbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037acbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100041 td 0xfffffe003e463e00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffffe003e462100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a18b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a18b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100046 td 0xfffffe003e461a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a1db00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a1db20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a1dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a1dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a1dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100047 td 0xfffffe003e461300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a52b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a52b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a52bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a52bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a52bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffffe003e460c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffffe003e1ef700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a5cb00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a5cb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a5cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a5cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a5cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffffe003e1ef000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffffe003e466800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffffe003e466100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffffe003e465a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffffe003e465300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffffe003e464c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffffe003e464500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffffe003e1e3000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffffe003e1f2800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffffe003e1f2100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffffe003e1f1a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffffe003e4b5c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b6db00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b6db20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b6dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b6dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b6dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffffe003e4b5500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b72b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b72b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffffe003e1a9a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b90b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b90b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffffe00d2e1ba00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffffe00d2e1b300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bd8b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bd8b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037bd8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bd8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bd8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100172 td 0xfffffe00e5918300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100173 td 0xfffffe00e5917c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100174 td 0xfffffe00e5917500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100175 td 0xfffffe00e5916e00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100176 td 0xfffffe00e5916700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100177 td 0xfffffe00e5916000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100178 td 0xfffffe00e59c4a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe00e59c4300 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffffe003e3e0300 (CPU 0) kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe00add46880 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add46890 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe00add468c0 uart_intr() at uart_intr+0x128/frame 0xfffffe00add46900 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add46950 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe00add46980 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add46980 --- interrupt, rip = 0xffffffff810320f6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe003e3dfc00 (CPU 1) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e17de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e17de10 trap() at trap+0x56/frame 0xfffffe003e17df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17df20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add4ba50, rbp = 0xfffffe00add4ba50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add4ba50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add4baa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add4bac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add4bae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add4bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add4bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add4bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe003e3df500 (CPU 2) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e189e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e189e10 trap() at trap+0x56/frame 0xfffffe003e189f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e189f20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add50a50, rbp = 0xfffffe00add50a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add50a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add50aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add50ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add50ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add50bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add50bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add50bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe003e3dee00 (CPU 3) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e195e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e195e10 trap() at trap+0x56/frame 0xfffffe003e195f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e195f20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add55a50, rbp = 0xfffffe00add55a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add55a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add55aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add55ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add55ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add55bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add55bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add55bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe003e3de700 (CPU 4) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1a1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1a1e10 trap() at trap+0x56/frame 0xfffffe003e1a1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a1f20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add5aa50, rbp = 0xfffffe00add5aa50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add5aa50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add5aaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add5aac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add5aae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add5abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add5abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add5abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe003e3de000 (CPU 5) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1ade00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1ade10 trap() at trap+0x56/frame 0xfffffe003e1adf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1adf20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add5fa50, rbp = 0xfffffe00add5fa50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add5fa50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add5faa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add5fac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add5fae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add5fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add5fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add5fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe003e3e8a00 (CPU 6) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1b9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1b9e10 trap() at trap+0x56/frame 0xfffffe003e1b9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1b9f20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add64a50, rbp = 0xfffffe00add64a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add64a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add64aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add64ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add64ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add64bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add64bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add64bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe003e3e8300 (CPU 7) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1c5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1c5e10 trap() at trap+0x56/frame 0xfffffe003e1c5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c5f20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add69a50, rbp = 0xfffffe00add69a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add69a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add69aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add69ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add69ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add69bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add69bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add69bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe003e3e7c00 (CPU 8) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1d1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1d1e10 trap() at trap+0x56/frame 0xfffffe003e1d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d1f20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add6ea50, rbp = 0xfffffe00add6ea50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add6ea50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add6eaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add6eac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add6eae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add6ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add6ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add6ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe003e3e7500 (CPU 9) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1dde00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1dde10 trap() at trap+0x56/frame 0xfffffe003e1ddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ddf20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add73a50, rbp = 0xfffffe00add73a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add73a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add73aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add73ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add73ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe003e3e6e00 (CPU 10) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1e9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1e9e10 trap() at trap+0x56/frame 0xfffffe003e1e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1e9f20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add78a50, rbp = 0xfffffe00add78a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add78a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add78aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add78ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add78ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add78bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add78bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add78bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe003e3e6700 (CPU 11) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1f5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1f5e10 trap() at trap+0x56/frame 0xfffffe003e1f5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f5f20 --- trap 0x13, rip = 0xffffffff810320f6, rsp = 0xfffffe00add7da50, rbp = 0xfffffe00add7da50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7da50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add7daa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7dac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7dae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add7dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe003e3e0a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add416e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add41700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add41740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00add417a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00add417b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00add41850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00add418e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00add41ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00add41bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00add41bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b133a, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe003e3e1100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add3ca90 mi_switch() at mi_switch+0x155/frame 0xfffffe00add3cab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add3caf0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe00add3cb50 audit_worker() at audit_worker+0x9f/frame 0xfffffe00add3cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add3cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add3cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81c8d740 sched_switch() at sched_switch+0x5b2/frame 0xffffffff82307c10 mi_switch() at mi_switch+0x155/frame 0xffffffff82307c30 sleepq_switch() at sleepq_switch+0x11a/frame 0xffffffff82307c70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82307cb0 _sleep() at _sleep+0x26c/frame 0xffffffff82307d50 swapper() at swapper+0x75/frame 0xffffffff82307da0 mi_startup() at mi_startup+0x2ed/frame 0xffffffff82307df0 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffffe003e3e6000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add82ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add82ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add82b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add82b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add82bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add82bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add82bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe003e3e1800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add87ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add87ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add87b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add87b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add87bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add87bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add87bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffffe003e455300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add8cab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add8cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add8cb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add8cb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add8cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add8cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add8cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe003e454c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add91ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add91ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add91b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add91b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add91bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add91bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add91bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe003e454500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add96ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add96ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add96b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add96b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add96bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add96bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add96bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe003e453e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add9bab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add9bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add9bb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add9bb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add9bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe003e453700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adda0ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adda0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adda0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adda0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adda0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe003e453000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adda5ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adda5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adda5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adda5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adda5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe003e3e9800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addaaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addaaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addaab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addaab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addaabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addaabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addaabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe003e3e9100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addafab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addafad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addafb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addafb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addafbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addafbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addafbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe003e458c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addb4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addb4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addb4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addb4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addb4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe003e458500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addb9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addb9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addb9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addb9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addb9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe003e457e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addbeab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addbead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addbeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addbeb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addbebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addbebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addbebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe003e457700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addc3ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addc3ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addc3b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addc3b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addc3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe003e457000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addc8ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addc8ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addc8b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addc8b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addc8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe003e456800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addcdab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addcdad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addcdb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addcdb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addcdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addcdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addcdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe003e456100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addd2ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addd2ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addd2b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addd2b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addd2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addd2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addd2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe003e455a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addd7ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addd7ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addd7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addd7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addd7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addd7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addd7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe003e460500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adddcab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adddcad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adddcb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adddcb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adddcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adddcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adddcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe003e45fe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adde1ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adde1ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adde1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adde1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adde1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adde1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adde1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe003e45f700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adde6ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adde6ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adde6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adde6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adde6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adde6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adde6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe003e45f000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addebab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addebad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addebb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addebb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe003e45a800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addf0ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addf0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addf0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addf0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addf0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addf0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addf0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe003e45a100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addf5ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addf5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addf5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addf5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addf5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addf5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addf5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe003e459a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addfaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addfaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addfab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addfab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addfabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addfabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addfabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe003e459300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addffa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00addffaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addffae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addffb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00addffbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addffbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffffe003e463700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a09a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a09aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a09ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a09b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffffe003e463000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a0ea80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a0eaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a0eae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a0eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffffe003e462800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a13a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a13aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a13ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a13b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe003e1f1300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037abca80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037abcaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037abcae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037abcb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037abcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037abcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037abcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe003e1e6100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ae1a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ae1aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae1ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037ae1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe003e1e5a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ae6a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ae6aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae6ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae6b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037ae6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe003e1e5300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037aeba80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037aebaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aebae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aebb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037aebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe003e1e4c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037af0a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037af0aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af0ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af0b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037af0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe003e1e4500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037af5a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037af5aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af5ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037af5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe003e1e3e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037afaa80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037afaaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037afaae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037afab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037afabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037afabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037afabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe003e1e3700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037affa80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037affaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037affae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037affb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037affbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037affbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037affbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe003e1ce100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b04a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b04aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b04ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b04b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe003e1cda00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b09a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b09aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b09ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b09b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe003e1cd300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b0ea80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b0eaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b0eae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b0eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe003e1ccc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b13a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b13aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b13ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b13b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffffe003e1cc500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b18a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b18aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b18ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffffe00d2e1ac00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bddab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bddad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bddb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bddb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe0037bddbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bddbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bddbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffffe00d609a800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bfbab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bfbad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bfbb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bfbb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe0037bfbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bfbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bfbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffffe00d609a100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7410ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7410ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7410b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d7410b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00d7410bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7410bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7410bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffffe00d6099a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7415ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7415ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7415b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d7415b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00d7415bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7415bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7415bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffffe00d6098c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d741fa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00d741faa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d741fae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d741fb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00d741fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d741fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d741fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> show allchains chain 1: thread 100294 (pid 64120, sleep) is sleeping on 0xffffffff81cadcd4 "nanslp" chain 2: thread 100189 (pid 4746, ls) is blocked on lockmgr ufsEXCL thread 100279 (pid 3974, umount) is sleeping on 0xfffffe0017206200 "vmopar" chain 3: thread 100232 (pid 4745, sh) is sleeping on 0xfffff8017e8c6a40 "wait" chain 4: thread 100279 (pid 3974, umount) is sleeping on 0xfffffe0017206200 "vmopar" chain 5: thread 100238 (pid 3727, md10) is sleeping on 0xfffff80068042000 "mdwait" chain 6: thread 100233 (pid 3715, bash) is sleeping on 0xfffff800214d2240 "select" chain 7: thread 100185 (pid 3714, sshd) is sleeping on 0xfffff8003f8247c0 "select" chain 8: thread 100147 (pid 3705, tee) is sleeping on 0xfffff8017e943000 "piperd" chain 9: thread 100204 (pid 3704, sh) is sleeping on 0xfffff800218cba40 "wait" chain 10: thread 100223 (pid 3703, sh) is sleeping on 0xfffff800218f2a40 "wait" chain 11: thread 100194 (pid 3666, sshd) is sleeping on 0xfffff80021502240 "select" chain 12: thread 100235 (pid 2618, sh) is sleeping on 0xfffff800217f82f8 "piperd" chain 13: thread 100196 (pid 2616, awk) is sleeping on 0xfffff80021898be0 "piperd" chain 14: thread 100234 (pid 2615, sh) is sleeping on 0xfffff80021f22520 "wait" chain 15: thread 100230 (pid 2568, sh) is sleeping on 0xfffff800216cfa40 "wait" chain 16: thread 100166 (pid 2485, sh) is sleeping on 0xfffff800216cf000 "wait" chain 17: thread 100208 (pid 2482, bash) is sleeping on 0xfffff800218f4a40 "wait" chain 18: thread 100197 (pid 2480, csh) is sleeping on 0xfffff80021a9fae8 "pause" chain 19: thread 100149 (pid 2479, su) is sleeping on 0xfffff800216cf520 "wait" chain 20: thread 100168 (pid 2474, bash) is sleeping on 0xfffff80004111520 "wait" chain 21: thread 100192 (pid 2473, sshd) is sleeping on 0xfffff8003f83e840 "select" chain 22: thread 100211 (pid 2470, sshd) is sleeping on 0xfffff800215023c0 "select" chain 23: thread 100171 (pid 2466, csh) is sleeping on 0xfffff8001c0748b0 "ttyin" chain 24: thread 100218 (pid 2431, login) is sleeping on 0xfffff800216b4000 "wait" chain 25: thread 100217 (pid 2430, getty) is sleeping on 0xfffff8001c05b4b0 "ttyin" chain 26: thread 100216 (pid 2429, getty) is sleeping on 0xfffff8002114f4b0 "ttyin" chain 27: thread 100215 (pid 2428, getty) is sleeping on 0xfffff8002114fcb0 "ttyin" chain 28: thread 100180 (pid 2427, getty) is sleeping on 0xfffff800210744b0 "ttyin" chain 29: thread 100162 (pid 2426, getty) is sleeping on 0xfffff80021074cb0 "ttyin" chain 30: thread 100199 (pid 2425, getty) is sleeping on 0xfffff800210734b0 "ttyin" chain 31: thread 100156 (pid 2424, getty) is sleeping on 0xfffff80021073cb0 "ttyin" chain 32: thread 100182 (pid 2423, getty) is sleeping on 0xfffff800210764b0 "ttyin" chain 33: thread 100142 (pid 2422, getty) is sleeping on 0xfffff80021076cb0 "ttyin" chain 34: thread 100213 (pid 2373, cron) is sleeping on 0xffffffff81cadcd5 "nanslp" chain 35: thread 100181 (pid 2369, sshd) is sleeping on 0xfffff800031c8640 "select" chain 36: thread 100167 (pid 2341, powerd) is sleeping on 0xfffff800219bc2c0 "select" chain 37: thread 100210 (pid 2338, ntpd) is sleeping on 0xfffff8002130b340 "select" chain 38: thread 100353 (pid 2338, ntpd) is sleeping on 0xfffff800214ac380 "usem" chain 39: thread 100183 (pid 2273, NLM: master) is sleeping on 0xfffff80021945060 "rpcsvc" chain 40: thread 100209 (pid 2270, rpc.statd) is sleeping on 0xfffff80021b2e440 "select" chain 41: thread 100200 (pid 2224, watchdogd) is sleeping on 0xfffff8006819a520 "wait" chain 42: thread 100146 (pid 2076, rpcbind) is sleeping on 0xfffff800212fc1c0 "select" chain 43: thread 100161 (pid 2066, syslogd) is sleeping on 0xfffff800219bc840 "select" chain 44: thread 100169 (pid 1995, devd) is sleeping on 0xfffff8003f8248c0 "select" chain 45: thread 100193 (pid 1990, dhclient) is sleeping on 0xfffff800212fc040 "select" chain 46: thread 100184 (pid 1931, dhclient) is sleeping on 0xfffff8002130e340 "select" chain 47: thread 100164 (pid 1928, dhclient) is sleeping on 0xfffff800219bc7c0 "select" chain 48: thread 100136 (pid 34, syncer) is sleeping on 0xffffffff81d99898 "syncer" chain 49: thread 100133 (pid 33, vnlru) is sleeping on 0xfffff800210e2000 "vlruwt" chain 50: thread 100130 (pid 32, bufdaemon) is sleeping on 0xffffffff81d98bc0 "qsleep" chain 51: thread 100131 (pid 32, bufspacedaemon-0) is sleeping on 0xffffffff8180aa00 "-" chain 52: thread 100134 (pid 32, bufspacedaemon-1) is sleeping on 0xffffffff81812cc0 "-" chain 53: thread 100135 (pid 32, bufspacedaemon-2) is sleeping on 0xffffffff8181af80 "-" chain 54: thread 100138 (pid 32, bufspacedaemon-3) is sleeping on 0xffffffff81823240 "-" chain 55: thread 100139 (pid 32, bufspacedaemon-4) is sleeping on 0xffffffff8182b500 "-" chain 56: thread 100140 (pid 32, bufspacedaemon-5) is sleeping on 0xffffffff818337c0 "-" chain 57: thread 100141 (pid 32, bufspacedaemon-6) is sleeping on 0xffffffff8183ba80 "-" chain 58: thread 100154 (pid 32, / worker) is sleeping on 0xfffff8001c0728e8 "sdflush" chain 59: thread 100157 (pid 32, /tmp worker) is sleeping on 0xfffff800215910e8 "sdflush" chain 60: thread 100129 (pid 31, vmdaemon) is sleeping on 0xffffffff81dbdac8 "psleep" chain 61: thread 100128 (pid 30, dom0) is sleeping on 0xffffffff81db2098 "psleep" chain 62: thread 100132 (pid 30, laundry: dom0) is sleeping on 0xffffffff81db20a4 "launds" chain 63: thread 100137 (pid 30, uma) is sleeping on 0xffffffff80f08770 "umarcl" chain 64: thread 100127 (pid 29, enc_daemon1) is sleeping on 0xfffff80003f0b520 "idle" chain 65: thread 100126 (pid 28, enc_daemon0) is sleeping on 0xfffff80003f0ba40 "idle" chain 66: thread 100123 (pid 27, rand_harvestq) is sleeping on 0xffffffff81ae18a0 "-" chain 67: thread 100119 (pid 26, sctp_iterator) is sleeping on 0xffffffff81d9c010 "waiting_for_work" chain 68: thread 100118 (pid 25, soaiod4) is sleeping on 0xffffffff81d984ec "-" chain 69: thread 100117 (pid 24, soaiod3) is sleeping on 0xffffffff81d984ec "-" chain 70: thread 100116 (pid 23, soaiod2) is sleeping on 0xffffffff81d984ec "-" chain 71: thread 100115 (pid 22, soaiod1) is sleeping on 0xffffffff81d984ec "-" chain 72: thread 100096 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84440 "-" chain 73: thread 100097 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84498 "-" chain 74: thread 100098 (pid 21, usbus0) is sleeping on 0xfffffe00d2d844f0 "-" chain 75: thread 100099 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84548 "-" chain 76: thread 100100 (pid 21, usbus0) is sleeping on 0xfffffe00d2d845a0 "-" chain 77: thread 100102 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2cf0 "-" chain 78: thread 100103 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2d48 "-" chain 79: thread 100104 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2da0 "-" chain 80: thread 100105 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2df8 "-" chain 81: thread 100106 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2e50 "-" chain 82: thread 100107 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23cf0 "-" chain 83: thread 100108 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23d48 "-" chain 84: thread 100109 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23da0 "-" chain 85: thread 100110 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23df8 "-" chain 86: thread 100111 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23e50 "-" chain 87: thread 100091 (pid 20, doneq0) is sleeping on 0xffffffff819b95c0 "-" chain 88: thread 100093 (pid 20, doneq2) is sleeping on 0xffffffff819b96c0 "-" chain 89: thread 100125 (pid 20, scanner) is sleeping on 0xffffffff819b9490 "-" chain 90: thread 100090 (pid 19, crypto returns 11) is sleeping on 0xfffff80003ab0c50 "crypto_ret_wait" chain 91: thread 100089 (pid 18, crypto returns 10) is sleeping on 0xfffff80003ab0bf0 "crypto_ret_wait" chain 92: thread 100088 (pid 17, crypto returns 9) is sleeping on 0xfffff80003ab0b90 "crypto_ret_wait" chain 93: thread 100087 (pid 16, crypto returns 8) is sleeping on 0xfffff80003ab0b30 "crypto_ret_wait" chain 94: thread 100086 (pid 15, crypto returns 7) is sleeping on 0xfffff80003ab0ad0 "crypto_ret_wait" chain 95: thread 100085 (pid 9, crypto returns 6) is sleeping on 0xfffff80003ab0a70 "crypto_ret_wait" chain 96: thread 100084 (pid 8, crypto returns 5) is sleeping on 0xfffff80003ab0a10 "crypto_ret_wait" chain 97: thread 100083 (pid 7, crypto returns 4) is sleeping on 0xfffff80003ab09b0 "crypto_ret_wait" chain 98: thread 100082 (pid 6, crypto returns 3) is sleeping on 0xfffff80003ab0950 "crypto_ret_wait" chain 99: thread 100081 (pid 5, crypto returns 2) is sleeping on 0xfffff80003ab08f0 "crypto_ret_wait" chain 100: thread 100080 (pid 4, crypto returns 1) is sleeping on 0xfffff80003ab0890 "crypto_ret_wait" chain 101: thread 100079 (pid 3, crypto returns 0) is sleeping on 0xfffff80003ab0830 "crypto_ret_wait" chain 102: thread 100078 (pid 2, crypto) is sleeping on 0xffffffff81daf7c0 "crypto_wait" chain 103: thread 100065 (pid 14, sequencer 00) is sleeping on 0xfffff80003a0a488 "seqstate" chain 104: thread 100062 (pid 13, g_event) is sleeping on 0xffffffff81c8cc80 "-" chain 105: thread 100063 (pid 13, g_up) is sleeping on 0xffffffff81c8cc88 "-" chain 106: thread 100064 (pid 13, g_down) is sleeping on 0xffffffff81c8cc90 "-" chain 107: thread 100002 (pid 1, init) is sleeping on 0xfffff800038f8000 "wait" chain 108: thread 100001 (pid 10, audit) is sleeping on 0xffffffff81dafc98 "audit_worker_cv" chain 109: thread 100000 (pid 0, swapper) is sleeping on 0xffffffff81c8d210 "swapin" chain 110: thread 100015 (pid 0, if_io_tqg_0) is sleeping on 0xfffff8000391c100 "-" chain 111: thread 100016 (pid 0, if_io_tqg_1) is sleeping on 0xfffff8000391c000 "-" chain 112: thread 100017 (pid 0, if_io_tqg_2) is sleeping on 0xfffff80003919e00 "-" chain 113: thread 100018 (pid 0, if_io_tqg_3) is sleeping on 0xfffff80003919d00 "-" chain 114: thread 100019 (pid 0, if_io_tqg_4) is sleeping on 0xfffff80003919c00 "-" chain 115: thread 100020 (pid 0, if_io_tqg_5) is sleeping on 0xfffff80003919b00 "-" chain 116: thread 100021 (pid 0, if_io_tqg_6) is sleeping on 0xfffff80003919a00 "-" chain 117: thread 100022 (pid 0, if_io_tqg_7) is sleeping on 0xfffff80003919900 "-" chain 118: thread 100023 (pid 0, if_io_tqg_8) is sleeping on 0xfffff80003919800 "-" chain 119: thread 100024 (pid 0, if_io_tqg_9) is sleeping on 0xfffff80003919700 "-" chain 120: thread 100025 (pid 0, if_io_tqg_10) is sleeping on 0xfffff80003919600 "-" chain 121: thread 100026 (pid 0, if_io_tqg_11) is sleeping on 0xfffff80003919500 "-" chain 122: thread 100027 (pid 0, if_config_tqg_0) is sleeping on 0xfffff80003919400 "-" chain 123: thread 100028 (pid 0, softirq_0) is sleeping on 0xfffff80003919300 "-" chain 124: thread 100029 (pid 0, softirq_1) is sleeping on 0xfffff80003919200 "-" chain 125: thread 100030 (pid 0, softirq_2) is sleeping on 0xfffff80003919100 "-" chain 126: thread 100031 (pid 0, softirq_3) is sleeping on 0xfffff80003919000 "-" chain 127: thread 100032 (pid 0, softirq_4) is sleeping on 0xfffff8000391ae00 "-" chain 128: thread 100033 (pid 0, softirq_5) is sleeping on 0xfffff8000391ad00 "-" chain 129: thread 100034 (pid 0, softirq_6) is sleeping on 0xfffff8000391ac00 "-" chain 130: thread 100035 (pid 0, softirq_7) is sleeping on 0xfffff8000391ab00 "-" chain 131: thread 100036 (pid 0, softirq_8) is sleeping on 0xfffff8000391aa00 "-" chain 132: thread 100037 (pid 0, softirq_9) is sleeping on 0xfffff8000391a900 "-" chain 133: thread 100038 (pid 0, softirq_10) is sleeping on 0xfffff8000391a800 "-" chain 134: thread 100039 (pid 0, softirq_11) is sleeping on 0xfffff8000391a700 "-" chain 135: thread 100040 (pid 0, thread taskq) is sleeping on 0xfffff8000393c100 "-" chain 136: thread 100042 (pid 0, aiod_kick taskq) is sleeping on 0xfffff80003939e00 "-" chain 137: thread 100043 (pid 0, in6m_free taskq) is sleeping on 0xfffff80003939d00 "-" chain 138: thread 100044 (pid 0, kqueue_ctx taskq) is sleeping on 0xfffff80003939c00 "-" chain 139: thread 100061 (pid 0, firmware taskq) is sleeping on 0xfffff80003939900 "-" chain 140: thread 100066 (pid 0, crypto_0) is sleeping on 0xfffff80003939800 "-" chain 141: thread 100067 (pid 0, crypto_1) is sleeping on 0xfffff80003939800 "-" chain 142: thread 100068 (pid 0, crypto_2) is sleeping on 0xfffff80003939800 "-" chain 143: thread 100069 (pid 0, crypto_3) is sleeping on 0xfffff80003939800 "-" chain 144: thread 100070 (pid 0, crypto_4) is sleeping on 0xfffff80003939800 "-" chain 145: thread 100071 (pid 0, crypto_5) is sleeping on 0xfffff80003939800 "-" chain 146: thread 100072 (pid 0, crypto_6) is sleeping on 0xfffff80003939800 "-" chain 147: thread 100073 (pid 0, crypto_7) is sleeping on 0xfffff80003939800 "-" chain 148: thread 100074 (pid 0, crypto_8) is sleeping on 0xfffff80003939800 "-" chain 149: thread 100075 (pid 0, crypto_9) is sleeping on 0xfffff80003939800 "-" chain 150: thread 100076 (pid 0, crypto_10) is sleeping on 0xfffff80003939800 "-" chain 151: thread 100077 (pid 0, crypto_11) is sleeping on 0xfffff80003939800 "-" chain 152: thread 100114 (pid 0, mca taskq) is sleeping on 0xfffff8001c0e0300 "-" chain 153: thread 100120 (pid 0, acpi_task_0) is sleeping on 0xfffff80021127500 "-" chain 154: thread 100121 (pid 0, acpi_task_1) is sleeping on 0xfffff80021127500 "-" chain 155: thread 100122 (pid 0, acpi_task_2) is sleeping on 0xfffff80021127500 "-" chain 156: thread 100124 (pid 0, CAM taskq) is sleeping on 0xfffff80003939700 "-" db:0:pho> chain 1: thread 100294 (pid 64120, sleep) is sleeping on 0xffffffff81cadcd4 "nanslp" chain 2: thread 100189 (pid 4746, ls) is blocked on lockmgr ufsEXCL thread 100279 (pid 3974, umount) is sleeping on 0xfffffe0017206200 "vmopar" chain 3: thread 100232 (pid 4745, sh) is sleeping on 0xfffff8017e8c6a40 "wait" chain 4: thread 100279 (pid 3974, umount) is sleeping on 0xfffffe0017206200 "vmopar" chain 5: thread 100238 (pid 3727, md10) is sleeping on 0xfffff80068042000 "mdwait" chain 6: thread 100233 (pid 3715, bash) is sleeping on 0xfffff800214d2240 "select" chain 7: thread 100185 (pid 3714, sshd) is sleeping on 0xfffff8003f8247c0 "select" chain 8: thread 100147 (pid 3705, tee) is sleeping on 0xfffff8017e943000 "piperd" chain 9: thread 100204 (pid 3704, sh) is sleeping on 0xfffff800218cba40 "wait" chain 10: thread 100223 (pid 3703, sh) is sleeping on 0xfffff800218f2a40 "wait" chain 11: thread 100194 (pid 3666, sshd) is sleeping on 0xfffff80021502240 "select" chain 12: thread 100235 (pid 2618, sh) is sleeping on 0xfffff800217f82f8 "piperd" chain 13: thread 100196 (pid 2616, awk) is sleeping on 0xfffff80021898be0 "piperd" chain 14: thread 100234 (pid 2615, sh) is sleeping on 0xfffff80021f22520 "wait" chain 15: thread 100230 (pid 2568, sh) is sleeping on 0xfffff800216cfa40 "wait" chain 16: thread 100166 (pid 2485, sh) is sleeping on 0xfffff800216cf000 "wait" chain 17: thread 100208 (pid 2482, bash) is sleeping on 0xfffff800218f4a40 "wait" chain 18: thread 100197 (pid 2480, csh) is sleeping on 0xfffff80021a9fae8 "pause" chain 19: thread 100149 (pid 2479, su) is sleeping on 0xfffff800216cf520 "wait" chain 20: thread 100168 (pid 2474, bash) is sleeping on 0xfffff80004111520 "wait" chain 21: thread 100192 (pid 2473, sshd) is sleeping on 0xfffff8003f83e840 "select" chain 22: thread 100211 (pid 2470, sshd) is sleeping on 0xfffff800215023c0 "select" chain 23: thread 100171 (pid 2466, csh) is sleeping on 0xfffff8001c0748b0 "ttyin" chain 24: thread 100218 (pid 2431, login) is sleeping on 0xfffff800216b4000 "wait" chain 25: thread 100217 (pid 2430, getty) is sleeping on 0xfffff8001c05b4b0 "ttyin" chain 26: thread 100216 (pid 2429, getty) is sleeping on 0xfffff8002114f4b0 "ttyin" chain 27: thread 100215 (pid 2428, getty) is sleeping on 0xfffff8002114fcb0 "ttyin" chain 28: thread 100180 (pid 2427, getty) is sleeping on 0xfffff800210744b0 "ttyin" chain 29: thread 100162 (pid 2426, getty) is sleeping on 0xfffff80021074cb0 "ttyin" chain 30: thread 100199 (pid 2425, getty) is sleeping on 0xfffff800210734b0 "ttyin" chain 31: thread 100156 (pid 2424, getty) is sleeping on 0xfffff80021073cb0 "ttyin" chain 32: thread 100182 (pid 2423, getty) is sleeping on 0xfffff800210764b0 "ttyin" chain 33: thread 100142 (pid 2422, getty) is sleeping on 0xfffff80021076cb0 "ttyin" chain 34: thread 100213 (pid 2373, cron) is sleeping on 0xffffffff81cadcd5 "nanslp" chain 35: thread 100181 (pid 2369, sshd) is sleeping on 0xfffff800031c8640 "select" chain 36: thread 100167 (pid 2341, powerd) is sleeping on 0xfffff800219bc2c0 "select" chain 37: thread 100210 (pid 2338, ntpd) is sleeping on 0xfffff8002130b340 "select" chain 38: thread 100353 (pid 2338, ntpd) is sleeping on 0xfffff800214ac380 "usem" chain 39: thread 100183 (pid 2273, NLM: master) is sleeping on 0xfffff80021945060 "rpcsvc" chain 40: thread 100209 (pid 2270, rpc.statd) is sleeping on 0xfffff80021b2e440 "select" chain 41: thread 100200 (pid 2224, watchdogd) is sleeping on 0xfffff8006819a520 "wait" chain 42: thread 100146 (pid 2076, rpcbind) is sleeping on 0xfffff800212fc1c0 "select" chain 43: thread 100161 (pid 2066, syslogd) is sleeping on 0xfffff800219bc840 "select" chain 44: thread 100169 (pid 1995, devd) is sleeping on 0xfffff8003f8248c0 "select" chain 45: thread 100193 (pid 1990, dhclient) is sleeping on 0xfffff800212fc040 "select" chain 46: thread 100184 (pid 1931, dhclient) is sleeping on 0xfffff8002130e340 "select" chain 47: thread 100164 (pid 1928, dhclient) is sleeping on 0xfffff800219bc7c0 "select" chain 48: thread 100136 (pid 34, syncer) is sleeping on 0xffffffff81d99898 "syncer" chain 49: thread 100133 (pid 33, vnlru) is sleeping on 0xfffff800210e2000 "vlruwt" chain 50: thread 100130 (pid 32, bufdaemon) is sleeping on 0xffffffff81d98bc0 "qsleep" chain 51: thread 100131 (pid 32, bufspacedaemon-0) is sleeping on 0xffffffff8180aa00 "-" chain 52: thread 100134 (pid 32, bufspacedaemon-1) is sleeping on 0xffffffff81812cc0 "-" chain 53: thread 100135 (pid 32, bufspacedaemon-2) is sleeping on 0xffffffff8181af80 "-" chain 54: thread 100138 (pid 32, bufspacedaemon-3) is sleeping on 0xffffffff81823240 "-" chain 55: thread 100139 (pid 32, bufspacedaemon-4) is sleeping on 0xffffffff8182b500 "-" chain 56: thread 100140 (pid 32, bufspacedaemon-5) is sleeping on 0xffffffff818337c0 "-" chain 57: thread 100141 (pid 32, bufspacedaemon-6) is sleeping on 0xffffffff8183ba80 "-" chain 58: thread 100154 (pid 32, / worker) is sleeping on 0xfffff8001c0728e8 "sdflush" chain 59: thread 100157 (pid 32, /tmp worker) is sleeping on 0xfffff800215910e8 "sdflush" chain 60: thread 100129 (pid 31, vmdaemon) is sleeping on 0xffffffff81dbdac8 "psleep" chain 61: thread 100128 (pid 30, dom0) is sleeping on 0xffffffff81db2098 "psleep" chain 62: thread 100132 (pid 30, laundry: dom0) is sleeping on 0xffffffff81db20a4 "launds" chain 63: thread 100137 (pid 30, uma) is sleeping on 0xffffffff80f08770 "umarcl" chain 64: thread 100127 (pid 29, enc_daemon1) is sleeping on 0xfffff80003f0b520 "idle" chain 65: thread 100126 (pid 28, enc_daemon0) is sleeping on 0xfffff80003f0ba40 "idle" chain 66: thread 100123 (pid 27, rand_harvestq) is sleeping on 0xffffffff81ae18a0 "-" chain 67: thread 100119 (pid 26, sctp_iterator) is sleeping on 0xffffffff81d9c010 "waiting_for_work" chain 68: thread 100118 (pid 25, soaiod4) is sleeping on 0xffffffff81d984ec "-" chain 69: thread 100117 (pid 24, soaiod3) is sleeping on 0xffffffff81d984ec "-" chain 70: thread 100116 (pid 23, soaiod2) is sleeping on 0xffffffff81d984ec "-" chain 71: thread 100115 (pid 22, soaiod1) is sleeping on 0xffffffff81d984ec "-" chain 72: thread 100096 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84440 "-" chain 73: thread 100097 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84498 "-" chain 74: thread 100098 (pid 21, usbus0) is sleeping on 0xfffffe00d2d844f0 "-" chain 75: thread 100099 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84548 "-" chain 76: thread 100100 (pid 21, usbus0) is sleeping on 0xfffffe00d2d845a0 "-" chain 77: thread 100102 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2cf0 "-" chain 78: thread 100103 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2d48 "-" chain 79: thread 100104 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2da0 "-" chain 80: thread 100105 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2df8 "-" chain 81: thread 100106 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2e50 "-" chain 82: thread 100107 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23cf0 "-" chain 83: thread 100108 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23d48 "-" chain 84: thread 100109 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23da0 "-" chain 85: thread 100110 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23df8 "-" chain 86: thread 100111 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23e50 "-" chain 87: thread 100091 (pid 20, doneq0) is sleeping on 0xffffffff819b95c0 "-" chain 88: thread 100093 (pid 20, doneq2) is sleeping on 0xffffffff819b96c0 "-" chain 89: thread 100125 (pid 20, scanner) is sleeping on 0xffffffff819b9490 "-" chain 90: thread 100090 (pid 19, crypto returns 11) is sleeping on 0xfffff80003ab0c50 "crypto_ret_wait" chain 91: thread 100089 (pid 18, crypto returns 10) is sleeping on 0xfffff80003ab0bf0 "crypto_ret_wait" chain 92: thread 100088 (pid 17, crypto returns 9) is sleeping on 0xfffff80003ab0b90 "crypto_ret_wait" chain 93: thread 100087 (pid 16, crypto returns 8) is sleeping on 0xfffff80003ab0b30 "crypto_ret_wait" chain 94: thread 100086 (pid 15, crypto returns 7) is sleeping on 0xfffff80003ab0ad0 "crypto_ret_wait" chain 95: thread 100085 (pid 9, crypto returns 6) is sleeping on 0xfffff80003ab0a70 "crypto_ret_wait" chain 96: thread 100084 (pid 8, crypto returns 5) is sleeping on 0xfffff80003ab0a10 "crypto_ret_wait" chain 97: thread 100083 (pid 7, crypto returns 4) is sleeping on 0xfffff80003ab09b0 "crypto_ret_wait" chain 98: thread 100082 (pid 6, crypto returns 3) is sleeping on 0xfffff80003ab0950 "crypto_ret_wait" chain 99: thread 100081 (pid 5, crypto returns 2) is sleeping on 0xfffff80003ab08f0 "crypto_ret_wait" chain 100: thread 100080 (pid 4, crypto returns 1) is sleeping on 0xfffff80003ab0890 "crypto_ret_wait" chain 101: thread 100079 (pid 3, crypto returns 0) is sleeping on 0xfffff80003ab0830 "crypto_ret_wait" chain 102: thread 100078 (pid 2, crypto) is sleeping on 0xffffffff81daf7c0 "crypto_wait" chain 103: thread 100065 (pid 14, sequencer 00) is sleeping on 0xfffff80003a0a488 "seqstate" chain 104: thread 100062 (pid 13, g_event) is sleeping on 0xffffffff81c8cc80 "-" chain 105: thread 100063 (pid 13, g_up) is sleeping on 0xffffffff81c8cc88 "-" chain 106: thread 100064 (pid 13, g_down) is sleeping on 0xffffffff81c8cc90 "-" chain 107: thread 100002 (pid 1, init) is sleeping on 0xfffff800038f8000 "wait" chain 108: thread 100001 (pid 10, audit) is sleeping on 0xffffffff81dafc98 "audit_worker_cv" chain 109: thread 100000 (pid 0, swapper) is sleeping on 0xffffffff81c8d210 "swapin" chain 110: thread 100015 (pid 0, if_io_tqg_0) is sleeping on 0xfffff8000391c100 "-" chain 111: thread 100016 (pid 0, if_io_tqg_1) is sleeping on 0xfffff8000391c000 "-" chain 112: thread 100017 (pid 0, if_io_tqg_2) is sleeping on 0xfffff80003919e00 "-" chain 113: thread 100018 (pid 0, if_io_tqg_3) is sleeping on 0xfffff80003919d00 "-" chain 114: thread 100019 (pid 0, if_io_tqg_4) is sleeping on 0xfffff80003919c00 "-" chain 115: thread 100020 (pid 0, if_io_tqg_5) is sleeping on 0xfffff80003919b00 "-" chain 116: thread 100021 (pid 0, if_io_tqg_6) is sleeping on 0xfffff80003919a00 "-" chain 117: thread 100022 (pid 0, if_io_tqg_7) is sleeping on 0xfffff80003919900 "-" chain 118: thread 100023 (pid 0, if_io_tqg_8) is sleeping on 0xfffff80003919800 "-" chain 119: thread 100024 (pid 0, if_io_tqg_9) is sleeping on 0xfffff80003919700 "-" chain 120: thread 100025 (pid 0, if_io_tqg_10) is sleeping on 0xfffff80003919600 "-" chain 121: thread 100026 (pid 0, if_io_tqg_11) is sleeping on 0xfffff80003919500 "-" chain 122: thread 100027 (pid 0, if_config_tqg_0) is sleeping on 0xfffff80003919400 "-" chain 123: thread 100028 (pid 0, softirq_0) is sleeping on 0xfffff80003919300 "-" chain 124: thread 100029 (pid 0, softirq_1) is sleeping on 0xfffff80003919200 "-" chain 125: thread 100030 (pid 0, softirq_2) is sleeping on 0xfffff80003919100 "-" chain 126: thread 100031 (pid 0, softirq_3) is sleeping on 0xfffff80003919000 "-" chain 127: thread 100032 (pid 0, softirq_4) is sleeping on 0xfffff8000391ae00 "-" chain 128: thread 100033 (pid 0, softirq_5) is sleeping on 0xfffff8000391ad00 "-" chain 129: thread 100034 (pid 0, softirq_6) is sleeping on 0xfffff8000391ac00 "-" chain 130: thread 100035 (pid 0, softirq_7) is sleeping on 0xfffff8000391ab00 "-" chain 131: thread 100036 (pid 0, softirq_8) is sleeping on 0xfffff8000391aa00 "-" chain 132: thread 100037 (pid 0, softirq_9) is sleeping on 0xfffff8000391a900 "-" chain 133: thread 100038 (pid 0, softirq_10) is sleeping on 0xfffff8000391a800 "-" chain 134: thread 100039 (pid 0, softirq_11) is sleeping on 0xfffff8000391a700 "-" chain 135: thread 100040 (pid 0, thread taskq) is sleeping on 0xfffff8000393c100 "-" chain 136: thread 100042 (pid 0, aiod_kick taskq) is sleeping on 0xfffff80003939e00 "-" chain 137: thread 100043 (pid 0, in6m_free taskq) is sleeping on 0xfffff80003939d00 "-" chain 138: thread 100044 (pid 0, kqueue_ctx taskq) is sleeping on 0xfffff80003939c00 "-" chain 139: thread 100061 (pid 0, firmware taskq) is sleeping on 0xfffff80003939900 "-" chain 140: thread 100066 (pid 0, crypto_0) is sleeping on 0xfffff80003939800 "-" chain 141: thread 100067 (pid 0, crypto_1) is sleeping on 0xfffff80003939800 "-" chain 142: thread 100068 (pid 0, crypto_2) is sleeping on 0xfffff80003939800 "-" chain 143: thread 100069 (pid 0, crypto_3) is sleeping on 0xfffff80003939800 "-" chain 144: thread 100070 (pid 0, crypto_4) is sleeping on 0xfffff80003939800 "-" chain 145: thread 100071 (pid 0, crypto_5) is sleeping on 0xfffff80003939800 "-" chain 146: thread 100072 (pid 0, crypto_6) is sleeping on 0xfffff80003939800 "-" chain 147: thread 100073 (pid 0, crypto_7) is sleeping on 0xfffff80003939800 "-" chain 148: thread 100074 (pid 0, crypto_8) is sleeping on 0xfffff80003939800 "-" chain 149: thread 100075 (pid 0, crypto_9) is sleeping on 0xfffff80003939800 "-" chain 150: thread 100076 (pid 0, crypto_10) is sleeping on 0xfffff80003939800 "-" chain 151: thread 100077 (pid 0, crypto_11) is sleeping on 0xfffff80003939800 "-" chain 152: thread 100114 (pid 0, mca taskq) is sleeping on 0xfffff8001c0e0300 "-" chain 153: thread 100120 (pid 0, acpi_task_0) is sleeping on 0xfffff80021127500 "-" chain 154: thread 100121 (pid 0, acpi_task_1) is sleeping on 0xfffff80021127500 "-" chain 155: thread 100122 (pid 0, acpi_task_2) is sleeping on 0xfffff80021127500 "-" chain 156: thread 100124 (pid 0, CAM taskq) is sleeping on 0xfffff80003939700 "-" db> (kgdb) proc 3974 [Switching to thread 196 (Thread 100279)]#0 sched_switch (td=0xfffffe00e671da00, flags=) at ../../../kern/sched_ule.c:2147 2147 cpuid = td->td_oncpu = PCPU_GET(cpuid); Current language: auto; currently minimal (kgdb) bt #0 sched_switch (td=0xfffffe00e671da00, flags=) at ../../../kern/sched_ule.c:2147 #1 0xffffffff80bd21c5 in mi_switch (flags=0x104) at ../../../kern/kern_synch.c:533 #2 0xffffffff80c1f99a in sleepq_switch (wchan=0xfffffe0017206200, pri=0x54) at ../../../kern/subr_sleepqueue.c:625 #3 0xffffffff80f284df in _vm_page_busy_sleep (obj=0xfffff8006897ad68, m=0xfffffe0017206200, pindex=0x0, wmesg=0xffffffff8122bb49 "vmopar", allocflags=0x0, locked=0x1) at ../../../vm/vm_page.c:1094 #4 0xffffffff80f29aef in vm_page_sleep_if_busy (m=0xfffffe0017206200, wmesg=0xffffffff8122bb49 "vmopar") at ../../../vm/vm_page.c:1389 #5 0xffffffff80f23cbf in vm_object_page_remove (object=0xfffff8006897ad68, start=0x0, end=, options=0x1) at ../../../vm/vm_object.c:2090 #6 0xffffffff80c9d585 in bufobj_invalbuf (bo=0xfffff8017e8c9b78, flags=0x1, slpflag=0x0, slptimeo=0x0) at ../../../kern/vfs_subr.c:1959 #7 0xffffffff80ca185e in vgonel (vp=0xfffff8017e8c9a00) at vnode_if.h:225 #8 0xffffffff80ca0e33 in vflush (mp=0xfffffe00e64ee280, rootrefs=0x0, flags=0x0, td=) at ../../../kern/vfs_subr.c:3757 #9 0xffffffff80ee5145 in ffs_flushfiles (mp=0xfffffe00e64ee280, flags=0x0, td=) at ../../../ufs/ffs/ffs_vfsops.c:1416 #10 0xffffffff80ee7962 in ffs_unmount (mp=0xfffffe00e64ee280, mntflags=) at ../../../ufs/ffs/ffs_vfsops.c:1273 #11 0xffffffff80c97213 in dounmount (mp=, flags=0x8000000, td=0xfffffe00e671da00) at ../../../kern/vfs_mount.c:1731 #12 0xffffffff80c96d99 in kern_unmount (td=, path=0x7fffffffd7e0
, flags=0x8000000) at ../../../kern/vfs_mount.c:1381 #13 0xffffffff81073cf9 in amd64_syscall (td=0xfffffe00e671da00, traced=0x0) at subr_syscall.c:162 #14 0xffffffff81049970 in fast_syscall_common () at ../../../amd64/amd64/exception.S:584 #15 0x00000008002e1eda in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 3 #3 0xffffffff80f284df in _vm_page_busy_sleep (obj=0xfffff8006897ad68, m=0xfffffe0017206200, pindex=0x0, wmesg=0xffffffff8122bb49 "vmopar", allocflags=0x0, locked=0x1) at ../../../vm/vm_page.c:1094 1094 sleepq_wait(m, PVM); (kgdb) l 1089 } while (!atomic_fcmpset_int(&m->busy_lock, &x, x | VPB_BIT_WAITERS)); 1090 if (locked) 1091 VM_OBJECT_DROP(obj); 1092 DROP_GIANT(); 1093 sleepq_add(m, NULL, wmesg, 0, 0); 1094 sleepq_wait(m, PVM); 1095 PICKUP_GIANT(); 1096 return (true); 1097 } 1098 (kgdb) p *m $1 = {plinks = {q = {tqe_next = 0xfffffe001d80e668, tqe_prev = 0xfffffe001d5d81d0}, s = {ss = {sle_next = 0xfffffe001d80e668}}, memguard = {p = 0xfffffe001d80e668, v = 0xfffffe001d5d81d0}, uma = {slab = 0xfffffe001d80e668, zone = 0xfffffe001d5d81d0}}, listq = {tqe_next = 0xfffffe001d77c610, tqe_prev = 0xfffff8006897adb0}, object = 0xfffff8006897ad68, pindex = 0x0, phys_addr = 0x38ed50000, md = {pv_list = {tqh_first = 0x0, tqh_last = 0xfffffe0017206238}, pv_gen = 0x4, pat_mode = 0x6}, ref_count = 0x80000000, busy_lock = 0xe671e106, a = {{flags = 0xa, queue = 0x0, act_count = 0x0}, _bits = 0xa}, order = 0xd, pool = 0x0, flags = 0x1, oflags = 0x0, psind = 0x0, segind = 0x8, valid = 0xff, dirty = 0x0} (kgdb) p *obj $2 = {lock = {lock_object = {lo_name = 0xffffffff8115db1c "vm object", lo_flags = 0x25630000, lo_data = 0x0, lo_witness = 0xfffff8087fd75800}, rw_lock = 0x1}, object_list = {tqe_next = 0xfffff8006897ae70, tqe_prev = 0xfffff8006897ac80}, shadow_head = {lh_first = 0x0}, shadow_list = {le_next = 0xffffffffffffffff, le_prev = 0xffffffffffffffff}, memq = {tqh_first = 0xfffffe0017206200, tqh_last = 0xfffffe001d5d81e0}, rtree = {rt_root = 0xfffff803aab311b0}, size = 0x64, domain = { dr_policy = 0x0, dr_iter = 0x0}, generation = 0x1, cleangeneration = 0x1, ref_count = 0x0, shadow_count = 0x0, memattr = 0x6, type = 0x2, flags = 0x1000, pg_color = 0x0, paging_in_progress = {__count = 0x1}, busy = {__count = 0x0}, resident_page_count = 0x4, backing_object = 0x0, backing_object_offset = 0x0, pager_object_list = {tqe_next = 0x0, tqe_prev = 0x0}, rvq = {lh_first = 0x0}, handle = 0xfffff8017e8c9a00, un_pager = {vnp = {vnp_size = 0x64000, writemappings = 0x0}, devp = {devp_pglist = {tqh_first = 0x64000, tqh_last = 0x0}, ops = 0x0, dev = 0x0}, sgp = {sgp_pglist = {tqh_first = 0x64000, tqh_last = 0x0}}, swp = { swp_tmpfs = 0x64000, swp_blks = {pt_root = 0x0}, writemappings = 0x0}}, cred = 0x0, charge = 0x0, umtx_data = 0x0} (kgdb) Index: src/sys/kern/kern_sendfile.c =================================================================== --- src/sys/kern/kern_sendfile.c (revision 359962) +++ src/sys/kern/kern_sendfile.c (working copy) @@ -295,10 +295,12 @@ sendfile_iodone(void *arg, vm_page_t *pa, int coun * unbusied the swapped-in pages, they can become * invalid under us. */ - for (i = 0; i < count; i++) { + MPASS(count == 0 || pa[0] != bogus_page); + for (i = 1; i < count; i++) { if (pa[i] == bogus_page) { - pa[i] = vm_page_relookup(sfio->obj, - sfio->pindex0 + i + (pa - sfio->pa)); + sfio->pa[(pa[0]->pindex - sfio->pindex0) + i] = + pa[i] = vm_page_relookup(sfio->obj, + pa[0]->pindex + i); KASSERT(pa[i] != NULL, ("%s: page %p[%d] disappeared", __func__, pa, i)); @@ -311,6 +313,24 @@ sendfile_iodone(void *arg, vm_page_t *pa, int coun if (!refcount_release(&sfio->nios)) return; +#ifdef INVARIANTS + for (i = 1; i < sfio->npages; i++) { + if (pa[i] == NULL) + break; + KASSERT(vm_page_wired(sfio->pa[i]), + ("sfio %p page %d %p not wired", sfio, i, pa[i])); + if (i == 0) + continue; + KASSERT(sfio->pa[0]->object == sfio->pa[i]->object, + ("sfio %p page %d %p wrong owner %p %p", sfio, i, pa[i], + sfio->pa[0]->object, sfio->pa[i]->object)); + KASSERT(sfio->pa[0]->pindex + i == sfio->pa[i]->pindex, + ("sfio %p page %d %p wrong index %jx %jx", sfio, i, pa[i], + (uintmax_t)sfio->pa[0]->pindex, + (uintmax_t)sfio->pa[i]->pindex)); + } +#endif + vm_object_pip_wakeup(sfio->obj); if (sfio->m == NULL) { -- Test scenario: wip/sendfile21b.sh