KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #0 r346964: Tue Apr 30 19:20:09 CEST 2019 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 8.0.0 (tags/RELEASE_800/final 356365) (based on LLVM 8.0.0) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33182613504 (31645 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads __stack_chk_init: WARNING: Initializing stack protection with non-random cookies! __stack_chk_init: WARNING: This severely limits the benefit of -fstack-protector! ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard Launching APs: 1 4 8 11 6 10 9 3 2 7 5 Timecounter "TSC-low" frequency 1750037880 Hz quality 1000 random: entropy device external interface [ath_hal] loaded kbd1 at kbdmux0 module_register_init: MOD_LOAD (vesa, 0xffffffff81140c70, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" 000.000061 [4254] netmap_init netmap: loaded module nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 tx descriptors and 1024 rx descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_quugen0.3: at usbus0 ukbd0 on uhub5 ukbd0: on usbus0 kbd2 at ukbd0 . lo0: link state changed to UP Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 igb0:SIMPLEX,MULTICAST> metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:da inet6 fe80::ec4:7aff:fea8:cdda%igb0 prefixlen 64 scopeid 0x1 media: Ethernet autoselect status: no carrier nd6 options=21 igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Starting devd. igb0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub5 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff80006008000 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 2 May 14:06:13 ntpdate[2051]: step time server 192.168.5.1 offset -0.705160 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. lock order reversal: 1st 0xfffffe00008a9a30 bufwait (bufwait) @ kern/vfs_bio.c:3903 2nd 0xfffff8000311e400 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0xffffffff80c4c803 at witness_debugger+0x73 #1 0xffffffff80c4c54d at witness_checkorder+0xa7d #2 0xffffffff80bec558 at _sx_xlock+0x68 #3 0xffffffff80eff08d at ufsdirhash_add+0x4d #4 0xffffffff80f03a06 at ufs_direnter+0x446 #5 0xffffffff80f0bc09 at ufs_mkdir+0x8c9 #6 0xffffffff8123ed2c at VOP_MKDIR_APV+0x8c #7 0xffffffff80cc5153 at kern_mkdirat+0x1b3 #8 0xffffffff810bbe31 at amd64_syscall+0x291 #9 0xffffffff810941dd at fast_syscall_common+0x101 Clearing /tmp (X related). Starting statd. Starting lockd. fscklock order reversal: 1st 0xfffff80007ca7558 ufs (ufs) @ kern/vfs_subr.c:2598 2nd 0xfffffe00008a9a30 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:283 3rd 0xfffff8001d727558 ufs (ufs) @ kern/vfs_subr.c:2598 stack backtrace: #0 0xffffffff80c4c803 at witness_debugger+0x73 #1 0xffffffff80c4c54d at witness_checkorder+0xa7d #2 0xffffffff80bb7b3b at lockmgr_xlock_hard+0x6b #3 0xffffffff80bb85ae at __lockmgr_args+0x5fe #4 0xffffffff80ef9a0c at ffs_lock+0x7c #5 0xffffffff8123f880 at VOP_LOCK1_APV+0x70 #6 0xffffffff80cc85f5 at _vn_lock+0x65 #7 0xffffffff80cb67c6 at vget+0xa6 #8 0xffffffff80ca855c at vfs_hash_get+0xcc #9 0xffffffff80ef528f at ffs_vgetf+0x3f #10 0xffffffff80eeaa0f at softdep_sync_buf+0x55f #11 0xffffffff80efa824 at ffs_syncvnode+0x234 #12 0xffffffff80ef7fcd at ffs_sync+0x20d #13 0xffffffff80caee9f at dounmount+0x4bf #14 0xffffffff80cae940 at sys_unmount+0x300 #15 0xffffffff810bbe31 at amd64_syscall+0x291 #16 0xffffffff810941dd at fast_syscall_common+0x101 lock order reversal: 1st 0xfffff80007ca7a48 ufs (ufs) @ kern/vfs_mount.c:1353 2nd 0xfffff80007ca77d0 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1606 stack backtrace: #0 0xffffffff80c4c803 at witness_debugger+0x73 #1 0xffffffff80c4c54d at witness_checkorder+0xa7d #2 0xffffffff80bb763b at lockmgr_lock_fast_path+0x16b #3 0xffffffff8123f880 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cc85f5 at _vn_lock+0x65 #5 0xffffffff80ef808f at ffs_sync+0x2cf #6 0xffffffff80caee9f at dounmount+0x4bf #7 0xffffffff80cae940 at sys_unmount+0x300 #8 0xffffffff810bbe31 at amd64_syscall+0x291 #9 0xffffffff810941dd at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 1777 files, 124662 used, 1140745 free (153 frags, 142574 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Configuring vt: blanktime. Performing sanity check on sshd configuration. May 2 14:06:17 mercat1 ntpd[2241]: leapsecond file ('/var/db/ntpd.leap-seconds.list'): expired less than 491 days ago Starting sshd. Starting cron. Thu May 2 14:06 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root May 2 14:06:20 mercat1 login[2329]: ROOT LOGIN (root) ON ttyu1 Last login: Tue Apr 30 20:08:25 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #0 r346964: Tue Apr 30 19:20:09 CEST 2019 root@mercat1:/stress2/misc # exec sh # ./sendmsg2.sh [zone: socket] kern.ipc.maxsockets limit reached socketpair: No buffer space available kern.maxfiles limit exceeded by uid 22, (sshd) please see tuning(7). kern.maxfiles limit exceeded by uid 2006, (sshd) please see tuning(7). kern.maxfiles limit exceeded by uid 123, (ntpd) please see tuning(7). # ./sendmsg2.sh [zone: socket] kern.ipc.maxsockets limit reached socketpair: No buffer space available socketpair: No buffer space available # ./sendmsg2.sh [zone: socket] kern.ipc.maxsockets limit reached socketpair: No buffer space available kern.maxfiles limit exceeded by uid 123, (ntpd) please see tuning(7). kern.maxfiles limit exceeded by uid 123, (ntpd) please see tuning(7). May 2 14:19:24 mercat1 ntpd[2241]: start_blocking_thread: pipe_socketpair() Too many open files in system FAIL UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 3023 3008 0 84 0 10816 2444 - RE+ u1 0:06.13 /tmp/sendmsg2 PID TID COMM TDNAME KSTACK # ps PID TT STAT TIME COMMAND 2328 u0 Is+ 0:00.00 /usr/libexec/getty 3wire ttyu0 2329 u1 Is 0:00.01 login [pam] (login) 2330 u1 S 0:00.03 sh 3430 u1 R+ 0:00.00 ps 2320 v0 Is+ 0:00.00 /usr/libexec/getty Pc ttyv0 2321 v1 Is+ 0:00.00 /usr/libexec/getty Pc ttyv1 2322 v2 Is+ 0:00.00 /usr/libexec/getty Pc ttyv2 2323 v3 Is+ 0:00.00 /usr/libexec/getty Pc ttyv3 2324 v4 Is+ 0:00.00 /usr/libexec/getty Pc ttyv4 2325 v5 Is+ 0:00.00 /usr/libexec/getty Pc ttyv5 2326 v6 Is+ 0:00.00 /usr/libexec/getty Pc ttyv6 2327 v7 Is+ 0:00.00 /usr/libexec/getty Pc ttyv7 # ./sendmsg2.sh [zone: socket] kern.ipc.maxsockets limit reached socketpair: No b[zone: unpcb] kern.ipc.maxsockets limit reached uffer space available socketpair: No buffer space available # ./sendmsg2.sh [zone: socket] kern.ipc.maxsockets limit reached socketpair: No buffer space available socketpair: No buffer space available socketpair: No buffer space available # while true; do > date +%T > ./sendmsg2.sh > done 14:47:22 [zone: unpcb] kern.ipc.maxsockets limit reached socketpair: No buffer space available FAIL UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 3829 3814 0 84 0 10816 2444 unp_link LE+ u1 0:05.98 /tmp/sendmsg2 PID TID COMM TDNAME KSTACK 14:52:23 [zone: unpcb] kern.ipc.maxsockets limit reached socketpair: No buffer space available FAIL UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 4162 4147 0 72 0 10784 2416 unp_link L+ u1 0:06.09 /tmp/sendmsg2 PID TID COMM TDNAME KSTACK 4162 100339 sendmsg2 - mi_switch turnstile_wait __rw_wlock_hard _rw_wlock_cookie uipc_attach socreate kern_socketpair sys_socketpair amd64_syscall fast_syscall_common 14:57:24 [zone: socket] kern.ipc.maxsockets limit reached socketpair: No buffer space available socketpair: No buffer space available 15:02:25 [zone: socket] kern.ipc.maxsockets limit reached socketpair: No buffer space available socketpair: No buffer space available 15:07:26 [zone: unpcb] kern.ipc.maxsockets limit reached socketpair: No buffer space available FAIL UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 5180 5165 0 72 0 10784 2420 - RE+ u1 0:06.03 /tmp/sendmsg2 PID TID COMM TDNAME KSTACK 15:12:27 [zone: socket] kern.ipc.maxsockets limit reached socketpair: No buffer space available FAIL UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 5524 5509 0 84 0 10816 2444 unp_link LE+ u1 0:06.05 /tmp/sendmsg2 PID TID COMM TDNAME KSTACK 15:17:28 [zone: unpcb] kern.ipc.maxsockets limit reached socketpair: No buffer space available 15:22:29 [zone: unpcb] kern.ipc.maxsockets limit reached socketpair: No b[zone: socket] kern.ipc.maxsockets limit reached uffer space available socketpair: No buffer space available ^C # ps PID TT STAT TIME COMMAND 2328 u0 Is+ 0:00.00 /usr/libexec/getty 3wire ttyu0 2329 u1 Is 0:00.01 login [pam] (login) 2330 u1 S 0:00.04 sh 6199 u1 LE 0:05.51 /tmp/sendmsg2 6200 u1 L 0:05.51 /tmp/sendmsg2 6201 u1 LE 0:05.51 /tmp/sendmsg2 6264 u1 R+ 0:00.00 ps 2320 v0 Is+ 0:00.00 /usr/libexec/getty Pc ttyv0 2321 v1 Is+ 0:00.00 /usr/libexec/getty Pc ttyv1 2322 v2 Is+ 0:00.00 /usr/libexec/getty Pc ttyv2 2323 v3 Is+ 0:00.00 /usr/libexec/getty Pc ttyv3 2324 v4 Is+ 0:00.00 /usr/libexec/getty Pc ttyv4 2325 v5 Is+ 0:00.00 /usr/libexec/getty Pc ttyv5 2326 v6 Is+ 0:00.00 /usr/libexec/getty Pc ttyv6 2327 v7 Is+ 0:00.00 /usr/libexec/getty Pc ttyv7 # procstat -k 6199 PID TID COMM TDNAME KSTACK # # KDB: enter: Break to debugger [ thread pid 11 tid 100003 ] Stopped at kdb_alt_break_internal+0x106: movq $0,kdb_why db> ps pid ppid pgrp uid state wmesg wchan cmd 6201 1 6186 0 LE+ *unp_lin 0xfffff80007d51240 sendmsg2 6200 1 6186 0 L+ *unp_lin 0xfffff80007d51240 sendmsg2 6199 1 6186 0 LE+ *unp_lin 0xfffff80007d51240 sendmsg2 2330 2329 2330 0 S+ ttyin 0xfffff800060aacb0 sh 2329 1 2329 0 Ss+ wait 0xfffff80191b73530 login 2328 1 2328 0 Ss+ ttyin 0xfffff800060ab0b0 getty 2327 1 2327 0 Ss+ ttyin 0xfffff800074da8b0 getty 2326 1 2326 0 Ss+ ttyin 0xfffff800074dacb0 getty 2325 1 2325 0 Ss+ ttyin 0xfffff800074dd0b0 getty 2324 1 2324 0 Ss+ ttyin 0xfffff800074dd4b0 getty 2323 1 2323 0 Ss+ ttyin 0xfffff800074dd8b0 getty 2322 1 2322 0 Ss+ ttyin 0xfffff800074ddcb0 getty 2321 1 2321 0 Ss+ ttyin 0xfffff800074e00b0 getty 2320 1 2320 0 Ss+ ttyin 0xfffff800074e04b0 getty 2274 1 2274 0 Ss nanslp 0xffffffff81e9dfc0 cron 2270 1 2270 0 Ss select 0xfffff80006022640 sshd 2182 1 2182 0 Ss rpcsvc 0xfffff801918f1760 NLM: master 2179 1 2179 0 Ss select 0xfffff80003fa9240 rpc.statd 2133 1 2133 0 Ss nanslp 0xffffffff81e9dfc1 watchdogd --More-- db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 11 tid 100003 td 0xfffff800036bd000 kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe0076766710 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0076766720 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe0076766750 uart_intr() at uart_intr+0x138/frame 0xfffffe0076766790 intr_event_handle() at intr_event_handle+0xb5/frame 0xfffffe00767667e0 intr_execute_handlers() at intr_execute_handlers+0x57/frame 0xfffffe0076766810 lapic_handle_intr() at lapic_handle_intr+0x5f/frame 0xfffffe0076766830 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe0076766830 --- interrupt, rip = 0xffffffff81222a56, rsp = 0xfffffe0076766900, rbp = 0xfffffe0076766900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0xd667c0 curthread = 0xfffff800036bd000: pid 11 tid 100003 "idle: cpu0" curpcb = 0xfffffe0076766b80 fpcurthread = none idlethread = 0xfffff800036bd000: tid 100003 "idle: cpu0" curpmap = 0xffffffff82095cb8 tssp = 0xffffffff821cd3a0 commontssp = 0xffffffff821cd3a0 rsp0 = 0xfffffe0076766b80 gs32p = 0xffffffff821d3fd8 ldt = 0xffffffff821d4018 tss = 0xffffffff821d4008 tlb gen = 6047 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe0084fdc7c0 curthread = 0xfffff800036bc5a0: pid 11 tid 100004 "idle: cpu1" curpcb = 0xfffffe007676bb80 fpcurthread = none idlethread = 0xfffff800036bc5a0: tid 100004 "idle: cpu1" curpmap = 0xffffffff82095cb8 tssp = 0xffffffff821cd408 commontssp = 0xffffffff821cd408 rsp0 = 0xfffffe007676bb80 gs32p = 0xffffffff821d4040 ldt = 0xffffffff821d4080 tss = 0xffffffff821d4070 tlb gen = 6047 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe0084fe87c0 curthread = 0xfffff800036bc000: pid 11 tid 100005 "idle: cpu2" curpcb = 0xfffffe0076770b80 fpcurthread = none idlethread = 0xfffff800036bc000: tid 100005 "idle: cpu2" curpmap = 0xffffffff82095cb8 tssp = 0xffffffff821cd470 commontssp = 0xffffffff821cd470 rsp0 = 0xfffffe0076770b80 gs32p = 0xffffffff821d40a8 ldt = 0xffffffff821d40e8 tss = 0xffffffff821d40d8 tlb gen = 6047 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe0084ff47c0 curthread = 0xfffff800036bb5a0: pid 11 tid 100006 "idle: cpu3" curpcb = 0xfffffe0076775b80 fpcurthread = none idlethread = 0xfffff800036bb5a0: tid 100006 "idle: cpu3" curpmap = 0xffffffff82095cb8 tssp = 0xffffffff821cd4d8 commontssp = 0xffffffff821cd4d8 rsp0 = 0xfffffe0076775b80 gs32p = 0xffffffff821d4110 ldt = 0xffffffff821d4150 tss = 0xffffffff821d4140 tlb gen = 6047 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00850007c0 curthread = 0xfffff800036bb000: pid 11 tid 100007 "idle: cpu4" curpcb = 0xfffffe007677ab80 fpcurthread = none idlethread = 0xfffff800036bb000: tid 100007 "idle: cpu4" curpmap = 0xffffffff82095cb8 tssp = 0xffffffff821cd540 commontssp = 0xffffffff821cd540 rsp0 = 0xfffffe007677ab80 gs32p = 0xffffffff821d4178 ldt = 0xffffffff821d41b8 tss = 0xffffffff821d41a8 tlb gen = 6047 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe008500c7c0 curthread = 0xfffff800036ba5a0: pid 11 tid 100008 "idle: cpu5" curpcb = 0xfffffe007677fb80 fpcurthread = none idlethread = 0xfffff800036ba5a0: tid 100008 "idle: cpu5" curpmap = 0xffffffff82095cb8 tssp = 0xffffffff821cd5a8 commontssp = 0xffffffff821cd5a8 rsp0 = 0xfffffe007677fb80 gs32p = 0xffffffff821d41e0 ldt = 0xffffffff821d4220 tss = 0xffffffff821d4210 tlb gen = 6047 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00850187c0 curthread = 0xfffff800037165a0: pid 0 tid 100020 "thread taskq" curpcb = 0xfffffe00767c7b80 fpcurthread = none idlethread = 0xfffff800036ba000: tid 100009 "idle: cpu6" curpmap = 0xffffffff82095cb8 tssp = 0xffffffff821cd610 commontssp = 0xffffffff821cd610 rsp0 = 0xfffffe00767c7b80 gs32p = 0xffffffff821d4248 ldt = 0xffffffff821d4288 tss = 0xffffffff821d4278 tlb gen = 6046 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00850247c0 curthread = 0xfffff800036ce5a0: pid 11 tid 100010 "idle: cpu7" curpcb = 0xfffffe0076789b80 fpcurthread = none idlethread = 0xfffff800036ce5a0: tid 100010 "idle: cpu7" curpmap = 0xffffffff82095cb8 tssp = 0xffffffff821cd678 commontssp = 0xffffffff821cd678 rsp0 = 0xfffffe0076789b80 gs32p = 0xffffffff821d42b0 ldt = 0xffffffff821d42f0 tss = 0xffffffff821d42e0 tlb gen = 6047 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00850307c0 curthread = 0xfffff800036ce000: pid 11 tid 100011 "idle: cpu8" curpcb = 0xfffffe007678eb80 fpcurthread = none idlethread = 0xfffff800036ce000: tid 100011 "idle: cpu8" curpmap = 0xffffffff82095cb8 tssp = 0xffffffff821cd6e0 commontssp = 0xffffffff821cd6e0 rsp0 = 0xfffffe007678eb80 gs32p = 0xffffffff821d4318 ldt = 0xffffffff821d4358 tss = 0xffffffff821d4348 tlb gen = 6047 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe008503c7c0 curthread = 0xfffff800036cd5a0: pid 11 tid 100012 "idle: cpu9" curpcb = 0xfffffe0076793b80 fpcurthread = none idlethread = 0xfffff800036cd5a0: tid 100012 "idle: cpu9" curpmap = 0xffffffff82095cb8 tssp = 0xffffffff821cd748 commontssp = 0xffffffff821cd748 rsp0 = 0xfffffe0076793b80 gs32p = 0xffffffff821d4380 ldt = 0xffffffff821d43c0 tss = 0xffffffff821d43b0 tlb gen = 6047 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00850487c0 curthread = 0xfffff800036cd000: pid 11 tid 100013 "idle: cpu10" curpcb = 0xfffffe0076798b80 fpcurthread = none idlethread = 0xfffff800036cd000: tid 100013 "idle: cpu10" curpmap = 0xffffffff82095cb8 tssp = 0xffffffff821cd7b0 commontssp = 0xffffffff821cd7b0 rsp0 = 0xfffffe0076798b80 gs32p = 0xffffffff821d43e8 ldt = 0xffffffff821d4428 tss = 0xffffffff821d4418 tlb gen = 6047 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00850547c0 curthread = 0xfffff800036cc5a0: pid 11 tid 100014 "idle: cpu11" curpcb = 0xfffffe007679db80 fpcurthread = none idlethread = 0xfffff800036cc5a0: tid 100014 "idle: cpu11" curpmap = 0xffffffff82095cb8 tssp = 0xffffffff821cd818 commontssp = 0xffffffff821cd818 rsp0 = 0xfffffe007679db80 gs32p = 0xffffffff821d4450 ldt = 0xffffffff821d4490 tss = 0xffffffff821d4480 tlb gen = 6047 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 6200 (sendmsg2) thread 0xfffff80007d55000 (100430) exclusive sx filedesc structure (filedesc structure) r = 0 (0xfffff8001d5a68e0) locked @ kern/uipc_usrreq.c:2016 exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff802299cfbb0) locked @ kern/uipc_sockbuf.c:285 Process 0 (kernel) thread 0xfffff800037165a0 (100020) shared rw unp_link_rwlock (unp_link_rwlock) r = 0 (0xffffffff8203f740) locked @ kern/uipc_usrreq.c:2536 db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show allchains chain 1: thread 100431 (pid 6201, sendmsg2) blocked on lock 0xffffffff8203f740 (rw) "unp_link_rwlock" chain 2: thread 100430 (pid 6200, sendmsg2) blocked on lock 0xffffffff8203f740 (rw) "unp_link_rwlock" chain 3: thread 100417 (pid 6199, sendmsg2) blocked on lock 0xffffffff8203f740 (rw) "unp_link_rwlock" chain 4: thread 100155 (pid 2330, sh) sleeping on 0xfffff800060aacb0 "ttyin" chain 5: thread 100222 (pid 2329, login) sleeping on 0xfffff80191b73530 "wait" chain 6: thread 100221 (pid 2328, getty) sleeping on 0xfffff800060ab0b0 "ttyin" chain 7: thread 100220 (pid 2327, getty) sleeping on 0xfffff800074da8b0 "ttyin" chain 8: thread 100219 (pid 2326, getty) sleeping on 0xfffff800074dacb0 "ttyin" chain 9: thread 100218 (pid 2325, getty) sleeping on 0xfffff800074dd0b0 "ttyin" chain 10: thread 100201 (pid 2324, getty) sleeping on 0xfffff800074dd4b0 "ttyin" chain 11: thread 100174 (pid 2323, getty) sleeping on 0xfffff800074dd8b0 "ttyin" chain 12: thread 100149 (pid 2322, getty) sleeping on 0xfffff800074ddcb0 "ttyin" chain 13: thread 100152 (pid 2321, getty) sleeping on 0xfffff800074e00b0 "ttyin" chain 14: thread 100142 (pid 2320, getty) sleeping on 0xfffff800074e04b0 "ttyin" chain 15: thread 100151 (pid 2274, cron) sleeping on 0xffffffff81e9dfc0 "nanslp" chain 16: thread 100202 (pid 2270, sshd) sleeping on 0xfffff80006022640 "select" chain 17: thread 100167 (pid 2182, NLM: master) sleeping on 0xfffff801918f1760 "rpcsvc" chain 18: thread 100206 (pid 2179, rpc.statd) sleeping on 0xfffff80003fa9240 "select" chain 19: thread 100205 (pid 2133, watchdogd) sleeping on 0xffffffff81e9dfc1 "nanslp" chain 20: thread 100177 (pid 2054, rpcbind) sleeping on 0xfffff80007387bc0 "select" chain 21: thread 100166 (pid 2044, syslogd) sleeping on 0xfffff80003dbdec0 "select" chain 22: thread 100171 (pid 1973, devd) sleeping on 0xfffff800075844c0 "select" chain 23: thread 100182 (pid 1968, dhclient) sleeping on 0xfffff800075855c0 "select" chain 24: thread 100183 (pid 1924, dhclient) sleeping on 0xfffff80007289040 "select" chain 25: thread 100168 (pid 1921, dhclient) sleeping on 0xfffff8000602fcc0 "select" chain 26: thread 100141 (pid 34, vnlru) sleeping on 0xfffff8000736ba60 "vlruwt" chain 27: thread 100140 (pid 33, syncer) sleeping on 0xffffffff82040400 "syncer" chain 28: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff8203f8a8 "qsleep" chain 29: thread 100131 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff81a0a880 "-" chain 30: thread 100132 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81a12b40 "-" chain 31: thread 100134 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff81a1ae00 "-" chain 32: thread 100135 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81a230c0 "-" chain 33: thread 100136 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff81a2b380 "-" chain 34: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81a33640 "-" chain 35: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff81a3b900 "-" chain 36: thread 100153 (pid 32, / worker) sleeping on 0xfffff80007e074e8 "sdflush" chain 37: thread 100208 (pid 32, /tmp worker) sleeping on 0xfffff800078c7ce8 "sdflush" chain 38: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff8205c788 "psleep" chain 39: thread 100128 (pid 30, dom0) sleeping on 0xffffffff820c64d8 "psleep" chain 40: thread 100133 (pid 30, laundry: dom0) sleeping on 0xffffffff820c64e4 "launds" chain 41: thread 100137 (pid 30, uma) sleeping on 0xffffffff80f17b40 "umarcl" chain 42: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff80007272000 "idle" chain 43: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff80007272530 "idle" chain 44: thread 100123 (pid 27, rand_harvestq) sleeping on 0xffffffff81cfd530 "-" chain 45: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff820c4bb0 "waiting_for_work" chain 46: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff8203f29c "-" chain 47: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff8203f29c "-" chain 48: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff8203f29c "-" chain 49: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff8203f29c "-" chain 50: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe009a1aa460 "-" chain 51: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe009a1aa4b8 "-" chain 52: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe009a1aa510 "-" chain 53: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe009a1aa568 "-" chain 54: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe009a1aa5c0 "-" chain 55: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe0006dd6d10 "-" chain 56: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe0006dd6d68 "-" chain 57: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe0006dd6dc0 "-" chain 58: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe0006dd6e18 "-" chain 59: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe0006dd6e70 "-" chain 60: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe00007f3d10 "-" chain 61: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe00007f3d68 "-" chain 62: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe00007f3dc0 "-" chain 63: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe00007f3e18 "-" chain 64: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe00007f3e70 "-" chain 65: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff81bd87c0 "-" chain 66: thread 100092 (pid 20, doneq1) sleeping on 0xffffffff81bd8840 "-" chain 67: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff81bd88c0 "-" chain 68: thread 100125 (pid 20, scanner) sleeping on 0xffffffff81bd8688 "-" chain 69: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff80003968450 "crypto_ret_wait" chain 70: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff800039683f0 "crypto_ret_wait" chain 71: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff80003968390 "crypto_ret_wait" chain 72: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff80003968330 "crypto_ret_wait" chain 73: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff800039682d0 "crypto_ret_wait" chain 74: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff80003968270 "crypto_ret_wait" chain 75: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff80003968210 "crypto_ret_wait" chain 76: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff800039681b0 "crypto_ret_wait" chain 77: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff80003968150 "crypto_ret_wait" chain 78: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff800039680f0 "crypto_ret_wait" chain 79: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff80003968090 "crypto_ret_wait" chain 80: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff80003968030 "crypto_ret_wait" chain 81: thread 100078 (pid 2, crypto) sleeping on 0xffffffff82056d70 "crypto_wait" chain 82: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff8000390bc88 "seqstate" chain 83: thread 100061 (pid 13, g_event) sleeping on 0xffffffff82095050 "-" chain 84: thread 100062 (pid 13, g_up) sleeping on 0xffffffff82095060 "-" chain 85: thread 100063 (pid 13, g_down) sleeping on 0xffffffff82095048 "-" chain 86: thread 100002 (pid 1, init) sleeping on 0xfffff800036b9530 "wait" chain 87: thread 100001 (pid 10, audit) sleeping on 0xffffffff820c58d0 "audit_worker_cv" chain 88: thread 100000 (pid 0, swapper) sleeping on 0xffffffff82095090 "swapin" chain 89: thread 100015 (pid 0, config_0) sleeping on 0xfffff8000369ae00 "-" chain 90: thread 100016 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff80003710000 "-" chain 91: thread 100017 (pid 0, aiod_kick taskq) sleeping on 0xfffff8000370fe00 "-" chain 92: thread 100022 (pid 0, if_config_tqg_0) sleeping on 0xfffff8000369a600 "-" chain 93: thread 100023 (pid 0, if_io_tqg_0) sleeping on 0xfffff8000369a400 "-" chain 94: thread 100024 (pid 0, if_io_tqg_1) sleeping on 0xfffff8000369a200 "-" chain 95: thread 100025 (pid 0, if_io_tqg_2) sleeping on 0xfffff8000369a000 "-" chain 96: thread 100026 (pid 0, if_io_tqg_3) sleeping on 0xfffff80003699d00 "-" chain 97: thread 100027 (pid 0, if_io_tqg_4) sleeping on 0xfffff80003699b00 "-" chain 98: thread 100028 (pid 0, if_io_tqg_5) sleeping on 0xfffff80003699900 "-" chain 99: thread 100029 (pid 0, if_io_tqg_6) sleeping on 0xfffff80003699700 "-" chain 100: thread 100030 (pid 0, if_io_tqg_7) sleeping on 0xfffff80003699500 "-" chain 101: thread 100031 (pid 0, if_io_tqg_8) sleeping on 0xfffff80003699300 "-" chain 102: thread 100032 (pid 0, if_io_tqg_9) sleeping on 0xfffff80003699100 "-" chain 103: thread 100033 (pid 0, if_io_tqg_10) sleeping on 0xfffff80003698e00 "-" chain 104: thread 100034 (pid 0, if_io_tqg_11) sleeping on 0xfffff80003698c00 "-" chain 105: thread 100035 (pid 0, softirq_0) sleeping on 0xfffff800037d2100 "-" chain 106: thread 100036 (pid 0, softirq_1) sleeping on 0xfffff800037d1e00 "-" chain 107: thread 100037 (pid 0, softirq_2) sleeping on 0xfffff800037d1c00 "-" chain 108: thread 100038 (pid 0, softirq_3) sleeping on 0xfffff800037d1a00 "-" chain 109: thread 100039 (pid 0, softirq_4) sleeping on 0xfffff800037d1800 "-" chain 110: thread 100040 (pid 0, softirq_5) sleeping on 0xfffff800037d1600 "-" chain 111: thread 100041 (pid 0, softirq_6) sleeping on 0xfffff800037d1400 "-" chain 112: thread 100042 (pid 0, softirq_7) sleeping on 0xfffff800037d1200 "-" chain 113: thread 100043 (pid 0, softirq_8) sleeping on 0xfffff800037d1000 "-" chain 114: thread 100044 (pid 0, softirq_9) sleeping on 0xfffff800037d0d00 "-" chain 115: thread 100045 (pid 0, softirq_10) sleeping on 0xfffff800037d0b00 "-" chain 116: thread 100046 (pid 0, softirq_11) sleeping on 0xfffff800037d0900 "-" chain 117: thread 100064 (pid 0, firmware taskq) sleeping on 0xfffff800038c0c00 "-" chain 118: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff800038c0400 "-" chain 119: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff800038c0400 "-" chain 120: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff800038c0400 "-" chain 121: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff800038c0400 "-" chain 122: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff800038c0400 "-" chain 123: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff800038c0400 "-" chain 124: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff800038c0400 "-" chain 125: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff800038c0400 "-" chain 126: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff800038c0400 "-" chain 127: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff800038c0400 "-" chain 128: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff800038c0400 "-" chain 129: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff800038c0400 "-" chain 130: thread 100114 (pid 0, mca taskq) blocked on lockmgr (null)EXCL KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0076765e00 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0076765e10 trap() at trap+0x5b/frame 0xfffffe0076765f20 calltrap() at calltrap+0x8/frame 0xfffffe0076765f20 --- trap 0xc, rip = 0xffffffff80c446aa, rsp = 0xfffffe0076765ff0, rbp = 0xfffffe0076766010 --- print_lockchain() at print_lockchain+0x3a/frame 0xfffffe0076766010 db_show_allchains() at db_show_allchains+0x80/frame 0xfffffe0076766040 db_command() at db_command+0x279/frame 0xfffffe0076766110 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00767661b0 db_command() at db_command+0x279/frame 0xfffffe0076766280 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0076766320 db_command() at db_command+0x279/frame 0xfffffe00767663f0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe0076766400 db_trap() at db_trap+0xef/frame 0xfffffe0076766490 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe0076766510 trap() at trap+0x811/frame 0xfffffe0076766620 calltrap() at calltrap+0x8/frame 0xfffffe0076766620 --- trap 0x3, rip = 0xffffffff80c2b806, rsp = 0xfffffe00767666f0, rbp = 0xfffffe0076766710 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe0076766710 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0076766720 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe0076766750 uart_intr() at uart_intr+0x138/frame 0xfffffe0076766790 intr_event_handle() at intr_event_handle+0xb5/frame 0xfffffe00767667e0 intr_execute_handlers() at intr_execute_handlers+0x57/frame 0xfffffe0076766810 lapic_handle_intr() at lapic_handle_intr+0x5f/frame 0xfffffe0076766830 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe0076766830 --- interrupt, rip = 0xffffffff81222a56, rsp = 0xfffffe0076766900, rbp = 0xfffffe0076766900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Script command 'show allchains' returned error db:1:pho1> show mount 0xfffff800076d1000 /dev/gpt/work on / (ufs) 0xfffff800076d2000 devfs on /dev (devfs) 0xfffff800076d0000 /dev/gpt/tmp on /tmp (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 102967 Buf domain 0 freebufs 14516 lofreebufs 219 hifreebufs 329 bufspace 18124800 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 525 (16363520) dirtyq count 0 (0) wakeup 0 lim 25 CPU 11, 11, 4, 4, 20, 1, 4, 12, 10, 2, 9, 4, Locked buffers: 0 space 0 Total buffers: 679 space 18124800 Buf domain 1 freebufs 14840 lofreebufs 219 hifreebufs 329 bufspace 7520256 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 8 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 231 (5767168) dirtyq count 8 (262144) wakeup 0 lim 25 CPU 0, 2, 9, 5, 4, 3, 0, 1, 3, 0, 20, 7, Locked buffers: 0 space 0 Total buffers: 296 space 7520256 Buf domain 2 freebufs 15014 lofreebufs 219 hifreebufs 329 bufspace 1884160 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 25 (139264) dirtyq count 0 (0) wakeup 0 lim 25 CPU 12, 5, 4, 6, 13, 2, 5, 15, 18, 1, 9, 4, Locked buffers: 0 space 0 Total buffers: 120 space 1884160 Buf domain 3 freebufs 13849 lofreebufs 219 hifreebufs 329 bufspace 40116224 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1150 (36646912) dirtyq count 0 (0) wakeup 0 lim 25 CPU 17, 5, 1, 7, 20, 5, 11, 7, 16, 1, 21, 23, Locked buffers: 0 space 0 Total buffers: 1291 space 40116224 Buf domain 4 freebufs 15006 lofreebufs 219 hifreebufs 329 bufspace 2334720 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 25 (159744) dirtyq count 0 (0) wakeup 0 lim 25 CPU 7, 4, 8, 4, 7, 5, 10, 16, 21, 1, 19, 0, Locked buffers: 0 space 0 Total buffers: 134 space 2334720 Buf domain 5 freebufs 14927 lofreebufs 219 hifreebufs 329 bufspace 4919296 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 100 (2580480) dirtyq count 0 (0) wakeup 0 lim 25 CPU 4, 5, 8, 5, 10, 3, 6, 20, 24, 0, 13, 8, Locked buffers: 0 space 0 Total buffers: 210 space 4919296 Buf domain 6 freebufs 14967 lofreebufs 219 hifreebufs 329 bufspace 3305472 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 25 (106496) dirtyq count 0 (0) wakeup 0 lim 25 CPU 6, 5, 9, 16, 5, 5, 19, 16, 14, 17, 24, 5, Locked buffers: 0 space 0 Total buffers: 170 space 3305472 db:1:pho1> show page vm_cnt.v_free_count: 7600615 vm_cnt.v_inactive_count: 3019 vm_cnt.v_active_count: 3067 vm_cnt.v_laundry_count: 0 vm_cnt.v_wire_count: 518857 vm_cnt.v_free_reserved: 10649 vm_cnt.v_free_min: 51289 vm_cnt.v_free_target: 173209 vm_cnt.v_inactive_target: 259813 db:1:pho1> show pageq pq_free 7600615 dom 0 page_cnt 8128423 free 7600615 pq_act 3067 pq_inact 3019 pq_laund 0 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 001836 | 000000 11 (008192K) | 000001 | 000000 10 (004096K) | 000001 | 000000 09 (002048K) | 000006 | 000000 08 (001024K) | 000001 | 000000 07 (000512K) | 000002 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000006 | 000001 04 (000064K) | 000002 | 000002 03 (000032K) | 000002 | 000007 02 (000016K) | 000033 | 000000 01 (000008K) | 000248 | 000003 00 (000004K) | 000598 | 000033 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000001 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket FFS2 dinode 256 811 479 1130 0 61 FFS1 dinode 128 0 0 0 0 125 FFS inode 160 811 485 1130 0 61 swblk 136 0 0 0 0 61 swpctrie 144 0 0 0 0 61 selfd 64 52 2986 13258 0 253 rtentry 208 12 615 15 0 61 ripcb 488 1 255 1 0 253 udplite_inpcb 488 0 0 0 0 253 sctp_asconf_ack 48 0 0 0 0 253 sctp_asconf 40 0 0 0 0 253 sctp_stream_msg_out 112 0 0 0 0 253 sctp_readq 152 0 0 0 0 253 sctp_chunk 152 0 0 0 0 253 sctp_raddr 736 0 0 0 0 253 sctp_laddr 48 0 1079 4 0 253 sctp_asoc 2408 0 0 0 0 253 sctp_ep 1280 0 0 0 0 253 tcp_log_node 120 0 0 0 0 125 tcp_log_bucket 144 0 0 0 0 61 tcp_log 408 0 0 0 0 253 tcpreass 48 0 0 0 0 253 tfo_ccache_entries 80 0 0 0 0 125 tfo 4 0 0 0 0 253 sackhole 32 0 0 0 0 253 hostcache 96 0 287 1 0 253 syncache 168 0 253 1 0 253 tcptw 88 0 0 0 0 253 tcpcb 976 8 1004 14 0 253 tcp_inpcb 488 8 1008 14 0 253 udpcb 32 13 3087 195 0 253 udp_inpcb 488 13 3027 195 0 253 ipq 56 0 0 0 0 253 IPsec SA lft_c 16 0 0 0 0 253 unpcb 256 947107 96773 13993837 0 253 socket 872 947130 96746 13994077 0 253 KNOTE 160 0 0 0 0 61 itimer 352 0 0 0 0 29 ksiginfo 112 128 2007 1127 0 125 procdesc 136 1 318 6 0 61 pipe 760 3 142 2649 0 13 AIOLIO 280 0 0 0 0 29 AIOCB 752 0 0 0 0 13 AIOP 32 0 0 0 0 253 AIO 208 0 0 0 0 61 Mountpoints 2896 3 3 4 0 3 DIRHASH 1024 80 40 83 0 13 NCLNODE 744 0 0 0 0 13 rentr 24 0 664 2 0 253 NAMEI 1024 0 156 116168 0 13 LTS VFS Cache 368 0 0 0 0 29 L VFS Cache 328 0 0 0 0 29 STS VFS Cache 148 0 0 0 0 61 S VFS Cache 108 861 1029 3363 0 125 BUF TRIE 144 398 105550 2242 0 61 VNODEPOLL 120 0 0 0 0 125 VNODE 632 917 97 1241 0 13 vtnet_tx_hdr 24 0 0 0 0 253 crypto_session 24 0 0 0 0 253 cryptodesc 120 0 0 0 0 125 cryptop 128 0 0 0 0 125 nvme_request 128 0 0 0 0 125 FPU_save_area 832 0 0 0 0 13 ttyoutq 256 165 510 282 0 61 ttyinq 160 315 429 540 0 61 DMAR_MAP_ENTRY 120 0 0 0 0 125 g_bio 408 0 522 37079 0 29 epoch_record pcpu 256 4 60 4 0 61 mbuf_jumbo_16k 16384 0 0 0 0 253 mbuf_jumbo_9k 9216 0 0 0 0 253 mbuf_jumbo_page 4096 0 253 2 0 253 mbuf_cluster 2048 8927 687 9448 0 253 mbuf 256 6180 1927 27997220 0 253 mbuf_packet 256 31 2752 246 0 253 audit_record 1280 0 0 0 0 9 domainset 40 0 0 0 0 253 cpuset 104 27 1492 27 0 125 THREAD 1416 270 90 431 0 9 PROC 1328 59 121 6265 0 9 MAC labels 40 0 0 0 0 253 pbuf 984 0 996 0 0 1 clpbuf 984 0 15 5 0 5 vnpbuf 984 0 0 0 0 13 mdpbuf 984 0 0 0 0 1 nfspbuf 984 0 0 0 0 5 swwbuf 984 0 0 0 0 1 swrbuf 984 0 0 0 0 5 umtx_shm 88 0 0 0 0 125 umtx pi 96 0 0 0 0 125 rl_entry 40 120 2949 120 0 253 TURNSTILE 136 361 439 361 0 61 rangeset pctrie nodes 144 0 0 0 0 61 filedesc0 1104 60 165 6266 0 9 Files 80 947182 97694 14040458 0 242 SLEEPQUEUE 88 361 1158 361 0 125 65536 65536 1 0 1 0 1 65536 65536 2 0 2 0 1 65536 65536 11 14 2305 0 1 65536 65536 0 0 0 0 1 65536 65536 1 0 1 0 1 65536 65536 2 0 2 0 1 65536 65536 3 0 3 0 1 65536 65536 0 0 0 0 1 32768 32768 0 0 0 0 1 32768 32768 13 1 14 0 1 32768 32768 10 29 2921 0 2 32768 32768 0 0 0 0 1 32768 32768 1 0 1 0 1 32768 32768 12 0 12 0 1 32768 32768 1 2 3 0 1 32768 32768 2 0 2 0 1 16384 16384 1 0 1 0 1 16384 16384 4 0 4 0 1 16384 16384 54 32 3353 0 1 16384 16384 1 0 1 0 1 16384 16384 1 0 1 0 1 16384 16384 1 2 5 0 1 16384 16384 0 2 2 0 1 16384 16384 0 0 0 0 1 8192 8192 1 0 1 0 1 8192 8192 89 1 91 0 1 8192 8192 19 17 2288 0 1 8192 8192 4 0 4 0 1 8192 8192 3 0 3 0 1 8192 8192 12 1 16 0 1 8192 8192 6 2 9 0 1 8192 8192 1 0 1 0 1 4096 4096 355 6 592 0 1 4096 4096 5 2 7 0 1 4096 4096 49 18 92298 0 1 4096 4096 12 12 982 0 1 4096 4096 16 1 33 0 1 4096 4096 61 17 6271 0 1 4096 4096 6 3 9 0 1 4096 4096 7 0 7 0 1 2048 2048 2 4 2 0 5 2048 2048 4 12 4 0 5 2048 2048 112 98 9789 0 5 2048 2048 0 0 0 0 5 2048 2048 7 19 7 0 5 2048 2048 3 7 7 0 5 2048 2048 7 19 9 0 5 2048 2048 0 0 0 0 5 1024 1024 0 92 10 0 13 1024 1024 20 60 21 0 13 1024 1024 213 487 19682 0 13 1024 1024 15 37 18 0 13 1024 1024 11 145 6230 0 13 1024 1024 2 26 6 0 13 1024 1024 13 79 16 0 13 1024 1024 1 15 1 0 13 512 512 0 266 48 0 29 512 512 13 225 15 0 29 512 512 206 235 13012 0 29 512 512 18 360 340 0 29 512 512 25 178 40 0 29 512 512 194 184 202 0 29 512 512 38 256 6994584 0 29 512 512 7 84 73 0 29 256 256 2 673 1386 0 61 256 256 19 176 19 0 61 256 256 825 540 9370 0 61 256 256 254 661 7561 0 61 256 256 24 711 8861 0 61 256 256 31 704 2046 0 61 256 256 19 656 296 0 61 256 256 117 438 124 0 61 128 128 569 1446 29324 0 125 128 128 73 826 73 0 125 128 128 1879 911 9775 0 125 128 128 153 1366 193 0 125 128 128 14375 1125 876070 0 125 128 128 0 1395 501 0 125 128 128 2179 1200 2608 0 125 128 128 101 922 101 0 125 64 64 40 2998 84392 0 253 64 64 146 2644 154 0 253 64 64 9098 2619 10473 0 253 64 64 77 2961 6309 0 253 64 64 9313 2839 17101 0 253 64 64 0 3038 109 0 253 64 64 791 2557 7173 0 253 64 64 209 1341 243 0 253 32 32 116 2984 4503 0 253 32 32 21 2335 55 0 253 32 32 398 2702 11469 0 253 32 32 59 3041 144 0 253 32 32 770 2826 22916 0 253 32 32 5 2599 69 0 253 32 32 3270 2310 8711 0 253 32 32 395 2705 398 0 253 16 16 24 2964 13989505 0 253 16 16 3 744 3 0 253 16 16 625 2612 23106 0 253 16 16 33 1710 34 0 253 16 16 492 2994 842323 0 253 16 16 2 2986 331 0 253 16 16 2815 2414 3010 0 253 16 16 20 478 49 0 253 mt_zone 24 429 401 429 0 253 mt_stats_zone 64 429 339 429 0 253 64 pcpu 8 3863 2025 3863 0 253 fakepg 104 0 0 0 0 125 VMSPACE 2552 26 52 6233 0 3 MAP ENTRY 112 798 3122 250075 0 126 KMAP ENTRY 112 7 761 7 0 125 MAP 232 2 65 2 0 61 RADIX NODE 144 10911 1605 207919 0 67 VM OBJECT 256 1282 863 84529 0 61 vmem btag 56 12139 1616 12139 0 253 vmem 1792 0 1 0 0 5 256 Bucket 2048 1764 11357 169883 0 10 128 Bucket 1024 244 136 1036 0 21 64 Bucket 512 246 209 742 0 29 32 Bucket 256 141 1028 8805 0 64 16 Bucket 128 675 1091 1114 0 128 12 Bucket 96 620 2619 18611 0 125 8 Bucket 64 52 3047 1655 0 253 6 Bucket 48 41 3030 348 0 253 4 Bucket 32 290 2810 1682 0 253 UMA Hash 256 2 9 7 0 0 UMA Slabs 112 13663 11 15498 0 0 UMA Zones 1960 80 0 80 0 0 UMA Kegs 216 74 5 74 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket vm pgcache 104 11239 2833 478802 253 buf free cache 984 2812 152 3769 13 buffer arena-65 65536 0 0 656 1 buffer arena-61 61440 0 0 656 1 buffer arena-57 57344 0 0 656 1 buffer arena-53 53248 0 0 656 1 buffer arena-49 49152 0 0 656 1 buffer arena-45 45056 0 0 656 1 buffer arena-40 40960 0 0 656 1 buffer arena-36 36864 0 0 656 1 buffer arena-32 32768 258 15 1108 1 buffer arena-28 28672 0 0 656 1 buffer arena-24 24576 0 0 656 1 buffer arena-20 20480 0 0 656 1 buffer arena-16 16384 3 1 666 1 buffer arena-12 12288 0 0 656 1 buffer arena-81 8192 0 0 656 1 buffer arena-40 4096 0 0 656 1 db:0:pho> acttrace Tracing command idle pid 11 tid 100003 td 0xfffff800036bd000 (CPU 0) kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe0076766710 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0076766720 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe0076766750 uart_intr() at uart_intr+0x138/frame 0xfffffe0076766790 intr_event_handle() at intr_event_handle+0xb5/frame 0xfffffe00767667e0 intr_execute_handlers() at intr_execute_handlers+0x57/frame 0xfffffe0076766810 lapic_handle_intr() at lapic_handle_intr+0x5f/frame 0xfffffe0076766830 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe0076766830 --- interrupt, rip = 0xffffffff81222a56, rsp = 0xfffffe0076766900, rbp = 0xfffffe0076766900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800036bc5a0 (CPU 1) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006b73df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b73e10 trap() at trap+0x48/frame 0xfffffe0006b73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b73f20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe007676b900, rbp = 0xfffffe007676b900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007676b900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007676b950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007676b970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007676b990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007676ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007676bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007676bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800036bc000 (CPU 2) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006b7fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b7fe10 trap() at trap+0x48/frame 0xfffffe0006b7ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b7ff20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe0076770900, rbp = 0xfffffe0076770900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076770900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076770950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076770970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076770990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076770a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076770ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076770ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800036bb5a0 (CPU 3) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006b8bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b8be10 trap() at trap+0x48/frame 0xfffffe0006b8bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b8bf20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe0076775900, rbp = 0xfffffe0076775900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076775900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076775950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076775970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076775990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076775a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076775ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076775ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800036bb000 (CPU 4) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006b97df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b97e10 trap() at trap+0x48/frame 0xfffffe0006b97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b97f20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe007677a900, rbp = 0xfffffe007677a900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677a900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677a950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677a970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677a990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007677aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800036ba5a0 (CPU 5) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006ba3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006ba3e10 trap() at trap+0x48/frame 0xfffffe0006ba3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006ba3f20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe007677f900, rbp = 0xfffffe007677f900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677f900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677f950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677f970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677f990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007677fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800036ce5a0 (CPU 7) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006bbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bbbe10 trap() at trap+0x48/frame 0xfffffe0006bbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bbbf20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe0076789900, rbp = 0xfffffe0076789900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076789900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076789950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076789970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076789990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076789a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076789ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076789ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800036ce000 (CPU 8) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006bc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bc7e10 trap() at trap+0x48/frame 0xfffffe0006bc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc7f20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe007678e900, rbp = 0xfffffe007678e900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007678e900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007678e950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007678e970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007678e990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007678ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007678eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007678eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800036cd5a0 (CPU 9) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006bd3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bd3e10 trap() at trap+0x48/frame 0xfffffe0006bd3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd3f20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe0076793900, rbp = 0xfffffe0076793900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076793900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076793950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076793970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076793990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076793a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076793ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076793ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800036cd000 (CPU 10) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006bdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bdfe10 trap() at trap+0x48/frame 0xfffffe0006bdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdff20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe0076798900, rbp = 0xfffffe0076798900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076798900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076798950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076798970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076798990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076798a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076798ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076798ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800036cc5a0 (CPU 11) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006bebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bebe10 trap() at trap+0x48/frame 0xfffffe0006bebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bebf20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe007679d900, rbp = 0xfffffe007679d900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007679d900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007679d950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007679d970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007679d990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007679da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007679dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007679dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff800037165a0 (CPU 6) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006bafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bafe10 trap() at trap+0x48/frame 0xfffffe0006baff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006baff20 --- trap 0x13, rip = 0xffffffff80c4cfdd, rsp = 0xfffffe00767c7920, rbp = 0xfffffe00767c7930 --- witness_unlock() at witness_unlock+0x1cd/frame 0xfffffe00767c7930 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe00767c7960 unp_gc() at unp_gc+0x50a/frame 0xfffffe00767c79e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00767c7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00767c7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767c7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767c7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 6201 1 6186 0 LE+ *unp_lin 0xfffff80007d51240 sendmsg2 6200 1 6186 0 L+ *unp_lin 0xfffff80007d51240 sendmsg2 6199 1 6186 0 LE+ *unp_lin 0xfffff80007d51240 sendmsg2 2330 2329 2330 0 S+ ttyin 0xfffff800060aacb0 sh 2329 1 2329 0 Ss+ wait 0xfffff80191b73530 login 2328 1 2328 0 Ss+ ttyin 0xfffff800060ab0b0 getty 2327 1 2327 0 Ss+ ttyin 0xfffff800074da8b0 getty 2326 1 2326 0 Ss+ ttyin 0xfffff800074dacb0 getty 2325 1 2325 0 Ss+ ttyin 0xfffff800074dd0b0 getty 2324 1 2324 0 Ss+ ttyin 0xfffff800074dd4b0 getty 2323 1 2323 0 Ss+ ttyin 0xfffff800074dd8b0 getty 2322 1 2322 0 Ss+ ttyin 0xfffff800074ddcb0 getty 2321 1 2321 0 Ss+ ttyin 0xfffff800074e00b0 getty 2320 1 2320 0 Ss+ ttyin 0xfffff800074e04b0 getty 2274 1 2274 0 Ss nanslp 0xffffffff81e9dfc0 cron 2270 1 2270 0 Ss select 0xfffff80006022640 sshd 2182 1 2182 0 Ss rpcsvc 0xfffff801918f1760 NLM: master 2179 1 2179 0 Ss select 0xfffff80003fa9240 rpc.statd 2133 1 2133 0 Ss nanslp 0xffffffff81e9dfc1 watchdogd 2054 1 2054 0 Ss select 0xfffff80007387bc0 rpcbind 2044 1 2044 0 Ss select 0xfffff80003dbdec0 syslogd 1973 1 1973 0 Ss select 0xfffff800075844c0 devd 1968 1 1968 65 Ss select 0xfffff800075855c0 dhclient 1924 1 1924 0 Ss select 0xfffff80007289040 dhclient 1921 1 1921 0 Ss select 0xfffff8000602fcc0 dhclient 34 0 0 0 DL vlruwt 0xfffff8000736ba60 [vnlru] 33 0 0 0 DL syncer 0xffffffff82040400 [syncer] 32 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff8203f8a8 [bufdaemon] 100131 D - 0xffffffff81a0a880 [bufspacedaemon-0] 100132 D - 0xffffffff81a12b40 [bufspacedaemon-1] 100134 D - 0xffffffff81a1ae00 [bufspacedaemon-2] 100135 D - 0xffffffff81a230c0 [bufspacedaemon-3] 100136 D - 0xffffffff81a2b380 [bufspacedaemon-4] 100138 D - 0xffffffff81a33640 [bufspacedaemon-5] 100139 D - 0xffffffff81a3b900 [bufspacedaemon-6] 100153 D sdflush 0xfffff80007e074e8 [/ worker] 100208 D sdflush 0xfffff800078c7ce8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff8205c788 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff820c64d8 [dom0] 100133 D launds 0xffffffff820c64e4 [laundry: dom0] 100137 D umarcl 0xffffffff80f17b40 [uma] 29 0 0 0 DL idle 0xfffff80007272000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff80007272530 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81cfd530 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff820c4bb0 [sctp_iterator] 25 0 0 0 DL - 0xffffffff8203f29c [soaiod4] 24 0 0 0 DL - 0xffffffff8203f29c [soaiod3] 23 0 0 0 DL - 0xffffffff8203f29c [soaiod2] 22 0 0 0 DL - 0xffffffff8203f29c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe009a1aa460 [usbus0] 100097 D - 0xfffffe009a1aa4b8 [usbus0] 100098 D - 0xfffffe009a1aa510 [usbus0] 100099 D - 0xfffffe009a1aa568 [usbus0] 100100 D - 0xfffffe009a1aa5c0 [usbus0] 100102 D - 0xfffffe0006dd6d10 [usbus1] 100103 D - 0xfffffe0006dd6d68 [usbus1] 100104 D - 0xfffffe0006dd6dc0 [usbus1] 100105 D - 0xfffffe0006dd6e18 [usbus1] 100106 D - 0xfffffe0006dd6e70 [usbus1] 100107 D - 0xfffffe00007f3d10 [usbus2] 100108 D - 0xfffffe00007f3d68 [usbus2] 100109 D - 0xfffffe00007f3dc0 [usbus2] 100110 D - 0xfffffe00007f3e18 [usbus2] 100111 D - 0xfffffe00007f3e70 [usbus2] 20 0 0 0 DL (threaded) [cam] 100091 D - 0xffffffff81bd87c0 [doneq0] 100092 D - 0xffffffff81bd8840 [doneq1] 100093 D - 0xffffffff81bd88c0 [doneq2] 100125 D - 0xffffffff81bd8688 [scanner] 19 0 0 0 DL crypto_ 0xfffff80003968450 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff800039683f0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003968390 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003968330 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff800039682d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003968270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003968210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff800039681b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003968150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff800039680f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003968090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003968030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff82056d70 [crypto] 14 0 0 0 DL seqstat 0xfffff8000390bc88 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100061 D - 0xffffffff82095050 [g_event] 100062 D - 0xffffffff82095060 [g_up] 100063 D - 0xffffffff82095048 [g_down] 12 0 0 0 WL (threaded) [intr] 100018 I [swi6: task queue] 100019 I [swi6: Giant taskq] 100021 I [swi5: fast taskq] 100047 I [swi4: clock (0)] 100048 I [swi4: clock (1)] 100049 I [swi4: clock (2)] 100050 I [swi4: clock (3)] 100051 I [swi4: clock (4)] 100052 I [swi4: clock (5)] 100053 I [swi4: clock (6)] 100054 I [swi4: clock (7)] 100055 I [swi4: clock (8)] 100056 I [swi4: clock (9)] 100057 I [swi4: clock (10)] 100058 I [swi4: clock (11)] 100059 I [swi3: vm] 100060 I [swi1: netisr 0] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100186 I [irq72: ioat0] 100187 I [irq73: ioat1] 100188 I [irq74: ioat2] 100189 I [irq75: ioat3] 100190 I [irq76: ioat4] 100191 I [irq77: ioat5] 100192 I [irq78: ioat6] 100193 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800036b9530 [init] 10 0 0 0 DL audit_w 0xffffffff820c58d0 [audit] 0 0 0 0 RLs (threaded) [kernel] 100000 D swapin 0xffffffff82095090 [swapper] 100015 D - 0xfffff8000369ae00 [config_0] 100016 D - 0xfffff80003710000 [kqueue_ctx taskq] 100017 D - 0xfffff8000370fe00 [aiod_kick taskq] 100020 Run CPU 6 [thread taskq] 100022 D - 0xfffff8000369a600 [if_config_tqg_0] 100023 D - 0xfffff8000369a400 [if_io_tqg_0] 100024 D - 0xfffff8000369a200 [if_io_tqg_1] 100025 D - 0xfffff8000369a000 [if_io_tqg_2] 100026 D - 0xfffff80003699d00 [if_io_tqg_3] 100027 D - 0xfffff80003699b00 [if_io_tqg_4] 100028 D - 0xfffff80003699900 [if_io_tqg_5] 100029 D - 0xfffff80003699700 [if_io_tqg_6] 100030 D - 0xfffff80003699500 [if_io_tqg_7] 100031 D - 0xfffff80003699300 [if_io_tqg_8] 100032 D - 0xfffff80003699100 [if_io_tqg_9] 100033 D - 0xfffff80003698e00 [if_io_tqg_10] 100034 D - 0xfffff80003698c00 [if_io_tqg_11] 100035 D - 0xfffff800037d2100 [softirq_0] 100036 D - 0xfffff800037d1e00 [softirq_1] 100037 D - 0xfffff800037d1c00 [softirq_2] 100038 D - 0xfffff800037d1a00 [softirq_3] 100039 D - 0xfffff800037d1800 [softirq_4] 100040 D - 0xfffff800037d1600 [softirq_5] 100041 D - 0xfffff800037d1400 [softirq_6] 100042 D - 0xfffff800037d1200 [softirq_7] 100043 D - 0xfffff800037d1000 [softirq_8] 100044 D - 0xfffff800037d0d00 [softirq_9] 100045 D - 0xfffff800037d0b00 [softirq_10] 100046 D - 0xfffff800037d0900 [softirq_11] 100064 D - 0xfffff800038c0c00 [firmware taskq] 100066 D - 0xfffff800038c0400 [crypto_0] 100067 D - 0xfffff800038c0400 [crypto_1] 100068 D - 0xfffff800038c0400 [crypto_2] 100069 D - 0xfffff800038c0400 [crypto_3] 100070 D - 0xfffff800038c0400 [crypto_4] 100071 D - 0xfffff800038c0400 [crypto_5] 100072 D - 0xfffff800038c0400 [crypto_6] 100073 D - 0xfffff800038c0400 [crypto_7] 100074 D - 0xfffff800038c0400 [crypto_8] 100075 D - 0xfffff800038c0400 [crypto_9] 100076 D - 0xfffff800038c0400 [crypto_10] 100077 D - 0xfffff800038c0400 [crypto_11] 100114 D - 0xfffff80006080b00 [mca taskq] 100120 D - 0xfffff800073c0600 [acpi_task_0] 100121 D - 0xfffff800073c0600 [acpi_task_1] 100122 D - 0xfffff800073c0600 [acpi_task_2] 100124 D - 0xfffff800038bfc00 [CAM taskq] db:0:pho> allt Tracing command sendmsg2 pid 6201 tid 100431 td 0xfffff80007d545a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00b9cd64e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00b9cd6510 turnstile_wait() at turnstile_wait+0x3ac/frame 0xfffffe00b9cd6560 __rw_wlock_hard() at __rw_wlock_hard+0x104/frame 0xfffffe00b9cd6610 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00b9cd6650 unp_dispose() at unp_dispose+0x30/frame 0xfffffe00b9cd6690 sofree() at sofree+0x2d9/frame 0xfffffe00b9cd66e0 soclose() at soclose+0x331/frame 0xfffffe00b9cd6750 _fdrop() at _fdrop+0x1a/frame 0xfffffe00b9cd6770 closef() at closef+0x1ec/frame 0xfffffe00b9cd6800 fdescfree_fds() at fdescfree_fds+0x8c/frame 0xfffffe00b9cd6850 fdescfree() at fdescfree+0x37a/frame 0xfffffe00b9cd6910 exit1() at exit1+0x4fe/frame 0xfffffe00b9cd6980 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00b9cd6990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b9cd6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b9cd6ab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8003ab8da, rsp = 0x7fffffffdef8, rbp = 0x7fffffffdf10 --- Tracing command sendmsg2 pid 6200 tid 100430 td 0xfffff80007d55000 sched_switch() at sched_switch+0x713/frame 0xfffffe00b9cd1590 mi_switch() at mi_switch+0x174/frame 0xfffffe00b9cd15c0 turnstile_wait() at turnstile_wait+0x3ac/frame 0xfffffe00b9cd1610 __rw_wlock_hard() at __rw_wlock_hard+0x104/frame 0xfffffe00b9cd16c0 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00b9cd1700 unp_externalize() at unp_externalize+0x2dd/frame 0xfffffe00b9cd1790 soreceive_generic() at soreceive_generic+0x705/frame 0xfffffe00b9cd1850 soreceive() at soreceive+0x59/frame 0xfffffe00b9cd1870 kern_recvit() at kern_recvit+0x1ec/frame 0xfffffe00b9cd1920 sys_recvmsg() at sys_recvmsg+0x6f/frame 0xfffffe00b9cd1990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b9cd1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b9cd1ab0 --- syscall (27, FreeBSD ELF64, sys_recvmsg), rip = 0x8003abaca, rsp = 0x7fffffffdf08, rbp = 0x7fffffffdf10 --- Tracing command sendmsg2 pid 6199 tid 100417 td 0xfffff80007d555a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00b9ccc4e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00b9ccc510 turnstile_wait() at turnstile_wait+0x3ac/frame 0xfffffe00b9ccc560 __rw_wlock_hard() at __rw_wlock_hard+0x104/frame 0xfffffe00b9ccc610 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00b9ccc650 unp_dispose() at unp_dispose+0x30/frame 0xfffffe00b9ccc690 sofree() at sofree+0x2d9/frame 0xfffffe00b9ccc6e0 soclose() at soclose+0x331/frame 0xfffffe00b9ccc750 _fdrop() at _fdrop+0x1a/frame 0xfffffe00b9ccc770 closef() at closef+0x1ec/frame 0xfffffe00b9ccc800 fdescfree_fds() at fdescfree_fds+0x8c/frame 0xfffffe00b9ccc850 fdescfree() at fdescfree+0x37a/frame 0xfffffe00b9ccc910 exit1() at exit1+0x4fe/frame 0xfffffe00b9ccc980 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00b9ccc990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b9cccab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b9cccab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8003ab8da, rsp = 0x7fffffffdef8, rbp = 0x7fffffffdf10 --- Tracing command sh pid 2330 tid 100155 td 0xfffff80007e57000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa81d630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa81d660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa81d6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa81d700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa81d730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa81d790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa81d7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa81d820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa81d850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa81d8b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa81d900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa81d940 sys_read() at sys_read+0x84/frame 0xfffffe00aa81d990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa81dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa81dab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047d22a, rsp = 0x7fffffffe748, rbp = 0x7fffffffe820 --- Tracing command login pid 2329 tid 100222 td 0xfffff800078f65a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa9df570 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa9df5a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa9df5e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa9df640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa9df670 _sleep() at _sleep+0x2d0/frame 0xfffffe00aa9df710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00aa9df7a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00aa9df990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa9dfab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa9dfab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003f39ea, rsp = 0x7fffffffeb48, rbp = 0x7fffffffed00 --- Tracing command getty pid 2328 tid 100221 td 0xfffff800078f7000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa9da630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa9da660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa9da6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa9da700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa9da730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa9da790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa9da7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa9da820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa9da850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa9da8b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa9da900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa9da940 sys_read() at sys_read+0x84/frame 0xfffffe00aa9da990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa9daab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa9daab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043822a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2327 tid 100220 td 0xfffff800078f75a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa9d5630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa9d5660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa9d56a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa9d5700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa9d5730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa9d5790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa9d57c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa9d5820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa9d5850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa9d58b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa9d5900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa9d5940 sys_read() at sys_read+0x84/frame 0xfffffe00aa9d5990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa9d5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa9d5ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043822a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2326 tid 100219 td 0xfffff80191b18000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa9d0630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa9d0660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa9d06a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa9d0700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa9d0730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa9d0790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa9d07c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa9d0820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa9d0850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa9d08b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa9d0900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa9d0940 sys_read() at sys_read+0x84/frame 0xfffffe00aa9d0990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa9d0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa9d0ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043822a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2325 tid 100218 td 0xfffff800076df5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa9cb630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa9cb660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa9cb6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa9cb700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa9cb730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa9cb790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa9cb7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa9cb820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa9cb850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa9cb8b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa9cb900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa9cb940 sys_read() at sys_read+0x84/frame 0xfffffe00aa9cb990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa9cbab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa9cbab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043822a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2324 tid 100201 td 0xfffff800076e8000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa957630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa957660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa9576a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa957700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa957730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa957790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa9577c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa957820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa957850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa9578b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa957900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa957940 sys_read() at sys_read+0x84/frame 0xfffffe00aa957990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa957ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa957ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043822a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2323 tid 100174 td 0xfffff800076fe5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa894630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa894660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa8946a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa894700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa894730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa894790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa8947c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa894820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa894850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa8948b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa894900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa894940 sys_read() at sys_read+0x84/frame 0xfffffe00aa894990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa894ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa894ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043822a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2322 tid 100149 td 0xfffff80007d57000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa7fd630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa7fd660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa7fd6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa7fd700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa7fd730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa7fd790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa7fd7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa7fd820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa7fd850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa7fd8b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa7fd900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa7fd940 sys_read() at sys_read+0x84/frame 0xfffffe00aa7fd990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa7fdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa7fdab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043822a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2321 tid 100152 td 0xfffff80007de15a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa80e630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa80e660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa80e6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa80e700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa80e730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa80e790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa80e7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa80e820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa80e850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa80e8b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa80e900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa80e940 sys_read() at sys_read+0x84/frame 0xfffffe00aa80e990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa80eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa80eab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043822a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2320 tid 100142 td 0xfffff80003749000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a35f8630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a35f8660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a35f86a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a35f8700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a35f8730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a35f8790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a35f87c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a35f8820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a35f8850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a35f88b0 dofileread() at dofileread+0x81/frame 0xfffffe00a35f8900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a35f8940 sys_read() at sys_read+0x84/frame 0xfffffe00a35f8990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a35f8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a35f8ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043822a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2274 tid 100151 td 0xfffff80007db6000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa809720 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa809750 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa809790 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa8097f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa809830 _sleep() at _sleep+0x265/frame 0xfffffe00aa8098d0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00aa809950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00aa809990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa809ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa809ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003dbb6a, rsp = 0x7fffffffead8, rbp = 0x7fffffffecc0 --- Tracing command sshd pid 2270 tid 100202 td 0xfffff80007d7e000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa95c5d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa95c600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa95c640 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa95c6a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa95c6d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa95c730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aa95c770 kern_select() at kern_select+0x953/frame 0xfffffe00aa95c950 sys_select() at sys_select+0x56/frame 0xfffffe00aa95c990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa95cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa95cab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80090920a, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6a0 --- Tracing command rpc.lockd pid 2182 tid 100167 td 0xfffff800060e95a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa8594f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa859520 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa859560 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa8595c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa859600 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aa859670 svc_run_internal() at svc_run_internal+0xa77/frame 0xfffffe00aa8597b0 svc_run() at svc_run+0x24e/frame 0xfffffe00aa859810 sys_nlm_syscall() at sys_nlm_syscall+0x77b/frame 0xfffffe00aa859990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa859ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa859ab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f762a, rsp = 0x7fffffffec08, rbp = 0x7fffffffecc0 --- Tracing command rpc.statd pid 2179 tid 100206 td 0xfffff80191785000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa9945b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa9945e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa994620 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa994680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa9946c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aa994730 seltdwait() at seltdwait+0x6b/frame 0xfffffe00aa994770 kern_select() at kern_select+0x953/frame 0xfffffe00aa994950 sys_select() at sys_select+0x56/frame 0xfffffe00aa994990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa994ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa994ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042c20a, rsp = 0x7fffffffea98, rbp = 0x7fffffffebe0 --- Tracing command watchdogd pid 2133 tid 100205 td 0xfffff801917855a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa98f720 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa98f750 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa98f790 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa98f7f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa98f830 _sleep() at _sleep+0x265/frame 0xfffffe00aa98f8d0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00aa98f950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00aa98f990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa98fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa98fab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c4b6a, rsp = 0x7fffffffea98, rbp = 0x7fffffffeae0 --- Tracing command rpcbind pid 2054 tid 100177 td 0xfffff800076e85a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa8a3630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa8a3660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa8a36a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa8a3700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa8a3740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aa8a37b0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00aa8a37f0 kern_poll() at kern_poll+0x448/frame 0xfffffe00aa8a3970 sys_poll() at sys_poll+0x50/frame 0xfffffe00aa8a3990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa8a3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa8a3ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003d335a, rsp = 0x7fffffffca38, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2044 tid 100166 td 0xfffff800060ea000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa8545d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa854600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa854640 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa8546a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa8546d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa854730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aa854770 kern_select() at kern_select+0x953/frame 0xfffffe00aa854950 sys_select() at sys_select+0x56/frame 0xfffffe00aa854990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa854ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa854ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043d20a, rsp = 0x7fffffffe748, rbp = 0x7fffffffecc0 --- Tracing command devd pid 1973 tid 100171 td 0xfffff80007713000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa8795b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa8795e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa879620 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa879680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa8796c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aa879730 seltdwait() at seltdwait+0x6b/frame 0xfffffe00aa879770 kern_select() at kern_select+0x953/frame 0xfffffe00aa879950 sys_select() at sys_select+0x56/frame 0xfffffe00aa879990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa879ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa879ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f530a, rsp = 0x7fffffffcb48, rbp = 0x7fffffffece0 --- Tracing command dhclient pid 1968 tid 100182 td 0xfffff80007d7f000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa8bc630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa8bc660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa8bc6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa8bc700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa8bc740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aa8bc7b0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00aa8bc7f0 kern_poll() at kern_poll+0x448/frame 0xfffffe00aa8bc970 sys_poll() at sys_poll+0x50/frame 0xfffffe00aa8bc990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa8bcab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa8bcab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f635a, rsp = 0x7fffffffec28, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1924 tid 100183 td 0xfffff80007d7e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa8c1650 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa8c1680 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa8c16c0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa8c1720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa8c1750 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa8c17b0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aa8c17f0 kern_poll() at kern_poll+0x448/frame 0xfffffe00aa8c1970 sys_poll() at sys_poll+0x50/frame 0xfffffe00aa8c1990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa8c1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa8c1ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f635a, rsp = 0x7fffffffec38, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1921 tid 100168 td 0xfffff80007279000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa85e5d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa85e600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa85e640 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa85e6a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa85e6d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa85e730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aa85e770 kern_select() at kern_select+0x953/frame 0xfffffe00aa85e950 sys_select() at sys_select+0x56/frame 0xfffffe00aa85e990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa85eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa85eab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80045420a, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffeaa0 --- Tracing command vnlru pid 34 tid 100141 td 0xfffff800076dd000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a35f3890 mi_switch() at mi_switch+0x174/frame 0xfffffe00a35f38c0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a35f3900 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a35f3940 _sleep() at _sleep+0x279/frame 0xfffffe00a35f39e0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe00a35f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a35f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a35f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100140 td 0xfffff800076dd5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a35ee8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a35ee8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a35ee930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a35ee970 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x185/frame 0xfffffe00a35ee9e0 sched_sync() at sched_sync+0x609/frame 0xfffffe00a35eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a35eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a35eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffff800076df000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f388d0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f38900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f38940 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f38980 _sleep() at _sleep+0x279/frame 0xfffffe0006f38a20 buf_daemon() at buf_daemon+0xc8/frame 0xfffffe0006f38a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f38ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f38ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100131 td 0xfffff80003fd45a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ffd8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ffd8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ffd930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ffd970 _sleep() at _sleep+0x279/frame 0xfffffe0006ffda10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006ffda70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ffdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ffdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100132 td 0xfffff80003fd4000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a2ca48c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a2ca48f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2ca4930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a2ca4970 _sleep() at _sleep+0x279/frame 0xfffffe00a2ca4a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a2ca4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2ca4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2ca4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffff8000771e000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a2de98c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a2de98f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2de9930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a2de9970 _sleep() at _sleep+0x279/frame 0xfffffe00a2de9a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a2de9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2de9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2de9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff8000771c5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a2dee8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a2dee8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2dee930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a2dee970 _sleep() at _sleep+0x279/frame 0xfffffe00a2deea10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a2deea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2deeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2deeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff8000771c000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a2df88c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a2df88f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2df8930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a2df8970 _sleep() at _sleep+0x279/frame 0xfffffe00a2df8a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a2df8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2df8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2df8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffff800077185a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a34648c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a34648f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a3464930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a3464970 _sleep() at _sleep+0x279/frame 0xfffffe00a3464a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a3464a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a3464ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a3464ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffff80007718000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a35e98c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a35e98f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a35e9930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a35e9970 _sleep() at _sleep+0x279/frame 0xfffffe00a35e9a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a35e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a35e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a35e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100153 td 0xfffff800077135a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa8138f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa813920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa813960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aa8139a0 _sleep() at _sleep+0x279/frame 0xfffffe00aa813a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00aa813a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00aa813ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00aa813ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100208 td 0xfffff8001d121000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aa8318f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa831920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa831960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aa8319a0 _sleep() at _sleep+0x279/frame 0xfffffe00aa831a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00aa831a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00aa831ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00aa831ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff800072915a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f338c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f338f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f33930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f33960 _sleep() at _sleep+0x2da/frame 0xfffffe0006f33a00 vm_daemon() at vm_daemon+0xabf/frame 0xfffffe0006f33a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f33ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f33ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff8000737a000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f2e560 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f2e590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f2e5d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f2e610 _sleep() at _sleep+0x279/frame 0xfffffe0006f2e6b0 vm_pageout_worker() at vm_pageout_worker+0x25e/frame 0xfffffe0006f2ea30 vm_pageout() at vm_pageout+0x156/frame 0xfffffe0006f2ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f2eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f2eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100133 td 0xfffff800077045a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a2df36b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a2df36e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2df3720 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a2df3750 _sleep() at _sleep+0x2da/frame 0xfffffe00a2df37f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xbed/frame 0xfffffe00a2df3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2df3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2df3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100137 td 0xfffff80007704000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a2dfd8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a2dfd920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2dfd960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a2dfd9a0 _sleep() at _sleep+0x279/frame 0xfffffe00a2dfda40 uma_reclaim_worker() at uma_reclaim_worker+0xda/frame 0xfffffe00a2dfda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2dfdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2dfdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff8000728e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f1d8b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f1d8e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f1d920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f1d950 _sleep() at _sleep+0x2da/frame 0xfffffe0006f1d9f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006f1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f1dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff8000728f000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f188b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f188e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f18920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f18950 _sleep() at _sleep+0x2da/frame 0xfffffe0006f189f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006f18a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f18ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100123 td 0xfffff8000738c5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f098c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f098f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f09930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f09970 _sleep() at _sleep+0x279/frame 0xfffffe0006f09a10 random_kthread() at random_kthread+0x27a/frame 0xfffffe0006f09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f09ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff8000738e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ee9910 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ee9940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ee9980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ee99b0 _sleep() at _sleep+0x2da/frame 0xfffffe0006ee9a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0006ee9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ee9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ee9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff8000728f5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ed88e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ed8910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ed8950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ed8990 _sleep() at _sleep+0x279/frame 0xfffffe0006ed8a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ed8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ed8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ed8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff80007290000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ed38e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ed3910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ed3950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ed3990 _sleep() at _sleep+0x279/frame 0xfffffe0006ed3a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ed3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ed3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ed3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff800072905a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ece8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ece910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ece950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ece990 _sleep() at _sleep+0x279/frame 0xfffffe0006ecea30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ecea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eceab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eceab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff80007291000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ec98e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ec9910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ec9950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ec9990 _sleep() at _sleep+0x279/frame 0xfffffe0006ec9a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ec9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff800037f3000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e5e930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e5e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e5e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e5e9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e5ea30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e5ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e5eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e5eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff800037f25a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e63930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e63960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e639a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e639d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e63a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e63a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e63ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e63ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff800037f2000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e68930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e68960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e689a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e689d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e68a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e68a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e68ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e68ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff800037eb5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e6d930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e6d960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e6d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e6d9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e6da30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e6da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e6dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e6dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff80003fd8000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e72930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e72960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e729a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e729d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e72a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e72a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e72ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e72ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff80003fd7000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e7c930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e7c960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e7c9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e7c9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e7ca30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e7ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e7cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e7cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff80003fd65a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e81930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e81960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e819a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e819d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e81a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e81a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e81ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e81ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff80003fd6000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e86930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e86960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e869a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e869d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e86a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e86a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e86ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e86ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff80003fd55a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e8b930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e8b960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e8b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e8b9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e8ba30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e8ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e8bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e8bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff80003fd5000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e90930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e90960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e909a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e909d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e90a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e90a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e90ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e90ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff80003aca5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ea1930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ea1960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ea19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ea19d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006ea1a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006ea1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff80003aca000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ea6930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ea6960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ea69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ea69d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006ea6a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006ea6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff80003ac95a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006eab930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eab960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006eab9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eab9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006eaba30 usb_process() at usb_process+0x13b/frame 0xfffffe0006eaba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eabab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eabab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff80003ac9000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006eb0930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eb0960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006eb09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eb09d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006eb0a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006eb0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff80003ac85a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006eb5930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eb5960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006eb59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eb59d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006eb5a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006eb5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff8000396d000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e458e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e45910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e45950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e45980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e45a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e45a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e45ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e45ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff80003acb5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e4a8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e4a910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e4a950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4a980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e4aa20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e4aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff80003acb000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e4f8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e4f910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e4f950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4f980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e4fa20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e4fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff8000737a5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f138d0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f13900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f13940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f13970 _sleep() at _sleep+0x2da/frame 0xfffffe0006f13a10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe0006f13a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f13ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffff8000396d5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e408c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e408f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e40930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e40960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e40a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e40a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e40ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e40ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffff8000396e000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e3b8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e3b8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e3b930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e3b960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e3ba00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e3ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e3bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e3bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffff8000396e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e368c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e368f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e36930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e36960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e36a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e36a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e36ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffff8000396f000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e318c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e318f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e31930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e31960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e31a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e31a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e31ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffff8000396f5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e2c8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e2c8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e2c930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e2c960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e2ca00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e2ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e2cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffff80003970000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e278c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e278f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e27930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e27960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e27a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e27a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e27ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e27ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffff800039705a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e228c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e228f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e22930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e22960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e22a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e22a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e22ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e22ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffff80003971000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e1d8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e1d8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e1d930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e1d960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e1da00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e1dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffff8000394d5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e188c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e188f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e18930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e18960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e18a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e18a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e18ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffff80003959000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e138c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e138f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e13930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e13960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e13a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e13a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e13ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffff800039595a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e0e8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e0e8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e0e930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e0e960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e0ea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e0ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e0eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffff8000395e000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e098c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e098f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e09930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e09960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e09a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e09ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffff8000395e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e048f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e04920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e04960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e04990 _sleep() at _sleep+0x2da/frame 0xfffffe0006e04a30 crypto_proc() at crypto_proc+0x2c4/frame 0xfffffe0006e04a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e04ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffff8000394d000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005c08f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c0920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005c0960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c0990 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005c09f0 seq_eventthread() at seq_eventthread+0xdc/frame 0xfffffe00005c0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100061 td 0xfffff8000382a000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005948f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000594920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000594960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000594990 _sleep() at _sleep+0x2da/frame 0xfffffe0000594a30 g_run_events() at g_run_events+0x4f/frame 0xfffffe0000594a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000594ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000594ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff800038295a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005998f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000599920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000599960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000599990 _sleep() at _sleep+0x2da/frame 0xfffffe0000599a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0000599a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe0000599a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000599ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000599ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff80003829000 sched_switch() at sched_switch+0x713/frame 0xfffffe000059e8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe000059e920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000059e960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000059e990 _sleep() at _sleep+0x2da/frame 0xfffffe000059ea30 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe000059ea60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe000059ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000059eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000059eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100018 td 0xfffff800036be5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00767bd9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00767bda10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00767bda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767bdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767bdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100019 td 0xfffff80003717000 sched_switch() at sched_switch+0x713/frame 0xfffffe00767c29e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00767c2a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00767c2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767c2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767c2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100021 td 0xfffff80003716000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff8000381a000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004ee9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00004eea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00004eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff800038195a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff80003819000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff800038185a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff80003818000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff800038175a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff80003817000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff8000380b5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff8000380b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff8000382c5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff8000382c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff8000382b5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff8000382b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffff8000382a5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe000052f9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe000052fa10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe000052fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000052fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000052fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffff800037f4000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e549e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e54a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e54a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e54ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e54ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff800037f35a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e599e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e59a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e59a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e59ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e59ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff80003fd75a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e779e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e77a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e77a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e77ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e77ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff80003ac8000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff800039715a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ebf9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ebfa10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006ebfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ebfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ebfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100186 td 0xfffff800076dc000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffff800076db5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffff800076db000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffff800076da5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffff800076da000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100191 td 0xfffff8001d850000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100192 td 0xfffff8001d84f5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100193 td 0xfffff8001d84f000 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff800036bd000 (CPU 0) kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe0076766710 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0076766720 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe0076766750 uart_intr() at uart_intr+0x138/frame 0xfffffe0076766790 intr_event_handle() at intr_event_handle+0xb5/frame 0xfffffe00767667e0 intr_execute_handlers() at intr_execute_handlers+0x57/frame 0xfffffe0076766810 lapic_handle_intr() at lapic_handle_intr+0x5f/frame 0xfffffe0076766830 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe0076766830 --- interrupt, rip = 0xffffffff81222a56, rsp = 0xfffffe0076766900, rbp = 0xfffffe0076766900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800036bc5a0 (CPU 1) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006b73df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b73e10 trap() at trap+0x48/frame 0xfffffe0006b73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b73f20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe007676b900, rbp = 0xfffffe007676b900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007676b900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007676b950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007676b970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007676b990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007676ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007676bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007676bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800036bc000 (CPU 2) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006b7fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b7fe10 trap() at trap+0x48/frame 0xfffffe0006b7ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b7ff20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe0076770900, rbp = 0xfffffe0076770900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076770900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076770950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076770970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076770990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076770a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076770ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076770ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800036bb5a0 (CPU 3) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006b8bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b8be10 trap() at trap+0x48/frame 0xfffffe0006b8bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b8bf20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe0076775900, rbp = 0xfffffe0076775900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076775900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076775950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076775970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076775990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076775a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076775ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076775ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800036bb000 (CPU 4) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006b97df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b97e10 trap() at trap+0x48/frame 0xfffffe0006b97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b97f20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe007677a900, rbp = 0xfffffe007677a900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677a900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677a950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677a970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677a990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007677aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800036ba5a0 (CPU 5) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006ba3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006ba3e10 trap() at trap+0x48/frame 0xfffffe0006ba3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006ba3f20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe007677f900, rbp = 0xfffffe007677f900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677f900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677f950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677f970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677f990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007677fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800036ba000 sched_switch() at sched_switch+0x713/frame 0xfffffe0076784940 mi_switch() at mi_switch+0x174/frame 0xfffffe0076784970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe0076784990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076784a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076784ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076784ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800036ce5a0 (CPU 7) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006bbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bbbe10 trap() at trap+0x48/frame 0xfffffe0006bbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bbbf20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe0076789900, rbp = 0xfffffe0076789900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076789900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076789950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076789970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076789990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076789a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076789ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076789ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800036ce000 (CPU 8) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006bc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bc7e10 trap() at trap+0x48/frame 0xfffffe0006bc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc7f20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe007678e900, rbp = 0xfffffe007678e900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007678e900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007678e950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007678e970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007678e990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007678ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007678eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007678eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800036cd5a0 (CPU 9) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006bd3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bd3e10 trap() at trap+0x48/frame 0xfffffe0006bd3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd3f20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe0076793900, rbp = 0xfffffe0076793900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076793900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076793950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076793970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076793990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076793a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076793ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076793ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800036cd000 (CPU 10) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006bdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bdfe10 trap() at trap+0x48/frame 0xfffffe0006bdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdff20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe0076798900, rbp = 0xfffffe0076798900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076798900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076798950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076798970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076798990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076798a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076798ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076798ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800036cc5a0 (CPU 11) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006bebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bebe10 trap() at trap+0x48/frame 0xfffffe0006bebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bebf20 --- trap 0x13, rip = 0xffffffff81222a56, rsp = 0xfffffe007679d900, rbp = 0xfffffe007679d900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007679d900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007679d950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007679d970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007679d990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007679da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007679dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007679dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800036bd5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0076761570 mi_switch() at mi_switch+0x174/frame 0xfffffe00767615a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767615e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0076761640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0076761670 _sleep() at _sleep+0x2d0/frame 0xfffffe0076761710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00767617a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0076761990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0076761ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0076761ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b10ca, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffff800036be000 sched_switch() at sched_switch+0x713/frame 0xfffffe007675c910 mi_switch() at mi_switch+0x174/frame 0xfffffe007675c940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe007675c980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe007675c9b0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe007675ca10 audit_worker() at audit_worker+0x93/frame 0xfffffe007675ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007675cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007675cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff820955e0 sched_switch() at sched_switch+0x713/frame 0xffffffff828fe980 mi_switch() at mi_switch+0x174/frame 0xffffffff828fe9b0 sleepq_switch() at sleepq_switch+0x110/frame 0xffffffff828fe9f0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xffffffff828fea30 _sleep() at _sleep+0x279/frame 0xffffffff828fead0 swapper() at swapper+0x77/frame 0xffffffff828feb20 mi_startup() at mi_startup+0x2ee/frame 0xffffffff828feb70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffff800036cc000 sched_switch() at sched_switch+0x713/frame 0xfffffe00767ae930 mi_switch() at mi_switch+0x174/frame 0xfffffe00767ae960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767ae9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767ae9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00767aea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00767aea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767aeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767aeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffff800036cb5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00767b3900 mi_switch() at mi_switch+0x174/frame 0xfffffe00767b3930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767b3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767b39a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767b3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767b3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767b3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767b3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff800036cb000 sched_switch() at sched_switch+0x713/frame 0xfffffe00767b8900 mi_switch() at mi_switch+0x174/frame 0xfffffe00767b8930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767b8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767b89a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767b8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767b8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767b8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767b8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff800037165a0 (CPU 6) cpustop_handler() at cpustop_handler+0x2f/frame 0xfffffe0006bafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bafe10 trap() at trap+0x48/frame 0xfffffe0006baff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006baff20 --- trap 0x13, rip = 0xffffffff80c4cfdd, rsp = 0xfffffe00767c7920, rbp = 0xfffffe00767c7930 --- witness_unlock() at witness_unlock+0x1cd/frame 0xfffffe00767c7930 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe00767c7960 unp_gc() at unp_gc+0x50a/frame 0xfffffe00767c79e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00767c7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00767c7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767c7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767c7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff800037155a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000471930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000471960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004719a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004719d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000471a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000471a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000471ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000471ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff80003715000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000476930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000476960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004769a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004769d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000476a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000476a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000476ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000476ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff800037145a0 sched_switch() at sched_switch+0x713/frame 0xfffffe000047b930 mi_switch() at mi_switch+0x174/frame 0xfffffe000047b960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000047b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000047b9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000047ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000047ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000047bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000047bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003714000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000480930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000480960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004809a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004809d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000480a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000480a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000480ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000480ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff800037135a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000485930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000485960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004859a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004859d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000485a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000485a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000485ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000485ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003713000 sched_switch() at sched_switch+0x713/frame 0xfffffe000048a930 mi_switch() at mi_switch+0x174/frame 0xfffffe000048a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000048a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048a9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000048aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff8000374c5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe000048f930 mi_switch() at mi_switch+0x174/frame 0xfffffe000048f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000048f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048f9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000048fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff8000374c000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000494930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000494960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004949d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000494a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000494a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000494ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000494ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff8000374b5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000499930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000499960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004999d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000499a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000499a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000499ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000499ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff8000374b000 sched_switch() at sched_switch+0x713/frame 0xfffffe000049e930 mi_switch() at mi_switch+0x174/frame 0xfffffe000049e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000049e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000049e9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000049ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000049ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000049eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000049eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff8000374a5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004a3930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004a3960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004a39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a39d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004a3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff8000374a000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004a8930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004a8960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004a89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a89d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004a8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff800037495a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004ad930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004ad960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004ad9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004ad9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004ada40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff800037eb000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004b2930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004b2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004b29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004b2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff800037ea5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004b7930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004b7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004b79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004b7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff800037ea000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004bc930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004bc960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004bc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004bc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004bca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800037e95a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004c1930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004c1960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004c19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c19d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004c1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff800037e9000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004c6930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004c6960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004c69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c69d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004c6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800037e85a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004cb930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004cb960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004cb9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004cb9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004cba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff800037e8000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004d0930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004d0960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004d09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d09d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004d0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff800037d75a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004d5930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004d5960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004d59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d59d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004d5a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff800037d7000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004da930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004da960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004da9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004da9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004daa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff800037f55a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004df930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004df960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004df9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004df9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004dfa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff800037f5000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004e4930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004e4960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004e49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e49d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004e4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff800037f45a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004e9930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004e9960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004e99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e99d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004e9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff8000381a5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005a3900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005a3930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005a3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a39a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005a3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff8000394c5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005c5900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c5930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005c5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c59a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005c5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff8000394c000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005ca900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ca930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ca970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ca9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005caa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005caa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005caab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005caab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff8000394b5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005cf900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005cf930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005cf970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005cf9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005cfa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005cfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005cfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005cfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff8000394b000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005d4900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005d4930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005d4970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d49a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff8000394a5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005d9900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005d9930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005d9970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d99a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff8000394a000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005de900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005de930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005de970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005de9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005dea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005dea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005deab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005deab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff800039495a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005e3900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e3930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005e3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e39a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005e3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005e3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80003949000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005e8900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e8930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005e8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e89a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005e8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005e8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff800039605a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005ed900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ed930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ed970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ed9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005eda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005eda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005edab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005edab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80003960000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005f2900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f2930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005f2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f29a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005f2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005f2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff8000395f5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005f7900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f7930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005f7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f79a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005f7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005f7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff8000395f000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005fc900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005fc930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005fc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005fc9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005fca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005fca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005fcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005fcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff800060ec5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ec4930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ec4960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ec49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ec49d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006ec4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ec4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffff8000738e000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006efa930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006efa960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006efa9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006efa9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006efaa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006efaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006efaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006efaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff8000738d5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006eff930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eff960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006eff9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eff9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006effa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006effa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006effab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006effab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff8000738d000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f04930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f04960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f049a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f049d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006f04a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006f04a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f04ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff8000738c000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f0e900 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f0e930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f0e970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f0e9a0 _sleep() at _sleep+0x2da/frame 0xfffffe0006f0ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0006f0ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f0eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 2866 out of 32621 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db> (kgdb) proc 6200 [Switching to thread 176 (Thread 100430)]#0 sched_switch (td=0xfffff80007d55000, newtd=0xfffff800036cc5a0, flags=) at ../../../kern/sched_ule.c:2112 2112 cpuid = PCPU_GET(cpuid); Current language: auto; currently minimal (kgdb) bt #0 sched_switch (td=0xfffff80007d55000, newtd=0xfffff800036cc5a0, flags=) at ../../../kern/sched_ule.c:2112 #1 0xffffffff80beec14 in mi_switch (flags=0x103, newtd=0x0) at ../../../kern/kern_synch.c:439 #2 0xffffffff80c4332c in turnstile_wait (ts=0xfffff80007d51240, owner=0x0, queue=) at ../../../kern/subr_turnstile.c:792 #3 0xffffffff80bde584 in __rw_wlock_hard (c=0xffffffff8203f758, v=, file=, line=) at ../../../kern/kern_rwlock.c:1145 #4 0xffffffff80bde420 in _rw_wlock_cookie (c=0xffffffff8203f758, file=0xffffffff812fd2c3 "../../../kern/uipc_usrreq.c", line=0x97d) at ../../../kern/kern_rwlock.c:285 #5 0xffffffff80c8764d in unp_externalize (control=0xfffff80239aa7000, controlp=0xfffffe00b9cd18d0, flags=) at ../../../kern/uipc_usrreq.c:2429 #6 0xffffffff80c7f3e5 in soreceive_generic (so=, psa=0xfffffe00b9cd18e8, uio=0xfffffe00b9cd1890, mp0=0x0, controlp=0xfffffe00b9cd18d0, flagsp=0xfffffe00b9cd1964) at ../../../kern/uipc_socket.c:1894 #7 0xffffffff80c80d79 in soreceive (so=, psa=, uio=, mp0=, controlp=, flagsp=) at ../../../kern/uipc_socket.c:2563 #8 0xffffffff80c8611c in kern_recvit (td=0xfffff80007d55000, s=0x56a66, mp=0xfffffe00b9cd1938, fromseg=UIO_USERSPACE, controlp=0x0) at ../../../kern/uipc_syscalls.c:955 #9 0xffffffff80c8667f in sys_recvmsg (td=0xfffff80007d55000, uap=0xfffff80007d553c8) at ../../../kern/uipc_syscalls.c:1058 #10 0xffffffff810bbe31 in amd64_syscall (td=0xfffff80007d55000, traced=0x0) at subr_syscall.c:135 #11 0xffffffff810941dd in fast_syscall_common () at ../../../amd64/amd64/exception.S:504 #12 0x00000008003abaca in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) (kgdb) f 5 #5 0xffffffff80c8764d in unp_externalize (control=0xfffff80239aa7000, controlp=0xfffffe00b9cd18d0, flags=) at ../../../kern/uipc_usrreq.c:2429 2429 UNP_LINK_WLOCK(); (kgdb) l 2424 unp_externalize_fp(struct file *fp) 2425 { 2426 struct unpcb *unp; 2427 int ret; 2428 2429 UNP_LINK_WLOCK(); 2430 if ((unp = fptounp(fp)) != NULL) { 2431 unp->unp_msgcount--; 2432 ret = 1; 2433 } else (kgdb) info loc td = (struct thread *) 0xfffff80007d55000 cm = fdesc = (struct filedesc *) 0xfffff8001d5a68a0 clen = error = 0x0 data = (void *) 0xfffff80239aa7030 fdep = (struct filedescent **) 0xfffff80239aa7030 datalen = 0x50 newfds = newlen = fdp = i = 0x0 (kgdb) p *control $1 = {{m_next = 0x0, m_slist = {sle_next = 0x0}, m_stailq = {stqe_next = 0x0}}, {m_nextpkt = 0x0, m_slistpkt = {sle_next = 0x0}, m_stailqpkt = {stqe_next = 0x0}}, m_data = 0xfffff80239aa7020 "`", m_len = 0x60, m_type = 0xe, m_flags = 0x0, {{m_pkthdr = {{snd_tag = 0xffff00000060, rcvif = 0xffff00000060}, tags = {slh_first = 0x1}, len = 0x7c64400, flowid = 0xfffff800, csum_flags = 0x7c64430, fibnum = 0xf800, numa_domain = 0xff, rsstype = 0xff, {rcv_tstmp = 0xfffff80007c64460, {l2hlen = 0x60, l3hlen = 0x44, l4hlen = 0xc6, l5hlen = 0x7, spare = 0xfffff800}}, PH_per = {eight = 0xfffff80239aa7048 "\220D\a", sixteen = 0xfffff80239aa7048, thirtytwo = 0xfffff80239aa7048, sixtyfour = 0xfffff80239aa7048, unintptr = 0xfffff80239aa7048, ptr = 0xfffff80007c64490}, PH_loc = { eight = 0xfffff80239aa7050 "D\a", sixteen = 0xfffff80239aa7050, thirtytwo = 0xfffff80239aa7050, sixtyfour = 0xfffff80239aa7050, unintptr = 0xfffff80239aa7050, ptr = 0xfffff80007c644c0}}, {m_ext = {{ext_count = 0x7c644f0, ext_cnt = 0xfffff80007c644f0}, ext_buf = 0xfffff80007c64520 "\020p", ext_size = 0x7c64550, ext_type = 0x0, ext_flags = 0xfffff8, ext_free = 0xfffff80007c64580, ext_arg1 = 0xfffff80007c645b0, ext_arg2 = 0xdeadc0dedeadc0de}, m_pktdat = 0xfffff80239aa7058 "D\a"}}, m_dat = 0xfffff80239aa7020 "`"}} (kgdb) p *controlp $2 = (struct mbuf *) 0xfffff8001d40dd00 (kgdb) p **controlp $3 = {{m_next = 0x0, m_slist = {sle_next = 0x0}, m_stailq = {stqe_next = 0x0}}, {m_nextpkt = 0x0, m_slistpkt = {sle_next = 0x0}, m_stailqpkt = {stqe_next = 0x0}}, m_data = 0xfffff8001d40dd20 "8", m_len = 0x38, m_type = 0xe, m_flags = 0x0, {{m_pkthdr = {{snd_tag = 0xffff00000038, rcvif = 0xffff00000038}, tags = {slh_first = 0x1}, len = 0x56a67, flowid = 0x56a68, csum_flags = 0x56a69, fibnum = 0x6a6a, numa_domain = 0x5, rsstype = 0x0, {rcv_tstmp = 0x56a6c00056a6b, {l2hlen = 0x6b, l3hlen = 0x6a, l4hlen = 0x5, l5hlen = 0x0, spare = 0x56a6c}}, PH_per = {eight = 0xfffff8001d40dd48 "mj\005", sixteen = 0xfffff8001d40dd48, thirtytwo = 0xfffff8001d40dd48, sixtyfour = 0xfffff8001d40dd48, unintptr = 0xfffff8001d40dd48, ptr = 0x56a6e00056a6d}, PH_loc = {eight = 0xfffff8001d40dd50 "oj\005", sixteen = 0xfffff8001d40dd50, thirtytwo = 0xfffff8001d40dd50, sixtyfour = 0xfffff8001d40dd50, unintptr = 0xfffff8001d40dd50, ptr = 0x56a7000056a6f}}, {m_ext = {{ext_count = 0xdeadc0de, ext_cnt = 0xdeadc0dedeadc0de}, ext_buf = 0xdeadc0dedeadc0de
, ext_size = 0xdeadc0de, ext_type = 0xde, ext_flags = 0xdeadc0, ext_free = 0xdeadc0dedeadc0de, ext_arg1 = 0xdeadc0dedeadc0de, ext_arg2 = 0xdeadc0dedeadc0de}, m_pktdat = 0xfffff8001d40dd58 ""...}}, m_dat = 0xfffff8001d40dd20 "8"}} (kgdb) -- Test scenario: misc/sendmsg2.sh