panic: lock (sleep mutex) vm page not locked @ vm/vm_object.c:1216, vmcore.71 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #0 r351219M: Mon Aug 19 19:32:45 CEST 2019 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 8.0.1 (tags/RELEASE_801/final 366581) (based on LLVM 8.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33159548928 (31623 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 4 9 2 7 6 3 11 10 8 5 Timecounter "TSC-low" frequency 1750033586 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 000.000054 [4254] netmap_init netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff811c9820, 0) error 19 [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0: Ethernet addresugen0.3: at usbus0 ukbd0 on uhub4 ukbd0: on usbus0 kbd2 at ukbd0 . lo0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub4 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff80006088000 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 19 Aug 19:53:34 ntpdate[2055]: step time server 192.168.5.1 offset -0.286175 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. fscklock order reversal: 1st 0xfffff8000455a068 ufs (ufs) @ kern/vfs_mount.c:1354 2nd 0xfffff8000604b7d0 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1926 stack backtrace: #0 0xffffffff80c415b3 at witness_debugger+0x73 #1 0xffffffff80c412fe at witness_checkorder+0xa9e #2 0xffffffff80ba751b at lockmgr_lock_fast_path+0x16b #3 0xffffffff8123f7b0 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cbed65 at _vn_lock+0x65 #5 0xffffffff80ed21cd at softdep_flushworklist+0x5d #6 0xffffffff80ef3296 at ffs_sync+0x406 #7 0xffffffff80ca4d0f at dounmount+0x4bf #8 0xffffffff80ca47b0 at sys_unmount+0x300 #9 0xffffffff811a1fc6 at amd64_syscall+0x2d6 #10 0xffffffff811796e0 at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 294 files, 18245 used, 1247162 free (122 frags, 155880 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Mon Aug 19 19:53 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Aug 19 19:55:34 mercat1 login[2337]: ROOT LOGIN (root) ON ttyu1 Last login: Mon Aug 19 11:08:53 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #0 r351219M: Mon Aug 19 19:32:45 CEST 2019 root@mercat1:~ # Aug 19 19:55:42 mercat1 su[2363]: pho to root on /dev/pts/0 20190819 19:56:00 all (1/660): 1st.sh 20190819 19:56:01 all (2/660): 256m.sh 20190819 19:56:03 all (3/660): audit.sh 20190819 19:56:04 all (4/660): beneath3.sh 20190819 19:56:08 all (5/660): buildworld.sh 20190819 19:56:09 all (6/660): buildworld2.sh 20190819 19:56:11 all (7/660): cluster.sh 20190819 19:56:12 all (8/660): cpuset.sh 20190819 19:56:13 all (9/660): crossmp2.sh 20190819 19:56:15 all (10/660): crossmp6.sh 20190819 19:56:16 all (11/660): datagram2.sh 20190819 19:56:18 all (12/660): datagram3.sh 20190819 19:56:20 all (13/660): datamove.sh freework leak: 32/43. newblk leak: 6/16. 20190819 19:56:21 all (14/660): datamove3.sh newblk leak: 1/17. 20190819 19:56:23 all (15/660): devfs2.sh 20190819 19:56:24 all (16/660): devfs5.sh 20190819 19:56:25 all (17/660): dtrace_fault.sh 20190819 19:56:27 all (18/660): dumpfs.sh newblk leak: 295/312. 20190819 19:56:29 all (19/660): dup2.sh 20190819 19:56:30 all (20/660): execi386.sh 20190819 19:56:32 all (21/660): extattr_set_fd.sh 20190819 19:56:33 all (22/660): extattrctl.sh lock order reversal: 1st 0xfffff8000467f238 ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:119 2nd 0xfffff8021ffd82e0 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1709 stack backtrace: #0 0xffffffff80c415b3 at witness_debugger+0x73 #1 0xffffffff80c412fe at witness_checkorder+0xa9e #2 0xffffffff80ba7a1b at lockmgr_xlock_hard+0x6b #3 0xffffffff80ba848e at __lockmgr_args+0x5fe #4 0xffffffff80ef03f3 at ffs_vgetf+0x133 #5 0xffffffff80f0315b at ufs_root+0x1b #6 0xffffffff80efb55f at ufs_extattr_autostart+0x5f #7 0xffffffff80ef2786 at ffs_mount+0x1c76 #8 0xffffffff80ca39c8 at vfs_domount+0x748 #9 0xffffffff80ca2cae at vfs_donmount+0x7be #10 0xffffffff80ca24b9 at sys_nmount+0x69 #11 0xffffffff811a1fc6 at amd64_syscall+0x2d6 #12 0xffffffff811796e0 at fast_syscall_common+0x101 20190819 19:56:35 all (23/660): fifo.sh 20190819 19:56:36 all (24/660): forkbomb.sh 20190819 19:56:38 all (25/660): fsck2.sh 20190819 19:56:39 all (26/660): fsck3.sh 20190819 19:56:41 all (27/660): fsck4.sh 20190819 19:56:42 all (28/660): geomleak.sh 20190819 19:56:44 all (29/660): getrandom.sh 20190819 19:56:45 all (30/660): gnop3.sh GEOM_NOP: Device md10.nop created. Aug 19 20:02:06 mercat1 kernel: pid 28046 (swap), jid 0, uid 2007, was killed: out of swap space Aug 19 20:06:11 mercat1 kernel: pid 35373 (swap), jid 0, uid 2007, was killed: out of swap space Aug 19 20:08:17 mercat1 kernel: pid 39477 (swap), jid 0, uid 2007, was killed: out of swap space Aug 19 20:12:28 mercat1 kernel: pid 45546 (swap), jid 0, uid 2007, was killed: out of swap space Aug 19 20:13:16 mercat1 kernel: pid 45635 (swap), jid 0, uid 2007, was killed: out of swap space Aug 19 20:16:49 mercat1 kernel: pid 51413 (swap), jid 0, uid 2007, was killed: out of swap space Aug 19 20:17:07 mercat1 kernel: pid 51429 (swap), jid 0, uid 2007, was killed: out of swap space Aug 19 20:17:34 mercat1 kernel: pid 51426 (swap), jid 0, uid 2007, was killed: out of swap space GEOM_NOP: Device md10.nop removed. 20190819 20:19:01 all (31/660): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20190819 20:19:03 all (32/660): holdcnt0.sh 20190819 20:19:04 all (33/660): holdcnt02.sh 20190819 20:19:05 all (34/660): holdcnt03.sh 20190819 20:19:07 all (35/660): holdcnt04.sh 20190819 20:19:08 all (36/660): isofs2.sh 20190819 20:19:10 all (37/660): jail.sh 20190819 20:19:13 all (38/660): jail2.sh 20190819 20:19:15 all (39/660): jail3.sh 20190819 20:19:16 all (40/660): jail4.sh 20190819 20:19:18 all (41/660): kern_umtx_inf_loop.sh 20190819 20:19:20 all (42/660): kevent10.sh 20190819 20:19:21 all (43/660): kevent3.sh 20190819 20:19:23 all (44/660): ldt.sh 20190819 20:19:25 all (45/660): ldt2.sh 20190819 20:19:26 all (46/660): libMicro.sh 20190819 20:19:27 all (47/660): linux.sh 20190819 20:19:29 all (48/660): lockd.sh 20190819 20:19:30 all (49/660): lockf.sh 20190819 20:19:32 all (50/660): lookup_shared.sh 20190819 20:19:33 all (51/660): mac.sh 20190819 20:19:34 all (52/660): mac_chkexec.sh 20190819 20:19:36 all (53/660): machipc.sh 20190819 20:19:37 all (54/660): machipc2.sh 20190819 20:19:39 all (55/660): maxmemdom.sh 20190819 20:19:40 all (56/660): maxproc.sh 20190819 20:19:42 all (57/660): md4.sh 20190819 20:19:43 all (58/660): md5.sh 20190819 20:19:45 all (59/660): md6.sh 20190819 20:19:46 all (60/660): mdconfig.sh 20190819 20:19:48 all (61/660): mdconfig3.sh 20190819 20:19:49 all (62/660): memguard4.sh 20190819 20:19:51 all (63/660): mkfifo5.sh 20190819 20:19:52 all (64/660): mkfifo7.sh mount leak: 16/47 20190819 20:19:54 all (65/660): mlockall5.sh 20190819 20:19:55 all (66/660): mmap.sh 20190819 20:19:57 all (67/660): mmap12.sh 20190819 20:19:58 all (68/660): mmap16.sh 20190819 20:20:00 all (69/660): mmap17.sh 20190819 20:20:01 all (70/660): mmap20.sh panic: lock (sleep mutex) vm page not locked @ vm/vm_object.c:1216 cpuid = 9 time = 1566238802 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aac9e770 vpanic() at vpanic+0x19d/frame 0xfffffe00aac9e7c0 panic() at panic+0x43/frame 0xfffffe00aac9e820 witness_unlock() at witness_unlock+0xea/frame 0xfffffe00aac9e860 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe00aac9e890 vm_object_madvise() at vm_object_madvise+0x1d4/frame 0xfffffe00aac9e8f0 vm_map_madvise() at vm_map_madvise+0x2db/frame 0xfffffe00aac9e960 sys_madvise() at sys_madvise+0x79/frame 0xfffffe00aac9e980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aac9eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aac9eab0 --- syscall (75, FreeBSD ELF64, sys_madvise), rip = 0x80033c94a, rsp = 0x7fffffffe6f8, rbp = 0x7fffffffe710 --- KDB: enter: panic [ thread pid 65308 tid 100265 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 65308 tid 100265 td 0xfffff8028634f000 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aac9e770 vpanic() at vpanic+0x1ba/frame 0xfffffe00aac9e7c0 panic() at panic+0x43/frame 0xfffffe00aac9e820 witness_unlock() at witness_unlock+0xea/frame 0xfffffe00aac9e860 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe00aac9e890 vm_object_madvise() at vm_object_madvise+0x1d4/frame 0xfffffe00aac9e8f0 vm_map_madvise() at vm_map_madvise+0x2db/frame 0xfffffe00aac9e960 sys_madvise() at sys_madvise+0x79/frame 0xfffffe00aac9e980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aac9eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aac9eab0 --- syscall (75, FreeBSD ELF64, sys_madvise), rip = 0x80033c94a, rsp = 0x7fffffffe6f8, rbp = 0x7fffffffe710 --- db:1:pho1> show allpcpu Current CPU: 9 cpuid = 0 dynamic pcpu = 0xc96600 curthread = 0xfffff800037a1000: pid 11 tid 100003 "idle: cpu0" curpcb = 0xfffffe0076766b80 fpcurthread = none idlethread = 0xfffff800037a1000: tid 100003 "idle: cpu0" curpmap = 0xffffffff81fb8c30 tssp = 0xffffffff821060a0 commontssp = 0xffffffff821060a0 rsp0 = 0xfffffe0076766b80 gs32p = 0xffffffff8210c8e8 ldt = 0xffffffff8210c928 tss = 0xffffffff8210c918 tlb gen = 36617115 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe0084fe9600 curthread = 0xfffff800037a25a0: pid 11 tid 100004 "idle: cpu1" curpcb = 0xfffffe007676bb80 fpcurthread = none idlethread = 0xfffff800037a25a0: tid 100004 "idle: cpu1" curpmap = 0xffffffff81fb8c30 tssp = 0xffffffff82106108 commontssp = 0xffffffff82106108 rsp0 = 0xfffffe007676bb80 gs32p = 0xffffffff8210c950 ldt = 0xffffffff8210c990 tss = 0xffffffff8210c980 tlb gen = 36617115 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe0084ff5600 curthread = 0xfffff800037a2000: pid 11 tid 100005 "idle: cpu2" curpcb = 0xfffffe0076770b80 fpcurthread = none idlethread = 0xfffff800037a2000: tid 100005 "idle: cpu2" curpmap = 0xffffffff81fb8c30 tssp = 0xffffffff82106170 commontssp = 0xffffffff82106170 rsp0 = 0xfffffe0076770b80 gs32p = 0xffffffff8210c9b8 ldt = 0xffffffff8210c9f8 tss = 0xffffffff8210c9e8 tlb gen = 36617115 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe0085001600 curthread = 0xfffff800037a35a0: pid 11 tid 100006 "idle: cpu3" curpcb = 0xfffffe0076775b80 fpcurthread = none idlethread = 0xfffff800037a35a0: tid 100006 "idle: cpu3" curpmap = 0xffffffff81fb8c30 tssp = 0xffffffff821061d8 commontssp = 0xffffffff821061d8 rsp0 = 0xfffffe0076775b80 gs32p = 0xffffffff8210ca20 ldt = 0xffffffff8210ca60 tss = 0xffffffff8210ca50 tlb gen = 36617115 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe008500d600 curthread = 0xfffff800037a3000: pid 11 tid 100007 "idle: cpu4" curpcb = 0xfffffe007677ab80 fpcurthread = none idlethread = 0xfffff800037a3000: tid 100007 "idle: cpu4" curpmap = 0xffffffff81fb8c30 tssp = 0xffffffff82106240 commontssp = 0xffffffff82106240 rsp0 = 0xfffffe007677ab80 gs32p = 0xffffffff8210ca88 ldt = 0xffffffff8210cac8 tss = 0xffffffff8210cab8 tlb gen = 36617115 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe0085019600 curthread = 0xfffff800037a45a0: pid 11 tid 100008 "idle: cpu5" curpcb = 0xfffffe007677fb80 fpcurthread = none idlethread = 0xfffff800037a45a0: tid 100008 "idle: cpu5" curpmap = 0xffffffff81fb8c30 tssp = 0xffffffff821062a8 commontssp = 0xffffffff821062a8 rsp0 = 0xfffffe007677fb80 gs32p = 0xffffffff8210caf0 ldt = 0xffffffff8210cb30 tss = 0xffffffff8210cb20 tlb gen = 36617115 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe0085025600 curthread = 0xfffff800037a4000: pid 11 tid 100009 "idle: cpu6" curpcb = 0xfffffe0076784b80 fpcurthread = none idlethread = 0xfffff800037a4000: tid 100009 "idle: cpu6" curpmap = 0xffffffff81fb8c30 tssp = 0xffffffff82106310 commontssp = 0xffffffff82106310 rsp0 = 0xfffffe0076784b80 gs32p = 0xffffffff8210cb58 ldt = 0xffffffff8210cb98 tss = 0xffffffff8210cb88 tlb gen = 36617115 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe0085031600 curthread = 0xfffff800037905a0: pid 11 tid 100010 "idle: cpu7" curpcb = 0xfffffe0076789b80 fpcurthread = none idlethread = 0xfffff800037905a0: tid 100010 "idle: cpu7" curpmap = 0xffffffff81fb8c30 tssp = 0xffffffff82106378 commontssp = 0xffffffff82106378 rsp0 = 0xfffffe0076789b80 gs32p = 0xffffffff8210cbc0 ldt = 0xffffffff8210cc00 tss = 0xffffffff8210cbf0 tlb gen = 36617115 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe008503d600 curthread = 0xfffff80003790000: pid 11 tid 100011 "idle: cpu8" curpcb = 0xfffffe007678eb80 fpcurthread = none idlethread = 0xfffff80003790000: tid 100011 "idle: cpu8" curpmap = 0xffffffff81fb8c30 tssp = 0xffffffff821063e0 commontssp = 0xffffffff821063e0 rsp0 = 0xfffffe007678eb80 gs32p = 0xffffffff8210cc28 ldt = 0xffffffff8210cc68 tss = 0xffffffff8210cc58 tlb gen = 36617115 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe0085049600 curthread = 0xfffff8028634f000: pid 65308 tid 100265 "mmap20" curpcb = 0xfffffe00aac9eb80 fpcurthread = 0xfffff8028634f000: pid 65308 "mmap20" idlethread = 0xfffff800037915a0: tid 100012 "idle: cpu9" curpmap = 0xfffff8021f9e0130 tssp = 0xffffffff82106448 commontssp = 0xffffffff82106448 rsp0 = 0xfffffe00aac9eb80 gs32p = 0xffffffff8210cc90 ldt = 0xffffffff8210ccd0 tss = 0xffffffff8210ccc0 tlb gen = 36617115 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe0085055600 curthread = 0xfffff80003791000: pid 11 tid 100013 "idle: cpu10" curpcb = 0xfffffe0076798b80 fpcurthread = none idlethread = 0xfffff80003791000: tid 100013 "idle: cpu10" curpmap = 0xffffffff81fb8c30 tssp = 0xffffffff821064b0 commontssp = 0xffffffff821064b0 rsp0 = 0xfffffe0076798b80 gs32p = 0xffffffff8210ccf8 ldt = 0xffffffff8210cd38 tss = 0xffffffff8210cd28 tlb gen = 36617114 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe0085061600 curthread = 0xfffff800037925a0: pid 11 tid 100014 "idle: cpu11" curpcb = 0xfffffe007679db80 fpcurthread = none idlethread = 0xfffff800037925a0: tid 100014 "idle: cpu11" curpmap = 0xffffffff81fb8c30 tssp = 0xffffffff82106518 commontssp = 0xffffffff82106518 rsp0 = 0xfffffe007679db80 gs32p = 0xffffffff8210cd60 ldt = 0xffffffff8210cda0 tss = 0xffffffff8210cd90 tlb gen = 36617115 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 65308 (mmap20) thread 0xfffff8028634f000 (100265) exclusive rw vm object (vm object) r = 0 (0xfffff80224d6f900) locked @ vm/vm_object.c:1153 shared sx vm map (user) (vm map (user)) r = 0 (0xfffff8021f9e0070) locked @ vm/vm_map.c:2668 db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show allchains chain 1: thread 100570 (pid 65297, sh) blocked on lockmgr `zVEXCL thread 0 (pid -512, ) is inactive chain 2: thread 100629 (pid 65296, tee) sleeping on 0xfffff80003d7dbe0 "piperd" chain 3: thread 100315 (pid 65295, sh) sleeping on 0xfffff80286567a60 "wait" chain 4: thread 100223 (pid 65182, sleep) sleeping on 0xffffffff81e8cfc2 "nanslp" chain 5: thread 100230 (pid 9916, sh) sleeping on 0xfffff80003d7d5f0 "piperd" chain 6: thread 100251 (pid 9914, awk) sleeping on 0xfffff8000a80f000 "piperd" chain 7: thread 100269 (pid 9913, sh) blocked on lockmgr 0EXCL thread 0 (pid -512, ) is inactive chain 8: thread 100247 (pid 9855, sh) sleeping on 0xfffff8021f9fea60 "wait" chain 9: thread 100222 (pid 7561, sh) sleeping on 0xfffff80003d3d530 "wait" chain 10: thread 100189 (pid 2365, bash) sleeping on 0xfffff8000404f530 "wait" chain 11: thread 100166 (pid 2363, csh) sleeping on 0xfffff800061935d8 "pause" chain 12: thread 100151 (pid 2362, su) blocked on lockmgr EXCL thread 0 (pid -512, ) can run chain 13: thread 100149 (pid 2358, bash) sleeping on 0xfffff80003d3ba60 "wait" chain 14: thread 100220 (pid 2357, sshd) sleeping on 0xfffff80003afbbc0 "select" chain 15: thread 100156 (pid 2354, sshd) sleeping on 0xfffff8001acfae40 "select" chain 16: thread 100205 (pid 2348, csh) sleeping on 0xfffff8000647b8b0 "ttyin" chain 17: thread 100142 (pid 2337, login) sleeping on 0xfffff8000a987a60 "wait" chain 18: thread 100218 (pid 2336, getty) sleeping on 0xfffff8000647bcb0 "ttyin" chain 19: thread 100217 (pid 2335, getty) sleeping on 0xfffff800039664b0 "ttyin" chain 20: thread 100216 (pid 2334, getty) sleeping on 0xfffff800039668b0 "ttyin" chain 21: thread 100215 (pid 2333, getty) sleeping on 0xfffff80003966cb0 "ttyin" chain 22: thread 100214 (pid 2332, getty) sleeping on 0xfffff800039650b0 "ttyin" chain 23: thread 100213 (pid 2331, getty) sleeping on 0xfffff800039654b0 "ttyin" chain 24: thread 100212 (pid 2330, getty) sleeping on 0xfffff800039658b0 "ttyin" chain 25: thread 100211 (pid 2329, getty) sleeping on 0xfffff80003965cb0 "ttyin" chain 26: thread 100209 (pid 2328, getty) sleeping on 0xfffff800039640b0 "ttyin" chain 27: thread 100198 (pid 2282, cron) sleeping on 0xffffffff81e8cfc9 "nanslp" chain 28: thread 100179 (pid 2278, sshd) sleeping on 0xfffff80003c95f40 "select" chain 29: thread 100144 (pid 2249, ntpd) sleeping on 0xfffff80003d678c0 "select" chain 30: thread 100823 (pid 2249, ntpd) sleeping on 0xfffff80664b8e680 "usem" chain 31: thread 100199 (pid 2186, NLM: master) sleeping on 0xfffff800045b1b60 "rpcsvc" chain 32: thread 100163 (pid 2183, rpc.statd) sleeping on 0xfffff800040edf40 "select" chain 33: thread 100172 (pid 2137, watchdogd) sleeping on 0xffffffff81e8cfc8 "nanslp" chain 34: thread 100171 (pid 2058, rpcbind) sleeping on 0xfffff80006090140 "select" chain 35: thread 100180 (pid 2048, syslogd) sleeping on 0xfffff80003d679c0 "select" chain 36: thread 100175 (pid 1977, devd) sleeping on 0xfffff800046f7140 "select" chain 37: thread 100154 (pid 1972, dhclient) sleeping on 0xfffff800046f72c0 "select" chain 38: thread 100191 (pid 1928, dhclient) sleeping on 0xfffff80003d67a40 "select" chain 39: thread 100164 (pid 1925, dhclient) sleeping on 0xfffff8000392f840 "select" chain 40: thread 100141 (pid 34, vnlru) sleeping on 0xfffff80003be6a60 "vlruwt" chain 41: thread 100140 (pid 33, syncer) sleeping on 0xffffffff81f63480 "syncer" chain 42: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff81f62918 "qsleep" chain 43: thread 100131 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff81a0a8c0 "-" chain 44: thread 100132 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81a12b80 "-" chain 45: thread 100134 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff81a1ae40 "-" chain 46: thread 100135 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81a23100 "-" chain 47: thread 100136 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff81a2b3c0 "-" chain 48: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81a33680 "-" chain 49: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff81a3b940 "-" chain 50: thread 100152 (pid 32, / worker) sleeping on 0xfffff800046c3ce8 "sdflush" chain 51: thread 100202 (pid 32, /tmp worker) sleeping on 0xfffff80003bdfce8 "sdflush" chain 52: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff81f7f688 "psleep" chain 53: thread 100128 (pid 30, dom0) sleeping on 0xffffffff81fe9418 "psleep" chain 54: thread 100133 (pid 30, laundry: dom0) sleeping on 0xffffffff81fe9424 "launds" chain 55: thread 100137 (pid 30, uma) sleeping on 0xffffffff80f12f80 "umarcl" chain 56: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff80003a75000 "idle" chain 57: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff80003a75530 "idle" chain 58: thread 100120 (pid 27, rand_harvestq) sleeping on 0xffffffff81cec6a0 "-" chain 59: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81fe7b30 "waiting_for_work" chain 60: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81f6231c "-" chain 61: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81f6231c "-" chain 62: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81f6231c "-" chain 63: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81f6231c "-" chain 64: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe009a1aa460 "-" chain 65: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe009a1aa4b8 "-" chain 66: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe009a1aa510 "-" chain 67: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe009a1aa568 "-" chain 68: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe009a1aa5c0 "-" chain 69: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe0006dd6d10 "-" chain 70: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe0006dd6d68 "-" chain 71: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe0006dd6dc0 "-" chain 72: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe0006dd6e18 "-" chain 73: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe0006dd6e70 "-" chain 74: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe009a63bd10 "-" chain 75: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe009a63bd68 "-" chain 76: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe009a63bdc0 "-" chain 77: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe009a63be18 "-" chain 78: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe009a63be70 "-" chain 79: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff81bc7a40 "-" chain 80: thread 100092 (pid 20, doneq1) sleeping on 0xffffffff81bc7ac0 "-" chain 81: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff81bc7b40 "-" chain 82: thread 100125 (pid 20, scanner) sleeping on 0xffffffff81bc7908 "-" chain 83: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff800041d0c50 "crypto_ret_wait" chain 84: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff800041d0bf0 "crypto_ret_wait" chain 85: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff800041d0b90 "crypto_ret_wait" chain 86: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff800041d0b30 "crypto_ret_wait" chain 87: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff800041d0ad0 "crypto_ret_wait" chain 88: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff800041d0a70 "crypto_ret_wait" chain 89: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff800041d0a10 "crypto_ret_wait" chain 90: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff800041d09b0 "crypto_ret_wait" chain 91: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff800041d0950 "crypto_ret_wait" chain 92: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff800041d08f0 "crypto_ret_wait" chain 93: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff800041d0890 "crypto_ret_wait" chain 94: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff800041d0830 "crypto_ret_wait" chain 95: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81f79cb8 "crypto_wait" chain 96: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff80003e90888 "seqstate" chain 97: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81fb7fc0 "-" chain 98: thread 100063 (pid 13, g_up) sleeping on 0xffffffff81fb7fd0 "-" chain 99: thread 100064 (pid 13, g_down) sleeping on 0xffffffff81fb7fb8 "-" chain 100: thread 100002 (pid 1, init) sleeping on 0xfffff800037a5530 "wait" chain 101: thread 100001 (pid 10, audit) sleeping on 0xffffffff81fe8840 "audit_worker_cv" chain 102: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81fb8000 "swapin" chain 103: thread 100017 (pid 0, thread taskq) sleeping on 0xfffff80003759d00 "-" chain 104: thread 100019 (pid 0, config_0) sleeping on 0xfffff80003748000 "-" chain 105: thread 100020 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff80003759b00 "-" chain 106: thread 100021 (pid 0, aiod_kick taskq) sleeping on 0xfffff80003759a00 "-" chain 107: thread 100022 (pid 0, softirq_0) sleeping on 0xfffff80003749e00 "-" chain 108: thread 100023 (pid 0, softirq_1) sleeping on 0xfffff80003749d00 "-" chain 109: thread 100024 (pid 0, softirq_2) sleeping on 0xfffff80003749c00 "-" chain 110: thread 100025 (pid 0, softirq_3) sleeping on 0xfffff80003749b00 "-" chain 111: thread 100026 (pid 0, softirq_4) sleeping on 0xfffff80003749a00 "-" chain 112: thread 100027 (pid 0, softirq_5) sleeping on 0xfffff80003749900 "-" chain 113: thread 100028 (pid 0, softirq_6) sleeping on 0xfffff80003749800 "-" chain 114: thread 100029 (pid 0, softirq_7) sleeping on 0xfffff80003749700 "-" chain 115: thread 100030 (pid 0, softirq_8) sleeping on 0xfffff80003749600 "-" chain 116: thread 100031 (pid 0, softirq_9) sleeping on 0xfffff80003749500 "-" chain 117: thread 100032 (pid 0, softirq_10) sleeping on 0xfffff80003749400 "-" chain 118: thread 100033 (pid 0, softirq_11) sleeping on 0xfffff80003749300 "-" chain 119: thread 100034 (pid 0, if_io_tqg_0) sleeping on 0xfffff80003749200 "-" chain 120: thread 100035 (pid 0, if_io_tqg_1) sleeping on 0xfffff80003749100 "-" chain 121: thread 100036 (pid 0, if_io_tqg_2) sleeping on 0xfffff80003749000 "-" chain 122: thread 100037 (pid 0, if_io_tqg_3) sleeping on 0xfffff8000374ae00 "-" chain 123: thread 100038 (pid 0, if_io_tqg_4) sleeping on 0xfffff8000374ad00 "-" chain 124: thread 100039 (pid 0, if_io_tqg_5) sleeping on 0xfffff8000374ac00 "-" chain 125: thread 100040 (pid 0, if_io_tqg_6) sleeping on 0xfffff8000374ab00 "-" chain 126: thread 100041 (pid 0, if_io_tqg_7) sleeping on 0xfffff8000374aa00 "-" chain 127: thread 100042 (pid 0, if_io_tqg_8) sleeping on 0xfffff8000374a900 "-" chain 128: thread 100043 (pid 0, if_io_tqg_9) sleeping on 0xfffff8000374a800 "-" chain 129: thread 100044 (pid 0, if_io_tqg_10) sleeping on 0xfffff80003998100 "-" chain 130: thread 100045 (pid 0, if_io_tqg_11) sleeping on 0xfffff80003998000 "-" chain 131: thread 100046 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003ec7200 "-" chain 132: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003e34100 "-" chain 133: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003e34000 "-" chain 134: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003e34000 "-" chain 135: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003e34000 "-" chain 136: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003e34000 "-" chain 137: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003e34000 "-" chain 138: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003e34000 "-" chain 139: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003e34000 "-" chain 140: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003e34000 "-" chain 141: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003e34000 "-" chain 142: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003e34000 "-" chain 143: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003e34000 "-" chain 144: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003e34000 "-" chain 145: thread 100114 (pid 0, mca taskq) blocked on lockmgr (null)EXCL thread 0 (pid 0, ) is inactive chain 146: thread 100121 (pid 0, acpi_task_0) sleeping on 0xfffff8000a578300 "-" chain 147: thread 100122 (pid 0, acpi_task_1) sleeping on 0xfffff8000a578300 "-" chain 148: thread 100123 (pid 0, acpi_task_2) sleeping on 0xfffff8000a578300 "-" chain 149: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003e35e00 "-" db:1:pho1> show mount 0xfffff800036e3000 /dev/gpt/work on / (ufs) 0xfffff800036e2000 devfs on /dev (devfs) 0xfffff8021f1d9000 /dev/gpt/tmp on /tmp (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 51556 Buf domain 0 freebufs 15068 lofreebufs 219 hifreebufs 329 bufspace 1286144 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 0 (0) dirtyq count 1 (32768) wakeup 0 lim 25 CPU 3, 0, 13, 5, 3, 2, 8, 1, 5, 0, 15, 9, Locked buffers: 0 space 0 Total buffers: 10500 space 1286144 Buf domain 1 freebufs 14519 lofreebufs 219 hifreebufs 329 bufspace 19251200 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 27 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 549 (17362944) dirtyq count 27 (884736) wakeup 0 lim 25 CPU 0, 7, 1, 0, 1, 3, 0, 0, 1, 1, 13, 11, Locked buffers: 0 space 0 Total buffers: 7401 space 19251200 Buf domain 2 freebufs 15067 lofreebufs 219 hifreebufs 329 bufspace 1392640 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 24 (724992) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 0, 1, 9, 1, 2, 2, 9, 2, 3, 1, 4, 7, Locked buffers: 0 space 0 Total buffers: 14168 space 1392640 Buf domain 3 freebufs 15055 lofreebufs 219 hifreebufs 329 bufspace 1634304 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 7 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 31 (802816) dirtyq count 7 (229376) wakeup 0 lim 25 CPU 1, 4, 12, 2, 1, 0, 4, 1, 8, 0, 6, 1, Locked buffers: 0 space 0 Total buffers: 5996 space 1634304 Buf domain 4 freebufs 15055 lofreebufs 219 hifreebufs 329 bufspace 1605632 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 0 (0) dirtyq count 0 (0) wakeup 0 lim 25 CPU 3, 0, 16, 1, 2, 4, 2, 4, 5, 8, 23, 10, Locked buffers: 0 space 0 Total buffers: 27154 space 1605632 Buf domain 5 freebufs 15053 lofreebufs 219 hifreebufs 329 bufspace 1798144 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 0 (0) dirtyq count 2 (36864) wakeup 0 lim 25 CPU 4, 7, 11, 2, 1, 2, 5, 7, 23, 3, 2, 11, Locked buffers: 0 space 0 Total buffers: 34461 space 1798144 Buf domain 6 freebufs 13823 lofreebufs 219 hifreebufs 329 bufspace 42045440 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1200 (38993920) dirtyq count 0 (0) wakeup 0 lim 25 CPU 5, 3, 0, 8, 21, 18, 7, 6, 24, 3, 10, 5, Locked buffers: 0 space 0 Total buffers: 6251 space 42045440 db:1:pho1> show page vm_cnt.v_free_count: 7905845 vm_cnt.v_inactive_count: 441 vm_cnt.v_active_count: 939 vm_cnt.v_laundry_count: 174 vm_cnt.v_wire_count: 208356 vm_cnt.v_free_reserved: 10642 vm_cnt.v_free_min: 51254 vm_cnt.v_free_target: 173090 vm_cnt.v_inactive_target: 259635 db:1:pho1> show pageq pq_free 7905845 dom 0 page_cnt 8122778 free 7905845 pq_act 939 pq_inact 441 pq_laund 174 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000028 | 000000 11 (008192K) | 000334 | 000000 10 (004096K) | 001523 | 000001 09 (002048K) | 003460 | 000002 08 (001024K) | 005639 | 000015 07 (000512K) | 006689 | 000035 06 (000256K) | 007951 | 000062 05 (000128K) | 009671 | 000108 04 (000064K) | 012261 | 000167 03 (000032K) | 018717 | 000341 02 (000016K) | 029652 | 000687 01 (000008K) | 043392 | 000425 00 (000004K) | 048301 | 000426 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000003 | 000000 03 (000032K) | 000001 | 000000 02 (000016K) | 000002 | 000000 01 (000008K) | 000001 | 000000 00 (000004K) | 000002 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket XFree FFS2 dinode 256 5066 52804 10208055 0 61 0 FFS1 dinode 128 0 0 11 0 125 0 FFS inode 160 5066 74854 10208066 0 61 0 swblk 136 1379 181611 770968 0 61 0 swpctrie 144 183 14829 63610 0 61 0 selfd 64 82 1778 36717 0 253 0 rtentry 208 12 140 15 0 61 0 IPsec SA lft_c 16 0 0 0 0 253 0 ripcb 488 1 7 3 0 29 0 udplite_inpcb 488 0 0 0 0 29 0 sctp_asconf_ack 48 0 0 0 0 253 0 sctp_asconf 40 0 0 0 0 253 0 sctp_stream_msg_out 112 0 0 0 0 125 0 sctp_readq 152 0 0 0 0 61 0 sctp_chunk 152 0 0 0 0 61 0 sctp_raddr 736 0 0 0 0 13 0 sctp_laddr 48 0 0 4 0 253 0 sctp_asoc 2408 0 0 0 0 3 0 sctp_ep 1280 0 0 0 0 9 0 tcp_log_node 120 0 0 0 0 125 0 tcp_log_bucket 144 0 0 0 0 61 0 tcp_log 408 0 0 0 0 29 0 tcpreass 48 0 0 0 0 253 0 tfo_ccache_entries 80 0 0 0 0 125 0 tfo 4 0 0 0 0 253 0 sackhole 32 0 0 0 0 253 0 hostcache 96 0 0 0 0 125 0 syncache 168 0 0 1 0 61 0 tcptw 88 0 0 0 0 125 0 tcpcb 976 9 15 14 0 13 0 tcp_inpcb 488 9 39 14 0 29 0 udpcb 32 20 600 269 0 253 0 udp_inpcb 488 20 60 269 0 29 0 ipq 56 0 0 0 0 253 0 unpcb 256 19 731 5034 0 61 0 socket 872 51 2985 5334 0 13 0 KNOTE 160 0 744 3072 0 61 0 itimer 352 0 0 0 0 29 0 ksiginfo 112 351 1259 4316 0 125 0 AIOLIO 280 0 0 0 0 29 0 AIOCB 752 0 0 0 0 13 0 AIOP 32 0 0 0 0 253 0 AIO 208 0 0 0 0 61 0 Mountpoints 2896 3 21 26 0 3 0 procdesc 136 1 28 10 0 61 0 pipe 760 7 248 35740 0 13 0 DIRHASH 1024 77 1691 538131 0 13 0 NCLNODE 744 0 0 0 0 13 0 LTS VFS Cache 368 0 0 0 0 29 0 L VFS Cache 328 1307 13 2614 0 29 0 STS VFS Cache 148 0 0 0 0 61 0 S VFS Cache 108 3796 119544 7205380 0 125 0 rentr 24 0 1826 24 0 253 0 NAMEI 1024 0 156 95625417 0 13 0 BUF TRIE 144 304 105644 5376352 0 61 0 VNODEPOLL 120 0 0 0 0 125 0 VNODE 632 5175 25953 10208280 0 13 0 vtnet_tx_hdr 24 0 0 0 0 253 0 crypto_session 24 0 0 0 0 253 0 cryptodesc 120 0 0 0 0 125 0 cryptop 128 0 0 0 0 125 0 nvme_request 128 0 0 0 0 125 0 g_bio 408 0 585 29531541 0 29 0 FPU_save_area 832 0 0 0 0 13 0 DMAR_MAP_ENTRY 120 0 0 0 0 125 0 ttyoutq 256 173 127 282 0 61 0 ttyinq 160 330 174 540 0 61 0 epoch_record pcpu 256 4 12 4 0 61 0 mbuf_extpgs 256 0 0 0 0 61 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 mbuf_jumbo_page 4096 0 0 2 0 1 0 mbuf_cluster 2048 7987 23 19127 0 5 0 mbuf 256 5972 2238 16175 0 253 0 mbuf_packet 256 11 2024 4265 0 253 0 audit_record 1280 0 0 0 0 9 0 domainset 40 0 0 0 0 253 0 cpuset 104 27 407 27 0 125 0 THREAD 1440 494 136 859 0 9 0 PROC 1328 73 311 65308 0 9 0 MAC labels 40 0 0 0 0 253 0 pbuf 984 0 890 0 0 1 0 vnpbuf 984 0 0 0 0 13 0 clpbuf 984 0 55 879209 4911 5 0 mdpbuf 984 0 10 11822 0 1 0 nfspbuf 984 0 0 0 0 5 0 swwbuf 984 0 0 445428 0 1 0 swrbuf 984 0 56 69086 0 5 0 umtx_shm 88 0 0 0 0 125 0 umtx pi 96 0 164 1 0 125 0 TURNSTILE 136 631 329 631 0 61 0 rangeset pctrie nodes 144 0 0 0 0 61 0 rl_entry 40 345 2229 345 0 253 0 filedesc0 1104 74 178 65309 0 9 0 Files 80 119 2135 6264706 0 125 0 SLEEPQUEUE 88 631 795 631 0 125 0 65536 65536 0 2 12 0 1 0 65536 65536 2 2 6 0 1 0 65536 65536 2 0 2 0 1 0 65536 65536 0 1 66 0 1 0 65536 65536 3 11 2569 0 1 0 65536 65536 0 0 0 0 1 0 65536 65536 4 0 4 0 1 0 65536 65536 2 0 2 0 1 0 32768 32768 12 3 27 0 1 0 32768 32768 3 0 4 0 1 0 32768 32768 4 0 5 0 1 0 32768 32768 1 13 209 0 1 0 32768 32768 9 6 2659 0 1 0 32768 32768 0 0 0 0 1 0 32768 32768 12 0 5573 0 1 0 32768 32768 0 0 0 0 1 0 16384 16384 1 8 67 0 1 0 16384 16384 5 2 11 0 1 0 16384 16384 2 0 4 0 1 0 16384 16384 3 2 225 0 1 0 16384 16384 49 12 2974 0 1 0 16384 16384 0 0 0 0 1 0 16384 16384 4 0 4 0 1 0 16384 16384 0 0 0 0 1 0 8192 8192 17 17 1427 0 1 0 8192 8192 5 3 9 0 1 0 8192 8192 1 0 4 0 1 0 8192 8192 5 9 46 0 1 0 8192 8192 14 1 1822 0 1 0 8192 8192 2 0 2 0 1 0 8192 8192 86 0 86 0 1 0 8192 8192 2 5 19 0 1 0 4096 4096 1 11 277 0 1 0 4096 4096 61 4 81 0 1 0 4096 4096 3 5 90 0 1 0 4096 4096 4 12 913 0 1 0 4096 4096 427 96 160682 0 1 0 4096 4096 15 1 27 0 1 0 4096 4096 1 12 23107 0 1 0 4096 4096 1 0 13 0 1 0 2048 2048 1 51 369 0 5 0 2048 2048 96 18 106 0 5 0 2048 2048 3 3 5 0 5 0 2048 2048 2 26 346 0 5 0 2048 2048 21 95 549403 0 5 0 2048 2048 4 6 5 0 5 0 2048 2048 7 15 689 0 5 0 2048 2048 2 2 2 0 5 0 1024 1024 2 158 834 0 13 0 1024 1024 196 108 406 0 13 0 1024 1024 8 156 227452 0 13 0 1024 1024 1 159 148224 0 13 0 1024 1024 31 53 3449 0 13 0 1024 1024 7 9 7 0 13 0 1024 1024 32 40 1510 0 13 0 1024 1024 6 158 5963 0 13 0 512 512 0 294 3756 0 29 0 512 512 149 124 165 0 29 0 512 512 17 354 806 0 29 0 512 512 59 354 33830 0 29 0 512 512 427 119 6689 0 29 0 512 512 13 64 15 0 29 0 512 512 52 326 13163640 0 29 0 512 512 3 11 20 0 29 0 256 256 58 96032 5559880 0 61 0 256 256 439 611 3164044 0 61 0 256 256 13 677 808 0 61 0 256 256 26 379 856 0 61 0 256 256 657 753 52234723 0 61 0 256 256 5 490 157 0 61 0 256 256 142 623 11135 0 61 0 256 256 35 685 14781925 0 61 0 128 128 35 1391 135651 0 125 0 128 128 424 1529 10896351 0 125 0 128 128 1273 2168 3520236 0 125 0 128 128 2787 6234 233166455 0 125 0 128 128 451 1378 12127 0 125 0 128 128 410 290277 59820426 0 125 0 128 128 181 1400 11635 0 125 0 128 128 14321 342 882579 0 125 0 64 64 25 2579 348 0 253 0 64 64 8605 3051 163771187 0 253 0 64 64 84 2830 66775 0 253 0 64 64 624 2042 118876629 0 253 0 64 64 774 3069 2227717 0 253 0 64 64 35 3065 305 0 253 0 64 64 259 1043 25083 0 253 0 64 64 9292 380 17123 0 253 0 32 32 41 2563 1166 0 253 0 32 32 132 3092 13200 0 253 0 32 32 881 2219 1052 0 253 0 32 32 3221 2855 3432 0 253 0 32 32 375 2849 32542 0 253 0 32 32 50 3050 1393 0 253 0 32 32 80 3144 42955 0 253 0 32 32 562 1298 23015 0 253 0 16 16 43 2945 1394 0 253 0 16 16 185 3052 17242 0 253 0 16 16 40 1952 332 0 253 0 16 16 2895 2832 3304 0 253 0 16 16 329 3157 24863 0 253 0 16 16 27 3210 883 0 253 0 16 16 10 1235 41672 0 253 0 16 16 468 777 848656 0 253 0 mt_zone 24 429 567 433 0 253 0 mt_stats_zone 64 429 531 433 0 253 0 64 pcpu 8 3030 2346 3327 0 253 0 fakepg 104 0 1520 297 0 125 0 VMSPACE 2552 40 239 65207 0 4 0 MAP ENTRY 112 1654 5031 3241361 0 129 0 KMAP ENTRY 112 7 376 11 0 125 0 MAP 232 2 65 2 0 61 0 RADIX NODE 144 8315 546523 8245473 0 61 0 VM OBJECT 256 6034 327821 8522127 0 63 0 vmem btag 56 13978 5670 77983 0 253 0 vmem 1856 0 1 0 0 5 0 256 Bucket 2048 536 67 1369402 0 6 0 128 Bucket 1024 1372 108 497747 0 13 0 64 Bucket 512 2650 241 363110 0 29 0 32 Bucket 256 182 792 322258 0 61 0 16 Bucket 128 782 1356 55381 0 125 0 12 Bucket 96 98 1419 44950 0 125 0 8 Bucket 64 133 2346 99870 0 253 0 6 Bucket 48 10 3061 7070 0 253 0 4 Bucket 32 274 2578 78922 0 253 0 UMA Hash 256 1 10 7 0 0 0 UMA Slabs 112 7086 184 53955 0 0 0 UMA Zones 1960 83 3 87 0 0 0 UMA Kegs 216 75 4 79 0 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket kstack_cache 16384 367 25 732 1 vm pgcache 104 72003 3577 5835604 253 vm pgcache 104 9368 3588 48713814 253 buf free cache 984 7277 52084 10140968 35 buffer arena-65 65536 0 0 5072032 1 buffer arena-61 61440 0 0 5072032 1 buffer arena-57 57344 0 0 5072032 1 buffer arena-53 53248 0 0 5072032 1 buffer arena-49 49152 0 0 5072032 1 buffer arena-45 45056 0 0 5072032 1 buffer arena-40 40960 0 0 5072032 1 buffer arena-36 36864 0 0 5072032 1 buffer arena-32 32768 14016 1062 6604759 14 buffer arena-28 28672 0 0 5072032 1 buffer arena-24 24576 0 0 5072032 1 buffer arena-20 20480 0 0 5072032 1 buffer arena-16 16384 -1 22 5072209 1 buffer arena-12 12288 0 0 5072032 1 buffer arena-81 8192 0 0 5072032 1 buffer arena-40 4096 0 0 5072032 1 db:0:pho> acttrace Tracing command mmap20 pid 65308 tid 100265 td 0xfffff8028634f000 (CPU 9) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aac9e770 vpanic() at vpanic+0x1ba/frame 0xfffffe00aac9e7c0 panic() at panic+0x43/frame 0xfffffe00aac9e820 witness_unlock() at witness_unlock+0xea/frame 0xfffffe00aac9e860 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe00aac9e890 vm_object_madvise() at vm_object_madvise+0x1d4/frame 0xfffffe00aac9e8f0 vm_map_madvise() at vm_map_madvise+0x2db/frame 0xfffffe00aac9e960 sys_madvise() at sys_madvise+0x79/frame 0xfffffe00aac9e980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aac9eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aac9eab0 --- syscall (75, FreeBSD ELF64, sys_madvise), rip = 0x80033c94a, rsp = 0x7fffffffe6f8, rbp = 0x7fffffffe710 --- Tracing command idle pid 11 tid 100003 td 0xfffff800037a1000 (CPU 0) cpustop_handler() at cpustop_handler+0x2d/frame 0xffffffff81f9e610 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xffffffff81f9e630 trap() at trap+0x48/frame 0xffffffff81f9e740 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81f9e740 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe0076766910, rbp = 0xfffffe0076766910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767669a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800037a25a0 (CPU 1) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b6fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b6fe10 trap() at trap+0x48/frame 0xfffffe0006b6ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b6ff20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe007676b910, rbp = 0xfffffe007676b910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007676b910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007676b960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007676b980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007676b9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe007676ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007676bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007676bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800037a2000 (CPU 2) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b7bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b7be10 trap() at trap+0x48/frame 0xfffffe0006b7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b7bf20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe0076770910, rbp = 0xfffffe0076770910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076770910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076770960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076770980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767709a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076770a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076770ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076770ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800037a35a0 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b87df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b87e10 trap() at trap+0x48/frame 0xfffffe0006b87f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b87f20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe0076775910, rbp = 0xfffffe0076775910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076775910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076775960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076775980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767759a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076775a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076775ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076775ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800037a3000 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b93df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b93e10 trap() at trap+0x48/frame 0xfffffe0006b93f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b93f20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe007677a910, rbp = 0xfffffe007677a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677a910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677a980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677a9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe007677aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800037a45a0 (CPU 5) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b9fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b9fe10 trap() at trap+0x48/frame 0xfffffe0006b9ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b9ff20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe007677f910, rbp = 0xfffffe007677f910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677f910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677f960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677f980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677f9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe007677fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800037a4000 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006babdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006babe10 trap() at trap+0x48/frame 0xfffffe0006babf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006babf20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe0076784910, rbp = 0xfffffe0076784910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076784910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076784960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076784980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767849a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076784a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076784ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076784ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800037905a0 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bb7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bb7e10 trap() at trap+0x48/frame 0xfffffe0006bb7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bb7f20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe0076789910, rbp = 0xfffffe0076789910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076789910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076789960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076789980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767899a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076789a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076789ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076789ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003790000 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bc3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bc3e10 trap() at trap+0x48/frame 0xfffffe0006bc3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc3f20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe007678e910, rbp = 0xfffffe007678e910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007678e910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007678e960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007678e980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007678e9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe007678ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007678eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007678eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff80003791000 (CPU 10) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bdbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bdbe10 trap() at trap+0x48/frame 0xfffffe0006bdbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdbf20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe0076798910, rbp = 0xfffffe0076798910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076798910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076798960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076798980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767989a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076798a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076798ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076798ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800037925a0 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006be7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006be7e10 trap() at trap+0x48/frame 0xfffffe0006be7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006be7f20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe007679d910, rbp = 0xfffffe007679d910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007679d910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007679d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007679d980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007679d9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe007679da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007679dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007679dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 65308 65297 7561 0 R+ CPU 9 mmap20 65297 65295 7561 0 S+ wait 0xfffff804ca76e000 sh 65296 7561 7561 0 S+ piperd 0xfffff80003d7dbe0 tee 65295 7561 7561 0 S+ wait 0xfffff80286567a60 sh 65182 9913 9855 0 S nanslp 0xffffffff81e8cfc2 sleep 9916 9855 9855 0 S piperd 0xfffff80003d7d5f0 sh 9914 9855 9855 0 S piperd 0xfffff8000a80f000 awk 9913 9855 9855 0 S wait 0xfffff8021f9c5530 sh 9855 1 9855 0 Ss wait 0xfffff8021f9fea60 sh 7561 2365 7561 0 S+ wait 0xfffff80003d3d530 sh 2365 2363 2365 0 S+ wait 0xfffff8000404f530 bash 2363 2362 2363 0 S+ pause 0xfffff800061935d8 csh 2362 2358 2362 2006 S+ wait 0xfffff800041c4530 su 2358 2357 2358 2006 Ss+ wait 0xfffff80003d3ba60 bash 2357 2354 2354 2006 S select 0xfffff80003afbbc0 sshd 2354 2278 2354 0 Ss select 0xfffff8001acfae40 sshd 2348 2337 2348 0 S+ ttyin 0xfffff8000647b8b0 csh 2337 1 2337 0 Ss+ wait 0xfffff8000a987a60 login 2336 1 2336 0 Ss+ ttyin 0xfffff8000647bcb0 getty 2335 1 2335 0 Ss+ ttyin 0xfffff800039664b0 getty 2334 1 2334 0 Ss+ ttyin 0xfffff800039668b0 getty 2333 1 2333 0 Ss+ ttyin 0xfffff80003966cb0 getty 2332 1 2332 0 Ss+ ttyin 0xfffff800039650b0 getty 2331 1 2331 0 Ss+ ttyin 0xfffff800039654b0 getty 2330 1 2330 0 Ss+ ttyin 0xfffff800039658b0 getty 2329 1 2329 0 Ss+ ttyin 0xfffff80003965cb0 getty 2328 1 2328 0 Ss+ ttyin 0xfffff800039640b0 getty 2282 1 2282 0 Ss nanslp 0xffffffff81e8cfc9 cron 2278 1 2278 0 Ss select 0xfffff80003c95f40 sshd 2249 1 2249 123 Ss (threaded) ntpd 100144 S select 0xfffff80003d678c0 ntpd 100823 S usem 0xfffff80664b8e680 ntpd 2186 1 2186 0 Ss rpcsvc 0xfffff800045b1b60 NLM: master 2183 1 2183 0 Ss select 0xfffff800040edf40 rpc.statd 2137 1 2137 0 Ss nanslp 0xffffffff81e8cfc8 watchdogd 2058 1 2058 0 Ss select 0xfffff80006090140 rpcbind 2048 1 2048 0 Ss select 0xfffff80003d679c0 syslogd 1977 1 1977 0 Ss select 0xfffff800046f7140 devd 1972 1 1972 65 Ss select 0xfffff800046f72c0 dhclient 1928 1 1928 0 Ss select 0xfffff80003d67a40 dhclient 1925 1 1925 0 Ss select 0xfffff8000392f840 dhclient 34 0 0 0 DL vlruwt 0xfffff80003be6a60 [vnlru] 33 0 0 0 DL syncer 0xffffffff81f63480 [syncer] 32 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff81f62918 [bufdaemon] 100131 D - 0xffffffff81a0a8c0 [bufspacedaemon-0] 100132 D - 0xffffffff81a12b80 [bufspacedaemon-1] 100134 D - 0xffffffff81a1ae40 [bufspacedaemon-2] 100135 D - 0xffffffff81a23100 [bufspacedaemon-3] 100136 D - 0xffffffff81a2b3c0 [bufspacedaemon-4] 100138 D - 0xffffffff81a33680 [bufspacedaemon-5] 100139 D - 0xffffffff81a3b940 [bufspacedaemon-6] 100152 D sdflush 0xfffff800046c3ce8 [/ worker] 100202 D sdflush 0xfffff80003bdfce8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff81f7f688 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff81fe9418 [dom0] 100133 D launds 0xffffffff81fe9424 [laundry: dom0] 100137 D umarcl 0xffffffff80f12f80 [uma] 29 0 0 0 DL idle 0xfffff80003a75000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff80003a75530 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81cec6a0 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff81fe7b30 [sctp_iterator] 25 0 0 0 DL - 0xffffffff81f6231c [soaiod4] 24 0 0 0 DL - 0xffffffff81f6231c [soaiod3] 23 0 0 0 DL - 0xffffffff81f6231c [soaiod2] 22 0 0 0 DL - 0xffffffff81f6231c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe009a1aa460 [usbus0] 100097 D - 0xfffffe009a1aa4b8 [usbus0] 100098 D - 0xfffffe009a1aa510 [usbus0] 100099 D - 0xfffffe009a1aa568 [usbus0] 100100 D - 0xfffffe009a1aa5c0 [usbus0] 100102 D - 0xfffffe0006dd6d10 [usbus1] 100103 D - 0xfffffe0006dd6d68 [usbus1] 100104 D - 0xfffffe0006dd6dc0 [usbus1] 100105 D - 0xfffffe0006dd6e18 [usbus1] 100106 D - 0xfffffe0006dd6e70 [usbus1] 100107 D - 0xfffffe009a63bd10 [usbus2] 100108 D - 0xfffffe009a63bd68 [usbus2] 100109 D - 0xfffffe009a63bdc0 [usbus2] 100110 D - 0xfffffe009a63be18 [usbus2] 100111 D - 0xfffffe009a63be70 [usbus2] 20 0 0 0 DL (threaded) [cam] 100091 D - 0xffffffff81bc7a40 [doneq0] 100092 D - 0xffffffff81bc7ac0 [doneq1] 100093 D - 0xffffffff81bc7b40 [doneq2] 100125 D - 0xffffffff81bc7908 [scanner] 19 0 0 0 DL crypto_ 0xfffff800041d0c50 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff800041d0bf0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff800041d0b90 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff800041d0b30 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff800041d0ad0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff800041d0a70 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff800041d0a10 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff800041d09b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff800041d0950 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff800041d08f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff800041d0890 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff800041d0830 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81f79cb8 [crypto] 14 0 0 0 DL seqstat 0xfffff80003e90888 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff81fb7fc0 [g_event] 100063 D - 0xffffffff81fb7fd0 [g_up] 100064 D - 0xffffffff81fb7fb8 [g_down] 12 0 0 0 WL (threaded) [intr] 100015 I [swi6: task queue] 100016 I [swi6: Giant taskq] 100018 I [swi5: fast taskq] 100047 I [swi4: clock (0)] 100048 I [swi4: clock (1)] 100049 I [swi4: clock (2)] 100050 I [swi4: clock (3)] 100051 I [swi4: clock (4)] 100052 I [swi4: clock (5)] 100053 I [swi4: clock (6)] 100054 I [swi4: clock (7)] 100055 I [swi4: clock (8)] 100056 I [swi4: clock (9)] 100057 I [swi4: clock (10)] 100058 I [swi4: clock (11)] 100059 I [swi3: vm] 100060 I [swi1: netisr 0] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100181 I [irq72: ioat0] 100182 I [irq73: ioat1] 100183 I [irq74: ioat2] 100184 I [irq75: ioat3] 100185 I [irq76: ioat4] 100186 I [irq77: ioat5] 100187 I [irq78: ioat6] 100188 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800037a5530 [init] 10 0 0 0 DL audit_w 0xffffffff81fe8840 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81fb8000 [swapper] 100017 D - 0xfffff80003759d00 [thread taskq] 100019 D - 0xfffff80003748000 [config_0] 100020 D - 0xfffff80003759b00 [kqueue_ctx taskq] 100021 D - 0xfffff80003759a00 [aiod_kick taskq] 100022 D - 0xfffff80003749e00 [softirq_0] 100023 D - 0xfffff80003749d00 [softirq_1] 100024 D - 0xfffff80003749c00 [softirq_2] 100025 D - 0xfffff80003749b00 [softirq_3] 100026 D - 0xfffff80003749a00 [softirq_4] 100027 D - 0xfffff80003749900 [softirq_5] 100028 D - 0xfffff80003749800 [softirq_6] 100029 D - 0xfffff80003749700 [softirq_7] 100030 D - 0xfffff80003749600 [softirq_8] 100031 D - 0xfffff80003749500 [softirq_9] 100032 D - 0xfffff80003749400 [softirq_10] 100033 D - 0xfffff80003749300 [softirq_11] 100034 D - 0xfffff80003749200 [if_io_tqg_0] 100035 D - 0xfffff80003749100 [if_io_tqg_1] 100036 D - 0xfffff80003749000 [if_io_tqg_2] 100037 D - 0xfffff8000374ae00 [if_io_tqg_3] 100038 D - 0xfffff8000374ad00 [if_io_tqg_4] 100039 D - 0xfffff8000374ac00 [if_io_tqg_5] 100040 D - 0xfffff8000374ab00 [if_io_tqg_6] 100041 D - 0xfffff8000374aa00 [if_io_tqg_7] 100042 D - 0xfffff8000374a900 [if_io_tqg_8] 100043 D - 0xfffff8000374a800 [if_io_tqg_9] 100044 D - 0xfffff80003998100 [if_io_tqg_10] 100045 D - 0xfffff80003998000 [if_io_tqg_11] 100046 D - 0xfffff80003ec7200 [if_config_tqg_0] 100061 D - 0xfffff80003e34100 [firmware taskq] 100066 D - 0xfffff80003e34000 [crypto_0] 100067 D - 0xfffff80003e34000 [crypto_1] 100068 D - 0xfffff80003e34000 [crypto_2] 100069 D - 0xfffff80003e34000 [crypto_3] 100070 D - 0xfffff80003e34000 [crypto_4] 100071 D - 0xfffff80003e34000 [crypto_5] 100072 D - 0xfffff80003e34000 [crypto_6] 100073 D - 0xfffff80003e34000 [crypto_7] 100074 D - 0xfffff80003e34000 [crypto_8] 100075 D - 0xfffff80003e34000 [crypto_9] 100076 D - 0xfffff80003e34000 [crypto_10] 100077 D - 0xfffff80003e34000 [crypto_11] 100114 D - 0xfffff800065ab200 [mca taskq] 100121 D - 0xfffff8000a578300 [acpi_task_0] 100122 D - 0xfffff8000a578300 [acpi_task_1] 100123 D - 0xfffff8000a578300 [acpi_task_2] 100124 D - 0xfffff80003e35e00 [CAM taskq] db:0:pho> allt Tracing command mmap20 pid 65308 tid 100265 td 0xfffff8028634f000 (CPU 9) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aac9e770 vpanic() at vpanic+0x1ba/frame 0xfffffe00aac9e7c0 panic() at panic+0x43/frame 0xfffffe00aac9e820 witness_unlock() at witness_unlock+0xea/frame 0xfffffe00aac9e860 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe00aac9e890 vm_object_madvise() at vm_object_madvise+0x1d4/frame 0xfffffe00aac9e8f0 vm_map_madvise() at vm_map_madvise+0x2db/frame 0xfffffe00aac9e960 sys_madvise() at sys_madvise+0x79/frame 0xfffffe00aac9e980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aac9eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aac9eab0 --- syscall (75, FreeBSD ELF64, sys_madvise), rip = 0x80033c94a, rsp = 0x7fffffffe6f8, rbp = 0x7fffffffe710 --- Tracing command sh pid 65297 tid 100570 td 0xfffff802866b55a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00b8108560 mi_switch() at mi_switch+0x174/frame 0xfffffe00b8108590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00b81085d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00b8108630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00b8108660 _sleep() at _sleep+0x2d0/frame 0xfffffe00b8108700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00b8108790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00b8108980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00b8108ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b8108ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe368, rbp = 0x7fffffffe420 --- Tracing command tee pid 65296 tid 100629 td 0xfffff804856f4000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00b822f6a0 mi_switch() at mi_switch+0x174/frame 0xfffffe00b822f6d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00b822f710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00b822f770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00b822f7a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00b822f840 pipe_read() at pipe_read+0x356/frame 0xfffffe00b822f8a0 dofileread() at dofileread+0x81/frame 0xfffffe00b822f8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00b822f930 sys_read() at sys_read+0x84/frame 0xfffffe00b822f980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00b822fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b822fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004151fa, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sh pid 65295 tid 100315 td 0xfffff80286528000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aad4d560 mi_switch() at mi_switch+0x174/frame 0xfffffe00aad4d590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aad4d5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aad4d630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aad4d660 _sleep() at _sleep+0x2d0/frame 0xfffffe00aad4d700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00aad4d790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00aad4d980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aad4dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aad4dab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffabc8, rbp = 0x7fffffffac80 --- Tracing command sleep pid 65182 tid 100223 td 0xfffff800042645a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aabcc710 mi_switch() at mi_switch+0x174/frame 0xfffffe00aabcc740 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aabcc780 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aabcc7e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aabcc820 _sleep() at _sleep+0x265/frame 0xfffffe00aabcc8c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00aabcc940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00aabcc980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aabccab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aabccab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003a4a0a, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffe6f0 --- Tracing command sh pid 9916 tid 100230 td 0xfffff8001a5cb5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aabef6a0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aabef6d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aabef710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aabef770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aabef7a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00aabef840 pipe_read() at pipe_read+0x356/frame 0xfffffe00aabef8a0 dofileread() at dofileread+0x81/frame 0xfffffe00aabef8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00aabef930 sys_read() at sys_read+0x84/frame 0xfffffe00aabef980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aabefab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aabefab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004761fa, rsp = 0x7fffffffe228, rbp = 0x7fffffffe330 --- Tracing command awk pid 9914 tid 100251 td 0xfffff8021f9205a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aac586a0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aac586d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aac58710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aac58770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aac587a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00aac58840 pipe_read() at pipe_read+0x356/frame 0xfffffe00aac588a0 dofileread() at dofileread+0x81/frame 0xfffffe00aac588f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00aac58930 sys_read() at sys_read+0x84/frame 0xfffffe00aac58980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aac58ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aac58ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004791fa, rsp = 0x7fffffffe328, rbp = 0x7fffffffe340 --- Tracing command sh pid 9913 tid 100269 td 0xfffff8028619d5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aacb2560 mi_switch() at mi_switch+0x174/frame 0xfffffe00aacb2590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aacb25d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aacb2630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aacb2660 _sleep() at _sleep+0x2d0/frame 0xfffffe00aacb2700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00aacb2790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00aacb2980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aacb2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aacb2ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe238, rbp = 0x7fffffffe2f0 --- Tracing command sh pid 9855 tid 100247 td 0xfffff800041c85a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aac44560 mi_switch() at mi_switch+0x174/frame 0xfffffe00aac44590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aac445d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aac44630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aac44660 _sleep() at _sleep+0x2d0/frame 0xfffffe00aac44700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00aac44790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00aac44980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aac44ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aac44ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe4c8, rbp = 0x7fffffffe580 --- Tracing command sh pid 7561 tid 100222 td 0xfffff8021f1de5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aabc7560 mi_switch() at mi_switch+0x174/frame 0xfffffe00aabc7590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aabc75d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aabc7630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aabc7660 _sleep() at _sleep+0x2d0/frame 0xfffffe00aabc7700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00aabc7790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00aabc7980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aabc7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aabc7ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffaee8, rbp = 0x7fffffffafa0 --- Tracing command bash pid 2365 tid 100189 td 0xfffff80004037000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aab03560 mi_switch() at mi_switch+0x174/frame 0xfffffe00aab03590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aab035d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aab03630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aab03660 _sleep() at _sleep+0x2d0/frame 0xfffffe00aab03700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00aab03790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00aab03980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aab03ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aab03ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8005158aa, rsp = 0x7fffffffe678, rbp = 0x7fffffffe6c0 --- Tracing command csh pid 2363 tid 100166 td 0xfffff8000616b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aaa54750 mi_switch() at mi_switch+0x174/frame 0xfffffe00aaa54780 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aaa547c0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aaa54820 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aaa54850 _sleep() at _sleep+0x2d0/frame 0xfffffe00aaa548f0 kern_sigsuspend() at kern_sigsuspend+0xb4/frame 0xfffffe00aaa54950 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe00aaa54980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aaa54ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aaa54ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80048992a, rsp = 0x7fffffffdff8, rbp = 0x7fffffffe080 --- Tracing command su pid 2362 tid 100151 td 0xfffff80004263000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aaa09560 mi_switch() at mi_switch+0x174/frame 0xfffffe00aaa09590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aaa095d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aaa09630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aaa09660 _sleep() at _sleep+0x2d0/frame 0xfffffe00aaa09700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00aaa09790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00aaa09980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aaa09ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aaa09ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003ea8aa, rsp = 0x7fffffffe5f8, rbp = 0x7fffffffeb40 --- Tracing command bash pid 2358 tid 100149 td 0xfffff80006447000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aa7fd560 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa7fd590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa7fd5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aa7fd630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa7fd660 _sleep() at _sleep+0x2d0/frame 0xfffffe00aa7fd700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00aa7fd790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00aa7fd980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aa7fdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa7fdab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8005158aa, rsp = 0x7fffffffe7c8, rbp = 0x7fffffffe810 --- Tracing command sshd pid 2357 tid 100220 td 0xfffff8021f1dd5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aabbd5c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aabbd5f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aabbd630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aabbd690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aabbd6c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aabbd720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aabbd760 kern_select() at kern_select+0x95a/frame 0xfffffe00aabbd940 sys_select() at sys_select+0x56/frame 0xfffffe00aabbd980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aabbdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aabbdab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8009021da, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 2354 tid 100156 td 0xfffff80006056000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aaa22640 mi_switch() at mi_switch+0x174/frame 0xfffffe00aaa22670 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aaa226b0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aaa22710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aaa22740 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aaa227a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aaa227e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00aaa22960 sys_poll() at sys_poll+0x50/frame 0xfffffe00aaa22980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aaa22ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aaa22ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8008a41fa, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command csh pid 2348 tid 100205 td 0xfffff80003d4e000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aab72620 mi_switch() at mi_switch+0x174/frame 0xfffffe00aab72650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aab72690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aab726f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aab72720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aab72780 tty_wait() at tty_wait+0x42/frame 0xfffffe00aab727b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aab72810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aab72840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aab728a0 dofileread() at dofileread+0x81/frame 0xfffffe00aab728f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00aab72930 sys_read() at sys_read+0x84/frame 0xfffffe00aab72980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aab72ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aab72ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004fa1fa, rsp = 0x7fffffffe1f8, rbp = 0x7fffffffe220 --- Tracing command login pid 2337 tid 100142 td 0xfffff80003ad3000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a33f8560 mi_switch() at mi_switch+0x174/frame 0xfffffe00a33f8590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a33f85d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a33f8630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a33f8660 _sleep() at _sleep+0x2d0/frame 0xfffffe00a33f8700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a33f8790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a33f8980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00a33f8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a33f8ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003ec8aa, rsp = 0x7fffffffeb48, rbp = 0x7fffffffed00 --- Tracing command getty pid 2336 tid 100218 td 0xfffff8021f63c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aabb3620 mi_switch() at mi_switch+0x174/frame 0xfffffe00aabb3650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aabb3690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aabb36f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aabb3720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aabb3780 tty_wait() at tty_wait+0x42/frame 0xfffffe00aabb37b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aabb3810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aabb3840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aabb38a0 dofileread() at dofileread+0x81/frame 0xfffffe00aabb38f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00aabb3930 sys_read() at sys_read+0x84/frame 0xfffffe00aabb3980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aabb3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aabb3ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2335 tid 100217 td 0xfffff8021f63c5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aabae620 mi_switch() at mi_switch+0x174/frame 0xfffffe00aabae650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aabae690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aabae6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aabae720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aabae780 tty_wait() at tty_wait+0x42/frame 0xfffffe00aabae7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aabae810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aabae840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aabae8a0 dofileread() at dofileread+0x81/frame 0xfffffe00aabae8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00aabae930 sys_read() at sys_read+0x84/frame 0xfffffe00aabae980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aabaeab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aabaeab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2334 tid 100216 td 0xfffff8021f63b000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aaba9620 mi_switch() at mi_switch+0x174/frame 0xfffffe00aaba9650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aaba9690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aaba96f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aaba9720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aaba9780 tty_wait() at tty_wait+0x42/frame 0xfffffe00aaba97b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aaba9810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aaba9840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aaba98a0 dofileread() at dofileread+0x81/frame 0xfffffe00aaba98f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00aaba9930 sys_read() at sys_read+0x84/frame 0xfffffe00aaba9980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aaba9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aaba9ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2333 tid 100215 td 0xfffff8021f63b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aaba4620 mi_switch() at mi_switch+0x174/frame 0xfffffe00aaba4650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aaba4690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aaba46f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aaba4720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aaba4780 tty_wait() at tty_wait+0x42/frame 0xfffffe00aaba47b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aaba4810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aaba4840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aaba48a0 dofileread() at dofileread+0x81/frame 0xfffffe00aaba48f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00aaba4930 sys_read() at sys_read+0x84/frame 0xfffffe00aaba4980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aaba4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aaba4ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2332 tid 100214 td 0xfffff8021f63a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aab9f620 mi_switch() at mi_switch+0x174/frame 0xfffffe00aab9f650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aab9f690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aab9f6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aab9f720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aab9f780 tty_wait() at tty_wait+0x42/frame 0xfffffe00aab9f7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aab9f810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aab9f840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aab9f8a0 dofileread() at dofileread+0x81/frame 0xfffffe00aab9f8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00aab9f930 sys_read() at sys_read+0x84/frame 0xfffffe00aab9f980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aab9fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aab9fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2331 tid 100213 td 0xfffff8021f63a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aab9a620 mi_switch() at mi_switch+0x174/frame 0xfffffe00aab9a650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aab9a690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aab9a6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aab9a720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aab9a780 tty_wait() at tty_wait+0x42/frame 0xfffffe00aab9a7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aab9a810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aab9a840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aab9a8a0 dofileread() at dofileread+0x81/frame 0xfffffe00aab9a8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00aab9a930 sys_read() at sys_read+0x84/frame 0xfffffe00aab9a980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aab9aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aab9aab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2330 tid 100212 td 0xfffff8021f639000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aab95620 mi_switch() at mi_switch+0x174/frame 0xfffffe00aab95650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aab95690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aab956f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aab95720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aab95780 tty_wait() at tty_wait+0x42/frame 0xfffffe00aab957b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aab95810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aab95840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aab958a0 dofileread() at dofileread+0x81/frame 0xfffffe00aab958f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00aab95930 sys_read() at sys_read+0x84/frame 0xfffffe00aab95980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aab95ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aab95ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2329 tid 100211 td 0xfffff8021f6395a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aab90620 mi_switch() at mi_switch+0x174/frame 0xfffffe00aab90650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aab90690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aab906f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aab90720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aab90780 tty_wait() at tty_wait+0x42/frame 0xfffffe00aab907b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aab90810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aab90840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aab908a0 dofileread() at dofileread+0x81/frame 0xfffffe00aab908f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00aab90930 sys_read() at sys_read+0x84/frame 0xfffffe00aab90980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aab90ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aab90ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2328 tid 100209 td 0xfffff800064365a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aab86620 mi_switch() at mi_switch+0x174/frame 0xfffffe00aab86650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aab86690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aab866f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aab86720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aab86780 tty_wait() at tty_wait+0x42/frame 0xfffffe00aab867b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aab86810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aab86840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aab868a0 dofileread() at dofileread+0x81/frame 0xfffffe00aab868f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00aab86930 sys_read() at sys_read+0x84/frame 0xfffffe00aab86980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aab86ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aab86ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2282 tid 100198 td 0xfffff8021f1dc5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aab54710 mi_switch() at mi_switch+0x174/frame 0xfffffe00aab54740 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aab54780 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aab547e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aab54820 _sleep() at _sleep+0x265/frame 0xfffffe00aab548c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00aab54940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00aab54980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aab54ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aab54ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d4a0a, rsp = 0x7fffffffead8, rbp = 0x7fffffffecc0 --- Tracing command sshd pid 2278 tid 100179 td 0xfffff8001ab435a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aaaa15c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aaaa15f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aaaa1630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aaaa1690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aaaa16c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aaaa1720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aaaa1760 kern_select() at kern_select+0x95a/frame 0xfffffe00aaaa1940 sys_select() at sys_select+0x56/frame 0xfffffe00aaaa1980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aaaa1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aaaa1ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8009021da, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6a0 --- Tracing command ntpd pid 2249 tid 100144 td 0xfffff8000a4c0000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aa7e45c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa7e45f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa7e4630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aa7e4690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa7e46c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa7e4720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aa7e4760 kern_select() at kern_select+0x95a/frame 0xfffffe00aa7e4940 sys_select() at sys_select+0x56/frame 0xfffffe00aa7e4980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aa7e4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa7e4ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80082e1da, rsp = 0x7fffffffdf18, rbp = 0x7fffffffdf50 --- Tracing command ntpd pid 2249 tid 100823 td 0xfffff80429d015a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00b83106b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00b83106e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00b8310720 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00b8310780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00b83107b0 _sleep() at _sleep+0x2d0/frame 0xfffffe00b8310850 umtxq_sleep() at umtxq_sleep+0x153/frame 0xfffffe00b83108b0 do_sem2_wait() at do_sem2_wait+0x41c/frame 0xfffffe00b8310930 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x76/frame 0xfffffe00b8310980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00b8310ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b8310ab0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x8007225aa, rsp = 0x7fffdffbced8, rbp = 0x7fffdffbcf50 --- Tracing command rpc.lockd pid 2186 tid 100199 td 0xfffff80003980000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aab594e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aab59510 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aab59550 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aab595b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aab595f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aab59660 svc_run_internal() at svc_run_internal+0xa90/frame 0xfffffe00aab597a0 svc_run() at svc_run+0x24e/frame 0xfffffe00aab59800 sys_nlm_syscall() at sys_nlm_syscall+0x763/frame 0xfffffe00aab59980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aab59ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aab59ab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f062a, rsp = 0x7fffffffec08, rbp = 0x7fffffffecc0 --- Tracing command rpc.statd pid 2183 tid 100163 td 0xfffff80003ad4000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aaa455a0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aaa455d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aaa45610 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aaa45670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aaa456b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aaa45720 seltdwait() at seltdwait+0x6b/frame 0xfffffe00aaa45760 kern_select() at kern_select+0x95a/frame 0xfffffe00aaa45940 sys_select() at sys_select+0x56/frame 0xfffffe00aaa45980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aaa45ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aaa45ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004251da, rsp = 0x7fffffffea98, rbp = 0x7fffffffebe0 --- Tracing command watchdogd pid 2137 tid 100172 td 0xfffff80003a6f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aaa7e710 mi_switch() at mi_switch+0x174/frame 0xfffffe00aaa7e740 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aaa7e780 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aaa7e7e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aaa7e820 _sleep() at _sleep+0x265/frame 0xfffffe00aaa7e8c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00aaa7e940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00aaa7e980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aaa7eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aaa7eab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003bda0a, rsp = 0x7fffffffea98, rbp = 0x7fffffffeae0 --- Tracing command rpcbind pid 2058 tid 100171 td 0xfffff80003a6f5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aaa79620 mi_switch() at mi_switch+0x174/frame 0xfffffe00aaa79650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aaa79690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aaa796f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aaa79730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aaa797a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00aaa797e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00aaa79960 sys_poll() at sys_poll+0x50/frame 0xfffffe00aaa79980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aaa79ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aaa79ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003cc1fa, rsp = 0x7fffffffca38, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2048 tid 100180 td 0xfffff800039805a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aaaa65c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aaaa65f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aaaa6630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aaaa6690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aaaa66c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aaaa6720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aaaa6760 kern_select() at kern_select+0x95a/frame 0xfffffe00aaaa6940 sys_select() at sys_select+0x56/frame 0xfffffe00aaaa6980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aaaa6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aaaa6ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004361da, rsp = 0x7fffffffe748, rbp = 0x7fffffffecc0 --- Tracing command devd pid 1977 tid 100175 td 0xfffff8001a5b1000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aaa8d5a0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aaa8d5d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aaa8d610 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aaa8d670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aaa8d6b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aaa8d720 seltdwait() at seltdwait+0x6b/frame 0xfffffe00aaa8d760 kern_select() at kern_select+0x95a/frame 0xfffffe00aaa8d940 sys_select() at sys_select+0x56/frame 0xfffffe00aaa8d980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aaa8dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aaa8dab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f533a, rsp = 0x7fffffffcb48, rbp = 0x7fffffffece0 --- Tracing command dhclient pid 1972 tid 100154 td 0xfffff800037085a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aaa18620 mi_switch() at mi_switch+0x174/frame 0xfffffe00aaa18650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aaa18690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aaa186f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aaa18730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aaa187a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00aaa187e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00aaa18960 sys_poll() at sys_poll+0x50/frame 0xfffffe00aaa18980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aaa18ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aaa18ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003ef1fa, rsp = 0x7fffffffec28, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1928 tid 100191 td 0xfffff8000a4c2000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aab0d640 mi_switch() at mi_switch+0x174/frame 0xfffffe00aab0d670 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aab0d6b0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aab0d710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aab0d740 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aab0d7a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aab0d7e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00aab0d960 sys_poll() at sys_poll+0x50/frame 0xfffffe00aab0d980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aab0dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aab0dab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003ef1fa, rsp = 0x7fffffffec38, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1925 tid 100164 td 0xfffff80003ad55a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aaa4a5c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aaa4a5f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aaa4a630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aaa4a690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aaa4a6c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aaa4a720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aaa4a760 kern_select() at kern_select+0x95a/frame 0xfffffe00aaa4a940 sys_select() at sys_select+0x56/frame 0xfffffe00aaa4a980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aaa4aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aaa4aab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80044d1da, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffeaa0 --- Tracing command vnlru pid 34 tid 100141 td 0xfffff8000a4c05a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a33f3890 mi_switch() at mi_switch+0x174/frame 0xfffffe00a33f38c0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a33f3900 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a33f3940 _sleep() at _sleep+0x279/frame 0xfffffe00a33f39e0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe00a33f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a33f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a33f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100140 td 0xfffff8000a4bf000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a33ee8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a33ee8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a33ee930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a33ee970 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x185/frame 0xfffffe00a33ee9e0 sched_sync() at sched_sync+0x609/frame 0xfffffe00a33eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a33eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a33eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffff8000a4bf5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006f378d0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f37900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f37940 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f37980 _sleep() at _sleep+0x279/frame 0xfffffe0006f37a20 buf_daemon() at buf_daemon+0xc8/frame 0xfffffe0006f37a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f37ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f37ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100131 td 0xfffff800060a05a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ffc8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ffc8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ffc930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ffc970 _sleep() at _sleep+0x279/frame 0xfffffe0006ffca10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006ffca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ffcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ffcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100132 td 0xfffff800060a0000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a2c448c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a2c448f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2c44930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a2c44970 _sleep() at _sleep+0x279/frame 0xfffffe00a2c44a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a2c44a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2c44ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2c44ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffff800060a15a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a2dc98c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a2dc98f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2dc9930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a2dc9970 _sleep() at _sleep+0x279/frame 0xfffffe00a2dc9a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a2dc9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2dc9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2dc9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff800060a1000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a2dee8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a2dee8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2dee930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a2dee970 _sleep() at _sleep+0x279/frame 0xfffffe00a2deea10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a2deea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2deeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2deeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff80003f285a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a2df38c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a2df38f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2df3930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a2df3970 _sleep() at _sleep+0x279/frame 0xfffffe00a2df3a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a2df3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2df3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2df3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffff800060555a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a33848c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a33848f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a3384930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a3384970 _sleep() at _sleep+0x279/frame 0xfffffe00a3384a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a3384a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a3384ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a3384ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffff80006055000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a33e98c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a33e98f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a33e9930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a33e9970 _sleep() at _sleep+0x279/frame 0xfffffe00a33e9a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a33e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a33e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a33e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100152 td 0xfffff8000ac7f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aaa0e8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aaa0e920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aaa0e960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aaa0e9a0 _sleep() at _sleep+0x279/frame 0xfffffe00aaa0ea40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00aaa0ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00aaa0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00aaa0eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100202 td 0xfffff8001a22a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aab688f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aab68920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aab68960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aab689a0 _sleep() at _sleep+0x279/frame 0xfffffe00aab68a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00aab68a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00aab68ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00aab68ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff80003bd9000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006f268c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f268f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f26930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f26960 _sleep() at _sleep+0x2da/frame 0xfffffe0006f26a00 vm_daemon() at vm_daemon+0xa6f/frame 0xfffffe0006f26a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f26ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f26ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff80003bd95a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006f21520 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f21550 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f21590 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f215d0 _sleep() at _sleep+0x279/frame 0xfffffe0006f21670 vm_pageout_worker() at vm_pageout_worker+0x26b/frame 0xfffffe0006f21a30 vm_pageout() at vm_pageout+0x176/frame 0xfffffe0006f21a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f21ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f21ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100133 td 0xfffff80003ad2000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a2df86b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a2df86e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2df8720 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a2df8750 _sleep() at _sleep+0x2da/frame 0xfffffe00a2df87f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xd06/frame 0xfffffe00a2df8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2df8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2df8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100137 td 0xfffff80003ad35a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a2dfd8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a2dfd920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a2dfd960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a2dfd9a0 _sleep() at _sleep+0x279/frame 0xfffffe00a2dfda40 uma_reclaim_worker() at uma_reclaim_worker+0xda/frame 0xfffffe00a2dfda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a2dfdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a2dfdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff80003a5b000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006f108b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f108e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f10920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f10950 _sleep() at _sleep+0x2da/frame 0xfffffe0006f109f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006f10a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f10ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f10ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff80003a5b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006f0b8b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f0b8e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f0b920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f0b950 _sleep() at _sleep+0x2da/frame 0xfffffe0006f0b9f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006f0ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f0bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f0bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100120 td 0xfffff80003bc95a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006eed8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eed8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006eed930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006eed970 _sleep() at _sleep+0x279/frame 0xfffffe0006eeda10 random_kthread() at random_kthread+0x26a/frame 0xfffffe0006eeda70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eedab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eedab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff8000a5ba000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006edc910 mi_switch() at mi_switch+0x174/frame 0xfffffe0006edc940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006edc980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006edc9b0 _sleep() at _sleep+0x2da/frame 0xfffffe0006edca50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0006edca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006edcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006edcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff80003a5a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ecb8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ecb910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ecb950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ecb990 _sleep() at _sleep+0x279/frame 0xfffffe0006ecba30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ecba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ecbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ecbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff80003a5a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ec68e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ec6910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ec6950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ec6990 _sleep() at _sleep+0x279/frame 0xfffffe0006ec6a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ec6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff80003a59000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ec18e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ec1910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ec1950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ec1990 _sleep() at _sleep+0x279/frame 0xfffffe0006ec1a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ec1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff80003a595a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ebc8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ebc910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ebc950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ebc990 _sleep() at _sleep+0x279/frame 0xfffffe0006ebca30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ebca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ebcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ebcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff80003f29000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e45930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e45960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e459a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e459d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e45a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e45a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e45ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e45ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff80003f2a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e4a930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e4a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e4a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4a9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e4aa30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e4aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff80003f2a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e4f930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e4f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e4f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4f9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e4fa30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e4fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff80003f2b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e54930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e54960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e549a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e549d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e54a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e54a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e54ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e54ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff80003f2b000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e59930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e59960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e599a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e599d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e59a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e59a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e59ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e59ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff80003f39000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e63930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e63960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e639a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e639d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e63a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e63a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e63ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e63ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff8000609e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e68930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e68960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e689a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e689d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e68a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e68a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e68ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e68ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff8000609e000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e6d930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e6d960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e6d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e6d9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e6da30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e6da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e6dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e6dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff8000609f5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e72930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e72960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e729a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e729d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e72a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e72a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e72ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e72ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff8000609f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e77930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e77960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e779a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e779d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e77a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e77a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e77ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e77ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff80006436000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e94930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e94960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e949d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e94a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e94a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e94ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e94ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff800064375a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e99930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e99960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e999d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e99a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e99a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e99ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e99ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff80006437000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e9e930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e9e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e9e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e9e9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e9ea30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e9ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e9eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e9eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff800064385a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ea3930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ea3960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ea39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ea39d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006ea3a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006ea3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff80006438000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ea8930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ea8960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ea89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ea89d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006ea8a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006ea8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff800042625a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e2c8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e2c910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e2c950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e2c980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e2ca20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e2ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e2cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff80004262000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e318e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e31910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e31950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e31980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e31a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e31a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e31ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff800042635a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e368e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e36910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e36950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e36980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e36a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e36a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e36ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff80003bcb000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006f068d0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f06900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f06940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f06970 _sleep() at _sleep+0x2da/frame 0xfffffe0006f06a10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe0006f06a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f06ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f06ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffff800041cc000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e278c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e278f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e27930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e27960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e27a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e27a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e27ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e27ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffff800041cc5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e228c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e228f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e22930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e22960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e22a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e22a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e22ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e22ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffff800041cb000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e1d8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e1d8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e1d930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e1d960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e1da00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e1dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffff800041cb5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e188c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e188f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e18930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e18960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e18a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e18a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e18ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffff800041ca000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e138c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e138f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e13930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e13960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e13a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e13a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e13ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffff800041ca5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e0e8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e0e8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e0e930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e0e960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e0ea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e0ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e0eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffff800041c9000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e098c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e098f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e09930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e09960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e09a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e09ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffff800041c95a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e048c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e048f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e04930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e04960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e04a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e04a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e04ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffff800041c8000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005fd8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005fd8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005fd930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005fd960 _sleep() at _sleep+0x2da/frame 0xfffffe00005fda00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffff80003e025a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005f88c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f88f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005f8930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f8960 _sleep() at _sleep+0x2da/frame 0xfffffe00005f8a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffff800041da000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005f38c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f38f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005f3930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f3960 _sleep() at _sleep+0x2da/frame 0xfffffe00005f3a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffff800041da5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005ee8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ee8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ee930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ee960 _sleep() at _sleep+0x2da/frame 0xfffffe00005eea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffff800041d9000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005e98f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e9920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005e9960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e9990 _sleep() at _sleep+0x2da/frame 0xfffffe00005e9a30 crypto_proc() at crypto_proc+0x2c4/frame 0xfffffe00005e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffff80003e035a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005a88f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005a8920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005a8960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a8990 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005a89f0 seq_eventthread() at seq_eventthread+0xdc/frame 0xfffffe00005a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff80003e9e000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000058d8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe000058d920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000058d960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000058d990 _sleep() at _sleep+0x2da/frame 0xfffffe000058da30 g_run_events() at g_run_events+0x4f/frame 0xfffffe000058da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff80003eb15a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005928f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000592920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000592960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000592990 _sleep() at _sleep+0x2da/frame 0xfffffe0000592a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0000592a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe0000592a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000592ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000592ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffff80003e02000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005978f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000597920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000597960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000597990 _sleep() at _sleep+0x2da/frame 0xfffffe0000597a30 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe0000597a60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe0000597a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000597ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000597ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100015 td 0xfffff80003792000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767ae9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00767aea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00767aea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767aeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767aeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100016 td 0xfffff800037935a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767b39e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00767b3a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00767b3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767b3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767b3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100018 td 0xfffff800037a05a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff80003eb25a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004ee9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00004eea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00004eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff80003eb2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff80003eb35a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff80003eb3000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff80003eb45a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff80003eb4000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff80003ec25a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff80003ec2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff80003e9b5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff80003e9b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff80003e9c5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff80003e9c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff80003e9d5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffff80003e9d000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000052f9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe000052fa10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe000052fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000052fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000052fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffff80003f28000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e3b9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e3ba10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e3ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e3bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e3bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff80003f295a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e409e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e40a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e40a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e40ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e40ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff80003f395a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e5e9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e5ea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e5ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e5eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e5eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff800064395a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff80006439000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006eb29e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eb2a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006eb2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100181 td 0xfffff8001a5b05a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffff8001a5b0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffff8001a5a35a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffff8001a5a3000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffff8001a5a25a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffff8001a5a2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffff8001a5a15a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffff8001a5a1000 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff800037a1000 (CPU 0) cpustop_handler() at cpustop_handler+0x2d/frame 0xffffffff81f9e610 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xffffffff81f9e630 trap() at trap+0x48/frame 0xffffffff81f9e740 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81f9e740 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe0076766910, rbp = 0xfffffe0076766910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767669a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800037a25a0 (CPU 1) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b6fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b6fe10 trap() at trap+0x48/frame 0xfffffe0006b6ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b6ff20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe007676b910, rbp = 0xfffffe007676b910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007676b910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007676b960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007676b980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007676b9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe007676ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007676bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007676bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800037a2000 (CPU 2) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b7bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b7be10 trap() at trap+0x48/frame 0xfffffe0006b7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b7bf20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe0076770910, rbp = 0xfffffe0076770910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076770910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076770960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076770980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767709a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076770a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076770ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076770ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800037a35a0 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b87df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b87e10 trap() at trap+0x48/frame 0xfffffe0006b87f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b87f20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe0076775910, rbp = 0xfffffe0076775910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076775910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076775960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076775980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767759a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076775a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076775ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076775ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800037a3000 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b93df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b93e10 trap() at trap+0x48/frame 0xfffffe0006b93f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b93f20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe007677a910, rbp = 0xfffffe007677a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677a910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677a980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677a9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe007677aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800037a45a0 (CPU 5) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b9fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b9fe10 trap() at trap+0x48/frame 0xfffffe0006b9ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b9ff20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe007677f910, rbp = 0xfffffe007677f910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677f910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677f960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677f980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677f9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe007677fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800037a4000 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006babdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006babe10 trap() at trap+0x48/frame 0xfffffe0006babf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006babf20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe0076784910, rbp = 0xfffffe0076784910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076784910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076784960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076784980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767849a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076784a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076784ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076784ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800037905a0 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bb7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bb7e10 trap() at trap+0x48/frame 0xfffffe0006bb7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bb7f20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe0076789910, rbp = 0xfffffe0076789910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076789910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076789960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076789980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767899a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076789a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076789ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076789ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003790000 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bc3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bc3e10 trap() at trap+0x48/frame 0xfffffe0006bc3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc3f20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe007678e910, rbp = 0xfffffe007678e910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007678e910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007678e960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007678e980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007678e9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe007678ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007678eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007678eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800037915a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0076793950 mi_switch() at mi_switch+0x174/frame 0xfffffe0076793980 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe00767939a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076793a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076793ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076793ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff80003791000 (CPU 10) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bdbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bdbe10 trap() at trap+0x48/frame 0xfffffe0006bdbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdbf20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe0076798910, rbp = 0xfffffe0076798910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076798910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076798960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076798980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767989a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076798a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076798ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076798ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800037925a0 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006be7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006be7e10 trap() at trap+0x48/frame 0xfffffe0006be7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006be7f20 --- trap 0x13, rip = 0xffffffff81161ed6, rsp = 0xfffffe007679d910, rbp = 0xfffffe007679d910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007679d910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007679d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007679d980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007679d9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe007679da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007679dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007679dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800037a15a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0076761560 mi_switch() at mi_switch+0x174/frame 0xfffffe0076761590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767615d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe0076761630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0076761660 _sleep() at _sleep+0x2d0/frame 0xfffffe0076761700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe0076761790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0076761980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe0076761ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0076761ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b0f8a, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffff800037a0000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe007675c910 mi_switch() at mi_switch+0x174/frame 0xfffffe007675c940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe007675c980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe007675c9b0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe007675ca10 audit_worker() at audit_worker+0x93/frame 0xfffffe007675ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007675cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007675cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81fb8540 sched_switch() at sched_switch+0x3f0/frame 0xffffffff8281d980 mi_switch() at mi_switch+0x174/frame 0xffffffff8281d9b0 sleepq_switch() at sleepq_switch+0x110/frame 0xffffffff8281d9f0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xffffffff8281da30 _sleep() at _sleep+0x279/frame 0xffffffff8281dad0 swapper() at swapper+0x77/frame 0xffffffff8281db20 mi_startup() at mi_startup+0x2ee/frame 0xffffffff8281db70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100017 td 0xfffff80003793000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767b8900 mi_switch() at mi_switch+0x174/frame 0xfffffe00767b8930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767b8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767b89a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767b8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767b8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767b8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767b8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff8000373e000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767c2930 mi_switch() at mi_switch+0x174/frame 0xfffffe00767c2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767c29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767c29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00767c2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00767c2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767c2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767c2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff8000373f5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767c7900 mi_switch() at mi_switch+0x174/frame 0xfffffe00767c7930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767c7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767c79a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767c7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767c7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767c7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767c7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff8000373f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767cc900 mi_switch() at mi_switch+0x174/frame 0xfffffe00767cc930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767cc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767cc9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767cca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767cca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767ccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767ccab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff800037405a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000471930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000471960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004719a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004719d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000471a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000471a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000471ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000471ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff80003740000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000476930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000476960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004769a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004769d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000476a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000476a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000476ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000476ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff800037415a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000047b930 mi_switch() at mi_switch+0x174/frame 0xfffffe000047b960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000047b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000047b9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000047ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000047ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000047bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000047bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003741000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000480930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000480960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004809a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004809d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000480a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000480a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000480ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000480ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff800037425a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000485930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000485960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004859a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004859d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000485a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000485a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000485ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000485ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003742000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000048a930 mi_switch() at mi_switch+0x174/frame 0xfffffe000048a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000048a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048a9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000048aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff800037095a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000048f930 mi_switch() at mi_switch+0x174/frame 0xfffffe000048f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000048f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048f9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000048fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003709000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000494930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000494960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004949d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000494a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000494a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000494ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000494ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff8000370a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000499930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000499960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004999d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000499a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000499a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000499ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000499ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff8000370a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000049e930 mi_switch() at mi_switch+0x174/frame 0xfffffe000049e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000049e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000049e9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000049ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000049ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000049eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000049eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff8000370b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004a3930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004a3960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004a39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a39d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004a3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff8000370b000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004a8930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004a8960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004a89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a89d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004a8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff8000370c5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004ad930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004ad960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004ad9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004ad9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004ada40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff8000370c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004b2930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004b2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004b29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004b2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff8000373e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004b7930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004b7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004b79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004b7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff80003704000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004bc930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004bc960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004bc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004bc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004bca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800037055a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004c1930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004c1960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004c19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c19d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004c1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80003705000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004c6930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004c6960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004c69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c69d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004c6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800037065a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004cb930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004cb960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004cb9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004cb9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004cba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff80003706000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004d0930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004d0960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004d09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d09d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004d0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff800037075a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004d5930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004d5960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004d59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d59d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004d5a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff80003707000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004da930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004da960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004da9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004da9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004daa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff8000397e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004df930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004df960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004df9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004df9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004dfa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff8000397e000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004e4930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004e4960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004e49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e49d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004e4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff80003eb1000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004e9930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004e9960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004e99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e99d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004e9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80003e9e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000588900 mi_switch() at mi_switch+0x174/frame 0xfffffe0000588930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000588970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005889a0 _sleep() at _sleep+0x2da/frame 0xfffffe0000588a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000588a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000588ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000588ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003e03000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005ad900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ad930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ad970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ad9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005ada40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003e045a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005b2900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005b2930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005b2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b29a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005b2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff80003e04000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005b7900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005b7930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005b7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b79a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005b7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff80003e055a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005bc900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005bc930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005bc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005bc9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005bca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff80003e05000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005c1900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c1930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005c1970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c19a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005c1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff80003e065a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005c6900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c6930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005c6970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c69a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005c6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff80003e06000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005cb900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005cb930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005cb970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005cb9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005cba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff800041d75a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005d0900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005d0930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005d0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d09a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff800041d7000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005d5900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005d5930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005d5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d59a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff800041d85a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005da900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005da930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005da970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005da9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005daa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff800041d8000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005df900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005df930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005df970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005df9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005dfa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff800041d95a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005e4900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e4930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005e4970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e49a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005e4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff800064475a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006eb7930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eb7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006eb79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eb79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006eb7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006eb7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff80003bc9000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ef2930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ef2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ef29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ef29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006ef2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ef2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ef2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ef2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff80003bca5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ef7930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ef7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ef79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ef79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006ef7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ef7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ef7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ef7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffff80003bca000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006efc930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006efc960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006efc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006efc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006efca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006efca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006efcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006efcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff80003bcb5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006f01900 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f01930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f01970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f019a0 _sleep() at _sleep+0x2da/frame 0xfffffe0006f01a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0006f01a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f01ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f01ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 1663 out of 32621 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db> (kgdb) bt #0 doadump (textdump=0x0) at include/pcpu.h:246 #1 0xffffffff804a1bbb in db_dump (dummy=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #2 0xffffffff804a1989 in db_command (cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #3 0xffffffff804a68c8 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #4 0xffffffff804a1989 in db_command (cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:482 #5 0xffffffff804a1704 in db_command_loop () at ../../../ddb/db_command.c:535 #6 0xffffffff804a48af in db_trap (type=, code=) at ../../../ddb/db_main.c:252 #7 0xffffffff80c1fe6c in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:692 #8 0xffffffff811a1021 in trap (frame=0xfffffe00aac9e6a0) at ../../../amd64/amd64/trap.c:621 #9 0xffffffff81178dbc in calltrap () at ../../../amd64/amd64/exception.S:289 #10 0xffffffff80c1f57b in kdb_enter (why=0xffffffff8134cb49 "panic", msg=) at include/cpufunc.h:65 #11 0xffffffff80bd484a in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:894 #12 0xffffffff80bd45c3 in panic (fmt=) at ../../../kern/kern_shutdown.c:832 #13 0xffffffff80c41d5a in witness_unlock (lock=0xffffffff81e86798, flags=0x80, file=0xfffffe00aac9e660 "", line=0x4c0) at ../../../kern/subr_witness.c:1637 #14 0xffffffff80bb35fd in __mtx_unlock_flags (c=0xffffffff81a45058, opts=0x0, file=, line=) at ../../../kern/kern_mutex.c:278 #15 0xffffffff80f2ac94 in vm_object_madvise (object=0xfffff80224d6f900, pindex=0x233, end=0x234, advice=0x3) at ../../../vm/vm_object.c:1216 #16 0xffffffff80f211ab in vm_map_madvise (map=, start=0x80065d000, end=0x80065e000, behav=0x3) at ../../../vm/vm_map.c:2776 #17 0xffffffff80f27279 in sys_madvise (td=, uap=) at ../../../vm/vm_mmap.c:761 #18 0xffffffff811a1fc6 in amd64_syscall (td=0xfffff8028634f000, traced=0x0) at subr_syscall.c:144 #19 0xffffffff811796e0 in fast_syscall_common () at ../../../amd64/amd64/exception.S:581 #20 0x000000080033c94a in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xffffffff80c41d5a in witness_unlock (lock=0xffffffff81e86798, flags=0x80, file=0xfffffe00aac9e660 "", line=0x4c0) at ../../../kern/subr_witness.c:1637 1637 kassert_panic("lock (%s) %s not locked @ %s:%d", class->lc_name, (kgdb) p *lock $1 = {lo_name = 0xffffffff813116ee "cnputs_mtx", lo_flags = 0x10000, lo_data = 0x0, lo_witness = 0x0} (kgdb) f 14 #14 0xffffffff80bb35fd in __mtx_unlock_flags (c=0xffffffff81a45058, opts=0x0, file=, line=) at ../../../kern/kern_mutex.c:278 278 WITNESS_UNLOCK(&m->lock_object, opts | LOP_EXCLUSIVE, file, line); (kgdb) l 273 KASSERT(m->mtx_lock != MTX_DESTROYED, 274 ("mtx_unlock() of destroyed mutex @ %s:%d", file, line)); 275 KASSERT(LOCK_CLASS(&m->lock_object) == &lock_class_mtx_sleep, 276 ("mtx_unlock() of spin mutex %s @ %s:%d", m->lock_object.lo_name, 277 file, line)); 278 WITNESS_UNLOCK(&m->lock_object, opts | LOP_EXCLUSIVE, file, line); 279 LOCK_LOG_LOCK("UNLOCK", &m->lock_object, opts, m->mtx_recurse, file, 280 line); 281 mtx_assert(m, MA_OWNED); 282 (kgdb) info loc m = (struct mtx *) 0xffffffff81a45040 (kgdb) p *m $2 = {lock_object = {lo_name = 0xffffffff812b325e "vm page", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd6b800}, mtx_lock = 0x0} (kgdb) f 15 #15 0xffffffff80f2ac94 in vm_object_madvise (object=0xfffff80224d6f900, pindex=0x233, end=0x234, advice=0x3) at ../../../vm/vm_object.c:1216 1216 vm_page_unlock(tm); (kgdb) l 1211 * If the page is not in a normal state, skip it. 1212 */ 1213 if (tm->valid != VM_PAGE_BITS_ALL) 1214 goto next_pindex; 1215 if (vm_page_wired(tm)) { 1216 vm_page_unlock(tm); 1217 goto next_pindex; 1218 } 1219 KASSERT((tm->flags & PG_FICTITIOUS) == 0, 1220 ("vm_object_madvise: page %p is fictitious", tm)); (kgdb) -- Test scenario: misc/mmap20.sh