panic: vm_object_madvise: page 0xfffffe0000174cf8 is not managed, vmcoee.112 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #0 r354585M: Sun Nov 10 08:31:25 CET 2019 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 9.0.0 (tags/RELEASE_900/final 372316) (based on LLVM 9.0.0) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33164046336 (31627 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 8 10 11 5 4 9 6 3 2 7 Timecounter "TSC-low" frequency 1750036132 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 module_register_init: MOD_LOAD (vesa, 0xffffffff80fb4450, 0) error 19 000.000055 [4336] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: Using 1024 TX descriptors and 1024 RX descriptors igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 p4tcc0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec ugen2.1: at usbus2 ugen0.1: <0x8086 XHCI root HUB> at usbus0 ugen1.1: at usbus1 uhub0 on usbus2 uhub0: on usbus2 uhub1 on usbus0 uhub1: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 uhub2 on usbus1 uhub2: on usbus1 Expensive timeout(9) function: 0xffffffff804d48e0(0xfffffe00d1352000) 0.004513547 s ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ses0: pass0 in 'Slot 01', SATA Slot: scbus1 target 0 ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 Trying to mount root from ufs:/dev/gpt/work [rw]... WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Expensive timeout(9) function: 0xffffffff80a34990(0xffffffff818e6568) 0.007402022 s WARNING: / was not properly dismounted Interface IP-Address Broadcast uhub0: 2 ports with 2 removable, self powered ugen0.3: at usbus0 ukbd0 on uhub4 ukbd0: on usbus0 kbd2 at ukbd0 . lo0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub4 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192.168.5.1 if_delmulti_locked: detaching ifnet instance 0xfffff80006076000 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 10 Nov 08:38:03 ntpdate[2055]: step time server 192.168.5.1 offset 0.163637 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. Recovering vi editor sessions:. fscklock order reversal: 1st 0xfffff800078947d0 ufs (ufs) @ kern/vfs_mount.c:1603 2nd 0xfffff80007746a48 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1927 stack backtrace: #0 0xffffffff80c30eb1 at witness_debugger+0x71 #1 0xffffffff80c30c21 at witness_checkorder+0xab1 #2 0xffffffff80b96b78 at lockmgr_lock_fast_path+0x178 #3 0xffffffff810dc3b2 at VOP_LOCK1_APV+0x92 #4 0xffffffff80cb1205 at _vn_lock+0x65 #5 0xffffffff80ebe35d at softdep_flushworklist+0x5d #6 0xffffffff80edf2f6 at ffs_sync+0x406 #7 0xffffffff80c9553a at dounmount+0x46a #8 0xffffffff80c9507e at sys_unmount+0x2ae #9 0xffffffff810625d0 at amd64_syscall+0x2d0 #10 0xffffffff810380c0 at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 235 files, 16785 used, 1248622 free (190 frags, 156054 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Sun Nov 10 08:38 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Nov 10 08:38:19 mercat1 login[2338]: ROOT LOGIN (root) ON ttyu1 Last login: Sun Nov 10 04:08:53 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #0 r354585M: Sun Nov 10 08:31:25 CET 2019 root@mercat1:~ # Nov 10 08:38:37 mercat1 su[2354]: pho to root on /dev/pts/0 20191110 08:38:54 all (1/1): stealer.sh swp_pager_getswapspace(32): failed Nov 10 08:39:43 mercat1 kernel: pid 3813 (stealer), jid 0, uid 2007, was killed: out of swap space Nov 10 08:39:45 mercat1 kernel: pid 3809 (stealer), jid 0, uid 2007, was killed: out of swap space Nov 10 08:39:46 mercat1 kernel: pid 3800 (stealer), jid 0, uid 2007, was killed: out of swap space Nov 10 08:39:47 mercat1 kernel: pid 3818 (stealer), jid 0, uid 2007, was killed: out of swap space Nov 10 08:40:00 mercat1 kernel: pid 3693 (stealer), jid 0, uid 2007, was killed: out of swap space Nov 10 08:40:05 mercat1 kernel: pid 3773 (stealer), jid 0, uid 2007, was killed: out of swap space Nov 10 08:41:37 mercat1 kernel: pid 3827 (stealer), jid 0, uid 2007, was killed: out of swap space freework leak: 8/18. 20191110 08:45:20 all.sh done, elapsed 0 day(s), 00:06.26 20191110 08:54:37 all (1/676): 1st.sh 20191110 08:54:38 all (2/676): 256m.sh 20191110 08:54:40 all (3/676): audit.sh 20191110 08:54:41 all (4/676): beneath3.sh 20191110 08:54:44 all (5/676): buildworld.sh 20191110 08:54:46 all (6/676): buildworld2.sh 20191110 08:54:47 all (7/676): cluster.sh 20191110 08:54:48 all (8/676): cpuset.sh 20191110 08:54:50 all (9/676): crossmp2.sh 20191110 08:54:51 all (10/676): crossmp6.sh 20191110 08:54:53 all (11/676): datagram2.sh 20191110 08:54:55 all (12/676): datagram3.sh 20191110 08:54:56 all (13/676): datamove.sh freework leak: 29/42. newblk leak: 6/17. 20191110 08:54:58 all (14/676): datamove3.sh 20191110 08:54:59 all (15/676): devfs2.sh 20191110 08:55:01 all (16/676): devfs5.sh 20191110 08:55:02 all (17/676): dtrace_fault.sh 20191110 08:55:04 all (18/676): dumpfs.sh newblk leak: 295/312. 20191110 08:55:06 all (19/676): dup2.sh 20191110 08:55:07 all (20/676): execi386.sh 20191110 08:55:09 all (21/676): extattr_set_fd.sh 20191110 08:55:11 all (22/676): extattrctl.sh lock order reversal: 1st 0xfffff8000430f438 ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:119 2nd 0xfffff807edf517d0 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1718 stack backtrace: #0 0xffffffff80c30eb1 at witness_debugger+0x71 #1 0xffffffff80c30c21 at witness_checkorder+0xab1 #2 0xffffffff80b9715f at lockmgr_xlock_hard+0x6f #3 0xffffffff80b97ced at __lockmgr_args+0x60d #4 0xffffffff80edc411 at ffs_vgetf+0x161 #5 0xffffffff80eef25b at ufs_root+0x1b #6 0xffffffff80ca2057 at vfs_cache_root_fallback+0x117 #7 0xffffffff80ca1dff at vfs_cache_root+0x1af #8 0xffffffff80ee76bf at ufs_extattr_autostart+0x5f #9 0xffffffff80ede7da at ffs_mount+0x1c6a #10 0xffffffff80c94219 at vfs_domount+0x819 #11 0xffffffff80c92bb1 at vfs_donmount+0x911 #12 0xffffffff80c92269 at sys_nmount+0x69 #13 0xffffffff810625d0 at amd64_syscall+0x2d0 #14 0xffffffff810380c0 at fast_syscall_common+0x101 20191110 08:55:12 all (23/676): fcntl3.sh 20191110 08:55:14 all (24/676): fifo.sh 20191110 08:55:15 all (25/676): forkbomb.sh 20191110 08:55:17 all (26/676): fsck2.sh 20191110 08:55:18 all (27/676): fsck3.sh 20191110 08:55:20 all (28/676): fsck4.sh 20191110 08:55:22 all (29/676): geomleak.sh 20191110 08:55:24 all (30/676): getrandom.sh 20191110 08:55:25 all (31/676): gnop3.sh 20191110 08:55:27 all (32/676): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20191110 08:55:28 all (33/676): holdcnt0.sh 20191110 08:55:30 all (34/676): holdcnt02.sh 20191110 08:55:31 all (35/676): holdcnt03.sh 20191110 08:55:33 all (36/676): holdcnt04.sh 20191110 08:55:34 all (37/676): holdcnt05.sh 20191110 08:55:36 all (38/676): isofs2.sh 20191110 08:55:37 all (39/676): jail.sh 20191110 08:55:39 all (40/676): jail2.sh 20191110 08:55:40 all (41/676): jail3.sh 20191110 08:55:42 all (42/676): jail4.sh 20191110 08:55:43 all (43/676): kern_umtx_inf_loop.sh 20191110 08:55:45 all (44/676): kevent10.sh 20191110 08:55:47 all (45/676): kevent3.sh 20191110 08:55:48 all (46/676): ldt.sh 20191110 08:55:50 all (47/676): ldt2.sh 20191110 08:55:51 all (48/676): libMicro.sh 20191110 08:55:53 all (49/676): linux.sh 20191110 08:55:54 all (50/676): lockd.sh 20191110 08:55:56 all (51/676): lockf.sh 20191110 08:55:57 all (52/676): lookup_shared.sh 20191110 08:55:59 all (53/676): mac.sh 20191110 08:56:00 all (54/676): mac_chkexec.sh 20191110 08:56:02 all (55/676): machipc.sh 20191110 08:56:03 all (56/676): machipc2.sh 20191110 08:56:04 all (57/676): maxmemdom.sh 20191110 08:56:06 all (58/676): maxproc.sh 20191110 08:56:07 all (59/676): md4.sh 20191110 08:56:09 all (60/676): md5.sh 20191110 08:56:11 all (61/676): md6.sh 20191110 08:56:12 all (62/676): mdconfig.sh 20191110 08:56:14 all (63/676): mdconfig3.sh 20191110 08:56:15 all (64/676): memguard4.sh 20191110 08:56:17 all (65/676): mkfifo5.sh 20191110 08:56:18 all (66/676): mkfifo7.sh mount leak: 16/47 20191110 08:56:20 all (67/676): mlockall5.sh 20191110 08:56:21 all (68/676): mmap.sh 20191110 08:56:23 all (69/676): mmap12.sh 20191110 08:56:24 all (70/676): mmap16.sh 20191110 08:56:26 all (71/676): mmap17.sh 20191110 08:56:28 all (72/676): mmap20.sh 20191110 08:56:29 all (73/676): mmap24.sh 20191110 08:56:31 all (74/676): mmap30.sh 20191110 08:56:32 all (75/676): mmap33.sh 20191110 08:56:34 all (76/676): mmap35.sh 20191110 08:56:35 all (77/676): mmap36.sh 20191110 08:56:37 all (78/676): mount.sh 20191110 08:56:38 all (79/676): mountro3.sh newblk leak: 1732/2044. 20191110 08:56:40 all (80/676): mprotect.sh 20191110 08:56:42 all (81/676): msdos2.sh 20191110 08:56:43 all (82/676): msdos3.sh 20191110 08:56:45 all (83/676): msdos7.sh lock order reversal: 1st 0xfffff805c1881558 msdosfs (msdosfs) @ kern/vfs_syscalls.c:3424 2nd 0xfffff80460efd2e0 devfs (devfs) @ fs/msdosfs/msdosfs_vnops.c:853 stack backtrace: #0 0xffffffff80c30eb1 at witness_debugger+0x71 #1 0xffffffff80c30c21 at witness_checkorder+0xab1 #2 0xffffffff80b96b78 at lockmgr_lock_fast_path+0x178 #3 0xffffffff810dc3b2 at VOP_LOCK1_APV+0x92 #4 0xffffffff80cb1205 at _vn_lock+0x65 #5 0xffffffff80a847d9 at msdosfs_fsync+0x49 #6 0xffffffff810db10a at VOP_FSYNC_APV+0xaa #7 0xffffffff80cacd49 at kern_fsync+0x199 #8 0xffffffff810625d0 at amd64_syscall+0x2d0 #9 0xffffffff810380c0 at fast_syscall_common+0x101 20191110 08:56:46 all (84/676): msdos8.sh 20191110 08:56:48 all (85/676): msetdomain.sh 20191110 08:56:50 all (86/676): nanosleep.sh 20191110 08:56:51 all (87/676): nbufkv.sh 20191110 08:56:53 all (88/676): nfs.sh 20191110 08:56:54 all (89/676): nfs12.sh 20191110 08:56:55 all (90/676): nfs14.sh 20191110 08:56:57 all (91/676): nfs15.sh 20191110 08:56:58 all (92/676): nfs15lockd.sh 20191110 08:57:00 all (93/676): nfs15lockd3.sh 20191110 08:57:01 all (94/676): nfs3.sh 20191110 08:57:03 all (95/676): nfs4.sh 20191110 08:57:04 all (96/676): nfs7.sh 20191110 08:57:06 all (97/676): nfs8.sh 20191110 08:57:07 all (98/676): nfs9.sh 20191110 08:57:09 all (99/676): nfs_halfpage.sh 20191110 08:57:10 all (100/676): nfs_halfpage2.sh 20191110 08:57:12 all (101/676): nfsdelegation.sh 20191110 08:57:13 all (102/676): nfsdepth.sh 20191110 08:57:15 all (103/676): nfsrename.sh 20191110 08:57:16 all (104/676): nfssillyrename.sh 20191110 08:57:18 all (105/676): nullfs13.sh 20191110 08:57:19 all (106/676): nullfs14.sh 20191110 08:57:21 all (107/676): nullfs15.sh 20191110 08:57:22 all (108/676): nullfs21.sh 20191110 08:57:24 all (109/676): nullfs23.sh 20191110 08:57:25 all (110/676): nullfs4.sh 20191110 08:57:27 all (111/676): nullfs6.sh 20191110 08:57:28 all (112/676): nullfs7.sh 20191110 08:57:30 all (113/676): nullfs9.sh 20191110 08:57:31 all (114/676): numa.sh 20191110 08:57:33 all (115/676): oom.sh 20191110 08:57:34 all (116/676): open.sh 20191110 08:57:36 all (117/676): pagefault.sh 20191110 08:57:37 all (118/676): parallelmount2.sh 20191110 08:57:39 all (119/676): pathconf.sh 20191110 08:57:40 all (120/676): pathconf2.sh 20191110 08:57:42 all (121/676): pcatch.sh 20191110 08:57:43 all (122/676): pcatch2.sh 20191110 08:57:45 all (123/676): ping.sh 20191110 08:57:46 all (124/676): pkru.sh 20191110 08:57:48 all (125/676): pkru2.sh 20191110 08:57:49 all (126/676): pmc4.sh 20191110 08:57:51 all (127/676): pmc5.sh 20191110 08:57:52 all (128/676): poll.sh 20191110 08:57:54 all (129/676): posix_fadvise.sh 20191110 08:57:55 all (130/676): posix_fadvise2.sh 20191110 08:57:57 all (131/676): procfs5.sh 20191110 08:57:58 all (132/676): procfs6.sh 20191110 08:58:00 all (133/676): procstat.sh 20191110 08:58:01 all (134/676): pthread9.sh 20191110 08:58:03 all (135/676): ptrace.sh 20191110 08:58:04 all (136/676): ptrace3.sh 20191110 08:58:06 all (137/676): pts2.sh 20191110 08:58:08 all (138/676): quota5.sh 20191110 08:58:09 all (139/676): rename13.sh 20191110 08:58:11 all (140/676): rename4.sh 20191110 08:58:12 all (141/676): revoke.sh 20191110 08:58:14 all (142/676): routetbl.sh 20191110 08:58:15 all (143/676): ruby.sh 20191110 08:58:17 all (144/676): rwlock_ronly.sh 20191110 08:58:18 all (145/676): schedfuzz.sh 20191110 08:58:20 all (146/676): seekdir.sh 20191110 08:58:21 all (147/676): segnp.sh 20191110 08:58:23 all (148/676): segregs.sh 20191110 08:58:25 all (149/676): select3.sh 20191110 08:58:26 all (150/676): sendfile2.sh lock order reversal: 1st 0xfffff804600958e0 filedesc structure (filedesc structure) @ kern/sys_generic.c:1516 2nd 0xfffff806313f9cc0 ufs (ufs) @ kern/vfs_vnops.c:1551 stack backtrace: #0 0xffffffff80c30eb1 at witness_debugger+0x71 #1 0xffffffff80c30c21 at witness_checkorder+0xab1 #2 0xffffffff80b9715f at lockmgr_xlock_hard+0x6f #3 0xffffffff80b97ced at __lockmgr_args+0x60d #4 0xffffffff80ee0b3c at ffs_lock+0x7c #5 0xffffffff810dc3b2 at VOP_LOCK1_APV+0x92 #6 0xffffffff80cb1205 at _vn_lock+0x65 #7 0xffffffff80cafcba at vn_poll+0x3a #8 0xffffffff80c37379 at kern_poll+0x419 #9 0xffffffff80c36f50 at sys_poll+0x50 #10 0xffffffff810625d0 at amd64_syscall+0x2d0 #11 0xffffffff810380c0 at fast_syscall_common+0x101 20191110 08:58:28 all (151/676): sendfile4.sh 20191110 08:58:29 all (152/676): sendfile6.sh 20191110 08:58:31 all (153/676): setuid.sh 20191110 08:58:33 all (154/676): shm_super.sh 20191110 08:58:35 all (155/676): sigaltstack.sh 20191110 08:58:36 all (156/676): sigreturn.sh 20191110 08:58:38 all (157/676): sigstop.sh 20191110 08:58:39 all (158/676): snap.sh lock order reversal: 1st 0xfffffe0038441ea0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:283 2nd 0xfffff803b7f31830 snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2326 stack backtrace: #0 0xffffffff80c30eb1 at witness_debugger+0x71 #1 0xffffffff80c30c21 at witness_checkorder+0xab1 #2 0xffffffff80b9715f at lockmgr_xlock_hard+0x6f #3 0xffffffff80b97ced at __lockmgr_args+0x60d #4 0xffffffff80ebd3e6 at ffs_copyonwrite+0x166 #5 0xffffffff80edfbcc at ffs_geom_strategy+0x8c #6 0xffffffff80ef3433 at ufs_strategy+0x83 #7 0xffffffff810dc7c2 at VOP_STRATEGY_APV+0xb2 #8 0xffffffff80c78774 at bufstrategy+0x44 #9 0xffffffff80c7860a at bufwrite+0x24a #10 0xffffffff80ee19dd at ffs_syncvnode+0x2bd #11 0xffffffff80ee09e2 at ffs_fsync+0x22 #12 0xffffffff810db10a at VOP_FSYNC_APV+0xaa #13 0xffffffff80ef105f at ufs_remove+0xdf #14 0xffffffff810db29e at VOP_REMOVE_APV+0xce #15 0xffffffff80ca9a01 at kern_funlinkat+0x2c1 #16 0xffffffff80ca9738 at sys_unlink+0x28 #17 0xffffffff810625d0 at amd64_syscall+0x2d0 lock order reversal: 1st 0xfffff803b7f31830 snaplk (snaplk) @ kern/vfs_subr.c:3053 2nd 0xfffff803ab0da2e0 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1649 stack backtrace: #0 0xffffffff80c30eb1 at witness_debugger+0x71 #1 0xffffffff80c30c21 at witness_checkorder+0xab1 #2 0xffffffff80b9715f at lockmgr_xlock_hard+0x6f #3 0xffffffff80b97ced at __lockmgr_args+0x60d #4 0xffffffff80ebb93d at ffs_snapremove+0xed #5 0xffffffff80eb5f1e at ffs_truncate+0x26e #6 0xffffffff80ee948c at ufs_inactive+0x1cc #7 0xffffffff810dbf9a at VOP_INACTIVE_APV+0xaa #8 0xffffffff80c9e314 at vinactive+0xf4 #9 0xffffffff80c9e980 at vputx+0x330 #10 0xffffffff80ca9a59 at kern_funlinkat+0x319 #11 0xffffffff80ca9738 at sys_unlink+0x28 #12 0xffffffff810625d0 at amd64_syscall+0x2d0 #13 0xffffffff810380c0 at fast_syscall_common+0x101 20191110 08:58:41 all (159/676): snap12.sh 20191110 08:58:43 all (160/676): snap2-1.sh 20191110 08:58:45 all (161/676): snap2.sh 20191110 08:58:46 all (162/676): sndstat.sh 20191110 08:58:48 all (163/676): socketpair.sh 20191110 08:58:49 all (164/676): socketpair2.sh 20191110 08:58:51 all (165/676): suj2.sh 20191110 08:58:52 all (166/676): suj32.sh 20191110 08:58:54 all (167/676): suj35.sh Nov 10 08:58:55 mercat1 kernel: pid 23210 (mkdir), uid 0 inumber 255 on /mnt: out of inodes 20191110 08:58:56 all (168/676): suj7.sh Failed to find journal. Use tunefs to create one Failed to start journal: 2 20191110 08:58:57 all (169/676): suj8.sh Nov 10 08:58:58 mercat1 kernel: pid 23457 (dd), uid 0 inumber 4 on /mnt: filesystem full Nov 10 08:58:59 mercat1 kernel: pid 23473 (dd), uid 0 inumber 5 on /mnt: filesystem full 20191110 08:58:59 all (170/676): tar.sh 20191110 08:59:00 all (171/676): temp.sh 20191110 08:59:02 all (172/676): tmpfs15.sh 20191110 08:59:03 all (173/676): tmpfs4.sh 20191110 08:59:05 all (174/676): tmpfs6.sh 20191110 08:59:07 all (175/676): tmpfs7.sh 20191110 08:59:09 all (176/676): trim5.sh 20191110 08:59:10 all (177/676): trim6.sh 20191110 08:59:12 all (178/676): trim7.sh 20191110 08:59:14 all (179/676): trim8.sh 20191110 08:59:15 all (180/676): truncate4.sh 20191110 08:59:17 all (181/676): truncate6.sh 20191110 08:59:18 all (182/676): tvnlru.sh 20191110 08:59:20 all (183/676): ufssuspend.sh 20191110 08:59:22 all (184/676): uma_zalloc_arg.sh 20191110 08:59:23 all (185/676): unlink.sh 20191110 08:59:25 all (186/676): unload.sh 20191110 08:59:26 all (187/676): unload2.sh 20191110 08:59:28 all (188/676): vfork.sh 20191110 08:59:30 all (189/676): vmio.sh 20191110 08:59:31 all (190/676): watchman.sh 20191110 08:59:33 all (191/676): write.sh 20191110 08:59:34 all (192/676): beneath2.sh 20191110 08:59:36 all (193/676): contigmalloc3.sh 20191110 08:59:41 all (194/676): datagram.sh 20191110 08:59:43 all (195/676): ext2fs3.sh 20191110 08:59:46 all (196/676): extattr.sh 20191110 08:59:49 all (197/676): fpclone2.sh 20191110 08:59:51 all (198/676): isofs.sh 20191110 08:59:53 all (199/676): killpg.sh 20191110 08:59:56 all (200/676): md9.sh 20191110 08:59:58 all (201/676): mmap25.sh 20191110 09:00:01 all (202/676): mmap26.sh 20191110 09:00:04 all (203/676): mmap28.sh Nov 10 09:00:06 mercat1 kernel: Failed to fully fault in a core file segment at VA 0x800e00000 with size 0x356c000 to be written at offset 0x86b000 for process mmap28 20191110 09:00:06 all (204/676): mmap8.sh 20191110 09:00:09 all (205/676): mmap9.sh 20191110 09:00:11 all (206/676): mountro2.sh 20191110 09:00:13 all (207/676): nullfs10.sh 20191110 09:00:15 all (208/676): nullfs12.sh 20191110 09:00:18 all (209/676): nullfs16.sh 20191110 09:00:20 all (210/676): nullfs3.sh 20191110 09:00:23 all (211/676): openlock.sh 20191110 09:00:26 all (212/676): ptrace11.sh 20191110 09:00:28 all (213/676): ptrace8.sh 20191110 09:00:31 all (214/676): quota9.sh lock order reversal: 1st 0xfffff806312a2288 FFS (FFS Lock) @ ufs/ufs/ufs_quota.c:759 2nd 0xfffff80225ad1000 struct mount mtx (struct mount mtx) @ ufs/ufs/ufs_quota.c:765 stack backtrace: #0 0xffffffff80c30eb1 at witness_debugger+0x71 #1 0xffffffff80c30c21 at witness_checkorder+0xab1 #2 0xffffffff80ba2a44 at __mtx_lock_flags+0x94 #3 0xffffffff80eede3d at quotaoff_inchange+0xbd #4 0xffffffff80edc22d at ffs_flushfiles+0x12d #5 0xffffffff80ebe61d at softdep_flushfiles+0xad #6 0xffffffff80ede9e7 at ffs_unmount+0xd7 #7 0xffffffff80c95529 at dounmount+0x459 #8 0xffffffff80c9507e at sys_unmount+0x2ae #9 0xffffffff810625d0 at amd64_syscall+0x2d0 #10 0xffffffff810380c0 at fast_syscall_common+0x101 20191110 09:00:33 all (215/676): random.sh 20191110 09:00:35 all (216/676): rename6.sh 20191110 09:00:38 all (217/676): scp.sh 20191110 09:00:41 all (218/676): sendfile.sh 20191110 09:00:42 all (219/676): snap10.sh 20191110 09:00:45 all (220/676): spin.sh 20191110 09:00:48 all (221/676): trim2.sh 20191110 09:00:50 all (222/676): umtx_suspend.sh 20191110 09:00:52 all (223/676): vm_fault_dontneed.sh 20191110 09:00:55 all (224/676): contigmalloc2.sh 20191110 09:00:57 all (225/676): datamove4.sh 20191110 09:01:00 all (226/676): extattr3.sh 20191110 09:01:04 all (227/676): fcntl.sh 20191110 09:01:07 all (228/676): kevent2.sh 20191110 09:01:10 all (229/676): kevent8.sh 20191110 09:01:15 all (230/676): mlockall7.sh 20191110 09:01:19 all (231/676): mmap23.sh 20191110 09:01:22 all (232/676): mmap4.sh vnode_pager_putpages: I/O error 28 0xfffff804c4935c58: tag ufs, type VREG usecount 0, writecount 0, refcount 3203 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff804600b1840 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff803eedc0000 (pid 53262, mmap4, tid 100331) #0 0xffffffff80b974fa at lockmgr_xlock_hard+0x40a #1 0xffffffff80b97ced at __lockmgr_args+0x60d #2 0xffffffff80ee0b3c at ffs_lock+0x7c #3 0xffffffff810dc3b2 at VOP_LOCK1_APV+0x92 #4 0xffffffff80cb1205 at _vn_lock+0x65 #5 0xffffffff80c9e87c at vputx+0x22c #6 0xffffffff80f097ed at vm_map_process_deferred+0xad #7 0xffffffff80f0f5eb at vm_map_remove+0xeb #8 0xffffffff80f090e5 at vmspace_exit+0xd5 #9 0xffffffff80b7cc52 at exit1+0x5a2 #10 0xffffffff80b7c6ad at sys_sys_exit+0xd #11 0xffffffff810625d0 at amd64_syscall+0x2d0 #12 0xffffffff810380c0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=40ad149e, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: residual I/O 32768 at 9760 0xfffff804c4935c58: tag ufs, type VREG usecount 0, writecount 0, refcount 3203 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff804600b1840 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff803eedc0000 (pid 53262, mmap4, tid 100331) #0 0xffffffff80b974fa at lockmgr_xlock_hard+0x40a #1 0xffffffff80b97ced at __lockmgr_args+0x60d #2 0xffffffff80ee0b3c at ffs_lock+0x7c #3 0xffffffff810dc3b2 at VOP_LOCK1_APV+0x92 #4 0xffffffff80cb1205 at _vn_lock+0x65 #5 0xffffffff80c9e87c at vputx+0x22c #6 0xffffNov 10 09:01:24 ffff80f097ed at vm_map_process_deferred+0xad mercat1 kernel: #7 0xffffffff80f0f5eb at vm_map_remove+0xeb pid 53262 (mmap4#8 0xffffffff80f090e5 at vmspace_exit+0xd5 ), uid 0 inumber#9 0xffffffff80b7cc52 at exit1+0x5a2 4 on /mnt: file#10 0xffffffff80b7c6ad at sys_sys_exit+0xd #system full 11 0xffffffff810625d0 at amd64_syscall+0x2d0 #12 0xffffffff810380c0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=40ad149e, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: zero-length write at 40075264 resid 131072 0xfffff804c4935c58: tag ufs, type VREG usecount 1, writecount 0, refcount 3203 flags (VI_ACTIVE) v_object 0xfffff804600b1840 ref 0 pages 25608 cleanbuf 3201 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8046011d6e0 (pid 53270, umount, tid 100360) #0 0xffffffff80b974fa at lockmgr_xlock_hard+0x40a #1 0xffffffff80b97ced at __lockmgr_args+0x60d #2 0xffffffff80ee0b3c at ffs_lock+0x7c #3 0xffffffff810dc3b2 at VOP_LOCK1_APV+0x92 Nov 10 09:01:25 #4 0xffffffff80cb1205 at _vn_lock+0x65 mercat1 kernel: #5 0xffffffff80c9dd9b at vget_finish+0x8b pid 53270 (umoun#6 0xffffffff80ca02a5 at vfs_msync+0x125 t), uid 0 inumbe#7 0xffffffff80c954a9 at dounmount+0x3d9 r 4 on /mnt: fil#8 0xffffffff80c9507e at sys_unmount+0x2ae esystem full #9 0xffffffff810625d0 at amd64_syscall+0x2d0 #10 0xffffffff810380c0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=40ad149e, uid=0, gid=0, flags=0x0 ino 4, on dev md10a 20191110 09:01:26 all (233/676): msdos9.sh 20191110 09:01:29 all (234/676): newfs5.sh 20191110 09:01:32 all (235/676): procfs2.sh 20191110 09:01:35 all (236/676): pthread.sh 20191110 09:01:38 all (237/676): tmpfs5.sh 20191110 09:01:42 all (238/676): truncate5.sh 20191110 09:01:45 all (239/676): udp.sh 20191110 09:01:49 all (240/676): unix_socket.sh 20191110 09:01:52 all (241/676): dup.sh 20191110 09:01:56 all (242/676): devfd.sh 20191110 09:02:01 all (243/676): mkfifo6.sh 20191110 09:02:06 all (244/676): mmap13.sh 20191110 09:02:10 all (245/676): mountro4.sh 20191110 09:02:15 all (246/676): growfs.sh g_access(997): provider ufsid/5dc7c408a8c4e1e4 has error 6 set g_access(997): provider ufsid/5dc7c408a8c4e1e4 has error 6 set g_access(997): provider ufsid/5dc7c408a8c4e1e4 has error 6 set g_access(997): provider gptid/69635dce-0390-11ea-b843-0cc47aa8cdda has error 6 set g_access(997): provider gptid/69635dce-0390-11ea-b843-0cc47aa8cdda has error 6 set g_access(997): provider gptid/69635dce-0390-11ea-b843-0cc47aa8cdda has error 6 set g_dev_taste: make_dev_p() failed (gp->name=gptid/69635dce-0390-11ea-b843-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/69635dce-0390-11ea-b843-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5dc7c408a8c4e1e4, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/69635dce-0390-11ea-b843-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5dc7c408a8c4e1e4, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/69635dce-0390-11ea-b843-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5dc7c408a8c4e1e4, error=17) GEOM leak: 14/87 20191110 09:02:21 all (247/676): procfs.sh 20191110 09:02:26 all (248/676): pshared.sh 20191110 09:02:32 all (249/676): ptrace2.sh 20191110 09:02:37 all (250/676): rename11.sh 20191110 09:02:42 all (251/676): symlink4.sh 20191110 09:02:48 all (252/676): tmpfs10.sh 20191110 09:02:53 all (253/676): truncate3.sh 20191110 09:02:59 all (254/676): truncate7.sh 20191110 09:03:05 all (255/676): datamove5.sh 20191110 09:03:11 all (256/676): fork.sh 20191110 09:03:18 all (257/676): linger3.sh 20191110 09:03:24 all (258/676): mlockall4.sh 20191110 09:03:31 all (259/676): ptrace9.sh 20191110 09:03:38 all (260/676): sparse.sh 20191110 09:03:47 all (261/676): linger2.sh Nov 10 09:03:50 mercat1 kernel: pid 3383 (linger2), uid 2007 inumber 892 on /mnt: filesystem full 20191110 09:03:54 all (262/676): linger4.sh Nov 10 09:04:00 mercat1 kernel: pid 4687 (linger4), uid 2007 inumber 187523 on /mnt: out of inodes 20191110 09:04:02 all (263/676): symlink2.sh 20191110 09:04:10 all (264/676): sysctl.sh 20191110 09:04:17 all (265/676): md8.sh 20191110 09:04:27 all (266/676): quota11.sh lock order reversal: 1st 0xfffff807b0373a48 syncer (syncer) @ kern/vfs_subr.c:2349 2nd 0xfffff802446a3068 ufs (ufs) @ kern/vfs_subr.c:2778 stack backtrace: #0 0xffffffff80c30eb1 at witness_debugger+0x71 #1 0xffffffff80c30c21 at witness_checkorder+0xab1 #2 0xffffffff80b9715f at lockmgr_xlock_hard+0x6f #3 0xffffffff80b97ced at __lockmgr_args+0x60d #4 0xffffffff80ee0b3c at ffs_lock+0x7c #5 0xffffffff810dc3b2 at VOP_LOCK1_APV+0x92 #6 0xffffffff80cb1205 at _vn_lock+0x65 #7 0xffffffff80c9dd9b at vget_finish+0x8b #8 0xffffffff80eee869 at qsync+0xa9 #9 0xffffffff80edf468 at ffs_sync+0x578 #10 0xffffffff80ca5bfe at sync_fsync+0x11e #11 0xffffffff810db10a at VOP_FSYNC_APV+0xaa #12 0xffffffff80ca3b62 at sched_sync+0x3d2 #13 0xffffffff80b82040 at fork_exit+0x80 #14 0xffffffff810387de at fork_trampoline+0xe 20191110 09:04:36 all (267/676): shm_open.sh 20191110 09:04:51 all (268/676): compare.sh 20191110 09:05:01 all (269/676): ffs_blkfree.sh newblk leak: 26639/28683. 20191110 09:05:11 all (270/676): procfs3.sh 20191110 09:05:16 all (271/676): execve.sh 20191110 09:05:31 all (272/676): thr.sh witness_lock_list_get: witness exhausted 20191110 09:05:41 all (273/676): tmpfs8.sh 20191110 09:05:52 all (274/676): rename8.sh 20191110 09:06:02 all (275/676): fsck5.sh 20191110 09:06:13 all (276/676): nfs15lockd2.sh 20191110 09:06:24 all (277/676): proccontrol.sh 20191110 09:06:35 all (278/676): rdgsbase.sh 20191110 09:06:46 all (279/676): rename9.sh 20191110 09:06:58 all (280/676): umountf4.sh freework leak: 155/197. 20191110 09:07:09 all (281/676): pmc7.sh 20191110 09:07:21 all (282/676): posix_fadvise3.sh 20191110 09:07:33 all (283/676): tmpfs14.sh 20191110 09:07:45 all (284/676): mprotect2.sh 20191110 09:07:58 all (285/676): pipe2.sh panic: vm_object_madvise: page 0xfffffe0000174cf8 is not managed cpuid = 5 time = 1573373297 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d32245c0 vpanic() at vpanic+0x17e/frame 0xfffffe00d3224620 panic() at panic+0x43/frame 0xfffffe00d3224680 vm_object_madvise() at vm_object_madvise+0x42b/frame 0xfffffe00d32246e0 vm_map_madvise() at vm_map_madvise+0x33a/frame 0xfffffe00d3224750 exec_release_args_kva() at exec_release_args_kva+0x33/frame 0xfffffe00d3224780 exec_args_kva_lowmem() at exec_args_kva_lowmem+0x7f/frame 0xfffffe00d32247b0 vm_pageout_worker() at vm_pageout_worker+0x3a0/frame 0xfffffe00d3224b70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe00d3224bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3224bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3224bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: panic [ thread pid 30 tid 100128 ] Stopped at kdb_enter+0x37: movq $0,0x10883c6(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 30 tid 100128 td 0xfffff800075b0000 kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32245c0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3224620 panic() at panic+0x43/frame 0xfffffe00d3224680 vm_object_madvise() at vm_object_madvise+0x42b/frame 0xfffffe00d32246e0 vm_map_madvise() at vm_map_madvise+0x33a/frame 0xfffffe00d3224750 exec_release_args_kva() at exec_release_args_kva+0x33/frame 0xfffffe00d3224780 exec_args_kva_lowmem() at exec_args_kva_lowmem+0x7f/frame 0xfffffe00d32247b0 vm_pageout_worker() at vm_pageout_worker+0x3a0/frame 0xfffffe00d3224b70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe00d3224bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3224bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3224bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 5 cpuid = 0 dynamic pcpu = 0x96c200 curthread = 0xfffff804602376e0: pid 74378 tid 100351 "swap" curpcb = 0xfffff80460237bd0 fpcurthread = 0xfffff804602376e0: pid 74378 "swap" idlethread = 0xfffff800038c7000: tid 100003 "idle: cpu0" curpmap = 0xfffff8043e9cd130 tssp = 0xffffffff81de9ca0 commontssp = 0xffffffff81de9ca0 rsp0 = 0xfffffe00e595dcc0 kcr3 = 0x800000043307a291 ucr3 = 0x800000062f9bea91 scr3 = 0x6ce99ca6f gs32p = 0xffffffff81df04d8 ldt = 0xffffffff81df0518 tss = 0xffffffff81df0508 tlb gen = 1798433 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bc7ec200 curthread = 0xfffff803ab08c6e0: pid 74386 tid 100818 "swap" curpcb = 0xfffff803ab08cbd0 fpcurthread = 0xfffff803ab08c6e0: pid 74386 "swap" idlethread = 0xfffff800038c86e0: tid 100004 "idle: cpu1" curpmap = 0xfffff8001bfe7130 tssp = 0xffffffff81de9d08 commontssp = 0xffffffff81de9d08 rsp0 = 0xfffffe00e6a22cc0 kcr3 = 0x8000000278fb4202 ucr3 = 0x80000007aca02a02 scr3 = 0x63dbe09fc gs32p = 0xffffffff81df0540 ldt = 0xffffffff81df0580 tss = 0xffffffff81df0570 tlb gen = 1798433 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bc7f8200 curthread = 0xfffff804559d26e0: pid 74372 tid 101209 "swap" curpcb = 0xfffff804559d2bd0 fpcurthread = 0xfffff804559d26e0: pid 74372 "swap" idlethread = 0xfffff800038c8000: tid 100005 "idle: cpu2" curpmap = 0xfffff8044fe71130 tssp = 0xffffffff81de9d70 commontssp = 0xffffffff81de9d70 rsp0 = 0xfffffe00e6a3bcc0 kcr3 = 0x80000006ce1816e1 ucr3 = 0x800000062fadcee1 scr3 = 0x63df26ed9 gs32p = 0xffffffff81df05a8 ldt = 0xffffffff81df05e8 tss = 0xffffffff81df05d8 tlb gen = 1798433 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bc804200 curthread = 0xfffff8044f51a000: pid 74385 tid 101055 "swap" curpcb = 0xfffff8044f51a4f0 fpcurthread = 0xfffff8044f51a000: pid 74385 "swap" idlethread = 0xfffff800038b86e0: tid 100006 "idle: cpu3" curpmap = 0xfffff804558a5130 tssp = 0xffffffff81de9dd8 commontssp = 0xffffffff81de9dd8 rsp0 = 0xfffffe00e99bfcc0 kcr3 = 0x800000043384c2e0 ucr3 = 0x800000062f7c4ae0 scr3 = 0x63fc5ead2 gs32p = 0xffffffff81df0610 ldt = 0xffffffff81df0650 tss = 0xffffffff81df0640 tlb gen = 1798433 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bc810200 curthread = 0xfffff807df9ef6e0: pid 74384 tid 101327 "swap" curpcb = 0xfffff807df9efbd0 fpcurthread = 0xfffff807df9ef6e0: pid 74384 "swap" idlethread = 0xfffff800038b8000: tid 100007 "idle: cpu4" curpmap = 0xfffff80454a0e130 tssp = 0xffffffff81de9e40 commontssp = 0xffffffff81de9e40 rsp0 = 0xfffffe00e6b1ccc0 kcr3 = 0x8000000278feb48e ucr3 = 0x800000030e473c8e scr3 = 0x63f8b3c80 gs32p = 0xffffffff81df0678 ldt = 0xffffffff81df06b8 tss = 0xffffffff81df06a8 tlb gen = 1798433 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bc81c200 curthread = 0xfffff800075b0000: pid 30 tid 100128 "dom0" curpcb = 0xfffff800075b04f0 fpcurthread = none idlethread = 0xfffff800038b96e0: tid 100008 "idle: cpu5" curpmap = 0xffffffff81d9ba60 tssp = 0xffffffff81de9ea8 commontssp = 0xffffffff81de9ea8 rsp0 = 0xfffffe00d3224cc0 kcr3 = 0x80000000022fb002 ucr3 = 0xffffffffffffffff scr3 = 0x63d84dbbe gs32p = 0xffffffff81df06e0 ldt = 0xffffffff81df0720 tss = 0xffffffff81df0710 tlb gen = 1790587 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bc828200 curthread = 0xfffff803eed13000: pid 74382 tid 102451 "swap" curpcb = 0xfffff803eed134f0 fpcurthread = 0xfffff803eed13000: pid 74382 "swap" idlethread = 0xfffff800038b9000: tid 100009 "idle: cpu6" curpmap = 0xfffff8046053f130 tssp = 0xffffffff81de9f10 commontssp = 0xffffffff81de9f10 rsp0 = 0xfffffe00e98f2cc0 kcr3 = 0x800000062fac82a8 ucr3 = 0x8000000278b57aa8 scr3 = 0x63d4e0aa6 gs32p = 0xffffffff81df0748 ldt = 0xffffffff81df0788 tss = 0xffffffff81df0778 tlb gen = 1798433 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bc834200 curthread = 0xfffff804503cf000: pid 74373 tid 100754 "swap" curpcb = 0xfffff804503cf4f0 fpcurthread = 0xfffff804503cf000: pid 74373 "swap" idlethread = 0xfffff800038c66e0: tid 100010 "idle: cpu7" curpmap = 0xfffff8043ef25130 tssp = 0xffffffff81de9f78 commontssp = 0xffffffff81de9f78 rsp0 = 0xfffffe00e6c16cc0 kcr3 = 0x80000007abbe45da ucr3 = 0x80000004332abdda scr3 = 0x433a6ddd6 gs32p = 0xffffffff81df07b0 ldt = 0xffffffff81df07f0 tss = 0xffffffff81df07e0 tlb gen = 1798433 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bc840200 curthread = 0xfffff803eee2e6e0: pid 74381 tid 101082 "swap" curpcb = 0xfffff803eee2ebd0 fpcurthread = 0xfffff803eee2e6e0: pid 74381 "swap" idlethread = 0xfffff800038b5000: tid 100011 "idle: cpu8" curpmap = 0xfffff804585c9130 tssp = 0xffffffff81de9fe0 commontssp = 0xffffffff81de9fe0 rsp0 = 0xfffffe00e98decc0 kcr3 = 0x80000006ce4285d7 ucr3 = 0x80000007ac5aedd7 scr3 = 0x6ce125dd4 gs32p = 0xffffffff81df0818 ldt = 0xffffffff81df0858 tss = 0xffffffff81df0848 tlb gen = 1798433 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bc84c200 curthread = 0xfffff806ce0b36e0: pid 74380 tid 101334 "swap" curpcb = 0xfffff806ce0b3bd0 fpcurthread = 0xfffff806ce0b36e0: pid 74380 "swap" idlethread = 0xfffff800038b66e0: tid 100012 "idle: cpu9" curpmap = 0xfffff80454ba8130 tssp = 0xffffffff81dea048 commontssp = 0xffffffff81dea048 rsp0 = 0xfffffe00e9929cc0 kcr3 = 0x800000030e3e61f3 ucr3 = 0x80000004332a89f3 scr3 = 0x278da99e4 gs32p = 0xffffffff81df0880 ldt = 0xffffffff81df08c0 tss = 0xffffffff81df08b0 tlb gen = 1798433 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bc858200 curthread = 0xfffff80278ba26e0: pid 74374 tid 101400 "swap" curpcb = 0xfffff80278ba2bd0 fpcurthread = 0xfffff80278ba26e0: pid 74374 "swap" idlethread = 0xfffff800038b6000: tid 100013 "idle: cpu10" curpmap = 0xfffff8044e58c130 tssp = 0xffffffff81dea0b0 commontssp = 0xffffffff81dea0b0 rsp0 = 0xfffffe00e5881cc0 kcr3 = 0x80000002781b41dd ucr3 = 0x80000007acbe39dd scr3 = 0x43390f9d0 gs32p = 0xffffffff81df08e8 ldt = 0xffffffff81df0928 tss = 0xffffffff81df0918 tlb gen = 1798433 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bc864200 curthread = 0xfffff8044edb8000: pid 74376 tid 100513 "swap" curpcb = 0xfffff8044edb84f0 fpcurthread = 0xfffff8044edb8000: pid 74376 "swap" idlethread = 0xfffff800038b76e0: tid 100014 "idle: cpu11" curpmap = 0xfffff8045849a130 tssp = 0xffffffff81dea118 commontssp = 0xffffffff81dea118 rsp0 = 0xfffffe00e99ddcc0 kcr3 = 0x8000000278eaf63e ucr3 = 0x80000007ac988e3e scr3 = 0x62f950e09 gs32p = 0xffffffff81df0950 ldt = 0xffffffff81df0990 tss = 0xffffffff81df0980 tlb gen = 1798433 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show mount 0xfffff80007896000 /dev/gpt/work on / (ufs) 0xfffff80007895000 devfs on /dev (devfs) 0xfffff8002f06d000 /dev/gpt/tmp on /tmp (ufs) 0xfffff803ee6cd000 procfs on /proc (procfs) More info: show mount db:1:pho1> show bufqueues bqempty: 48696 Buf domain 0 freebufs 13532 lofreebufs 219 hifreebufs 329 bufspace 12247040 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1480 (11685888) dirtyq count 0 (0) wakeup 0 lim 25 CPU 2, 10, 15, 13, 5, 17, 13, 1, 16, 15, 0, 14, Locked buffers: 0 space 0 Total buffers: 6367 space 12247040 Buf domain 1 freebufs 13345 lofreebufs 219 hifreebufs 329 bufspace 22454272 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 40 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1710 (20041728) dirtyq count 40 (1310720) wakeup 0 lim 25 CPU 6, 1, 0, 6, 2, 6, 0, 2, 1, 0, 4, 10, Locked buffers: 0 space 0 Total buffers: 19047 space 22454272 Buf domain 2 freebufs 15047 lofreebufs 219 hifreebufs 329 bufspace 2252800 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 10 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 29 (790528) dirtyq count 10 (290816) wakeup 0 lim 25 CPU 0, 2, 0, 5, 9, 6, 0, 4, 0, 0, 7, 13, Locked buffers: 1 space 32768 Total buffers: 5249 space 2252800 Buf domain 3 freebufs 14901 lofreebufs 219 hifreebufs 329 bufspace 4018176 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 151 (2834432) dirtyq count 1 (32768) wakeup 0 lim 25 CPU 2, 15, 0, 16, 0, 23, 8, 7, 0, 0, 0, 9, Locked buffers: 0 space 0 Total buffers: 6553 space 4018176 Buf domain 4 freebufs 15012 lofreebufs 219 hifreebufs 329 bufspace 3260416 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 77 (2437120) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 1, 17, 2, 7, 0, 1, 5, 0, 0, 5, 6, Locked buffers: 0 space 0 Total buffers: 12352 space 3260416 Buf domain 5 freebufs 15066 lofreebufs 219 hifreebufs 329 bufspace 331776 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 48 (200704) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 0, 0, 0, 4, 1, 0, 0, 10, 0, 0, 1, 2, Locked buffers: 0 space 0 Total buffers: 11414 space 331776 Buf domain 6 freebufs 12543 lofreebufs 219 hifreebufs 329 bufspace 49455104 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 3 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2553 (48840704) dirtyq count 3 (98304) wakeup 0 lim 25 CPU 3, 8, 0, 3, 0, 2, 6, 0, 0, 0, 12, 0, Locked buffers: 0 space 0 Total buffers: 7884 space 49455104 db:1:pho1> show page vm_cnt.v_free_count: 30884 vm_cnt.v_inactive_count: 42408 vm_cnt.v_active_count: 7449987 vm_cnt.v_laundry_count: 0 vm_cnt.v_wire_count: 593504 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51263 vm_cnt.v_free_target: 173120 vm_cnt.v_inactive_target: 259680 db:1:pho1> show pageq pq_free 30884 dom 0 page_cnt 8124058 free 30884 pq_act 7449987 pq_inact 42408 pq_laund 0 pq_unsw 8503 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000001 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000001 | 000000 00 (000004K) | 000000 | 000000 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree 1024 1024 8 500112 500094 0 13 512122880 0 VNODE 632 90119 235801 2087673 0 162 205981440 0 VM OBJECT 264 15867 498603 5479025 0 64 135820080 0 512 512 23 262575 2722871 0 45 134450176 0 256 256 156 500694 500818 0 61 128217600 0 FFS2 dinode 256 89347 234293 911444 0 84 82851840 0 RADIX NODE 144 514634 23038 10745807 0 253 77424768 0 FFS inode 160 89347 234413 911480 0 81 51801600 0 256 256 15 153780 1210696 0 61 39371520 0 64 64 227 502964 500375 0 253 32204224 0 mbuf_cluster 2048 15486 30 18608 0 5 31776768 0 128 128 492 236906 2626873 0 126 30386944 0 MAP ENTRY 112 2214 265606 31512374 0 171 29995840 0 256 Bucket 2048 8771 4056 287340 0 253 26269696 0 128 128 16 136570 907019 0 126 17483008 0 UMA Slabs 112 152872 33 160979 0 0 17125360 0 4096 4096 105 3977 371508 0 4 16719872 0 BUF TRIE 144 432 105516 668601 0 62 15256512 0 THREAD 1760 4178 3356 281441 0 15 13259840 0 S VFS Cache 108 114390 3210 3162039 0 127 12700800 0 128 Bucket 1024 8501 2591 78124 0 127 11358208 0 2048 2048 6 5222 518113 0 39 10706944 0 64 Bucket 512 15923 1528 80228 0 35 8934912 0 8192 8192 88 1002 3160 0 2 8929280 0 PROC 1328 95 3997 279499 0 9 5434176 0 16 Bucket 128 40410 1811 122232 0 125 5404288 0 mbuf 256 15571 4739 137853 0 253 5199360 0 16 16 7 294809 1914737 0 253 4717056 0 256 256 41 17329 138540 0 61 4446720 0 128 128 377 34188 857467 0 125 4424320 0 vmem btag 56 27285 43205 113531 0 253 3947440 0 VMSPACE 2552 63 1051 279306 0 6 2842928 0 socket 904 49 2987 6313 0 13 2744544 0 32 Bucket 256 1432 8887 82965 0 61 2641664 0 16 16 274 163319 699938 0 253 2617488 0 4096 4096 55 530 24661 0 1 2396160 0 32 32 367 72669 90301 0 253 2337152 0 512 512 4156 163 10026 0 30 2211328 0 128 128 15731 792 21617 0 125 2114944 0 128 128 14334 1507 925478 0 125 2027648 0 256 256 681 6489 647251 0 61 1835520 0 4096 4096 348 54 270841 0 2 1646592 0 DIRHASH 1024 488 892 12393 0 13 1413120 0 pipe 760 122 1723 491249 0 18 1402200 0 256 256 39 5436 240768 0 66 1401600 0 filedesc0 1104 96 1098 279500 0 10 1318176 0 64 64 653 18753 138710 0 253 1241984 0 swblk 136 0 8729 8697 0 61 1187144 0 32768 32768 13 22 9129 0 1 1146880 0 TURNSTILE 136 7535 405 7535 0 61 1079840 0 65536 65536 3 13 1521 0 1 1048576 0 32768 32768 10 22 205 0 2 1048576 0 mbuf_packet 256 14 4036 77999 0 253 1036800 0 g_bio 408 0 2484 2713499 0 73 1013472 0 64 64 8712 5920 407377 0 253 936448 0 65536 65536 1 13 91 0 1 917504 0 pbuf 984 0 848 0 0 1 834432 0 64 64 9308 3092 3246051 0 253 793600 0 SLEEPQUEUE 88 7535 835 7535 0 125 736560 0 65536 65536 0 10 39 0 1 655360 0 32768 32768 1 19 6255 0 1 655360 0 16384 16384 36 0 36 0 1 589824 0 32768 32768 12 5 17 0 1 557056 0 ksiginfo 112 4036 689 115418 0 125 529200 0 16384 16384 9 20 170 0 1 475136 0 Files 80 235 5694 5624070 0 142 474320 0 128 128 2193 1496 306948 0 125 472192 0 8192 8192 11 46 3307 0 1 466944 0 1024 1024 215 233 1220820 0 13 458752 0 64 64 138 6868 42021 0 253 448384 0 NAMEI 1024 0 420 18927984 0 16 430080 0 64 64 161 5667 293590 0 253 372992 0 Mountpoints 3008 4 116 3668 0 3 360960 0 2048 2048 96 78 1062 0 5 356352 0 256 256 32 1288 66083 0 61 337920 0 65536 65536 1 4 5 0 1 327680 0 65536 65536 5 0 5 0 1 327680 0 8192 8192 19 20 2125 0 1 319488 0 unpcb 256 17 1168 5923 0 61 303360 0 8 Bucket 64 2280 2431 76252 0 253 301504 0 512 512 151 437 1219789 0 29 301056 0 8192 8192 0 36 39606 0 1 294912 0 256 256 396 744 6932 0 61 291840 0 128 128 622 1517 12325 0 125 273792 0 2048 2048 20 110 226278 0 5 266240 0 16384 16384 1 14 424 0 1 245760 0 ttyoutq 256 173 742 2762 0 61 234240 0 KNOTE 160 0 1440 368098 0 64 230400 0 64 64 550 3046 158260 0 253 230144 0 32768 32768 1 6 12 0 1 229376 0 1024 1024 28 196 21303 0 13 229376 0 4 Bucket 32 2125 4943 225012 0 253 226176 0 512 512 52 382 1704 0 29 222208 0 256 256 60 795 855059 0 61 218880 0 selfd 64 292 3118 449503 0 253 218240 0 1024 1024 2 210 7003 0 13 217088 0 128 128 173 1501 3905 0 125 214272 0 16384 16384 13 0 2842 0 1 212992 0 512 512 153 260 526 0 29 211456 0 6 Bucket 48 111 4288 42353 0 253 211152 0 32 32 3211 3361 9205 0 253 210304 0 512 512 0 406 87766 0 29 207872 0 65536 65536 0 3 12 0 1 196608 0 65536 65536 3 0 2158 0 1 196608 0 4096 4096 14 31 1907 0 1 184320 0 512 512 3 354 834 0 29 182784 0 12 Bucket 96 581 1305 16100 0 125 181056 0 udp_inpcb 488 20 348 294 0 29 179584 0 UMA Zones 1968 86 3 124 0 0 175152 0 32 32 745 4711 765318 0 253 174592 0 ttyinq 160 330 750 5190 0 61 172800 0 1024 1024 6 158 820 0 13 167936 0 1024 1024 6 158 99 0 13 167936 0 32768 32768 0 5 15 0 1 163840 0 tcp_inpcb 488 9 319 65 0 29 160064 0 2048 2048 2 76 7695 0 5 159744 0 fakepg 104 0 1520 1513 0 125 158080 0 512 512 13 295 105 0 29 157696 0 tcpcb 976 9 143 65 0 13 148352 0 16384 16384 2 7 233 0 1 147456 0 4096 4096 17 19 1621 0 1 147456 0 4096 4096 0 35 3810 0 1 143360 0 mt_stats_zone 64 429 1811 512 0 253 143360 0 1024 1024 5 131 79 0 13 139264 0 65536 65536 2 0 2 0 1 131072 0 L VFS Cache 328 352 44 352 0 29 129888 0 rl_entry 40 974 2194 974 0 253 126720 0 clpbuf 984 0 128 64065 21120 5 125952 0 swpctrie 144 0 864 820 0 61 124416 0 32 32 279 3565 133419 0 253 123008 0 32 32 593 3127 30856 0 253 119040 0 64 64 26 1772 702 0 253 115072 0 16384 16384 0 7 64 0 1 114688 0 tcptw 88 0 1260 17 0 125 110880 0 16 16 2827 3647 55541 0 253 103584 0 32 32 129 3095 50389 0 253 103168 0 KMAP ENTRY 112 18 889 163 0 125 101584 0 32 32 31 3069 29847 0 253 99200 0 syncache 168 0 552 18 0 61 92736 0 udpcb 32 20 2832 294 0 253 91264 0 32 32 87 2765 291 0 253 91264 0 2048 2048 1 41 22 0 5 86016 0 ripcb 488 1 175 15 0 29 85888 0 FFS1 dinode 128 0 651 11 0 125 83328 0 8192 8192 1 9 216 0 1 81920 0 8192 8192 10 0 1670 0 1 81920 0 rentr 24 0 3154 3552 0 253 75696 0 VNODEPOLL 120 0 627 7 0 126 75240 0 procdesc 136 1 550 34 0 61 74936 0 mbuf_jumbo_page 4096 0 15 319 0 3 61440 0 16 16 471 3264 892189 0 253 59760 0 mt_zone 24 429 1895 512 0 253 55776 0 umtx_shm 88 0 630 35 0 125 55440 0 4096 4096 3 10 500069 0 1 53248 0 16 16 20 3217 226011 0 253 51792 0 16 16 61 3176 281 0 253 51792 0 16384 16384 1 2 3 0 1 49152 0 16384 16384 1 2 3 0 1 49152 0 8192 8192 5 1 6 0 1 49152 0 1024 1024 19 29 21 0 13 49152 0 16 16 296 2443 20732 0 253 43824 0 64 pcpu 8 3085 2291 3572 0 253 43008 0 16 16 87 2403 123 0 253 39840 0 32768 32768 1 0 1 0 1 32768 0 cpuset 104 27 252 27 0 125 29016 0 2048 2048 4 10 5640 0 5 28672 0 rtentry 208 12 121 15 0 61 27664 0 umtx pi 96 0 287 2 0 125 27552 0 mdpbuf 984 0 22 36999 0 1 21648 0 UMA Kegs 216 75 3 113 0 0 16848 0 4096 4096 2 2 8 0 1 16384 0 2048 2048 3 5 5 0 5 16384 0 hostcache 96 1 163 1 0 125 15744 0 MAP 232 2 65 2 0 61 15544 0 vnpbuf 984 0 13 2484 0 13 12792 0 int pcpu 4 480 2592 480 0 253 12288 0 8192 8192 0 1 2 0 1 8192 0 2048 2048 3 1 501 0 5 8192 0 epoch_record pcpu 256 4 12 4 0 61 4096 0 UMA Hash 256 0 10 8 0 0 2560 0 vmem 1856 0 1 0 0 5 1856 0 udplite_inpcb 488 0 0 0 0 29 0 0 sctp_asconf_ack 48 0 0 0 0 253 0 0 sctp_asconf 40 0 0 0 0 253 0 0 sctp_stream_msg_out 112 0 0 0 0 125 0 0 sctp_readq 152 0 0 0 0 61 0 0 sctp_chunk 152 0 0 0 0 61 0 0 sctp_raddr 736 0 0 0 0 13 0 0 sctp_laddr 48 0 0 4 0 253 0 0 sctp_asoc 2408 0 0 0 0 3 0 0 sctp_ep 1280 0 0 0 0 9 0 0 tcp_log_node 120 0 0 0 0 125 0 0 tcp_log_bucket 144 0 0 0 0 61 0 0 tcp_log 408 0 0 0 0 29 0 0 tcpreass 48 0 0 0 0 253 0 0 tfo_ccache_entries 80 0 0 0 0 125 0 0 tfo 4 0 0 0 0 253 0 0 sackhole 32 0 0 0 0 253 0 0 ipq 56 0 0 0 0 253 0 0 IPsec SA lft_c 16 0 0 0 0 253 0 0 itimer 352 0 0 0 0 29 0 0 AIOLIO 280 0 0 0 0 29 0 0 AIOCB 752 0 0 0 0 13 0 0 AIOP 32 0 0 0 0 253 0 0 AIO 208 0 0 0 0 61 0 0 NCLNODE 744 0 0 0 0 13 0 0 LTS VFS Cache 368 0 0 0 0 29 0 0 STS VFS Cache 148 0 0 0 0 61 0 0 vtnet_tx_hdr 24 0 0 0 0 253 0 0 crypto_session 24 0 0 0 0 253 0 0 cryptodesc 120 0 0 0 0 125 0 0 cryptop 128 0 0 0 0 125 0 0 nvme_request 128 0 0 0 0 125 0 0 DMAR_MAP_ENTRY 120 0 0 0 0 125 0 0 FPU_save_area 832 0 0 0 0 13 0 0 mbuf_extpgs 256 0 0 0 0 61 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 audit_record 1280 0 0 0 0 9 0 0 domainset 40 0 0 0 0 253 0 0 MAC labels 40 0 0 0 0 253 0 0 nfspbuf 984 0 0 0 0 5 0 0 swwbuf 984 0 0 4947 0 1 0 0 swrbuf 984 0 0 5478 0 5 0 0 rangeset pctrie nodes 144 0 0 0 0 61 0 0 32768 32768 0 0 2324 0 1 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 kstack_cache 16384 4051 0 281314 1 vm pgcache 104 465258 1154 8427605 253 vm pgcache 104 351655 1516 25026570 253 buf free cache 984 6485 50750 1131848 19 buffer arena-65 65536 0 9 249 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 2958 5771 262009 5 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 3 58 94427 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 1 db:0:pho> acttrace Tracing command swap pid 74386 tid 100818 td 0xfffff803ab08c6e0 (CPU 1) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e173dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e173df0 trap() at trap+0x44/frame 0xfffffe003e173f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e173f20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74385 tid 101055 td 0xfffff8044f51a000 (CPU 3) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e18bdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e18bdf0 trap() at trap+0x44/frame 0xfffffe003e18bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e18bf20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74384 tid 101327 td 0xfffff807df9ef6e0 (CPU 4) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e197dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e197df0 trap() at trap+0x44/frame 0xfffffe003e197f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e197f20 --- trap 0x13, rip = 0x203689, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74382 tid 102451 td 0xfffff803eed13000 (CPU 6) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1afdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1afdf0 trap() at trap+0x44/frame 0xfffffe003e1aff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1aff20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74381 tid 101082 td 0xfffff803eee2e6e0 (CPU 8) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1c7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1c7df0 trap() at trap+0x44/frame 0xfffffe003e1c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c7f20 --- trap 0x13, rip = 0x203689, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74380 tid 101334 td 0xfffff806ce0b36e0 (CPU 9) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1d3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1d3df0 trap() at trap+0x44/frame 0xfffffe003e1d3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d3f20 --- trap 0x13, rip = 0x203689, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74378 tid 100351 td 0xfffff804602376e0 (CPU 0) cpustop_handler() at cpustop_handler+0x2a/frame 0xffffffff81d845f0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffffff81d84610 trap() at trap+0x44/frame 0xffffffff81d84740 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d84740 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74376 tid 100513 td 0xfffff8044edb8000 (CPU 11) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1ebdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1ebdf0 trap() at trap+0x44/frame 0xfffffe003e1ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ebf20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74374 tid 101400 td 0xfffff80278ba26e0 (CPU 10) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1dfdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1dfdf0 trap() at trap+0x44/frame 0xfffffe003e1dff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1dff20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74373 tid 100754 td 0xfffff804503cf000 (CPU 7) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1bbdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1bbdf0 trap() at trap+0x44/frame 0xfffffe003e1bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1bbf20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74372 tid 101209 td 0xfffff804559d26e0 (CPU 2) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e17fdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e17fdf0 trap() at trap+0x44/frame 0xfffffe003e17ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17ff20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff800075b0000 (CPU 5) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32245c0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3224620 panic() at panic+0x43/frame 0xfffffe00d3224680 vm_object_madvise() at vm_object_madvise+0x42b/frame 0xfffffe00d32246e0 vm_map_madvise() at vm_map_madvise+0x33a/frame 0xfffffe00d3224750 exec_release_args_kva() at exec_release_args_kva+0x33/frame 0xfffffe00d3224780 exec_args_kva_lowmem() at exec_args_kva_lowmem+0x7f/frame 0xfffffe00d32247b0 vm_pageout_worker() at vm_pageout_worker+0x3a0/frame 0xfffffe00d3224b70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe00d3224bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3224bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3224bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 79638 1 75524 2007 D+ pfault 0xffffffff81847ec0 pipe2 75524 75523 75524 2007 S+ nanslp 0xffffffff81c7feb5 pipe2 75523 74356 62289 0 S+ wait 0xfffff8044f6c0530 su 75520 2492 2434 0 D pfault 0xffffffff81847ec0 sleep 74389 74371 74369 0 D pfault 0xffffffff81847ec0 swap 74388 74371 74369 0 D pfault 0xffffffff81847ec0 swap 74387 74371 74369 0 D pfault 0xffffffff81847ec0 swap 74386 74371 74369 0 R CPU 1 swap 74385 74371 74369 0 R CPU 3 swap 74384 74371 74369 0 R CPU 4 swap 74383 74371 74369 0 D pfault 0xffffffff81847ec0 swap 74382 74371 74369 0 R CPU 6 swap 74381 74371 74369 0 R CPU 8 swap 74380 74371 74369 0 R CPU 9 swap 74379 74371 74369 0 D pfault 0xffffffff81847ec0 swap 74378 74371 74369 0 R CPU 0 swap 74377 74371 74369 0 D pfault 0xffffffff81847ec0 swap 74376 74371 74369 0 R CPU 11 swap 74375 74371 74369 0 D pfault 0xffffffff81847ec0 swap 74374 74371 74369 0 R CPU 10 swap 74373 74371 74369 0 R CPU 7 swap 74372 74371 74369 0 R CPU 2 swap 74371 74369 74369 0 S wait 0xfffff804580f1a60 swap 74369 1 74369 0 Ss nanslp 0xffffffff81c7feb2 swap 74356 74354 62289 0 S+ wait 0xfffff8001b66ca60 sh 74355 62289 62289 0 S+ piperd 0xfffff80208ac4be0 tee 74354 62289 62289 0 S+ wait 0xfffff8045a045000 sh 62289 2356 62289 0 S+ wait 0xfffff800060a7530 sh 2495 2434 2434 0 S piperd 0xfffff800076568e8 sh 2493 2434 2434 0 S piperd 0xfffff80007656be0 awk 2492 2434 2434 0 S wait 0xfffff800038ca000 sh 2434 1 2434 0 Ss wait 0xfffff80006452a60 sh 2356 2354 2356 0 S+ select 0xfffff80003fe5340 bash 2354 2353 2354 0 S+ pause 0xfffff8038cbcd5d8 csh 2353 2347 2353 2006 S+ wait 0xfffff8038cbcda60 su 2347 2346 2347 2006 Ss+ wait 0xfffff80003fae000 bash 2346 2343 2343 2006 S select 0xfffff80003d60440 sshd 2343 2279 2343 0 Ss select 0xfffff80003f2b240 sshd 2339 2338 2339 0 S+ ttyin 0xfffff800065dc8b0 csh 2338 1 2338 0 Ss+ wait 0xfffff8038cbcc000 login 2337 1 2337 0 Ss+ ttyin 0xfffff800065f3cb0 getty 2336 1 2336 0 Ss+ ttyin 0xfffff8000778d0b0 getty 2335 1 2335 0 Ss+ ttyin 0xfffff800077bb0b0 getty 2334 1 2334 0 Ss+ ttyin 0xfffff800077bb8b0 getty 2333 1 2333 0 Ss+ ttyin 0xfffff800077ba0b0 getty 2332 1 2332 0 Ss+ ttyin 0xfffff800077ba8b0 getty 2331 1 2331 0 Ss+ ttyin 0xfffff800077b90b0 getty 2330 1 2330 0 Ss+ ttyin 0xfffff800077b98b0 getty 2329 1 2329 0 Ss+ ttyin 0xfffff800077b80b0 getty 2283 1 2283 0 Ss nanslp 0xffffffff81c7feb7 cron 2279 1 2279 0 Ss select 0xfffff800076c6140 sshd 2250 1 2250 123 Ss (threaded) ntpd 100193 S select 0xfffff80003e8a0c0 ntpd 2187 1 2187 0 Ss rpcsvc 0xfffff80003d39660 NLM: master 2184 1 2184 0 Ss select 0xfffff80006052dc0 rpc.statd 2138 1 2138 0 Ss nanslp 0xffffffff81c7feb6 watchdogd 2058 1 2058 0 Ss select 0xfffff80007722440 rpcbind 2048 1 2048 0 Ss select 0xfffff80003fe54c0 syslogd 1977 1 1977 0 Ss select 0xfffff800077224c0 devd 1972 1 1972 65 Ss select 0xfffff8000462bec0 dhclient 1928 1 1928 0 Ss select 0xfffff80003d5f340 dhclient 1925 1 1925 0 Ss select 0xfffff800075a7f40 dhclient 34 0 0 0 DL vlruwt 0xfffff800060f8a60 [vnlru] 33 0 0 0 DL syncer 0xffffffff81d56370 [syncer] 32 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff81d55818 [bufdaemon] 100132 D - 0xffffffff8180a900 [bufspacedaemon-0] 100134 D - 0xffffffff81812bc0 [bufspacedaemon-1] 100135 D - 0xffffffff8181ae80 [bufspacedaemon-2] 100136 D - 0xffffffff81823140 [bufspacedaemon-3] 100137 D - 0xffffffff8182b400 [bufspacedaemon-4] 100138 D - 0xffffffff818336c0 [bufspacedaemon-5] 100139 D - 0xffffffff8183b980 [bufspacedaemon-6] 100153 D sdflush 0xfffff80007c262e8 [/ worker] 100197 D sdflush 0xfffff80003dc54e8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff81d70cc8 [vmdaemon] 30 0 0 0 RL (threaded) [pagedaemon] 100128 Run CPU 5 [dom0] 100131 D launds 0xffffffff81d9cb24 [laundry: dom0] 100133 D umarcl 0xffffffff80efecd0 [uma] 29 0 0 0 DL idle 0xfffff80003fa9000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff80003fa9530 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81adbb20 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff81de20f0 [sctp_iterator] 25 0 0 0 DL - 0xffffffff81d5521c [soaiod4] 24 0 0 0 DL - 0xffffffff81d5521c [soaiod3] 23 0 0 0 DL - 0xffffffff81d5521c [soaiod2] 22 0 0 0 DL - 0xffffffff81d5521c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe00d1584460 [usbus0] 100097 D - 0xfffffe00d15844b8 [usbus0] 100098 D - 0xfffffe00d1584510 [usbus0] 100099 D - 0xfffffe00d1584568 [usbus0] 100100 D - 0xfffffe00d15845c0 [usbus0] 100102 D - 0xfffffe0037b66d10 [usbus1] 100103 D - 0xfffffe0037b66d68 [usbus1] 100104 D - 0xfffffe0037b66dc0 [usbus1] 100105 D - 0xfffffe0037b66e18 [usbus1] 100106 D - 0xfffffe0037b66e70 [usbus1] 100107 D - 0xfffffe00d16a7d10 [usbus2] 100108 D - 0xfffffe00d16a7d68 [usbus2] 100109 D - 0xfffffe00d16a7dc0 [usbus2] 100110 D - 0xfffffe00d16a7e18 [usbus2] 100111 D - 0xfffffe00d16a7e70 [usbus2] 20 0 0 0 DL (threaded) [cam] 100091 D - 0xffffffff819b6ec0 [doneq0] 100092 D - 0xffffffff819b6f40 [doneq1] 100093 D - 0xffffffff819b6fc0 [doneq2] 100125 D - 0xffffffff819b6d88 [scanner] 19 0 0 0 DL crypto_ 0xfffff8000417e450 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff8000417e3f0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff8000417e390 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff8000417e330 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff8000417e2d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff8000417e270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff8000417e210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff8000417e1b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff8000417e150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff8000417e0f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff8000417e090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff8000417e030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81d6b308 [crypto] 14 0 0 0 DL seqstat 0xfffff80003adc888 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff81d9b110 [g_event] 100063 D - 0xffffffff81d9b120 [g_up] 100064 D - 0xffffffff81d9b118 [g_down] 12 0 0 0 WL (threaded) [intr] 100018 I [swi6: task queue] 100019 I [swi6: Giant taskq] 100021 I [swi5: fast taskq] 100047 I [swi3: vm] 100048 I [swi1: netisr 0] 100049 I [swi4: clock (0)] 100050 I [swi4: clock (1)] 100051 I [swi4: clock (2)] 100052 I [swi4: clock (3)] 100053 I [swi4: clock (4)] 100054 I [swi4: clock (5)] 100055 I [swi4: clock (6)] 100056 I [swi4: clock (7)] 100057 I [swi4: clock (8)] 100058 I [swi4: clock (9)] 100059 I [swi4: clock (10)] 100060 I [swi4: clock (11)] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100176 I [irq72: ioat0] 100177 I [irq73: ioat1] 100178 I [irq74: ioat2] 100179 I [irq75: ioat3] 100180 I [irq76: ioat4] 100181 I [irq77: ioat5] 100182 I [irq78: ioat6] 100183 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800038c9530 [init] 10 0 0 0 DL audit_w 0xffffffff81de2d80 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81d8a828 [swapper] 100015 D - 0xfffff80003888000 [config_0] 100016 D - 0xfffff80003889e00 [kqueue_ctx taskq] 100017 D - 0xfffff80003889d00 [aiod_kick taskq] 100020 D - 0xfffff80003889a00 [thread taskq] 100022 D - 0xfffff80003889800 [if_config_tqg_0] 100023 D - 0xfffff80003889700 [softirq_0] 100024 D - 0xfffff80003889600 [softirq_1] 100025 D - 0xfffff80003889500 [softirq_2] 100026 D - 0xfffff80003889400 [softirq_3] 100027 D - 0xfffff80003889300 [softirq_4] 100028 D - 0xfffff80003889200 [softirq_5] 100029 D - 0xfffff80003889100 [softirq_6] 100030 D - 0xfffff80003889000 [softirq_7] 100031 D - 0xfffff8000388ae00 [softirq_8] 100032 D - 0xfffff8000388ad00 [softirq_9] 100033 D - 0xfffff8000388ac00 [softirq_10] 100034 D - 0xfffff8000388ab00 [softirq_11] 100035 D - 0xfffff8000388aa00 [if_io_tqg_0] 100036 D - 0xfffff8000388a900 [if_io_tqg_1] 100037 D - 0xfffff8000388a800 [if_io_tqg_2] 100038 D - 0xfffff8000388a700 [if_io_tqg_3] 100039 D - 0xfffff8000388a600 [if_io_tqg_4] 100040 D - 0xfffff8000388a500 [if_io_tqg_5] 100041 D - 0xfffff8000388a400 [if_io_tqg_6] 100042 D - 0xfffff8000388a300 [if_io_tqg_7] 100043 D - 0xfffff8000388a200 [if_io_tqg_8] 100044 D - 0xfffff8000388a100 [if_io_tqg_9] 100045 D - 0xfffff8000388a000 [if_io_tqg_10] 100046 D - 0xfffff8000388be00 [if_io_tqg_11] 100061 D - 0xfffff80003a56100 [firmware taskq] 100066 D - 0xfffff80003a56000 [crypto_0] 100067 D - 0xfffff80003a56000 [crypto_1] 100068 D - 0xfffff80003a56000 [crypto_2] 100069 D - 0xfffff80003a56000 [crypto_3] 100070 D - 0xfffff80003a56000 [crypto_4] 100071 D - 0xfffff80003a56000 [crypto_5] 100072 D - 0xfffff80003a56000 [crypto_6] 100073 D - 0xfffff80003a56000 [crypto_7] 100074 D - 0xfffff80003a56000 [crypto_8] 100075 D - 0xfffff80003a56000 [crypto_9] 100076 D - 0xfffff80003a56000 [crypto_10] 100077 D - 0xfffff80003a56000 [crypto_11] 100114 D - 0xfffff800038e9b00 [mca taskq] 100121 D - 0xfffff800075b3400 [acpi_task_0] 100122 D - 0xfffff800075b3400 [acpi_task_1] 100123 D - 0xfffff800075b3400 [acpi_task_2] 100124 D - 0xfffff80003a57e00 [CAM taskq] db:0:pho> allt Tracing command pipe2 pid 79638 tid 104971 td 0xfffff806ce1666e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe033a9e4330 mi_switch() at mi_switch+0x166/frame 0xfffffe033a9e4370 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe033a9e43b0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe033a9e43f0 _sleep() at _sleep+0x26c/frame 0xfffffe033a9e4490 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe033a9e44c0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe033a9e4620 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe033a9e4660 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe033a9e46e0 trap() at trap+0x2a3/frame 0xfffffe033a9e4810 calltrap() at calltrap+0x8/frame 0xfffffe033a9e4810 --- trap 0xc, rip = 0xffffffff8105e92c, rsp = 0xfffffe033a9e48e0, rbp = 0xfffffe033a9e48e0 --- copyin_nosmap_erms() at copyin_nosmap_erms+0xfc/frame 0xfffffe033a9e48e0 uiomove_faultflag() at uiomove_faultflag+0x108/frame 0xfffffe033a9e4920 pipe_write() at pipe_write+0x8f6/frame 0xfffffe033a9e49e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe033a9e4a30 kern_writev() at kern_writev+0x49/frame 0xfffffe033a9e4a70 sys_write() at sys_write+0x83/frame 0xfffffe033a9e4ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe033a9e4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033a9e4bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800417b4a, rsp = 0x7fffffffe678, rbp = 0x7fffffffe6b0 --- Tracing command pipe2 pid 75524 tid 100988 td 0xfffff8030e419000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e6b99830 mi_switch() at mi_switch+0x166/frame 0xfffffe00e6b99870 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e6b998b0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e6b99910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e6b99950 _sleep() at _sleep+0x258/frame 0xfffffe00e6b999f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e6b99a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e6b99ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e6b99bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6b99bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003a8a7a, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6b0 --- Tracing command su pid 75523 tid 102310 td 0xfffff804503b8000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e990b690 mi_switch() at mi_switch+0x166/frame 0xfffffe00e990b6d0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e990b710 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e990b770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e990b7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e990b840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e990b8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e990bac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e990bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e990bbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003ec91a, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe6f0 --- Tracing command sleep pid 75520 tid 102161 td 0xfffff8045a3de000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e98c5710 mi_switch() at mi_switch+0x166/frame 0xfffffe00e98c5750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e98c5790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e98c57d0 _sleep() at _sleep+0x26c/frame 0xfffffe00e98c5870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe00e98c58a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe00e98c5a00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe00e98c5a40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe00e98c5ac0 trap() at trap+0x453/frame 0xfffffe00e98c5bf0 calltrap() at calltrap+0x8/frame 0xfffffe00e98c5bf0 --- trap 0xc, rip = 0x800388a2f, rsp = 0x7fffffffe6e0, rbp = 0x7fffffffe6f0 --- Tracing command swap pid 74389 tid 101097 td 0xfffff804557df000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e6d10710 mi_switch() at mi_switch+0x166/frame 0xfffffe00e6d10750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e6d10790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e6d107d0 _sleep() at _sleep+0x26c/frame 0xfffffe00e6d10870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe00e6d108a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe00e6d10a00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe00e6d10a40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe00e6d10ac0 trap() at trap+0x453/frame 0xfffffe00e6d10bf0 calltrap() at calltrap+0x8/frame 0xfffffe00e6d10bf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1d8, rbp = 0x7fffffffe220 --- Tracing command swap pid 74388 tid 100961 td 0xfffff80278f75000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e4d49710 mi_switch() at mi_switch+0x166/frame 0xfffffe00e4d49750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e4d49790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e4d497d0 _sleep() at _sleep+0x26c/frame 0xfffffe00e4d49870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe00e4d498a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe00e4d49a00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe00e4d49a40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe00e4d49ac0 trap() at trap+0x453/frame 0xfffffe00e4d49bf0 calltrap() at calltrap+0x8/frame 0xfffffe00e4d49bf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1d8, rbp = 0x7fffffffe220 --- Tracing command swap pid 74387 tid 100864 td 0xfffff804546b9000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e6bd5710 mi_switch() at mi_switch+0x166/frame 0xfffffe00e6bd5750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e6bd5790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e6bd57d0 _sleep() at _sleep+0x26c/frame 0xfffffe00e6bd5870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe00e6bd58a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe00e6bd5a00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe00e6bd5a40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe00e6bd5ac0 trap() at trap+0x453/frame 0xfffffe00e6bd5bf0 calltrap() at calltrap+0x8/frame 0xfffffe00e6bd5bf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1d8, rbp = 0x7fffffffe220 --- Tracing command swap pid 74386 tid 100818 td 0xfffff803ab08c6e0 (CPU 1) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e173dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e173df0 trap() at trap+0x44/frame 0xfffffe003e173f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e173f20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74385 tid 101055 td 0xfffff8044f51a000 (CPU 3) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e18bdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e18bdf0 trap() at trap+0x44/frame 0xfffffe003e18bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e18bf20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74384 tid 101327 td 0xfffff807df9ef6e0 (CPU 4) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e197dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e197df0 trap() at trap+0x44/frame 0xfffffe003e197f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e197f20 --- trap 0x13, rip = 0x203689, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74383 tid 100923 td 0xfffff804602386e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e6d4c710 mi_switch() at mi_switch+0x166/frame 0xfffffe00e6d4c750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e6d4c790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e6d4c7d0 _sleep() at _sleep+0x26c/frame 0xfffffe00e6d4c870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe00e6d4c8a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe00e6d4ca00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe00e6d4ca40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe00e6d4cac0 trap() at trap+0x453/frame 0xfffffe00e6d4cbf0 calltrap() at calltrap+0x8/frame 0xfffffe00e6d4cbf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1d8, rbp = 0x7fffffffe220 --- Tracing command swap pid 74382 tid 102451 td 0xfffff803eed13000 (CPU 6) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1afdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1afdf0 trap() at trap+0x44/frame 0xfffffe003e1aff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1aff20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74381 tid 101082 td 0xfffff803eee2e6e0 (CPU 8) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1c7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1c7df0 trap() at trap+0x44/frame 0xfffffe003e1c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c7f20 --- trap 0x13, rip = 0x203689, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74380 tid 101334 td 0xfffff806ce0b36e0 (CPU 9) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1d3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1d3df0 trap() at trap+0x44/frame 0xfffffe003e1d3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d3f20 --- trap 0x13, rip = 0x203689, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74379 tid 100689 td 0xfffff80278e25000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e6d3d710 mi_switch() at mi_switch+0x166/frame 0xfffffe00e6d3d750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e6d3d790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e6d3d7d0 _sleep() at _sleep+0x26c/frame 0xfffffe00e6d3d870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe00e6d3d8a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe00e6d3da00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe00e6d3da40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe00e6d3dac0 trap() at trap+0x453/frame 0xfffffe00e6d3dbf0 calltrap() at calltrap+0x8/frame 0xfffffe00e6d3dbf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1d8, rbp = 0x7fffffffe220 --- Tracing command swap pid 74378 tid 100351 td 0xfffff804602376e0 (CPU 0) cpustop_handler() at cpustop_handler+0x2a/frame 0xffffffff81d845f0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffffff81d84610 trap() at trap+0x44/frame 0xffffffff81d84740 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d84740 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74377 tid 100567 td 0xfffff806ce9596e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e6b08710 mi_switch() at mi_switch+0x166/frame 0xfffffe00e6b08750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e6b08790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e6b087d0 _sleep() at _sleep+0x26c/frame 0xfffffe00e6b08870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe00e6b088a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe00e6b08a00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe00e6b08a40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe00e6b08ac0 trap() at trap+0x453/frame 0xfffffe00e6b08bf0 calltrap() at calltrap+0x8/frame 0xfffffe00e6b08bf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1d8, rbp = 0x7fffffffe220 --- Tracing command swap pid 74376 tid 100513 td 0xfffff8044edb8000 (CPU 11) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1ebdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1ebdf0 trap() at trap+0x44/frame 0xfffffe003e1ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ebf20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74375 tid 101278 td 0xfffff807acbcf6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e996a710 mi_switch() at mi_switch+0x166/frame 0xfffffe00e996a750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e996a790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e996a7d0 _sleep() at _sleep+0x26c/frame 0xfffffe00e996a870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe00e996a8a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe00e996aa00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe00e996aa40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe00e996aac0 trap() at trap+0x453/frame 0xfffffe00e996abf0 calltrap() at calltrap+0x8/frame 0xfffffe00e996abf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1d8, rbp = 0x7fffffffe220 --- Tracing command swap pid 74374 tid 101400 td 0xfffff80278ba26e0 (CPU 10) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1dfdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1dfdf0 trap() at trap+0x44/frame 0xfffffe003e1dff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1dff20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74373 tid 100754 td 0xfffff804503cf000 (CPU 7) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1bbdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1bbdf0 trap() at trap+0x44/frame 0xfffffe003e1bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1bbf20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74372 tid 101209 td 0xfffff804559d26e0 (CPU 2) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e17fdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e17fdf0 trap() at trap+0x44/frame 0xfffffe003e17ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17ff20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe530, rbp = 0x7fffffffe550 --- Tracing command swap pid 74371 tid 100544 td 0xfffff8047cbce6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e6c98690 mi_switch() at mi_switch+0x166/frame 0xfffffe00e6c986d0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e6c98710 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e6c98770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e6c987a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e6c98840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e6c988d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e6c98ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e6c98bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6c98bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003c391a, rsp = 0x7fffffffe578, rbp = 0x7fffffffe5b0 --- Tracing command swap pid 74369 tid 100398 td 0xfffff8063114b6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e4e3e830 mi_switch() at mi_switch+0x166/frame 0xfffffe00e4e3e870 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e4e3e8b0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e4e3e910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e4e3e950 _sleep() at _sleep+0x258/frame 0xfffffe00e4e3e9f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e4e3ea80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e4e3eac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e4e3ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e4e3ebf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c3a7a, rsp = 0x7fffffffe568, rbp = 0x7fffffffe5b0 --- Tracing command sh pid 74356 tid 102348 td 0xfffff806d8f97000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e5962690 mi_switch() at mi_switch+0x166/frame 0xfffffe00e59626d0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e5962710 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e5962770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e59627a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e5962840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e59628d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e5962ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e5962bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5962bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040791a, rsp = 0x7fffffffe358, rbp = 0x7fffffffe410 --- Tracing command tee pid 74355 tid 100832 td 0xfffff8045ab4e000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e6a8b7d0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e6a8b810 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e6a8b850 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e6a8b8b0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e6a8b8e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e6a8b980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e6a8b9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e6a8ba30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e6a8ba70 sys_read() at sys_read+0x83/frame 0xfffffe00e6a8bac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e6a8bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6a8bbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800417b8a, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffe6f0 --- Tracing command sh pid 74354 tid 101491 td 0xfffff8043d5e06e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e9848690 mi_switch() at mi_switch+0x166/frame 0xfffffe00e98486d0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e9848710 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e9848770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e98487a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e9848840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e98488d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e9848ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e9848bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e9848bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040791a, rsp = 0x7fffffffaa88, rbp = 0x7fffffffab40 --- Tracing command sh pid 62289 tid 100249 td 0xfffff8038c8fa000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3f72690 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3f726d0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3f72710 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3f72770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3f727a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e3f72840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e3f728d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3f72ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3f72bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3f72bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040791a, rsp = 0x7fffffffada8, rbp = 0x7fffffffae60 --- Tracing command sh pid 2495 tid 100238 td 0xfffff8038c9b56e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3f3b7d0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3f3b810 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3f3b850 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3f3b8b0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3f3b8e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e3f3b980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e3f3b9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3f3ba30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3f3ba70 sys_read() at sys_read+0x83/frame 0xfffffe00e3f3bac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3f3bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3f3bbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800476b8a, rsp = 0x7fffffffe238, rbp = 0x7fffffffe330 --- Tracing command awk pid 2493 tid 100237 td 0xfffff8038c900000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3f367d0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3f36810 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3f36850 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3f368b0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3f368e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e3f36980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e3f369e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3f36a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3f36a70 sys_read() at sys_read+0x83/frame 0xfffffe00e3f36ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3f36bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3f36bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047bb8a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe340 --- Tracing command sh pid 2492 tid 100171 td 0xfffff80007db46e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d99690 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1d996d0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1d99710 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1d99770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1d997a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e1d99840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e1d998d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e1d99ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1d99bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d99bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040791a, rsp = 0x7fffffffe238, rbp = 0x7fffffffe2f0 --- Tracing command sh pid 2434 tid 100188 td 0xfffff8001b6db6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e22690 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e226d0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e22710 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e22770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e227a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e3e22840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e3e228d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3e22ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e22bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e22bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040791a, rsp = 0x7fffffffe4c8, rbp = 0x7fffffffe580 --- Tracing command bash pid 2356 tid 100203 td 0xfffff8038c9006e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e916b0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e916f0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e91730 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e91790 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e917c0 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3e91820 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e3e91860 kern_select() at kern_select+0x962/frame 0xfffffe00e3e91a40 sys_pselect() at sys_pselect+0x127/frame 0xfffffe00e3e91ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e91bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e91bf0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x800517a3a, rsp = 0x7fffffffd638, rbp = 0x7fffffffd700 --- Tracing command csh pid 2354 tid 100215 td 0xfffff8038cb786e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3ecd880 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3ecd8c0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3ecd900 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3ecd960 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ecd990 _sleep() at _sleep+0x2c3/frame 0xfffffe00e3ecda30 kern_sigsuspend() at kern_sigsuspend+0xd6/frame 0xfffffe00e3ecda90 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe00e3ecdac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3ecdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ecdbf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80048c99a, rsp = 0x7fffffffdff8, rbp = 0x7fffffffe080 --- Tracing command su pid 2353 tid 100214 td 0xfffff8038cb77000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3ec8690 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3ec86d0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3ec8710 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3ec8770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ec87a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e3ec8840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e3ec88d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3ec8ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3ec8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ec8bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003ec91a, rsp = 0x7fffffffe608, rbp = 0x7fffffffeb40 --- Tracing command bash pid 2347 tid 100189 td 0xfffff8006613b6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e27690 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e276d0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e27710 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e27770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e277a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e3e27840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e3e278d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3e27ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e27bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e27bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80051791a, rsp = 0x7fffffffe7c8, rbp = 0x7fffffffe810 --- Tracing command sshd pid 2346 tid 100187 td 0xfffff8001b62c6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e1d6f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e1d730 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e1d770 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e1d7d0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e1d800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3e1d860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e3e1d8a0 kern_select() at kern_select+0x962/frame 0xfffffe00e3e1da80 sys_select() at sys_select+0x56/frame 0xfffffe00e3e1dac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e1dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e1dbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f5b6a, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 2343 tid 100199 td 0xfffff8006613b000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e7d770 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e7d7b0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e7d7f0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e7d850 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e7d880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3e7d8e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e3e7d920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e3e7daa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3e7dac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e7dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e7dbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80089913a, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command csh pid 2339 tid 100195 td 0xfffff8000770d000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e5d750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e5d790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e5d7d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e5d830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e5d860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3e5d8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3e5d8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3e5d950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3e5d980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3e5d9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3e5da30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3e5da70 sys_read() at sys_read+0x83/frame 0xfffffe00e3e5dac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e5dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e5dbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004fbb8a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe210 --- Tracing command login pid 2338 tid 100212 td 0xfffff8038cb776e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3ebe690 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3ebe6d0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3ebe710 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3ebe770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ebe7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e3ebe840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e3ebe8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3ebeac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3ebebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ebebf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003ee91a, rsp = 0x7fffffffeb48, rbp = 0x7fffffffed00 --- Tracing command getty pid 2337 tid 100211 td 0xfffff8038cbca000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3eb9750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3eb9790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3eb97d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3eb9830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3eb9860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3eb98c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3eb98f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3eb9950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3eb9980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3eb99e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3eb9a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3eb9a70 sys_read() at sys_read+0x83/frame 0xfffffe00e3eb9ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3eb9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3eb9bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2336 tid 100210 td 0xfffff8038cbca6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3eb4750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3eb4790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3eb47d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3eb4830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3eb4860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3eb48c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3eb48f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3eb4950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3eb4980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3eb49e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3eb4a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3eb4a70 sys_read() at sys_read+0x83/frame 0xfffffe00e3eb4ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3eb4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3eb4bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2335 tid 100209 td 0xfffff8038cbc9000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3eaf750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3eaf790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3eaf7d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3eaf830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3eaf860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3eaf8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3eaf8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3eaf950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3eaf980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3eaf9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3eafa30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3eafa70 sys_read() at sys_read+0x83/frame 0xfffffe00e3eafac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3eafbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3eafbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2334 tid 100208 td 0xfffff8038cbc96e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3eaa750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3eaa790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3eaa7d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3eaa830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3eaa860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3eaa8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3eaa8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3eaa950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3eaa980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3eaa9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3eaaa30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3eaaa70 sys_read() at sys_read+0x83/frame 0xfffffe00e3eaaac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3eaabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3eaabf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2333 tid 100207 td 0xfffff8038cbc8000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3ea5750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3ea5790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3ea57d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3ea5830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ea5860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3ea58c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3ea58f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3ea5950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3ea5980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3ea59e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3ea5a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3ea5a70 sys_read() at sys_read+0x83/frame 0xfffffe00e3ea5ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3ea5bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ea5bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2332 tid 100206 td 0xfffff8001b38a000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3ea0750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3ea0790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3ea07d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3ea0830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ea0860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3ea08c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3ea08f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3ea0950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3ea0980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3ea09e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3ea0a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3ea0a70 sys_read() at sys_read+0x83/frame 0xfffffe00e3ea0ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3ea0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ea0bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2331 tid 100205 td 0xfffff8001b38a6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e9b750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e9b790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e9b7d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e9b830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e9b860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3e9b8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3e9b8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3e9b950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3e9b980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3e9b9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3e9ba30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3e9ba70 sys_read() at sys_read+0x83/frame 0xfffffe00e3e9bac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e9bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e9bbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2330 tid 100204 td 0xfffff80007db4000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e96750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e96790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e967d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e96830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e96860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3e968c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3e968f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3e96950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3e96980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3e969e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3e96a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3e96a70 sys_read() at sys_read+0x83/frame 0xfffffe00e3e96ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e96bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e96bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2329 tid 100142 td 0xfffff80003bf1000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1ce4750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1ce4790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1ce47d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1ce4830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1ce4860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1ce48c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e1ce48f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e1ce4950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e1ce4980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e1ce49e0 dofileread() at dofileread+0x81/frame 0xfffffe00e1ce4a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e1ce4a70 sys_read() at sys_read+0x83/frame 0xfffffe00e1ce4ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1ce4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1ce4bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2283 tid 100164 td 0xfffff80007b7f6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d5e830 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1d5e870 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1d5e8b0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1d5e910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e1d5e950 _sleep() at _sleep+0x258/frame 0xfffffe00e1d5e9f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e1d5ea80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e1d5eac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1d5ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d5ebf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d8a7a, rsp = 0x7fffffffead8, rbp = 0x7fffffffecc0 --- Tracing command sshd pid 2279 tid 100160 td 0xfffff80003bf2000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d4a6f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1d4a730 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1d4a770 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1d4a7d0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1d4a800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1d4a860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1d4a8a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1d4aa80 sys_select() at sys_select+0x56/frame 0xfffffe00e1d4aac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1d4abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d4abf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f5b6a, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6a0 --- Tracing command ntpd pid 2250 tid 100193 td 0xfffff8001b1ac6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e536f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e53730 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e53770 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e537d0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e53800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3e53860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e3e538a0 kern_select() at kern_select+0x962/frame 0xfffffe00e3e53a80 sys_select() at sys_select+0x56/frame 0xfffffe00e3e53ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e53bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e53bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800827b6a, rsp = 0x7fffffffdf18, rbp = 0x7fffffffdf50 --- Tracing command rpc.lockd pid 2187 tid 100146 td 0xfffff80007a4e6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1cf8610 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1cf8650 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1cf8690 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1cf86f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e1cf8730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e1cf87a0 svc_run_internal() at svc_run_internal+0xabe/frame 0xfffffe00e1cf88e0 svc_run() at svc_run+0x253/frame 0xfffffe00e1cf8940 sys_nlm_syscall() at sys_nlm_syscall+0x745/frame 0xfffffe00e1cf8ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1cf8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1cf8bf0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f54aa, rsp = 0x7fffffffec08, rbp = 0x7fffffffecc0 --- Tracing command rpc.statd pid 2184 tid 100145 td 0xfffff80006475000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1cf36d0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1cf3710 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1cf3750 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1cf37b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e1cf37f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e1cf3860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e1cf38a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1cf3a80 sys_select() at sys_select+0x56/frame 0xfffffe00e1cf3ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1cf3bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1cf3bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800427b6a, rsp = 0x7fffffffeaa8, rbp = 0x7fffffffebf0 --- Tracing command watchdogd pid 2138 tid 100172 td 0xfffff80007b7f000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d9e830 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1d9e870 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1d9e8b0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1d9e910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e1d9e950 _sleep() at _sleep+0x258/frame 0xfffffe00e1d9e9f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e1d9ea80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e1d9eac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1d9ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d9ebf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c1a7a, rsp = 0x7fffffffea98, rbp = 0x7fffffffeae0 --- Tracing command rpcbind pid 2058 tid 100184 td 0xfffff8000770d6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e0e750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e0e790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e0e7d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e0e830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e3e0e870 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e3e0e8e0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e3e0e920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e3e0eaa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3e0eac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e0ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e0ebf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003cf13a, rsp = 0x7fffffffca38, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2048 tid 100155 td 0xfffff80003f4b6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d256f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1d25730 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1d25770 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1d257d0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1d25800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1d25860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1d258a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1d25a80 sys_select() at sys_select+0x56/frame 0xfffffe00e1d25ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1d25bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d25bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800438b6a, rsp = 0x7fffffffe748, rbp = 0x7fffffffecc0 --- Tracing command devd pid 1977 tid 100159 td 0xfffff8000647d000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d456d0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1d45710 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1d45750 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1d457b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e1d457f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e1d45860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e1d458a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1d45a80 sys_select() at sys_select+0x56/frame 0xfffffe00e1d45ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1d45bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d45bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f5d1a, rsp = 0x7fffffffcb58, rbp = 0x7fffffffece0 --- Tracing command dhclient pid 1972 tid 100194 td 0xfffff800077046e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e58750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e58790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e587d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e58830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e3e58870 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e3e588e0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e3e58920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e3e58aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3e58ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e58bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e58bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f213a, rsp = 0x7fffffffec28, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1928 tid 100163 td 0xfffff8000401c000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d59770 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1d597b0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1d597f0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1d59850 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1d59880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1d598e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1d59920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e1d59aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e1d59ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1d59bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d59bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f213a, rsp = 0x7fffffffec38, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1925 tid 100170 td 0xfffff80007db5000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d946f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1d94730 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1d94770 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1d947d0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1d94800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1d94860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1d948a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1d94a80 sys_select() at sys_select+0x56/frame 0xfffffe00e1d94ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1d94bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d94bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80044eb6a, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffeaa0 --- Tracing command vnlru pid 34 tid 100141 td 0xfffff80007a4d000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00dadfd9c0 mi_switch() at mi_switch+0x166/frame 0xfffffe00dadfda00 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00dadfda40 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00dadfda80 _sleep() at _sleep+0x26c/frame 0xfffffe00dadfdb20 vnlru_proc() at vnlru_proc+0x149/frame 0xfffffe00dadfdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dadfdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dadfdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100140 td 0xfffff80007a4d6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00dadf89f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00dadf8a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00dadf8a70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00dadf8ab0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x184/frame 0xfffffe00dadf8b20 sched_sync() at sched_sync+0x5ce/frame 0xfffffe00dadf8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dadf8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dadf8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffff800075b1000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d3246a00 mi_switch() at mi_switch+0x166/frame 0xfffffe00d3246a40 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d3246a80 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00d3246ac0 _sleep() at _sleep+0x26c/frame 0xfffffe00d3246b60 buf_daemon() at buf_daemon+0x112/frame 0xfffffe00d3246bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3246bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3246bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100132 td 0xfffff80003bfb6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d33f59f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00d33f5a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d33f5a70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00d33f5ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00d33f5b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d33f5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d33f5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d33f5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffff80003bfb000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d33fa9f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00d33faa30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d33faa70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00d33faab0 _sleep() at _sleep+0x26c/frame 0xfffffe00d33fab50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d33fabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d33fabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d33fabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff80003c076e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d33ff9f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00d33ffa30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d33ffa70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00d33ffab0 _sleep() at _sleep+0x26c/frame 0xfffffe00d33ffb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d33ffbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d33ffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d33ffbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff80003c07000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00dada49f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00dada4a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00dada4a70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00dada4ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dada4b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00dada4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dada4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dada4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffff800064746e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00dade99f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00dade9a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00dade9a70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00dade9ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dade9b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00dade9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dade9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dade9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffff80003bf0000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00dadee9f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00dadeea30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00dadeea70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00dadeeab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dadeeb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00dadeebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dadeebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dadeebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffff80003bf16e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00dadf39f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00dadf3a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00dadf3a70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00dadf3ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dadf3b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00dadf3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dadf3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dadf3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100153 td 0xfffff80003bf26e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d1ba20 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1d1ba60 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1d1baa0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e1d1bae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e1d1bb80 softdep_flush() at softdep_flush+0x175/frame 0xfffffe00e1d1bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1d1bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1d1bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100197 td 0xfffff8001b1ac000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e73a20 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e73a60 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e73aa0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e3e73ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e3e73b80 softdep_flush() at softdep_flush+0x175/frame 0xfffffe00e3e73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e3e73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e3e73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff800075b16e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d32359f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00d3235a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d3235a70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00d3235aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x82/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff800075b0000 (CPU 5) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32245c0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3224620 panic() at panic+0x43/frame 0xfffffe00d3224680 vm_object_madvise() at vm_object_madvise+0x42b/frame 0xfffffe00d32246e0 vm_map_madvise() at vm_map_madvise+0x33a/frame 0xfffffe00d3224750 exec_release_args_kva() at exec_release_args_kva+0x33/frame 0xfffffe00d3224780 exec_args_kva_lowmem() at exec_args_kva_lowmem+0x7f/frame 0xfffffe00d32247b0 vm_pageout_worker() at vm_pageout_worker+0x3a0/frame 0xfffffe00d3224b70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe00d3224bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3224bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3224bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100131 td 0xfffff80006474000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d33eb7e0 mi_switch() at mi_switch+0x166/frame 0xfffffe00d33eb820 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d33eb860 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00d33eb890 _sleep() at _sleep+0x2cd/frame 0xfffffe00d33eb930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xd7b/frame 0xfffffe00d33ebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d33ebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d33ebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100133 td 0xfffff800064756e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d33f0a20 mi_switch() at mi_switch+0x166/frame 0xfffffe00d33f0a60 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d33f0aa0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00d33f0ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00d33f0b80 uma_reclaim_worker() at uma_reclaim_worker+0xb8/frame 0xfffffe00d33f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d33f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d33f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff80003f4a6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d32139e0 mi_switch() at mi_switch+0x166/frame 0xfffffe00d3213a20 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d3213a60 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00d3213a90 _sleep() at _sleep+0x2cd/frame 0xfffffe00d3213b30 enc_daemon() at enc_daemon+0xe1/frame 0xfffffe00d3213bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3213bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3213bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff80003fa3000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d320e9e0 mi_switch() at mi_switch+0x166/frame 0xfffffe00d320ea20 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d320ea60 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00d320ea90 _sleep() at _sleep+0x2cd/frame 0xfffffe00d320eb30 enc_daemon() at enc_daemon+0xe1/frame 0xfffffe00d320ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d320ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d320ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100120 td 0xfffff800060e9000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5f09f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5f0a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5f0a70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e5f0ab0 _sleep() at _sleep+0x26c/frame 0xfffffe003e5f0b50 random_kthread() at random_kthread+0x67/frame 0xfffffe003e5f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff800060e96e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5dfa40 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5dfa80 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5dfac0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5dfaf0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e5dfb90 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe003e5dfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5dfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5dfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff80003fa36e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5cea10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5cea50 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5cea90 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e5cead0 _sleep() at _sleep+0x26c/frame 0xfffffe003e5ceb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe003e5cebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5cebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5cebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff80003f97000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5c9a10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5c9a50 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5c9a90 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e5c9ad0 _sleep() at _sleep+0x26c/frame 0xfffffe003e5c9b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe003e5c9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5c9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5c9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff80003f976e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5c4a10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5c4a50 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5c4a90 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e5c4ad0 _sleep() at _sleep+0x26c/frame 0xfffffe003e5c4b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe003e5c4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5c4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5c4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff80003f96000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5bfa10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5bfa50 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5bfa90 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e5bfad0 _sleep() at _sleep+0x26c/frame 0xfffffe003e5bfb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe003e5bfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5bfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5bfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff80004217000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e554a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e554aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e554ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e554b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e554b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e554bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e554bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e554bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff8000421f6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e559a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e559aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e559ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e559b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e559b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e559bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e559bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e559bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff8000421f000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e55ea60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e55eaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e55eae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e55eb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e55eb70 usb_process() at usb_process+0xc3/frame 0xfffffe003e55ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e55ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e55ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff8000609b6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e563a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e563aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e563ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e563b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e563b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e563bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e563bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e563bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff8000609b000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e568a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e568aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e568ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e568b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e568b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e568bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e568bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e568bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff8000609c000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e572a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e572aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e572ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e572b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e572b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e572bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e572bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e572bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff800042166e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e577a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e577aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e577ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e577b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e577b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e577bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e577bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e577bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff8000608a000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e57ca60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e57caa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e57cae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e57cb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e57cb70 usb_process() at usb_process+0xc3/frame 0xfffffe003e57cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e57cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e57cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff8000608b6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e581a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e581aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e581ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e581b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e581b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e581bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e581bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e581bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff8000608b000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e586a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e586aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e586ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e586b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e586b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e586bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e586bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e586bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff80003991000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e597a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e597aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e597ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e597b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e597b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e597bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e597bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e597bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff800039a46e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e59ca60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e59caa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e59cae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e59cb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e59cb70 usb_process() at usb_process+0xc3/frame 0xfffffe003e59cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e59cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e59cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff800039a4000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5a1a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5a1aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5a1ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5a1b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e5a1b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e5a1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5a1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5a1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff8000383a6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5a6a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5a6aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5a6ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5a6b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e5a6b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e5a6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5a6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5a6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff800038f06e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5aba60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5abaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5abae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5abb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e5abb70 usb_process() at usb_process+0xc3/frame 0xfffffe003e5abbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5abbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5abbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff8000416c000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e53ba10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e53ba50 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e53ba90 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e53bac0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e53bb60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe003e53bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e53bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e53bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff8000430c6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e540a10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e540a50 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e540a90 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e540ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e540b60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe003e540bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e540bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e540bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff8000430c000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e545a10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e545a50 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e545a90 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e545ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e545b60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe003e545bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e545bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e545bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff800075b06e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d3209a00 mi_switch() at mi_switch+0x166/frame 0xfffffe00d3209a40 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d3209a80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00d3209ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d3209b50 xpt_scanner_thread() at xpt_scanner_thread+0x92/frame 0xfffffe00d3209bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3209bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3209bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffff8000416c6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5369f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e536a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e536a70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e536aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e536b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e536bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e536bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e536bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffff8000416b000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5319f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e531a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e531a70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e531aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e531b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e531bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e531bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e531bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffff8000416b6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e52c9f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e52ca30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e52ca70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e52caa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e52cb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e52cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e52cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e52cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffff8000416a000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5279f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e527a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e527a70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e527aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e527b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e527bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e527bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e527bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffff800041826e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5229f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e522a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e522a70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e522aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e522b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e522bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e522bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e522bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffff8000417a000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e51d9f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e51da30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e51da70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e51daa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e51db40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e51dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e51dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e51dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffff8000417a6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5189f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e518a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e518a70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e518aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e518b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e518bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e518bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e518bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffff80004179000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5139f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e513a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e513a70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e513aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e513b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e513bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e513bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e513bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffff800041796e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e50e9f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e50ea30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e50ea70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e50eaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e50eb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e50ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e50ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e50ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffff80004184000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5099f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e509a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e509a70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e509aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e509b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e509bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e509bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e509bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffff800041846e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5049f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e504a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e504a70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e504aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e504b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e504bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e504bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e504bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffff80004183000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4ff9f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4ffa30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4ffa70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4ffaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4ffb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e4ffbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4ffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4ffbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffff800041836e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4faa20 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4faa60 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4faaa0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4faad0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4fab70 crypto_proc() at crypto_proc+0x2bf/frame 0xfffffe003e4fabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4fabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4fabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffff80003a3f000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4b9a20 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4b9a60 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4b9aa0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4b9ad0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e4b9b30 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe003e4b9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4b9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4b9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff80003a3e6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e49ea20 mi_switch() at mi_switch+0x166/frame 0xfffffe003e49ea60 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e49eaa0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e49ead0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e49eb70 g_run_events() at g_run_events+0x45d/frame 0xfffffe003e49ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e49ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e49ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff80003a3e000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4a3a20 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4a3a60 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4a3aa0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4a3ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4a3b70 g_io_schedule_up() at g_io_schedule_up+0x4c/frame 0xfffffe003e4a3ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe003e4a3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4a3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4a3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffff80003a3f6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4a8a20 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4a8a60 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4a8aa0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4a8ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4a8b70 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe003e4a8ba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe003e4a8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4a8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4a8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100018 td 0xfffff800038856e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00addbdb10 mi_switch() at mi_switch+0x166/frame 0xfffffe00addbdb50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe00addbdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addbdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addbdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100019 td 0xfffff80003885000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00addc2b10 mi_switch() at mi_switch+0x166/frame 0xfffffe00addc2b50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe00addc2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100021 td 0xfffff8000387b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff80003af6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffff80003af76e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e404b10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e404b50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e404bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e404bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e404bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffff80003af7000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e409b10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e409b50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e409bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e409bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e409bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffff80003b096e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff80003b09000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff80003ae86e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff80003ae8000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff80003ae96e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff80003ae9000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff80003af66e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff80003ae5000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff80003ae66e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff80003ae6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffff80003ae76e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffff80004216000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e54ab10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e54ab50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e54abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e54abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e54abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff800042176e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e54fb10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e54fb50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e54fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e54fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e54fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff8000609c6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e56db10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e56db50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e56dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e56dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e56dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff800038f0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff800038f16e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5b5b10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5b5b50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e5b5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5b5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5b5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100176 td 0xfffff80003f4b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100177 td 0xfffff800075af6e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100178 td 0xfffff8001bb936e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffff8001bb93000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffff8001b1776e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffff8001b177000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffff80007db56e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffff8001b214000 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff800038c7000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add72a90 mi_switch() at mi_switch+0x166/frame 0xfffffe00add72ad0 sched_idletd() at sched_idletd+0x459/frame 0xfffffe00add72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800038c86e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add77a70 mi_switch() at mi_switch+0x166/frame 0xfffffe00add77ab0 critical_exit_preempt() at critical_exit_preempt+0x63/frame 0xfffffe00add77ad0 sched_idletd() at sched_idletd+0x401/frame 0xfffffe00add77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800038c8000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add7ca70 mi_switch() at mi_switch+0x166/frame 0xfffffe00add7cab0 critical_exit_preempt() at critical_exit_preempt+0x63/frame 0xfffffe00add7cad0 sched_idletd() at sched_idletd+0x401/frame 0xfffffe00add7cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800038b86e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add81a70 mi_switch() at mi_switch+0x166/frame 0xfffffe00add81ab0 critical_exit_preempt() at critical_exit_preempt+0x63/frame 0xfffffe00add81ad0 sched_idletd() at sched_idletd+0x401/frame 0xfffffe00add81bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add81bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add81bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800038b8000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add86a70 mi_switch() at mi_switch+0x166/frame 0xfffffe00add86ab0 critical_exit_preempt() at critical_exit_preempt+0x63/frame 0xfffffe00add86ad0 sched_idletd() at sched_idletd+0x401/frame 0xfffffe00add86bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add86bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add86bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800038b96e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add8ba70 mi_switch() at mi_switch+0x166/frame 0xfffffe00add8bab0 critical_exit_preempt() at critical_exit_preempt+0x63/frame 0xfffffe00add8bad0 sched_idletd() at sched_idletd+0x401/frame 0xfffffe00add8bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add8bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add8bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800038b9000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add90a70 mi_switch() at mi_switch+0x166/frame 0xfffffe00add90ab0 critical_exit_preempt() at critical_exit_preempt+0x63/frame 0xfffffe00add90ad0 sched_idletd() at sched_idletd+0x401/frame 0xfffffe00add90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800038c66e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add95a70 mi_switch() at mi_switch+0x166/frame 0xfffffe00add95ab0 critical_exit_preempt() at critical_exit_preempt+0x63/frame 0xfffffe00add95ad0 sched_idletd() at sched_idletd+0x401/frame 0xfffffe00add95bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add95bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add95bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800038b5000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add9aa70 mi_switch() at mi_switch+0x166/frame 0xfffffe00add9aab0 critical_exit_preempt() at critical_exit_preempt+0x63/frame 0xfffffe00add9aad0 sched_idletd() at sched_idletd+0x401/frame 0xfffffe00add9abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800038b66e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add9fa70 mi_switch() at mi_switch+0x166/frame 0xfffffe00add9fab0 critical_exit_preempt() at critical_exit_preempt+0x63/frame 0xfffffe00add9fad0 sched_idletd() at sched_idletd+0x401/frame 0xfffffe00add9fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800038b6000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00adda4a90 mi_switch() at mi_switch+0x166/frame 0xfffffe00adda4ad0 sched_idletd() at sched_idletd+0x459/frame 0xfffffe00adda4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800038b76e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00adda9a90 mi_switch() at mi_switch+0x166/frame 0xfffffe00adda9ad0 sched_idletd() at sched_idletd+0x459/frame 0xfffffe00adda9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800038c76e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add6d690 mi_switch() at mi_switch+0x166/frame 0xfffffe00add6d6d0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00add6d710 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00add6d770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00add6d7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00add6d840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00add6d8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00add6dac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00add6dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00add6dbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b0c2a, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffff800038c6000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add68a40 mi_switch() at mi_switch+0x166/frame 0xfffffe00add68a80 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00add68ac0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00add68af0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe00add68b50 audit_worker() at audit_worker+0x9f/frame 0xfffffe00add68bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add68bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add68bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81d9b220 sched_switch() at sched_switch+0x38f/frame 0xffffffff822f4bf0 mi_switch() at mi_switch+0x166/frame 0xffffffff822f4c30 sleepq_switch() at sleepq_switch+0x10e/frame 0xffffffff822f4c70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xffffffff822f4cb0 _sleep() at _sleep+0x26c/frame 0xffffffff822f4d50 swapper() at swapper+0x75/frame 0xffffffff822f4da0 mi_startup() at mi_startup+0x2ed/frame 0xffffffff822f4df0 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffff800038b7000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00addaea60 mi_switch() at mi_switch+0x166/frame 0xfffffe00addaeaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00addaeae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00addaeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addaeb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00addaebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addaebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addaebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffff800038846e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00addb3a30 mi_switch() at mi_switch+0x166/frame 0xfffffe00addb3a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00addb3ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00addb3ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addb3b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addb3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff80003884000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00addb8a30 mi_switch() at mi_switch+0x166/frame 0xfffffe00addb8a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00addb8ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00addb8ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addb8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addb8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff800038b56e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00addc7a30 mi_switch() at mi_switch+0x166/frame 0xfffffe00addc7a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00addc7ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00addc7ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addc7b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addc7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff8000387c6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe0037781a60 mi_switch() at mi_switch+0x166/frame 0xfffffe0037781aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0037781ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0037781b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037781b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037781bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037781bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037781bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff8000387c000 sched_switch() at sched_switch+0x38f/frame 0xfffffe0037786a60 mi_switch() at mi_switch+0x166/frame 0xfffffe0037786aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0037786ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0037786b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037786b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037786bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037786bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037786bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff8000387d6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003778ba60 mi_switch() at mi_switch+0x166/frame 0xfffffe003778baa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003778bae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003778bb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003778bb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003778bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003778bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003778bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff8000387d000 sched_switch() at sched_switch+0x38f/frame 0xfffffe0037790a60 mi_switch() at mi_switch+0x166/frame 0xfffffe0037790aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0037790ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0037790b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037790b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037790bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037790bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037790bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff800038486e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe0037795a60 mi_switch() at mi_switch+0x166/frame 0xfffffe0037795aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0037795ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0037795b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037795b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037795bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037795bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037795bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003848000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003779aa60 mi_switch() at mi_switch+0x166/frame 0xfffffe003779aaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003779aae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003779ab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003779ab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003779abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff800038496e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003779fa60 mi_switch() at mi_switch+0x166/frame 0xfffffe003779faa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003779fae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003779fb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003779fb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003779fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003849000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377a4a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377a4aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377a4ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377a4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377a4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377a4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff8000387b6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377a9a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377a9aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377a9ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377a9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377a9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377a9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003843000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377aea60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377aeaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377aeae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377aeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377aeb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377aebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377aebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377aebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff800038446e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377b3a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377b3aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377b3ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377b3b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377b3b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377b3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80003844000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377b8a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377b8aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377b8ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377b8b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377b8b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377b8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff800038456e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377bda60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377bdaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377bdae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377bdb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377bdb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377bdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377bdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377bdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff80003845000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377c2a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377c2aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377c2ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377c2b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377c2b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377c2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff8000383d6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377c7a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377c7aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377c7ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377c7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377c7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377c7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff8000383d000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377cca60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377ccaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377ccae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377ccb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377ccb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377ccbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ccbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800038426e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377d1a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377d1aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377d1ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377d1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377d1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80003842000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377d6a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377d6aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377d6ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377d6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377d6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800038436e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377dba60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377dbaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377dbae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377dbb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377dbb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377dbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377dbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377dbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff8000383a000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377e0a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377e0aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377e0ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377e0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377e0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff8000383b6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377e5a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377e5aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377e5ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377e5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377e5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff8000383b000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377eaa60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377eaaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377eaae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377eab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377eab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377eabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377eabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377eabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff8000383c6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377efa60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377efaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377efae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377efb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377efb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377efbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377efbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377efbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff8000383c000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377f4a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377f4aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377f4ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377f4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff800039916e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377f9a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377f9aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377f9ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377f9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80003ae7000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e499a30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e499a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e499ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e499ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e499b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e499bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e499bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e499bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003ae56e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4bea30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4bea70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4beab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4beae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4beb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4bebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4bebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4bebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80004189000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4c3a30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4c3a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4c3ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4c3ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4c3b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4c3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4c3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4c3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff8000418a6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4c8a30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4c8a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4c8ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4c8ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4c8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4c8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4c8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4c8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff8000418a000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4cda30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4cda70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4cdab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4cdae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4cdb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4cdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4cdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4cdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff8000418b6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4d2a30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4d2a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4d2ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4d2ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4d2b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4d2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4d2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4d2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff8000418b000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4d7a30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4d7a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4d7ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4d7ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4d7b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4d7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4d7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4d7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff800041876e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4dca30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4dca70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4dcab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4dcae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4dcb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4dcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4dcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4dcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80004187000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4e1a30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4e1a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4e1ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4e1ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4e1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4e1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4e1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4e1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff800041886e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4e6a30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4e6a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4e6ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4e6ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4e6b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4e6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4e6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4e6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80004188000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4eba30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4eba70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4ebab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4ebae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4ebb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4ebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4ebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4ebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff800041896e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4f0a30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4f0a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4f0ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4f0ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4f0b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff80004182000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4f5a30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4f5a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4f5ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4f5ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4f5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4f5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4f5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4f5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff800038f1000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5baa60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5baaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5baae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5bab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003e5bab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe003e5babb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5babf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5babf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff800060f16e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5f5a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5f5aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5f5ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5f5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003e5f5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe003e5f5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5f5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5f5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff800060f1000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5faa60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5faaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5faae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5fab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003e5fab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe003e5fabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5fabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5fabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffff80003f966e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5ffa60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5ffaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5ffae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5ffb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003e5ffb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe003e5ffbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5ffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5ffbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff800075af000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d3204a30 mi_switch() at mi_switch+0x166/frame 0xfffffe00d3204a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d3204ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00d3204ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d3204b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00d3204bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3204bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3204bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 3116 out of 32626 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:0:pho> show allchains chain 1: thread 104971 (pid 79638, pipe2) sleeping on 0xffffffff81847ec0 "pfault" chain 2: thread 100988 (pid 75524, pipe2) sleeping on 0xffffffff81c7feb5 "nanslp" chain 3: thread 102310 (pid 75523, su) sleeping on 0xfffff8044f6c0530 "wait" chain 4: thread 102161 (pid 75520, sleep) sleeping on 0xffffffff81847ec0 "pfault" chain 5: thread 101097 (pid 74389, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 6: thread 100961 (pid 74388, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 7: thread 100864 (pid 74387, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 8: thread 100923 (pid 74383, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 9: thread 100689 (pid 74379, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 10: thread 100567 (pid 74377, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 11: thread 101278 (pid 74375, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 12: thread 100544 (pid 74371, swap) sleeping on 0xfffff804580f1a60 "wait" chain 13: thread 100398 (pid 74369, swap) sleeping on 0xffffffff81c7feb2 "nanslp" chain 14: thread 102348 (pid 74356, sh) sleeping on 0xfffff8001b66ca60 "wait" chain 15: thread 100832 (pid 74355, tee) sleeping on 0xfffff80208ac4be0 "piperd" chain 16: thread 101491 (pid 74354, sh) sleeping on 0xfffff8045a045000 "wait" chain 17: thread 100249 (pid 62289, sh) sleeping on 0xfffff800060a7530 "wait" chain 18: thread 100238 (pid 2495, sh) sleeping on 0xfffff800076568e8 "piperd" chain 19: thread 100237 (pid 2493, awk) sleeping on 0xfffff80007656be0 "piperd" chain 20: thread 100171 (pid 2492, sh) sleeping on 0xfffff800038ca000 "wait" chain 21: thread 100188 (pid 2434, sh) sleeping on 0xfffff80006452a60 "wait" chain 22: thread 100203 (pid 2356, bash) sleeping on 0xfffff80003fe5340 "select" chain 23: thread 100215 (pid 2354, csh) sleeping on 0xfffff8038cbcd5d8 "pause" chain 24: thread 100214 (pid 2353, su) sleeping on 0xfffff8038cbcda60 "wait" chain 25: thread 100189 (pid 2347, bash) sleeping on 0xfffff80003fae000 "wait" chain 26: thread 100187 (pid 2346, sshd) sleeping on 0xfffff80003d60440 "select" chain 27: thread 100199 (pid 2343, sshd) sleeping on 0xfffff80003f2b240 "select" chain 28: thread 100195 (pid 2339, csh) sleeping on 0xfffff800065dc8b0 "ttyin" chain 29: thread 100212 (pid 2338, login) sleeping on 0xfffff8038cbcc000 "wait" chain 30: thread 100211 (pid 2337, getty) sleeping on 0xfffff800065f3cb0 "ttyin" chain 31: thread 100210 (pid 2336, getty) sleeping on 0xfffff8000778d0b0 "ttyin" chain 32: thread 100209 (pid 2335, getty) sleeping on 0xfffff800077bb0b0 "ttyin" chain 33: thread 100208 (pid 2334, getty) sleeping on 0xfffff800077bb8b0 "ttyin" chain 34: thread 100207 (pid 2333, getty) sleeping on 0xfffff800077ba0b0 "ttyin" chain 35: thread 100206 (pid 2332, getty) sleeping on 0xfffff800077ba8b0 "ttyin" chain 36: thread 100205 (pid 2331, getty) sleeping on 0xfffff800077b90b0 "ttyin" chain 37: thread 100204 (pid 2330, getty) sleeping on 0xfffff800077b98b0 "ttyin" chain 38: thread 100142 (pid 2329, getty) sleeping on 0xfffff800077b80b0 "ttyin" chain 39: thread 100164 (pid 2283, cron) sleeping on 0xffffffff81c7feb7 "nanslp" chain 40: thread 100160 (pid 2279, sshd) sleeping on 0xfffff800076c6140 "select" chain 41: thread 100193 (pid 2250, ntpd) sleeping on 0xfffff80003e8a0c0 "select" chain 42: thread 100146 (pid 2187, NLM: master) sleeping on 0xfffff80003d39660 "rpcsvc" chain 43: thread 100145 (pid 2184, rpc.statd) sleeping on 0xfffff80006052dc0 "select" chain 44: thread 100172 (pid 2138, watchdogd) sleeping on 0xffffffff81c7feb6 "nanslp" chain 45: thread 100184 (pid 2058, rpcbind) sleeping on 0xfffff80007722440 "select" chain 46: thread 100155 (pid 2048, syslogd) sleeping on 0xfffff80003fe54c0 "select" chain 47: thread 100159 (pid 1977, devd) sleeping on 0xfffff800077224c0 "select" chain 48: thread 100194 (pid 1972, dhclient) sleeping on 0xfffff8000462bec0 "select" chain 49: thread 100163 (pid 1928, dhclient) sleeping on 0xfffff80003d5f340 "select" chain 50: thread 100170 (pid 1925, dhclient) sleeping on 0xfffff800075a7f40 "select" chain 51: thread 100141 (pid 34, vnlru) sleeping on 0xfffff800060f8a60 "vlruwt" chain 52: thread 100140 (pid 33, syncer) sleeping on 0xffffffff81d56370 "syncer" chain 53: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff81d55818 "qsleep" chain 54: thread 100132 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff8180a900 "-" chain 55: thread 100134 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81812bc0 "-" chain 56: thread 100135 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff8181ae80 "-" chain 57: thread 100136 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81823140 "-" chain 58: thread 100137 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff8182b400 "-" chain 59: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff818336c0 "-" chain 60: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff8183b980 "-" chain 61: thread 100153 (pid 32, / worker) sleeping on 0xfffff80007c262e8 "sdflush" chain 62: thread 100197 (pid 32, /tmp worker) sleeping on 0xfffff80003dc54e8 "sdflush" chain 63: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff81d70cc8 "psleep" chain 64: thread 100131 (pid 30, laundry: dom0) sleeping on 0xffffffff81d9cb24 "launds" chain 65: thread 100133 (pid 30, uma) sleeping on 0xffffffff80efecd0 "umarcl" chain 66: thread 100127 (pid 29, enc_daemon1) blocked on lockmgr 0%EXCL thread 0 (pid -512, ) is inactive chain 67: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff80003fa9530 "idle" chain 68: thread 100120 (pid 27, rand_harvestq) sleeping on 0xffffffff81adbb20 "-" chain 69: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81de20f0 "waiting_for_work" chain 70: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81d5521c "-" chain 71: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81d5521c "-" chain 72: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81d5521c "-" chain 73: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81d5521c "-" chain 74: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe00d1584460 "-" chain 75: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe00d15844b8 "-" chain 76: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe00d1584510 "-" chain 77: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe00d1584568 "-" chain 78: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe00d15845c0 "-" chain 79: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe0037b66d10 "-" chain 80: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe0037b66d68 "-" chain 81: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe0037b66dc0 "-" chain 82: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe0037b66e18 "-" chain 83: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe0037b66e70 "-" chain 84: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe00d16a7d10 "-" chain 85: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe00d16a7d68 "-" chain 86: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe00d16a7dc0 "-" chain 87: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe00d16a7e18 "-" chain 88: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe00d16a7e70 "-" chain 89: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff819b6ec0 "-" chain 90: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff819b6fc0 "-" chain 91: thread 100125 (pid 20, scanner) sleeping on 0xffffffff819b6d88 "-" chain 92: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff8000417e450 "crypto_ret_wait" chain 93: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff8000417e3f0 "crypto_ret_wait" chain 94: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff8000417e390 "crypto_ret_wait" chain 95: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff8000417e330 "crypto_ret_wait" chain 96: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff8000417e2d0 "crypto_ret_wait" chain 97: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff8000417e270 "crypto_ret_wait" chain 98: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff8000417e210 "crypto_ret_wait" chain 99: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff8000417e1b0 "crypto_ret_wait" chain 100: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff8000417e150 "crypto_ret_wait" chain 101: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff8000417e0f0 "crypto_ret_wait" chain 102: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff8000417e090 "crypto_ret_wait" chain 103: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff8000417e030 "crypto_ret_wait" chain 104: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81d6b308 "crypto_wait" chain 105: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff80003adc888 "seqstate" chain 106: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81d9b110 "-" chain 107: thread 100063 (pid 13, g_up) sleeping on 0xffffffff81d9b120 "-" chain 108: thread 100064 (pid 13, g_down) sleeping on 0xffffffff81d9b118 "-" chain 109: thread 100002 (pid 1, init) sleeping on 0xfffff800038c9530 "wait" chain 110: thread 100001 (pid 10, audit) sleeping on 0xffffffff81de2d80 "audit_worker_cv" chain 111: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81d8a828 "swapin" chain 112: thread 100015 (pid 0, config_0) sleeping on 0xfffff80003888000 "-" chain 113: thread 100016 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff80003889e00 "-" chain 114: thread 100017 (pid 0, aiod_kick taskq) sleeping on 0xfffff80003889d00 "-" chain 115: thread 100020 (pid 0, thread taskq) sleeping on 0xfffff80003889a00 "-" chain 116: thread 100022 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003889800 "-" chain 117: thread 100023 (pid 0, softirq_0) sleeping on 0xfffff80003889700 "-" chain 118: thread 100024 (pid 0, softirq_1) sleeping on 0xfffff80003889600 "-" chain 119: thread 100025 (pid 0, softirq_2) sleeping on 0xfffff80003889500 "-" chain 120: thread 100026 (pid 0, softirq_3) sleeping on 0xfffff80003889400 "-" chain 121: thread 100027 (pid 0, softirq_4) sleeping on 0xfffff80003889300 "-" chain 122: thread 100028 (pid 0, softirq_5) sleeping on 0xfffff80003889200 "-" chain 123: thread 100029 (pid 0, softirq_6) sleeping on 0xfffff80003889100 "-" chain 124: thread 100030 (pid 0, softirq_7) sleeping on 0xfffff80003889000 "-" chain 125: thread 100031 (pid 0, softirq_8) sleeping on 0xfffff8000388ae00 "-" chain 126: thread 100032 (pid 0, softirq_9) sleeping on 0xfffff8000388ad00 "-" chain 127: thread 100033 (pid 0, softirq_10) sleeping on 0xfffff8000388ac00 "-" chain 128: thread 100034 (pid 0, softirq_11) sleeping on 0xfffff8000388ab00 "-" chain 129: thread 100035 (pid 0, if_io_tqg_0) sleeping on 0xfffff8000388aa00 "-" chain 130: thread 100036 (pid 0, if_io_tqg_1) sleeping on 0xfffff8000388a900 "-" chain 131: thread 100037 (pid 0, if_io_tqg_2) sleeping on 0xfffff8000388a800 "-" chain 132: thread 100038 (pid 0, if_io_tqg_3) sleeping on 0xfffff8000388a700 "-" chain 133: thread 100039 (pid 0, if_io_tqg_4) sleeping on 0xfffff8000388a600 "-" chain 134: thread 100040 (pid 0, if_io_tqg_5) sleeping on 0xfffff8000388a500 "-" chain 135: thread 100041 (pid 0, if_io_tqg_6) sleeping on 0xfffff8000388a400 "-" chain 136: thread 100042 (pid 0, if_io_tqg_7) sleeping on 0xfffff8000388a300 "-" chain 137: thread 100043 (pid 0, if_io_tqg_8) sleeping on 0xfffff8000388a200 "-" chain 138: thread 100044 (pid 0, if_io_tqg_9) sleeping on 0xfffff8000388a100 "-" chain 139: thread 100045 (pid 0, if_io_tqg_10) sleeping on 0xfffff8000388a000 "-" chain 140: thread 100046 (pid 0, if_io_tqg_11) sleeping on 0xfffff8000388be00 "-" chain 141: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003a56100 "-" chain 142: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003a56000 "-" chain 143: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003a56000 "-" chain 144: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003a56000 "-" chain 145: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003a56000 "-" chain 146: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003a56000 "-" chain 147: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003a56000 "-" chain 148: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003a56000 "-" chain 149: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003a56000 "-" chain 150: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003a56000 "-" chain 151: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003a56000 "-" chain 152: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003a56000 "-" chain 153: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003a56000 "-" chain 154: thread 100114 (pid 0, mca taskq) sleeping on 0xfffff800038e9b00 "-" chain 155: thread 100121 (pid 0, acpi_task_0) sleeping on 0xfffff800075b3400 "-" chain 156: thread 100122 (pid 0, acpi_task_1) sleeping on 0xfffff800075b3400 "-" chain 157: thread 100123 (pid 0, acpi_task_2) sleeping on 0xfffff800075b3400 "-" chain 158: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003a57e00 "-" db:0:pho> chain 1: thread 104971 (pid 79638, pipe2) sleeping on 0xffffffff81847ec0 "pfault" chain 2: thread 100988 (pid 75524, pipe2) sleeping on 0xffffffff81c7feb5 "nanslp" chain 3: thread 102310 (pid 75523, su) sleeping on 0xfffff8044f6c0530 "wait" chain 4: thread 102161 (pid 75520, sleep) sleeping on 0xffffffff81847ec0 "pfault" chain 5: thread 101097 (pid 74389, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 6: thread 100961 (pid 74388, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 7: thread 100864 (pid 74387, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 8: thread 100923 (pid 74383, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 9: thread 100689 (pid 74379, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 10: thread 100567 (pid 74377, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 11: thread 101278 (pid 74375, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 12: thread 100544 (pid 74371, swap) sleeping on 0xfffff804580f1a60 "wait" chain 13: thread 100398 (pid 74369, swap) sleeping on 0xffffffff81c7feb2 "nanslp" chain 14: thread 102348 (pid 74356, sh) sleeping on 0xfffff8001b66ca60 "wait" chain 15: thread 100832 (pid 74355, tee) sleeping on 0xfffff80208ac4be0 "piperd" chain 16: thread 101491 (pid 74354, sh) sleeping on 0xfffff8045a045000 "wait" chain 17: thread 100249 (pid 62289, sh) sleeping on 0xfffff800060a7530 "wait" chain 18: thread 100238 (pid 2495, sh) sleeping on 0xfffff800076568e8 "piperd" chain 19: thread 100237 (pid 2493, awk) sleeping on 0xfffff80007656be0 "piperd" chain 20: thread 100171 (pid 2492, sh) sleeping on 0xfffff800038ca000 "wait" chain 21: thread 100188 (pid 2434, sh) sleeping on 0xfffff80006452a60 "wait" chain 22: thread 100203 (pid 2356, bash) sleeping on 0xfffff80003fe5340 "select" chain 23: thread 100215 (pid 2354, csh) sleeping on 0xfffff8038cbcd5d8 "pause" chain 24: thread 100214 (pid 2353, su) sleeping on 0xfffff8038cbcda60 "wait" chain 25: thread 100189 (pid 2347, bash) sleeping on 0xfffff80003fae000 "wait" chain 26: thread 100187 (pid 2346, sshd) sleeping on 0xfffff80003d60440 "select" chain 27: thread 100199 (pid 2343, sshd) sleeping on 0xfffff80003f2b240 "select" chain 28: thread 100195 (pid 2339, csh) sleeping on 0xfffff800065dc8b0 "ttyin" chain 29: thread 100212 (pid 2338, login) sleeping on 0xfffff8038cbcc000 "wait" chain 30: thread 100211 (pid 2337, getty) sleeping on 0xfffff800065f3cb0 "ttyin" chain 31: thread 100210 (pid 2336, getty) sleeping on 0xfffff8000778d0b0 "ttyin" chain 32: thread 100209 (pid 2335, getty) sleeping on 0xfffff800077bb0b0 "ttyin" chain 33: thread 100208 (pid 2334, getty) sleeping on 0xfffff800077bb8b0 "ttyin" chain 34: thread 100207 (pid 2333, getty) sleeping on 0xfffff800077ba0b0 "ttyin" chain 35: thread 100206 (pid 2332, getty) sleeping on 0xfffff800077ba8b0 "ttyin" chain 36: thread 100205 (pid 2331, getty) sleeping on 0xfffff800077b90b0 "ttyin" chain 37: thread 100204 (pid 2330, getty) sleeping on 0xfffff800077b98b0 "ttyin" chain 38: thread 100142 (pid 2329, getty) sleeping on 0xfffff800077b80b0 "ttyin" chain 39: thread 100164 (pid 2283, cron) sleeping on 0xffffffff81c7feb7 "nanslp" chain 40: thread 100160 (pid 2279, sshd) sleeping on 0xfffff800076c6140 "select" chain 41: thread 100193 (pid 2250, ntpd) sleeping on 0xfffff80003e8a0c0 "select" chain 42: thread 100146 (pid 2187, NLM: master) sleeping on 0xfffff80003d39660 "rpcsvc" chain 43: thread 100145 (pid 2184, rpc.statd) sleeping on 0xfffff80006052dc0 "select" chain 44: thread 100172 (pid 2138, watchdogd) sleeping on 0xffffffff81c7feb6 "nanslp" chain 45: thread 100184 (pid 2058, rpcbind) sleeping on 0xfffff80007722440 "select" chain 46: thread 100155 (pid 2048, syslogd) sleeping on 0xfffff80003fe54c0 "select" chain 47: thread 100159 (pid 1977, devd) sleeping on 0xfffff800077224c0 "select" chain 48: thread 100194 (pid 1972, dhclient) sleeping on 0xfffff8000462bec0 "select" chain 49: thread 100163 (pid 1928, dhclient) sleeping on 0xfffff80003d5f340 "select" chain 50: thread 100170 (pid 1925, dhclient) sleeping on 0xfffff800075a7f40 "select" chain 51: thread 100141 (pid 34, vnlru) sleeping on 0xfffff800060f8a60 "vlruwt" chain 52: thread 100140 (pid 33, syncer) sleeping on 0xffffffff81d56370 "syncer" chain 53: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff81d55818 "qsleep" chain 54: thread 100132 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff8180a900 "-" chain 55: thread 100134 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81812bc0 "-" chain 56: thread 100135 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff8181ae80 "-" chain 57: thread 100136 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81823140 "-" chain 58: thread 100137 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff8182b400 "-" chain 59: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff818336c0 "-" chain 60: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff8183b980 "-" chain 61: thread 100153 (pid 32, / worker) sleeping on 0xfffff80007c262e8 "sdflush" chain 62: thread 100197 (pid 32, /tmp worker) sleeping on 0xfffff80003dc54e8 "sdflush" chain 63: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff81d70cc8 "psleep" chain 64: thread 100131 (pid 30, laundry: dom0) sleeping on 0xffffffff81d9cb24 "launds" chain 65: thread 100133 (pid 30, uma) sleeping on 0xffffffff80efecd0 "umarcl" chain 66: thread 100127 (pid 29, enc_daemon1) blocked on lockmgr 0%EXCL thread 0 (pid -512, ) is inactive chain 67: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff80003fa9530 "idle" chain 68: thread 100120 (pid 27, rand_harvestq) sleeping on 0xffffffff81adbb20 "-" chain 69: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81de20f0 "waiting_for_work" chain 70: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81d5521c "-" chain 71: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81d5521c "-" chain 72: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81d5521c "-" chain 73: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81d5521c "-" chain 74: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe00d1584460 "-" chain 75: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe00d15844b8 "-" chain 76: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe00d1584510 "-" chain 77: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe00d1584568 "-" chain 78: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe00d15845c0 "-" chain 79: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe0037b66d10 "-" chain 80: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe0037b66d68 "-" chain 81: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe0037b66dc0 "-" chain 82: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe0037b66e18 "-" chain 83: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe0037b66e70 "-" chain 84: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe00d16a7d10 "-" chain 85: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe00d16a7d68 "-" chain 86: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe00d16a7dc0 "-" chain 87: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe00d16a7e18 "-" chain 88: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe00d16a7e70 "-" chain 89: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff819b6ec0 "-" chain 90: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff819b6fc0 "-" chain 91: thread 100125 (pid 20, scanner) sleeping on 0xffffffff819b6d88 "-" chain 92: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff8000417e450 "crypto_ret_wait" chain 93: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff8000417e3f0 "crypto_ret_wait" chain 94: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff8000417e390 "crypto_ret_wait" chain 95: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff8000417e330 "crypto_ret_wait" chain 96: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff8000417e2d0 "crypto_ret_wait" chain 97: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff8000417e270 "crypto_ret_wait" chain 98: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff8000417e210 "crypto_ret_wait" chain 99: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff8000417e1b0 "crypto_ret_wait" chain 100: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff8000417e150 "crypto_ret_wait" chain 101: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff8000417e0f0 "crypto_ret_wait" chain 102: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff8000417e090 "crypto_ret_wait" chain 103: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff8000417e030 "crypto_ret_wait" chain 104: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81d6b308 "crypto_wait" chain 105: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff80003adc888 "seqstate" chain 106: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81d9b110 "-" chain 107: thread 100063 (pid 13, g_up) sleeping on 0xffffffff81d9b120 "-" chain 108: thread 100064 (pid 13, g_down) sleeping on 0xffffffff81d9b118 "-" chain 109: thread 100002 (pid 1, init) sleeping on 0xfffff800038c9530 "wait" chain 110: thread 100001 (pid 10, audit) sleeping on 0xffffffff81de2d80 "audit_worker_cv" chain 111: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81d8a828 "swapin" chain 112: thread 100015 (pid 0, config_0) sleeping on 0xfffff80003888000 "-" chain 113: thread 100016 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff80003889e00 "-" chain 114: thread 100017 (pid 0, aiod_kick taskq) sleeping on 0xfffff80003889d00 "-" chain 115: thread 100020 (pid 0, thread taskq) sleeping on 0xfffff80003889a00 "-" chain 116: thread 100022 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003889800 "-" chain 117: thread 100023 (pid 0, softirq_0) sleeping on 0xfffff80003889700 "-" chain 118: thread 100024 (pid 0, softirq_1) sleeping on 0xfffff80003889600 "-" chain 119: thread 100025 (pid 0, softirq_2) sleeping on 0xfffff80003889500 "-" chain 120: thread 100026 (pid 0, softirq_3) sleeping on 0xfffff80003889400 "-" chain 121: thread 100027 (pid 0, softirq_4) sleeping on 0xfffff80003889300 "-" chain 122: thread 100028 (pid 0, softirq_5) sleeping on 0xfffff80003889200 "-" chain 123: thread 100029 (pid 0, softirq_6) sleeping on 0xfffff80003889100 "-" chain 124: thread 100030 (pid 0, softirq_7) sleeping on 0xfffff80003889000 "-" chain 125: thread 100031 (pid 0, softirq_8) sleeping on 0xfffff8000388ae00 "-" chain 126: thread 100032 (pid 0, softirq_9) sleeping on 0xfffff8000388ad00 "-" chain 127: thread 100033 (pid 0, softirq_10) sleeping on 0xfffff8000388ac00 "-" chain 128: thread 100034 (pid 0, softirq_11) sleeping on 0xfffff8000388ab00 "-" chain 129: thread 100035 (pid 0, if_io_tqg_0) sleeping on 0xfffff8000388aa00 "-" chain 130: thread 100036 (pid 0, if_io_tqg_1) sleeping on 0xfffff8000388a900 "-" chain 131: thread 100037 (pid 0, if_io_tqg_2) sleeping on 0xfffff8000388a800 "-" chain 132: thread 100038 (pid 0, if_io_tqg_3) sleeping on 0xfffff8000388a700 "-" chain 133: thread 100039 (pid 0, if_io_tqg_4) sleeping on 0xfffff8000388a600 "-" chain 134: thread 100040 (pid 0, if_io_tqg_5) sleeping on 0xfffff8000388a500 "-" chain 135: thread 100041 (pid 0, if_io_tqg_6) sleeping on 0xfffff8000388a400 "-" chain 136: thread 100042 (pid 0, if_io_tqg_7) sleeping on 0xfffff8000388a300 "-" chain 137: thread 100043 (pid 0, if_io_tqg_8) sleeping on 0xfffff8000388a200 "-" chain 138: thread 100044 (pid 0, if_io_tqg_9) sleeping on 0xfffff8000388a100 "-" chain 139: thread 100045 (pid 0, if_io_tqg_10) sleeping on 0xfffff8000388a000 "-" chain 140: thread 100046 (pid 0, if_io_tqg_11) sleeping on 0xfffff8000388be00 "-" chain 141: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003a56100 "-" chain 142: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003a56000 "-" chain 143: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003a56000 "-" chain 144: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003a56000 "-" chain 145: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003a56000 "-" chain 146: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003a56000 "-" chain 147: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003a56000 "-" chain 148: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003a56000 "-" chain 149: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003a56000 "-" chain 150: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003a56000 "-" chain 151: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003a56000 "-" chain 152: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003a56000 "-" chain 153: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003a56000 "-" chain 154: thread 100114 (pid 0, mca taskq) sleeping on 0xfffff800038e9b00 "-" chain 155: thread 100121 (pid 0, acpi_task_0) sleeping on 0xfffff800075b3400 "-" chain 156: thread 100122 (pid 0, acpi_task_1) sleeping on 0xfffff800075b3400 "-" chain 157: thread 100123 (pid 0, acpi_task_2) sleeping on 0xfffff800075b3400 "-" chain 158: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003a57e00 "-" db> (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=0x0) at ../../../kern/kern_shutdown.c:392 #2 0xffffffff80495b9a in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #3 0xffffffff8049595c in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #4 0xffffffff8049a928 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #5 0xffffffff8049595c in db_command (last_cmdp=, cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:482 #6 0xffffffff804956cd in db_command_loop () at ../../../ddb/db_command.c:535 #7 0xffffffff804988f8 in db_trap (type=, code=) at ../../../ddb/db_main.c:252 #8 0xffffffff80c0f797 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:691 #9 0xffffffff81061617 in trap (frame=0xfffffe00d32244f0) at ../../../amd64/amd64/trap.c:585 #10 #11 kdb_enter (why=0xffffffff811ea2a5 "panic", msg=) at ../../../kern/subr_kdb.c:478 #12 0xffffffff80bc3f8a in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:897 #13 0xffffffff80bc3d23 in panic (fmt=0xffffffff81c79658 "\a\355\032\201\377\377\377\377") at ../../../kern/kern_shutdown.c:835 #14 0xffffffff80f176eb in vm_object_madvise (object=, pindex=0x1595, end=0x15d6, advice=0x5) at ../../../vm/vm_object.c:1163 #15 0xffffffff80f0d96a in vm_map_madvise (map=0xfffff80003663910, start=0xfffffe00af395000, end=0xfffffe00af3d6000, behav=0x5) at ../../../vm/vm_map.c:2757 #16 0xffffffff80b7c103 in exec_release_args_kva (argkva=0xfffff8000614ec60, gen=0x12) at ../../../kern/kern_exec.c:1358 #17 0xffffffff80b7c06f in exec_args_kva_lowmem (arg=) at ../../../kern/kern_exec.c:1398 #18 0xffffffff80f23f00 in vm_pageout_lowmem () at ../../../vm/vm_pageout.c:1983 #19 vm_pageout_worker (arg=) at ../../../vm/vm_pageout.c:2068 #20 0xffffffff80f23b43 in vm_pageout () at ../../../vm/vm_pageout.c:2223 #21 0xffffffff80b82040 in fork_exit (callout=0xffffffff80f239b0 , arg=0x0, frame=0xfffffe00d3224c00) at ../../../kern/kern_fork.c:1059 #22 (kgdb) f 14 #14 0xffffffff80f176eb in vm_object_madvise (object=, pindex=0x1595, end=0x15d6, advice=0x5) at ../../../vm/vm_object.c:1163 1163 KASSERT((tm->oflags & VPO_UNMANAGED) == 0, (kgdb) l 1158 */ 1159 if (!vm_page_all_valid(tm) || vm_page_wired(tm)) 1160 goto next_pindex; 1161 KASSERT((tm->flags & PG_FICTITIOUS) == 0, 1162 ("vm_object_madvise: page %p is fictitious", tm)); 1163 KASSERT((tm->oflags & VPO_UNMANAGED) == 0, 1164 ("vm_object_madvise: page %p is not managed", tm)); 1165 if (vm_page_tryxbusy(tm) == 0) { 1166 if (object != tobject) 1167 VM_OBJECT_WUNLOCK(object); (kgdb) info loc m = 0xfffffe0007a0c828 tm = tobject = 0xfffff80003bf6b58 tpindex = backing_object = (kgdb) f 15 #15 0xffffffff80f0d96a in vm_map_madvise (map=0xfffff80003663910, start=0xfffffe00af395000, end=0xfffffe00af3d6000, behav=0x5) at ../../../vm/vm_map.c:2757 2757 vm_object_madvise(current->object.vm_object, pstart, (kgdb) l 2752 */ 2753 if (behav == MADV_DONTNEED || behav == MADV_FREE) 2754 pmap_advise(map->pmap, useStart, useEnd, 2755 behav); 2756 2757 vm_object_madvise(current->object.vm_object, pstart, 2758 pend, behav); 2759 2760 /* 2761 * Pre-populate paging structures in the (kgdb) info loc useEnd = useStart = 0xfffffe00af395000 pstart = 0x1595 pend = 0x15d6 modify_map = entry = current = 0xfffff8000613c850 (kgdb) p *current $1 = {prev = 0xfffff80003663910, next = 0xfffff80003663910, left = 0x0, right = 0x0, start = 0xfffffe00ade00000, end = 0xfffffe00af660000, next_read = 0xfffffe00ade00000, max_free = 0x40000, object = {vm_object = 0xfffff80003bf6b58, sub_map = 0xfffff80003bf6b58}, offset = 0x0, eflags = 0x0, protection = 0x3, max_protection = 0x3, inheritance = 0x1, read_ahead = 0xf, wired_count = 0x0, cred = 0x0, wiring_thread = 0x0} (kgdb) p *map $2 = {header = {prev = 0xfffff8000613c850, next = 0xfffff8000613c850, left = 0x0, right = 0x0, start = 0xfffffe00af6a0000, end = 0xfffffe00ade00000, next_read = 0x0, max_free = 0x0, object = {vm_object = 0x0, sub_map = 0x0}, offset = 0x0, eflags = 0x80000, protection = 0x0, max_protection = 0x0, inheritance = 0x0, read_ahead = 0x0, wired_count = 0x0, cred = 0x0, wiring_thread = 0x0}, lock = {lock_object = {lo_name = 0xffffffff8119aa48 "vm map (user)", lo_flags = 0x2330000, lo_data = 0x0, lo_witness = 0xfffff8087fd6b700}, sx_lock = 0x21}, system_mtx = {lock_object = {lo_name = 0xffffffff81150552 "vm map (system)", lo_flags = 0x1430000, lo_data = 0x0, lo_witness = 0xfffff8087fd6b580}, mtx_lock = 0x0}, nentries = 0x1, size = 0x1860000, timestamp = 0x62, needs_wakeup = 0x0, system_map = 0x0, flags = 0x4, root = 0xfffff8000613c850, pmap = 0xffffffff81dccde0 , anon_loc = 0x0, busy = 0x0, nupdates = 0x0} (kgdb) Index: src/sys/vm/swap_pager.c =================================================================== --- src/sys/vm/swap_pager.c (revision 354585) +++ src/sys/vm/swap_pager.c (working copy) @@ -422,6 +422,8 @@ static daddr_t swp_pager_getswapspace(int *npages, */ static daddr_t swp_pager_meta_build(vm_object_t, vm_pindex_t, daddr_t); static void swp_pager_meta_free(vm_object_t, vm_pindex_t, vm_pindex_t); +static void swp_pager_meta_copy_free(vm_object_t src, vm_object_t dst, + vm_pindex_t pindex, vm_pindex_t count); static void swp_pager_meta_free_all(vm_object_t); static daddr_t swp_pager_meta_ctl(vm_object_t, vm_pindex_t, int); @@ -933,6 +935,39 @@ swap_pager_reserve(vm_object_t object, vm_pindex_t return (0); } +static bool +swp_pager_copy_source(vm_object_t srcobject, vm_object_t dstobject, + vm_pindex_t pindex, daddr_t addr) +{ + daddr_t dstaddr; + + if (dstobject == NULL || + swp_pager_meta_ctl(dstobject, pindex, 0) != SWAPBLK_NONE) { + /* + * No destination, or destination has valid swapblk, or it is + * represented by a resident page. Caller should destroy the + * source block. + */ + return (false); + } + + /* + * Destination has no swapblk and is not resident, copy source. + * + * swp_pager_meta_build() can sleep. + */ + vm_object_pip_add(srcobject, 1); + VM_OBJECT_WUNLOCK(srcobject); + vm_object_pip_add(dstobject, 1); + dstaddr = swp_pager_meta_build(dstobject, pindex, addr); + KASSERT(dstaddr == SWAPBLK_NONE, + ("Unexpected destination swapblk")); + vm_object_pip_wakeup(dstobject); + VM_OBJECT_WLOCK(srcobject); + vm_object_pip_wakeup(srcobject); + return (true); +} + /* * SWAP_PAGER_COPY() - copy blocks from source pager to destination pager * and destroy the source. @@ -956,8 +991,6 @@ void swap_pager_copy(vm_object_t srcobject, vm_object_t dstobject, vm_pindex_t offset, int destroysource) { - vm_pindex_t i; - daddr_t dstaddr, n_free, s_free, srcaddr; VM_OBJECT_ASSERT_WLOCKED(srcobject); VM_OBJECT_ASSERT_WLOCKED(dstobject); @@ -984,39 +1017,8 @@ swap_pager_copy(vm_object_t srcobject, vm_object_t /* * Transfer source to destination. */ - swp_pager_init_freerange(&s_free, &n_free); - for (i = 0; i < dstobject->size; ++i) { - srcaddr = swp_pager_meta_ctl(srcobject, i + offset, SWM_POP); - if (srcaddr == SWAPBLK_NONE) - continue; - dstaddr = swp_pager_meta_ctl(dstobject, i, 0); - if (dstaddr != SWAPBLK_NONE) { - /* - * Destination has valid swapblk or it is represented - * by a resident page. We destroy the source block. - */ - swp_pager_update_freerange(&s_free, &n_free, srcaddr); - continue; - } + swp_pager_meta_copy_free(srcobject, dstobject, offset, dstobject->size); - /* - * Destination has no swapblk and is not resident, - * copy source. - * - * swp_pager_meta_build() can sleep. - */ - vm_object_pip_add(srcobject, 1); - VM_OBJECT_WUNLOCK(srcobject); - vm_object_pip_add(dstobject, 1); - dstaddr = swp_pager_meta_build(dstobject, i, srcaddr); - KASSERT(dstaddr == SWAPBLK_NONE, - ("Unexpected destination swapblk")); - vm_object_pip_wakeup(dstobject); - VM_OBJECT_WLOCK(srcobject); - vm_object_pip_wakeup(srcobject); - } - swp_pager_freeswapspace(s_free, n_free); - /* * Free left over swap blocks in source. * @@ -2003,7 +2005,8 @@ allocated: } /* - * SWP_PAGER_META_FREE() - free a range of blocks in the object's swap metadata + * SWP_PAGER_META_COPY_FREE() - free a range of blocks in the srcobject's swap + * metadata, or copy it into dstobject. * * The requested range of blocks is freed, with any associated swap * returned to the swap bitmap. @@ -2013,21 +2016,23 @@ allocated: * with resident pages. */ static void -swp_pager_meta_free(vm_object_t object, vm_pindex_t pindex, vm_pindex_t count) +swp_pager_meta_copy_free(vm_object_t srcobject, vm_object_t dstobject, + vm_pindex_t pindex, vm_pindex_t count) { struct swblk *sb; daddr_t n_free, s_free; - vm_pindex_t last; + vm_pindex_t offset, last; int i, limit, start; - VM_OBJECT_ASSERT_WLOCKED(object); - if (object->type != OBJT_SWAP || count == 0) + VM_OBJECT_ASSERT_WLOCKED(srcobject); + if (srcobject->type != OBJT_SWAP || count == 0) return; swp_pager_init_freerange(&s_free, &n_free); + offset = pindex; last = pindex + count; for (;;) { - sb = SWAP_PCTRIE_LOOKUP_GE(&object->un_pager.swp.swp_blks, + sb = SWAP_PCTRIE_LOOKUP_GE(&srcobject->un_pager.swp.swp_blks, rounddown(pindex, SWAP_META_PAGES)); if (sb == NULL || sb->p >= last) break; @@ -2037,13 +2042,17 @@ static void for (i = start; i < limit; i++) { if (sb->d[i] == SWAPBLK_NONE) continue; - swp_pager_update_freerange(&s_free, &n_free, sb->d[i]); + if (!swp_pager_copy_source(srcobject, dstobject, + sb->p + i - offset, sb->d[i])) { + swp_pager_update_freerange(&s_free, &n_free, + sb->d[i]); + } sb->d[i] = SWAPBLK_NONE; } pindex = sb->p + SWAP_META_PAGES; if (swp_pager_swblk_empty(sb, 0, start) && swp_pager_swblk_empty(sb, limit, SWAP_META_PAGES)) { - SWAP_PCTRIE_REMOVE(&object->un_pager.swp.swp_blks, + SWAP_PCTRIE_REMOVE(&srcobject->un_pager.swp.swp_blks, sb->p); uma_zfree(swblk_zone, sb); } @@ -2052,6 +2061,22 @@ static void } /* + * SWP_PAGER_META_FREE() - free a range of blocks in the object's swap metadata + * + * The requested range of blocks is freed, with any associated swap + * returned to the swap bitmap. + * + * This routine will free swap metadata structures as they are cleaned + * out. This routine does *NOT* operate on swap metadata associated + * with resident pages. + */ +static void +swp_pager_meta_free(vm_object_t object, vm_pindex_t pindex, vm_pindex_t count) +{ + swp_pager_meta_copy_free(object, NULL, pindex, count); +} + +/* * SWP_PAGER_META_FREE_ALL() - destroy all swap metadata associated with object * * This routine locates and destroys all swap metadata associated with -- Test scenario: misc/pipe2.sh