panic: double fault, vmcore.54 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #2 r349405M: Wed Jun 26 08:09:23 CEST 2019 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 8.0.1 (branches/release_80 363030) (based on LLVM 8.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33184874496 (31647 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads arc4random: WARNING: initial seeding bypassed the cryptographic random device because it was not yet seeded and the knob 'bypass_before_seeding' was enabled. ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard Launching APs: 1 10 6 4 8 3 9 11 2 7 5 Timecounter "TSC-low" frequency 1750036216 Hz quality 1000 random: entropy device external interface [ath_hal] loaded kbd1 at kbdmux0 module_register_init: MOD_LOAD (vesa, 0xffffffff811202d0, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" 000.000061 [4254] netmap_init netmap: loaded module nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0:6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 p4tcc0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec ugen2.1: at usbus2 ugen1.1: at usbus1 ugen0.1: <0x8086 XHCI root HUB> at usbus0 uhub0 on usbus2 uhub0: on usbus2 uhub1 on usbus0 uhub1: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 uhub2 on usbus1 uhub2: on usbus1 Expensive timeout(9) function: 0xffffffff804db390(0xfffffe0099fd4000) 0.004485459 s ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ses0: pass0 in 'Slot 01', SATA Slot: scbus1 target 0 ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> Trying to mount root from ufs:/dev/gpt/work [rw]... WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. WARNING: / was not properly dismounted Expensive timeout(9) function: 0xffffffff80a3d4a0(0xffffffff81ae7390) 0.007388869 s random: unblocking device. uhub0: 2 ports with 2 removable, self powered Interface IP-Address Broadcast Setting hostuuid: 00000000-0000-0000-0000-002590c99976. Setting hostid: 0x90b83241. uhub2: 2 ports with 2 removable, self powered Starting file system checks: WARNING: / was not properly dismounted . lo0: link state changed to UP Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 igb0: flags=8843 metric 0 mtuigb0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub4 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff8000603f800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 26 Jun 08:18:10 ntpdate[2051]: step time server 192.168.5.1 offset 134.193551 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. lock order reversal: 1st 0xfffffe0000880510 bufwait (bufwait) @ kern/vfs_bio.c:3904 2nd 0xfffff8000aca9600 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0xffffffff80c34833 at witness_debugger+0x73 #1 0xffffffff80c3457d at witness_checkorder+0xa7d #2 0xffffffff80bd3b88 at _sx_xlock+0x68 #3 0xffffffff80edcdcd at ufsdirhash_add+0x4d #4 0xffffffff80ee1766 at ufs_direnter+0x446 #5 0xffffffff80ee9979 at ufs_mkdir+0x8c9 #6 0xffffffff812209fc at VOP_MKDIR_APV+0x8c #7 0xffffffff80cace93 at kern_mkdirat+0x1b3 #8 0xffffffff8109ab91 at amd64_syscall+0x291 #9 0xffffffff8107276d at fast_syscall_common+0x101 Clearing /tmp (X related). Starting statd. Starting lockd. fscklock order reversal: 1st 0xfffff8000ab747d0 ufs (ufs) @ kern/vfs_subr.c:2687 2nd 0xfffffe0000880138 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:283 3rd 0xfffff802ac145558 ufs (ufs) @ kern/vfs_subr.c:2687 stack backtrace: #0 0xffffffff80c34833 at witness_debugger+0x73 #1 0xffffffff80c3457d at witness_checkorder+0xa7d #2 0xffffffff80b9e99b at lockmgr_xlock_hard+0x6b #3 0xffffffff80b9f40e at __lockmgr_args+0x5fe #4 0xffffffff80ed776c at ffs_lock+0x7c #5 0xffffffff81221550 at VOP_LOCK1_APV+0x70 #6 0xffffffff80cb0395 at _vn_lock+0x65 #7 0xffffffff80c9e256 at vget+0xa6 #8 0xffffffff80c9000c at vfs_hash_get+0xcc #9 0xffffffff80ed2fef at ffs_vgetf+0x3f #10 0xffffffff80ec831f at softdep_sync_buf+0x56f #11 0xffffffff80ed8584 at ffs_syncvnode+0x234 #12 0xffffffff80ed5d2d at ffs_sync+0x20d #13 0xffffffff80c9695f at dounmount+0x4bf #14 0xffffffff80c96400 at sys_unmount+0x300 #15 0xffffffff8109ab91 at amd64_syscall+0x291 #16 0xffffffff8107276d at fast_syscall_common+0x101 lock order reversal: 1st 0xfffff8000ac39558 ufs (ufs) @ kern/vfs_mount.c:1354 2nd 0xfffff8000ab74a48 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1926 stack backtrace: #0 0xffffffff80c34833 at witness_debugger+0x73 #1 0xffffffff80c3457d at witness_checkorder+0xa7d #2 0xffffffff80b9e49b at lockmgr_lock_fast_path+0x16b #3 0xffffffff81221550 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cb0395 at _vn_lock+0x65 #5 0xffffffff80eb517d at softdep_flushworklist+0x5d #6 0xffffffff80ed5f26 at ffs_sync+0x406 #7 0xffffffff80c9695f at dounmount+0x4bf #8 0xffffffff80c96400 at sys_unmount+0x300 #9 0xffffffff8109ab91 at amd64_syscall+0x291 #10 0xffffffff8107276d at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 215 files, 38434 used, 1226973 free (93 frags, 153360 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Wed Jun 26 08:18 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Jun 26 08:18:18 mercat1 login[2332]: ROOT LOGIN (root) ON ttyu1 Last login: Tue Jun 25 22:49:31 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #2 r349405M: Wed Jun 26 08:09:23 CEST 2019 root@mercat1:~ # Jun 26 08:18:26 mercat1 su[2346]: pho to root on /dev/pts/0 20190626 08:19:01 all (1/636): crossmp2.sh 20190626 08:19:02 all (2/636): getrandom.sh 20190626 08:19:04 all (3/636): holdcnt0.sh 20190626 08:19:05 all (4/636): maxmemdom.sh 20190626 08:19:07 all (5/636): nfs12.sh 20190626 08:19:08 all (6/636): nfs15lockd.sh 20190626 08:19:09 all (7/636): nfs15lockd3.sh 20190626 08:19:11 all (8/636): nfs4.sh 20190626 08:19:12 all (9/636): nfs7.sh 20190626 08:19:14 all (10/636): nfs9.sh 20190626 08:19:15 all (11/636): parallelmount2.sh 20190626 08:19:16 all (12/636): pathconf2.sh 20190626 08:19:18 all (13/636): 1st.sh 20190626 08:19:19 all (14/636): 256m.sh 20190626 08:19:21 all (15/636): audit.sh 20190626 08:19:22 all (16/636): buildworld2.sh 20190626 08:19:23 all (17/636): cpuset.sh 20190626 08:19:25 all (18/636): crossmp6.sh 20190626 08:19:26 all (19/636): devfs5.sh 20190626 08:19:28 all (20/636): fsck4.sh 20190626 08:19:29 all (21/636): geomleak.sh 20190626 08:19:31 all (22/636): gnop3.sh 20190626 08:19:32 all (23/636): holdcnt02.sh 20190626 08:19:34 all (24/636): holdcnt03.sh 20190626 08:19:35 all (25/636): isofs2.sh 20190626 08:19:36 all (26/636): ldt.sh 20190626 08:19:38 all (27/636): ldt2.sh 20190626 08:19:39 all (28/636): libMicro.sh 20190626 08:19:41 all (29/636): linux.sh 20190626 08:19:42 all (30/636): lockf.sh 20190626 08:19:43 all (31/636): mac.sh 20190626 08:19:45 all (32/636): mac_chkexec.sh 20190626 08:19:46 all (33/636): machipc.sh 20190626 08:19:48 all (34/636): machipc2.sh 20190626 08:19:49 all (35/636): md4.sh 20190626 08:19:50 all (36/636): md6.sh 20190626 08:19:52 all (37/636): mdconfig.sh 20190626 08:19:53 all (38/636): mdconfig3.sh freework leak: 7/15. newblk leak: 140/152. 20190626 08:19:55 all (39/636): memguard4.sh 20190626 08:19:56 all (40/636): mmap16.sh 20190626 08:19:58 all (41/636): mmap35.sh 20190626 08:19:59 all (42/636): msdos2.sh 20190626 08:20:01 all (43/636): msetdomain.sh 20190626 08:20:02 all (44/636): nbufkv.sh 20190626 08:20:04 all (45/636): nfs.sh 20190626 08:20:05 all (46/636): nfs13.sh 20190626 08:20:06 all (47/636): nfs14.sh 20190626 08:20:08 all (48/636): nfs15.sh 20190626 08:20:09 all (49/636): nfs3.sh 20190626 08:20:11 all (50/636): nfs8.sh pts leak: 1/2 20190626 08:20:12 all (51/636): nfsdelegation.sh Jun 26 08:20:12 mercat1 su[28961]: pho to root on /dev/pts/1 20190626 08:20:13 all (52/636): nfsdepth.sh 20190626 08:20:15 all (53/636): nfsrename.sh 20190626 08:20:16 all (54/636): nfssillyrename.sh 20190626 08:20:17 all (55/636): nullfs23.sh 20190626 08:20:19 all (56/636): numa.sh 20190626 08:20:20 all (57/636): oom.sh 20190626 08:20:22 all (58/636): pagefault.sh 20190626 08:20:23 all (59/636): pathconf.sh 20190626 08:20:24 all (60/636): pcatch.sh 20190626 08:20:26 all (61/636): pcatch2.sh 20190626 08:20:27 all (62/636): pkru.sh 20190626 08:20:29 all (63/636): pkru2.sh 20190626 08:20:30 all (64/636): procstat.sh 20190626 08:20:31 all (65/636): quota5.sh 20190626 08:20:33 all (66/636): routetbl.sh 20190626 08:20:34 all (67/636): schedfuzz.sh 20190626 08:20:35 all (68/636): segregs.sh 20190626 08:20:37 all (69/636): select3.sh 20190626 08:20:38 all (70/636): snap2-1.sh lock order reversal: 1st 0xfffffe000094e328 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:283 2nd 0xfffff8000a341e30 snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2327 stack backtrace: #0 0xffffffff80c34833 at witness_debugger+0x73 #1 0xffffffff80c3457d at witness_checkorder+0xa7d #2 0xffffffff80b9e99b at lockmgr_xlock_hard+0x6b #3 0xffffffff80b9f40e at __lockmgr_args+0x5fe #4 0xffffffff80eb4206 at ffs_copyonwrite+0x176 #5 0xffffffff80ed67ec at ffs_geom_strategy+0x8c #6 0xffffffff80ee9e73 at ufs_strategy+0x83 #7 0xffffffff81221990 at VOP_STRATEGY_APV+0x90 #8 0xffffffff80c7a8f4 at bufstrategy+0x44 #9 0xffffffff80c7a77d at bufwrite+0x24d #10 0xffffffff80ed860e at ffs_syncvnode+0x2be #11 0xffffffff80ed7622 at ffs_fsync+0x22 #12 0xffffffff81220388 at VOP_FSYNC_APV+0x88 #13 0xffffffff80ee7aaf at ufs_remove+0xdf #14 0xffffffff8122052c at VOP_REMOVE_APV+0xac #15 0xffffffff80ca9491 at kern_funlinkat+0x2a1 #16 0xffffffff80ca91e8 at sys_unlink+0x28 #17 0xffffffff8109ab91 at amd64_syscall+0x291 lock order reversal: 1st 0xfffff8000a341e30 snaplk (snaplk) @ ufs/ufs/ufs_vnops.c:918 2nd 0xfffff80397124558 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1650 stack backtrace: #0 0xffffffff80c34833 at witness_debugger+0x73 #1 0xffffffff80c3457d at witness_checkorder+0xa7d #2 0xffffffff80b9e99b at lockmgr_xlock_hard+0x6b #3 0xffffffff80b9f40e at __lockmgr_args+0x5fe #4 0xffffffff80eb275d at ffs_snapremove+0xed #5 0xffffffff80eacd60 at ffs_truncate+0x270 #6 0xffffffff80edfefd at ufs_inactive+0x1cd #7 0xffffffff81221268 at VOP_INACTIVE_APV+0x88 #8 0xffffffff80c9e698 at vinactive+0xe8 #9 0xffffffff80c9ecd2 at vputx+0x322 #10 0xffffffff80ca94e9 at kern_funlinkat+0x2f9 #11 0xffffffff80ca91e8 at sys_unlink+0x28 #12 0xffffffff8109ab91 at amd64_syscall+0x291 #13 0xffffffff8107276d at fast_syscall_common+0x101 freework leak: 1/16. 20190626 08:20:40 all (71/636): tmpfs18.sh 20190626 08:20:41 all (72/636): trim7.sh 20190626 08:20:43 all (73/636): tvnlru.sh 20190626 08:20:44 all (74/636): uma_zalloc_arg.sh 20190626 08:20:46 all (75/636): watchman.sh 20190626 08:20:47 all (76/636): beneath3.sh 20190626 08:20:50 all (77/636): jail4.sh 20190626 08:20:52 all (78/636): mlockall5.sh 20190626 08:20:54 all (79/636): mprotect.sh 20190626 08:20:55 all (80/636): nullfs6.sh 20190626 08:20:57 all (81/636): procfs2.sh lock order reversal: (sleepable after non-sleepable) 1st 0xfffff800060d5a88 pfs_node (pfs_node) @ fs/pseudofs/pseudofs_internal.h:105 2nd 0xfffff80003674740 pidhash (pidhash) @ kern/kern_proc.c:429 stack backtrace: #0 0xffffffff80c34833 at witness_debugger+0x73 #1 0xffffffff80c3457d at witness_checkorder+0xa7d #2 0xffffffff80bd4cb8 at _sx_slock_int+0x68 #3 0xffffffff80baee0e at pfind+0x6e #4 0xffffffff80b05f39 at pfs_readdir+0x149 #5 0xffffffff81220f68 at VOP_READDIR_APV+0x88 #6 0xffffffff80cad77d at kern_getdirentries+0x1fd #7 0xffffffff80cad9a9 at sys_getdirentries+0x29 #8 0xffffffff8109ab91 at amd64_syscall+0x291 #9 0xffffffff8107276d at fast_syscall_common+0x101 mount leak: 13/44 20190626 08:21:00 all (82/636): mmap36.sh 20190626 08:21:01 all (83/636): rename4.sh 20190626 08:21:03 all (84/636): scp.sh 20190626 08:21:05 all (85/636): seekdir.sh 20190626 08:21:07 all (86/636): socketpair.sh 20190626 08:21:08 all (87/636): udp.sh 20190626 08:21:12 all (88/636): vfork.sh 20190626 08:21:13 all (89/636): datamove.sh freework leak: 26/42. 20190626 08:21:15 all (90/636): extattr_set_fd.sh 20190626 08:21:16 all (91/636): fsck2.sh 20190626 08:21:18 all (92/636): jail.sh 20190626 08:21:19 all (93/636): kevent3.sh 20190626 08:21:21 all (94/636): quota9.sh lock order reversal: 1st 0xfffff8000acfc688 FFS (FFS Lock) @ ufs/ufs/ufs_quota.c:757 2nd 0xfffff80397881000 struct mount mtx (struct mount mtx) @ ufs/ufs/ufs_quota.c:763 stack backtrace: #0 0xffffffff80c34833 at witness_debugger+0x73 #1 0xffffffff80c3457d at witness_checkorder+0xa7d #2 0xffffffff80ba9485 at __mtx_lock_flags+0x95 #3 0xffffffff80ee48bd at quotaoff_inchange+0xbd #4 0xffffffff80ed2f2d at ffs_flushfiles+0x12d #5 0xffffffff80eb53f3 at softdep_flushfiles+0x73 #6 0xffffffff80ed5617 at ffs_unmount+0xd7 #7 0xffffffff80c9694e at dounmount+0x4ae #8 0xffffffff80c96400 at sys_unmount+0x300 #9 0xffffffff8109ab91 at amd64_syscall+0x291 #10 0xffffffff8107276d at fast_syscall_common+0x101 newblk leak: 1440/1592. 20190626 08:21:23 all (95/636): unload2.sh 20190626 08:21:25 all (96/636): datagram.sh 20190626 08:21:27 all (97/636): md9.sh 20190626 08:21:29 all (98/636): mmap.sh 20190626 08:21:31 all (99/636): mmap30.sh 20190626 08:21:32 all (100/636): nullfs21.sh 20190626 08:21:34 all (101/636): ptrace11.sh 20190626 08:21:36 all (102/636): pts2.sh 20190626 08:21:38 all (103/636): revoke.sh 20190626 08:21:39 all (104/636): suj2.sh 20190626 08:21:41 all (105/636): truncate6.sh 20190626 08:21:43 all (106/636): write.sh 20190626 08:21:44 all (107/636): datagram2.sh 20190626 08:21:46 all (108/636): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20190626 08:21:47 all (109/636): mmap12.sh 20190626 08:21:49 all (110/636): mmap26.sh 20190626 08:21:52 all (111/636): ptrace.sh 20190626 08:21:53 all (112/636): ptrace3.sh 20190626 08:21:54 all (113/636): ruby.sh 20190626 08:21:56 all (114/636): setuid.sh 20190626 08:21:58 all (115/636): suj7.sh 20190626 08:21:59 all (116/636): beneath2.sh 20190626 08:22:01 all (117/636): maxproc.sh 20190626 08:22:02 all (118/636): mmap17.sh 20190626 08:22:04 all (119/636): mmap20.sh 20190626 08:22:05 all (120/636): nullfs13.sh 20190626 08:22:07 all (121/636): openlock.sh 20190626 08:22:09 all (122/636): pmc5.sh hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 20190626 08:22:11 all (123/636): posix_fadvise.sh 20190626 08:22:12 all (124/636): sendfile6.sh 20190626 08:22:14 all (125/636): sigstop.sh 20190626 08:22:16 all (126/636): temp.sh 20190626 08:22:17 all (127/636): datagram3.sh 20190626 08:22:19 all (128/636): datamove4.sh 20190626 08:22:22 all (129/636): dtrace_fault.sh 20190626 08:22:24 all (130/636): mkfifo7.sh mount leak: 16/60 20190626 08:22:25 all (131/636): mmap24.sh 20190626 08:22:27 all (132/636): nanosleep.sh 20190626 08:22:29 all (133/636): procfs5.sh 20190626 08:22:30 all (134/636): ptrace8.sh 20190626 08:22:32 all (135/636): ptrace9.sh 20190626 08:22:39 all (136/636): rename13.sh 20190626 08:22:40 all (137/636): snap12.sh 20190626 08:22:42 all (138/636): tar.sh 20190626 08:22:43 all (139/636): tmpfs6.sh 20190626 08:22:45 all (140/636): dup2.sh 20190626 08:22:47 all (141/636): killpg.sh 20190626 08:22:49 all (142/636): mountro4.sh lock order reversal: 1st 0xfffff8011935b068 msdosfs (msdosfs) @ kern/vfs_subr.c:3201 2nd 0xfffff80397a3ca48 devfs (devfs) @ fs/msdosfs/msdosfs_vnops.c:854 stack backtrace: #0 0xffffffff80c34833 at witness_debugger+0x73 #1 0xffffffff80c3457d at witness_checkorder+0xa7d #2 0xffffffff80b9e49b at lockmgr_lock_fast_path+0x16b #3 0xffffffff81221550 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cb0395 at _vn_lock+0x65 #5 0xffffffff80a8d3c9 at msdosfs_fsync+0x49 #6 0xffffffff81220388 at VOP_FSYNC_APV+0x88 #7 0xffffffff80c9f059 at vflush+0x189 #8 0xffffffff80a8a82b at msdosfs_mount+0xbb #9 0xffffffff80c955a8 at vfs_domount+0x678 #10 0xffffffff80c9495e at vfs_donmount+0x7be #11 0xffffffff80c94169 at sys_nmount+0x69 #12 0xffffffff8109ab91 at amd64_syscall+0x291 #13 0xffffffff8107276d at fast_syscall_common+0x101 20190626 08:22:54 all (143/636): msdos3.sh 20190626 08:22:55 all (144/636): nullfs14.sh 20190626 08:22:57 all (145/636): nullfs15.sh 20190626 08:22:58 all (146/636): nullfs4.sh 20190626 08:23:00 all (147/636): sendfile4.sh 20190626 08:23:01 all (148/636): sigaltstack.sh 20190626 08:23:03 all (149/636): sndstat.sh 20190626 08:23:04 all (150/636): datamove3.sh 20190626 08:23:06 all (151/636): devfd.sh 20190626 08:23:10 all (152/636): kevent2.sh 20190626 08:23:14 all (153/636): mmap9.sh 20190626 08:23:16 all (154/636): nfs_halfpage.sh 20190626 08:23:18 all (155/636): nullfs12.sh 20190626 08:23:20 all (156/636): nullfs9.sh lock order reversal: 1st 0xfffff803979707d0 tmpfs (tmpfs) @ kern/vfs_subr.c:2687 2nd 0xfffff802acf1a558 nullfs (nullfs) @ /usr/src/sys/fs/nullfs/null_vnops.c:800 stack backtrace: #0 0xffffffff80c34833 at witness_debugger+0x73 #1 0xffffffff80c3457d at witness_checkorder+0xa7d #2 0xffffffff80b9e99b at lockmgr_xlock_hard+0x6b #3 0xffffffff80b9f40e at __lockmgr_args+0x5fe #4 0xffffffff828536e0 at null_reclaim+0x60 #5 0xffffffff812213e8 at VOP_RECLAIM_APV+0x88 #6 0xffffffff80c9f959 at vgonel+0x249 #7 0xffffffff80c9fedc at vrecycle+0x5c #8 0xffffffff82853677 at null_inactive+0x57 #9 0xffffffff81221268 at VOP_INACTIVE_APV+0x88 #10 0xffffffff80c9e698 at vinactive+0xe8 #11 0xffffffff80c9ecd2 at vputx+0x322 #12 0xffffffff82852ee3 at nullfs_unlink_lowervp+0x33 #13 0xffffffff80ca00f2 at vfs_notify_upper+0x192 #14 0xffffffff80ca9469 at kern_funlinkat+0x279 #15 0xffffffff80ca91e8 at sys_unlink+0x28 #16 0xffffffff8109ab91 at amd64_syscall+0x291 #17 0xffffffff8107276d at fast_syscall_common+0x101 20190626 08:23:22 all (157/636): proccontrol.sh 20190626 08:23:33 all (158/636): rwlock_ronly.sh 20190626 08:23:34 all (159/636): shm_super.sh 20190626 08:23:36 all (160/636): contigmalloc2.sh 20190626 08:23:43 all (161/636): execi386.sh 20190626 08:23:44 all (162/636): extattr.sh 20190626 08:23:47 all (163/636): fcntl.sh 20190626 08:23:50 all (164/636): fork.sh 20190626 08:23:57 all (165/636): fsck5.sh 20190626 08:24:08 all (166/636): jail2.sh 20190626 08:24:09 all (167/636): msdos8.sh 20190626 08:24:11 all (168/636): nfs15lockd2.sh 20190626 08:24:23 all (169/636): nfs_halfpage2.sh 20190626 08:24:24 all (170/636): sigreturn.sh 20190626 08:24:26 all (171/636): mmap23.sh 20190626 08:24:29 all (172/636): mmap25.sh 20190626 08:24:32 all (173/636): pthread.sh 20190626 08:24:35 all (174/636): dumpfs.sh 20190626 08:24:37 all (175/636): mlockall4.sh 20190626 08:24:43 all (176/636): mmap13.sh 20190626 08:24:48 all (177/636): posix_fadvise2.sh 20190626 08:24:50 all (178/636): procfs3.sh 20190626 08:24:59 all (179/636): ptrace2.sh 20190626 08:25:04 all (180/636): tmpfs4.sh 20190626 08:25:06 all (181/636): tmpfs8.sh 20190626 08:25:18 all (182/636): mmap8.sh 20190626 08:25:20 all (183/636): snap10.sh 20190626 08:25:23 all (184/636): ufssuspend.sh 20190626 08:25:24 all (185/636): nullfs16.sh 20190626 08:25:27 all (186/636): tmpfs14.sh 20190626 08:25:39 all (187/636): devfs2.sh 20190626 08:25:40 all (188/636): kern_umtx_inf_loop.sh 20190626 08:25:42 all (189/636): md5.sh 20190626 08:25:43 all (190/636): mlockall.sh 20190626 08:25:55 all (191/636): mmap4.sh vnode_pager_putpages: I/O error 28 0xfffff803e01fa278: tag ufs, type VREG usecount 0, writecount 0, refcount 3203 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff801196e9600 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff800039575a0 (pid 702, mmap4, tid 100225) #0 0xffffffff80b9ecc9 at lockmgr_xlock_hard+0x399 #1 0xffffffff80b9f40e at __lockmgr_args+0x5fe #2 0xffffffff80ed776c at ffs_lock+0x7c #3 0xffffffff81221550 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cb0395 at _vn_lock+0x65 #5 0xffffffff80c9eb4e at vputx+0x19e #6 0xffffffff80f0bd1b at vm_object_deallocate+0x55b #7 0xffffffff80effacf at vm_map_process_deferred+0x7f #8 0xffffffff80f057d6 at vm_map_remove+0xc6 #9 0xffffffff80eff643 at vmspace_exit+0xd3 #10 0xffffffff80b844dd at exit1+0x5ad #11 0xffffffff80b83f2d at sys_sys_exit+0xd #12 0xffffffff8109ab91 at amd64_syscall+0x291 #13 0xffffffff8107276d at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=b7c3b2a4, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpagJun 26 08:25:57 es: residual I/O 32768 at 9760 0xfffff803e01fa278: tag ufs, type VREG usecount 0, writecount 0, refcount 3203 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff801196e9600 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff800039575a0 (pid 702, mmap4, tid 100225) mercat1 kernel: #pid 702 (mmap4), uid 0 inumber 4 on /mnt: filesystem full 0 0xffffffff80b9ecc9 at lockmgr_xlock_hard+0x399 #1 0xffffffff80b9f40e at __lockmgr_args+0x5fe #2 0xffffffff80ed776c at ffs_lock+0x7c #3 0xffffffff81221550 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cb0395 at _vn_lock+0x65 #5 0xffffffff80c9eb4e at vputx+0x19e #6 0xffffffff80f0bd1b at vm_object_deallocate+0x55b #7 0xffffffff80effacf at vm_map_process_deferred+0x7f #8 0xffffffff80f057d6 at vm_map_remove+0xc6 #9 0xffffffff80eff643 at vmspace_exit+0xd3 #10 0xffffffff80b844dd at exit1+0x5ad #11 0xffffffff80b83f2d at sys_sys_exit+0xd #12 0xffffffff8109ab91 at amd64_syscall+0x291 #13 0xffffffff8107276d at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=b7c3b2a4, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: zero-length write at 40075264 resid 131072 0xfffff803e01fa278: tag ufs, type VREG usecount 1, writecount 0, refcount 3203 flags (VI_ACTIVE) v_object 0xfffff801196e9600 ref 0 pages 25608 cleanbuf 3201 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff801195cf5a0 (pid 1142, umount, tid 100333) #0 0xffffffff80b9ecc9 at lockmgr_xlock_hard+0x399 #1 0xffffffff80b9f40e at __lockmgr_args+0x5fe #2 0xffffffff80ed776c at ffs_lock+0x7c #3 0xffffffff81221550 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cb0395 at _vn_lock+0x65 #5 0xffffffff80c9e256 at vget+0xa6 #6 0xffffffff80ca0456 at vfs_msync+0xa6 #7 0xffffffff80c968ce at dounmount+0x42e #8 0xffffffff80c96400 at sys_unmount+0x300 #9 0xffffffff8109ab91 at amd64_syscall+0x291 #10 0xffffffff8107276d at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=b7c3b2a4, uid=0, gid=0, flags=0x0 ino 4, on dev md10a Jun 26 08:25:58 mercat1 kernel: pid 1142 (umount), uid 0 inumber 4 on /mnt: filesystem full 20190626 08:25:58 all (192/636): segnp.sh 20190626 08:26:00 all (193/636): snap2.sh 20190626 08:26:02 all (194/636): isofs.sh 20190626 08:26:04 all (195/636): mountro3.sh newblk leak: 448/2040. 20190626 08:26:06 all (196/636): tmpfs10.sh 20190626 08:26:11 all (197/636): growfs.sh g_access(958): provider ufsid/5d13100486709bf5 has error 6 set g_access(958): provider ufsid/5d13100486709bf5 has error 6 set g_access(958): provider ufsid/5d13100486709bf5 has error 6 set g_access(958): provider gptid/4b3fdacf-97db-11e9-a51c-0cc47aa8cdda has error 6 set g_access(958): provider gptid/4b3fdacf-97db-11e9-a51c-0cc47aa8cdda has error 6 set g_access(958): provider gptid/4b3fdacf-97db-11e9-a51c-0cc47aa8cdda has error 6 set g_dev_taste: make_dev_p() failed (gp->name=gptid/4b3fdacf-97db-11e9-a51c-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/4b3fdacf-97db-11e9-a51c-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5d13100486709bf5, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/4b3fdacf-97db-11e9-a51c-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5d13100486709bf5, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/4b3fdacf-97db-11e9-a51c-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5d13100486709bf5, error=17) GEOM leak: 14/87 20190626 08:26:16 all (198/636): cluster.sh 20190626 08:26:17 all (199/636): jail3.sh 20190626 08:26:19 all (200/636): mountro6.sh 20190626 08:26:40 all (201/636): pmc4.sh 20190626 08:26:42 all (202/636): unix_socket.sh 20190626 08:26:45 all (203/636): thr.sh witness_lock_list_get: witness exhausted 20190626 08:26:55 all (204/636): mmap28.sh Jun 26 08:26:58 mercat1 kernel: Failed to fully fault in a core file segment at VA 0x800e00000 with size 0x5189000 to be written at offset 0x86d000 for process mmap28 20190626 08:26:58 all (205/636): pshared.sh 20190626 08:27:04 all (206/636): unlink.sh 20190626 08:27:05 all (207/636): fsck3.sh 20190626 08:27:07 all (208/636): nullfs7.sh 20190626 08:27:08 all (209/636): suj32.sh 20190626 08:27:10 all (210/636): pthread9.sh 20190626 08:27:12 all (211/636): truncate7.sh 20190626 08:27:17 all (212/636): mkfifo6.sh 20190626 08:27:21 all (213/636): nullfs10.sh 20190626 08:27:23 all (214/636): compare.sh 20190626 08:27:32 all (215/636): shm_open.sh 20190626 08:27:40 all (216/636): multicast.sh 20190626 08:28:02 all (217/636): rdwr.sh 20190626 08:28:20 all (218/636): sendfile2.sh 20190626 08:28:21 all (219/636): mmap33.sh 20190626 08:28:23 all (220/636): beneath.sh Fatal double fault rip 0xffffffff80ef9584 rsp 0xfffffe00a7c00f80 rbp 0xfffffe00a7c010b0 rax 0xfffff80397d07000 rdx 0x1 rbx 0 rcx 0 rsi 0xfffff803e0c70000 rdi 0 r8 0 r9 0xfffffe00a7c014f8 r10 0xfffffe00a7c014cc r11 0xfffffe00a7c01527 r12 0x1 r13 0xfffff803979ae000 r14 0 r15 0xfffff803e0c70000 rflags 0x10282 cs 0x20 ss 0x28 ds 0x3b es 0x3b fs 0x13 gs 0x1b fsbase 0x8002438d0 gsbase 0xffffffff820c7480 kgsbase 0 cpuid = 9; apic id = 09 panic: double fault cpuid = 9 time = 1561530504 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0006bd1db0 vpanic() at vpanic+0x19d/frame 0xfffffe0006bd1e00 panic() at panic+0x43/frame 0xfffffe0006bd1e60 dblfault_handler() at dblfault_handler+0x1de/frame 0xfffffe0006bd1f30 Xdblfault() at Xdblfault+0xc3/frame 0xfffffe0006bd1f30 --- trap 0x17, rip = 0xffffffff80ef9584, rsp = 0xfffffe00a7c00f80, rbp = 0xfffffe00a7c010b0 --- vm_fault_hold() at vm_fault_hold+0x14/frame 0xfffffe00a7c010b0 vm_fault() at vm_fault+0x60/frame 0xfffffe00a7c010f0 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a7c01140 trap() at trap+0x2b4/frame 0xfffffe00a7c01250 calltrap() at calltrap+0x8/frame 0xfffffe00a7c01250 --- trap 0xc, rip = 0xffffffff80f06a14, rsp = 0xfffffe00a7c01320, rbp = 0xfffffe00a7c01400 --- vm_map_lookup() at vm_map_lookup+0x294/frame 0xfffffe00a7c01400 vm_fault_hold() at vm_fault_hold+0x80/frame 0xfffffe00a7c01550 vm_fault() at vm_fault+0x60/frame 0xfffffe00a7c01590 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a7c015e0 trap() at trap+0x2b4/frame 0xfffffe00a7c016f0 calltrap() at calltrap+0x8/frame 0xfffffe00a7c016f0 --- trap 0xc, rip = 0x7ffffffcb001, rsp = 0xfffffe00a7c017c0, rbp = 0xfffffe00a7c01988 --- ??() at 0x7ffffffcb001/frame 0xfffffe00a7c01988 ??() at 0xfffff803e0c70000/frame 0xffffffff820be480 ??() at 0xfffff800036bf000/frame 0xfffff800036bf000 ??() at 0xfffff800036b7000/frame 0xffffffff81ea54c0 ll() at 0xb0000/frame 0xffffffff81ea6138 KDB: enter: panic [ thread pid 19330 tid 100497 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 19330 tid 100497 td 0xfffff803979ae000 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe0006bd1db0 vpanic() at vpanic+0x1ba/frame 0xfffffe0006bd1e00 panic() at panic+0x43/frame 0xfffffe0006bd1e60 dblfault_handler() at dblfault_handler+0x1de/frame 0xfffffe0006bd1f30 Xdblfault() at Xdblfault+0xc3/frame 0xfffffe0006bd1f30 --- trap 0x17, rip = 0xffffffff80ef9584, rsp = 0xfffffe00a7c00f80, rbp = 0xfffffe00a7c010b0 --- vm_fault_hold() at vm_fault_hold+0x14/frame 0xfffffe00a7c010b0 vm_fault() at vm_fault+0x60/frame 0xfffffe00a7c010f0 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a7c01140 trap() at trap+0x2b4/frame 0xfffffe00a7c01250 calltrap() at calltrap+0x8/frame 0xfffffe00a7c01250 --- trap 0xc, rip = 0xffffffff80f06a14, rsp = 0xfffffe00a7c01320, rbp = 0xfffffe00a7c01400 --- vm_map_lookup() at vm_map_lookup+0x294/frame 0xfffffe00a7c01400 vm_fault_hold() at vm_fault_hold+0x80/frame 0xfffffe00a7c01550 vm_fault() at vm_fault+0x60/frame 0xfffffe00a7c01590 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a7c015e0 trap() at trap+0x2b4/frame 0xfffffe00a7c016f0 calltrap() at calltrap+0x8/frame 0xfffffe00a7c016f0 --- trap 0xc, rip = 0x7ffffffcb001, rsp = 0xfffffe00a7c017c0, rbp = 0xfffffe00a7c01988 --- ??() at 0x7ffffffcb001/frame 0xfffffe00a7c01988 ??() at 0xfffff803e0c70000/frame 0xffffffff820be480 ??() at 0xfffff800036bf000/frame 0xfffff800036bf000 ??() at 0xfffff800036b7000/frame 0xffffffff81ea54c0 ll() at 0xb0000/frame 0xffffffff81ea6138 db:1:pho1> show allpcpu Current CPU: 9 cpuid = 0 dynamic pcpu = 0xb86800 curthread = 0xfffff800036bf000: pid 11 tid 100003 "idle: cpu0" curpcb = 0xfffffe0076766b80 fpcurthread = none idlethread = 0xfffff800036bf000: tid 100003 "idle: cpu0" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be4a0 commontssp = 0xffffffff821be4a0 rsp0 = 0xfffffe0076766b80 gs32p = 0xffffffff821c50d8 ldt = 0xffffffff821c5118 tss = 0xffffffff821c5108 tlb gen = 626076 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe0084fea800 curthread = 0xfffff800036ba5a0: pid 11 tid 100004 "idle: cpu1" curpcb = 0xfffffe007676bb80 fpcurthread = none idlethread = 0xfffff800036ba5a0: tid 100004 "idle: cpu1" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be508 commontssp = 0xffffffff821be508 rsp0 = 0xfffffe007676bb80 gs32p = 0xffffffff821c5140 ldt = 0xffffffff821c5180 tss = 0xffffffff821c5170 tlb gen = 626078 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe0084ff6800 curthread = 0xfffff800036ba000: pid 11 tid 100005 "idle: cpu2" curpcb = 0xfffffe0076770b80 fpcurthread = none idlethread = 0xfffff800036ba000: tid 100005 "idle: cpu2" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be570 commontssp = 0xffffffff821be570 rsp0 = 0xfffffe0076770b80 gs32p = 0xffffffff821c51a8 ldt = 0xffffffff821c51e8 tss = 0xffffffff821c51d8 tlb gen = 626078 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe0085002800 curthread = 0xfffff800036b95a0: pid 11 tid 100006 "idle: cpu3" curpcb = 0xfffffe0076775b80 fpcurthread = none idlethread = 0xfffff800036b95a0: tid 100006 "idle: cpu3" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be5d8 commontssp = 0xffffffff821be5d8 rsp0 = 0xfffffe0076775b80 gs32p = 0xffffffff821c5210 ldt = 0xffffffff821c5250 tss = 0xffffffff821c5240 tlb gen = 626078 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe008500e800 curthread = 0xfffff800036b9000: pid 11 tid 100007 "idle: cpu4" curpcb = 0xfffffe007677ab80 fpcurthread = none idlethread = 0xfffff800036b9000: tid 100007 "idle: cpu4" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be640 commontssp = 0xffffffff821be640 rsp0 = 0xfffffe007677ab80 gs32p = 0xffffffff821c5278 ldt = 0xffffffff821c52b8 tss = 0xffffffff821c52a8 tlb gen = 626078 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe008501a800 curthread = 0xfffff800036b85a0: pid 11 tid 100008 "idle: cpu5" curpcb = 0xfffffe007677fb80 fpcurthread = none idlethread = 0xfffff800036b85a0: tid 100008 "idle: cpu5" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be6a8 commontssp = 0xffffffff821be6a8 rsp0 = 0xfffffe007677fb80 gs32p = 0xffffffff821c52e0 ldt = 0xffffffff821c5320 tss = 0xffffffff821c5310 tlb gen = 626078 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe0085026800 curthread = 0xfffff800036b8000: pid 11 tid 100009 "idle: cpu6" curpcb = 0xfffffe0076784b80 fpcurthread = none idlethread = 0xfffff800036b8000: tid 100009 "idle: cpu6" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be710 commontssp = 0xffffffff821be710 rsp0 = 0xfffffe0076784b80 gs32p = 0xffffffff821c5348 ldt = 0xffffffff821c5388 tss = 0xffffffff821c5378 tlb gen = 626078 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe0085032800 curthread = 0xfffff800036d05a0: pid 11 tid 100010 "idle: cpu7" curpcb = 0xfffffe0076789b80 fpcurthread = none idlethread = 0xfffff800036d05a0: tid 100010 "idle: cpu7" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be778 commontssp = 0xffffffff821be778 rsp0 = 0xfffffe0076789b80 gs32p = 0xffffffff821c53b0 ldt = 0xffffffff821c53f0 tss = 0xffffffff821c53e0 tlb gen = 626078 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe008503e800 curthread = 0xfffff800036d0000: pid 11 tid 100011 "idle: cpu8" curpcb = 0xfffffe007678eb80 fpcurthread = none idlethread = 0xfffff800036d0000: tid 100011 "idle: cpu8" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be7e0 commontssp = 0xffffffff821be7e0 rsp0 = 0xfffffe007678eb80 gs32p = 0xffffffff821c5418 ldt = 0xffffffff821c5458 tss = 0xffffffff821c5448 tlb gen = 626078 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe008504a800 curthread = 0xfffff803979ae000: pid 19330 tid 100497 "xargs" curpcb = 0xfffffe00a7c04b80 fpcurthread = 0xfffff803979ae000: pid 19330 "xargs" idlethread = 0xfffff800036cf5a0: tid 100012 "idle: cpu9" curpmap = 0xfffff803e0c70130 tssp = 0xffffffff821be848 commontssp = 0xffffffff821be848 rsp0 = 0xfffffe00a7c04b80 gs32p = 0xffffffff821c5480 ldt = 0xffffffff821c54c0 tss = 0xffffffff821c54b0 tlb gen = 626078 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe0085056800 curthread = 0xfffff800036cf000: pid 11 tid 100013 "idle: cpu10" curpcb = 0xfffffe0076798b80 fpcurthread = none idlethread = 0xfffff800036cf000: tid 100013 "idle: cpu10" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be8b0 commontssp = 0xffffffff821be8b0 rsp0 = 0xfffffe0076798b80 gs32p = 0xffffffff821c54e8 ldt = 0xffffffff821c5528 tss = 0xffffffff821c5518 tlb gen = 626078 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe0085062800 curthread = 0xfffff800036ce5a0: pid 11 tid 100014 "idle: cpu11" curpcb = 0xfffffe007679db80 fpcurthread = none idlethread = 0xfffff800036ce5a0: tid 100014 "idle: cpu11" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be918 commontssp = 0xffffffff821be918 rsp0 = 0xfffffe007679db80 gs32p = 0xffffffff821c5550 ldt = 0xffffffff821c5590 tss = 0xffffffff821c5580 tlb gen = 626078 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show allchains chain 1: thread 100303 (pid 19329, xargs) sleeping on 0xfffff80397d074f0 "ppwait" chain 2: thread 100267 (pid 19328, find) sleeping on 0xfffff8000ad12be0 "pipewr" chain 3: thread 100399 (pid 19327, sh) sleeping on 0xfffff8057538b000 "wait" chain 4: thread 100409 (pid 19303, sh) sleeping on 0xfffff805753a0000 "wait" chain 5: thread 100388 (pid 19302, tee) sleeping on 0xfffff800113928e8 "piperd" chain 6: thread 100507 (pid 19301, sh) sleeping on 0xfffff80397d32a60 "wait" chain 7: thread 100406 (pid 18954, sleep) sleeping on 0xffffffff81e8f0b5 "nanslp" chain 8: thread 100213 (pid 29060, bash) sleeping on 0xfffff80006089340 "select" chain 9: thread 100285 (pid 28961, csh) sleeping on 0xfffff8000ab2eb08 "pause" chain 10: thread 100254 (pid 28960, su) sleeping on 0xfffff80003ff6530 "wait" chain 11: thread 100192 (pid 28857, bash) sleeping on 0xfffff80011c3b530 "wait" chain 12: thread 100269 (pid 28856, sshd) sleeping on 0xfffff8000a18f340 "select" chain 13: thread 100273 (pid 28758, sshd) sleeping on 0xfffff8000aace140 "select" chain 14: thread 100228 (pid 16372, sh) sleeping on 0xfffff8000aaf75f0 "piperd" chain 15: thread 100256 (pid 16370, awk) sleeping on 0xfffff802acd1f000 "piperd" chain 16: thread 100162 (pid 16369, sh) sleeping on 0xfffff8000aabf000 "wait" chain 17: thread 100226 (pid 16334, sh) sleeping on 0xfffff8000a70f530 "wait" chain 18: thread 100214 (pid 14130, sh) sleeping on 0xfffff8000abbda60 "wait" chain 19: thread 100154 (pid 2348, bash) sleeping on 0xfffff8000a39f000 "wait" chain 20: thread 100198 (pid 2346, csh) sleeping on 0xfffff8000a7105d8 "pause" chain 21: thread 100200 (pid 2345, su) sleeping on 0xfffff8000a786530 "wait" chain 22: thread 100163 (pid 2341, bash) sleeping on 0xfffff8000a711530 "wait" chain 23: thread 100189 (pid 2340, sshd) sleeping on 0xfffff800060893c0 "select" chain 24: thread 100201 (pid 2337, sshd) sleeping on 0xfffff8000a18f540 "select" chain 25: thread 100167 (pid 2333, csh) sleeping on 0xfffff8000618a0b0 "ttyin" chain 26: thread 100211 (pid 2332, login) sleeping on 0xfffff802ac4b3530 "wait" chain 27: thread 100210 (pid 2331, getty) sleeping on 0xfffff8000618a4b0 "ttyin" chain 28: thread 100209 (pid 2330, getty) sleeping on 0xfffff8000a3ef4b0 "ttyin" chain 29: thread 100208 (pid 2329, getty) sleeping on 0xfffff8000a3ef8b0 "ttyin" chain 30: thread 100207 (pid 2328, getty) sleeping on 0xfffff8000a3efcb0 "ttyin" chain 31: thread 100206 (pid 2327, getty) sleeping on 0xfffff8000a3f10b0 "ttyin" chain 32: thread 100205 (pid 2326, getty) sleeping on 0xfffff8000a3f14b0 "ttyin" chain 33: thread 100204 (pid 2325, getty) sleeping on 0xfffff8000a3f18b0 "ttyin" chain 34: thread 100147 (pid 2324, getty) sleeping on 0xfffff8000a3f1cb0 "ttyin" chain 35: thread 100142 (pid 2323, getty) sleeping on 0xfffff8000a3f30b0 "ttyin" chain 36: thread 100196 (pid 2277, cron) sleeping on 0xffffffff81e8f0b8 "nanslp" chain 37: thread 100150 (pid 2273, sshd) sleeping on 0xfffff800037dc9c0 "select" chain 38: thread 100197 (pid 2244, ntpd) sleeping on 0xfffff800037dc940 "select" chain 39: thread 100385 (pid 2244, ntpd) sleeping on 0xfffff805f41c8000 "usem" chain 40: thread 100174 (pid 2183, NLM: master) sleeping on 0xfffff80003da1360 "rpcsvc" chain 41: thread 100164 (pid 2180, rpc.statd) sleeping on 0xfffff80006070ac0 "select" chain 42: thread 100158 (pid 2134, watchdogd) sleeping on 0xffffffff81e8f0b2 "nanslp" chain 43: thread 100187 (pid 2054, rpcbind) sleeping on 0xfffff800036bb1c0 "select" chain 44: thread 100170 (pid 2044, syslogd) sleeping on 0xfffff8000a18f5c0 "select" chain 45: thread 100152 (pid 1973, devd) sleeping on 0xfffff8000607cec0 "select" chain 46: thread 100145 (pid 1968, dhclient) sleeping on 0xfffff8000aacec40 "select" chain 47: thread 100161 (pid 1924, dhclient) sleeping on 0xfffff8000607cf40 "select" chain 48: thread 100169 (pid 1921, dhclient) sleeping on 0xfffff80003dc1dc0 "select" chain 49: thread 100141 (pid 34, syncer) sleeping on 0xffffffff820315c0 "syncer" chain 50: thread 100140 (pid 33, vnlru) sleeping on 0xfffff8000a4dfa60 "vlruwt" chain 51: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff82030a58 "qsleep" chain 52: thread 100133 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff81a0a8c0 "-" chain 53: thread 100134 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81a12b80 "-" chain 54: thread 100135 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff81a1ae40 "-" chain 55: thread 100136 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81a23100 "-" chain 56: thread 100137 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff81a2b3c0 "-" chain 57: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81a33680 "-" chain 58: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff81a3b940 "-" chain 59: thread 100153 (pid 32, / worker) sleeping on 0xfffff8000ac054e8 "sdflush" chain 60: thread 100195 (pid 32, /tmp worker) sleeping on 0xfffff8000ac936e8 "sdflush" chain 61: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff8204d808 "psleep" chain 62: thread 100128 (pid 30, dom0) sleeping on 0xffffffff820b75d8 "psleep" chain 63: thread 100131 (pid 30, laundry: dom0) sleeping on 0xffffffff820b75e4 "launds" chain 64: thread 100132 (pid 30, uma) sleeping on 0xffffffff80ef5850 "umarcl" chain 65: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff8000a39f530 "idle" chain 66: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff8000a39fa60 "idle" chain 67: thread 100120 (pid 27, rand_harvestq) sleeping on 0xffffffff81cee7a0 "-" chain 68: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff820b5cb0 "waiting_for_work" chain 69: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff8203045c "-" chain 70: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff8203045c "-" chain 71: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff8203045c "-" chain 72: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff8203045c "-" chain 73: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe009a19c460 "-" chain 74: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe009a19c4b8 "-" chain 75: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe009a19c510 "-" chain 76: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe009a19c568 "-" chain 77: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe009a19c5c0 "-" chain 78: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe0006dd6d10 "-" chain 79: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe0006dd6d68 "-" chain 80: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe0006dd6dc0 "-" chain 81: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe0006dd6e18 "-" chain 82: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe0006dd6e70 "-" chain 83: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe009a633d10 "-" chain 84: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe009a633d68 "-" chain 85: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe009a633dc0 "-" chain 86: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe009a633e18 "-" chain 87: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe009a633e70 "-" chain 88: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff81bc9b40 "-" chain 89: thread 100092 (pid 20, doneq1) sleeping on 0xffffffff81bc9bc0 "-" chain 90: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff81bc9c40 "-" chain 91: thread 100125 (pid 20, scanner) sleeping on 0xffffffff81bc9a08 "-" chain 92: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff8000394f450 "crypto_ret_wait" chain 93: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff8000394f3f0 "crypto_ret_wait" chain 94: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff8000394f390 "crypto_ret_wait" chain 95: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff8000394f330 "crypto_ret_wait" chain 96: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff8000394f2d0 "crypto_ret_wait" chain 97: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff8000394f270 "crypto_ret_wait" chain 98: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff8000394f210 "crypto_ret_wait" chain 99: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff8000394f1b0 "crypto_ret_wait" chain 100: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff8000394f150 "crypto_ret_wait" chain 101: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff8000394f0f0 "crypto_ret_wait" chain 102: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff8000394f090 "crypto_ret_wait" chain 103: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff8000394f030 "crypto_ret_wait" chain 104: thread 100078 (pid 2, crypto) sleeping on 0xffffffff82047df8 "crypto_wait" chain 105: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff800038f5c88 "seqstate" chain 106: thread 100062 (pid 13, g_event) sleeping on 0xffffffff82086140 "-" chain 107: thread 100063 (pid 13, g_up) sleeping on 0xffffffff82086150 "-" chain 108: thread 100064 (pid 13, g_down) sleeping on 0xffffffff82086138 "-" chain 109: thread 100002 (pid 1, init) sleeping on 0xfffff800036b7530 "wait" chain 110: thread 100001 (pid 10, audit) sleeping on 0xffffffff820b69d0 "audit_worker_cv" chain 111: thread 100000 (pid 0, swapper) sleeping on 0xffffffff82086180 "swapin" chain 112: thread 100016 (pid 0, config_0) sleeping on 0xfffff8000370ae00 "-" chain 113: thread 100017 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff8000370ad00 "-" chain 114: thread 100018 (pid 0, aiod_kick taskq) sleeping on 0xfffff8000370ac00 "-" chain 115: thread 100021 (pid 0, thread taskq) sleeping on 0xfffff8000370a900 "-" chain 116: thread 100022 (pid 0, if_io_tqg_0) sleeping on 0xfffff8000370a800 "-" chain 117: thread 100023 (pid 0, if_io_tqg_1) sleeping on 0xfffff8000370a700 "-" chain 118: thread 100024 (pid 0, if_io_tqg_2) sleeping on 0xfffff8000370a600 "-" chain 119: thread 100025 (pid 0, if_io_tqg_3) sleeping on 0xfffff8000370a500 "-" chain 120: thread 100026 (pid 0, if_io_tqg_4) sleeping on 0xfffff8000370a400 "-" chain 121: thread 100027 (pid 0, if_io_tqg_5) sleeping on 0xfffff8000370a300 "-" chain 122: thread 100028 (pid 0, if_io_tqg_6) sleeping on 0xfffff8000370a200 "-" chain 123: thread 100029 (pid 0, if_io_tqg_7) sleeping on 0xfffff8000370a100 "-" chain 124: thread 100030 (pid 0, if_io_tqg_8) sleeping on 0xfffff8000370a000 "-" chain 125: thread 100031 (pid 0, if_io_tqg_9) sleeping on 0xfffff80003709e00 "-" chain 126: thread 100032 (pid 0, if_io_tqg_10) sleeping on 0xfffff80003709d00 "-" chain 127: thread 100033 (pid 0, if_io_tqg_11) sleeping on 0xfffff80003709c00 "-" chain 128: thread 100034 (pid 0, softirq_0) sleeping on 0xfffff80003709b00 "-" chain 129: thread 100035 (pid 0, softirq_1) sleeping on 0xfffff80003709a00 "-" chain 130: thread 100036 (pid 0, softirq_2) sleeping on 0xfffff80003709900 "-" chain 131: thread 100037 (pid 0, softirq_3) sleeping on 0xfffff80003709800 "-" chain 132: thread 100038 (pid 0, softirq_4) sleeping on 0xfffff80003709700 "-" chain 133: thread 100039 (pid 0, softirq_5) sleeping on 0xfffff80003709600 "-" chain 134: thread 100040 (pid 0, softirq_6) sleeping on 0xfffff80003709500 "-" chain 135: thread 100041 (pid 0, softirq_7) sleeping on 0xfffff800037bf100 "-" chain 136: thread 100042 (pid 0, softirq_8) sleeping on 0xfffff800037bf000 "-" chain 137: thread 100043 (pid 0, softirq_9) sleeping on 0xfffff800037bde00 "-" chain 138: thread 100044 (pid 0, softirq_10) sleeping on 0xfffff800037bdd00 "-" chain 139: thread 100045 (pid 0, softirq_11) sleeping on 0xfffff800037bdc00 "-" chain 140: thread 100046 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003805200 "-" chain 141: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003805100 "-" chain 142: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003804e00 "-" chain 143: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003804e00 "-" chain 144: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003804e00 "-" chain 145: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003804e00 "-" chain 146: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003804e00 "-" chain 147: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003804e00 "-" chain 148: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003804e00 "-" chain 149: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003804e00 "-" chain 150: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003804e00 "-" chain 151: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003804e00 "-" chain 152: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003804e00 "-" chain 153: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003804e00 "-" chain 154: thread 100114 (pid 0, mca taskq) blocked on lockmgr (null)EXCL thread 0 (pid 1970434661, ) is inactive chain 155: thread 100121 (pid 0, acpi_task_0) sleeping on 0xfffff8000a20cd00 "-" chain 156: thread 100122 (pid 0, acpi_task_1) sleeping on 0xfffff8000a20cd00 "-" chain 157: thread 100123 (pid 0, acpi_task_2) sleeping on 0xfffff8000a20cd00 "-" chain 158: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003804c00 "-" db:1:pho1> show mount 0xfffff8000a4d7000 /dev/gpt/work on / (ufs) 0xfffff8000a4d9000 devfs on /dev (devfs) 0xfffff8000ac7b000 /dev/gpt/tmp on /tmp (ufs) 0xfffff803979f4000 procfs on /proc (procfs) More info: show mount db:1:pho1> show bufqueues bqempty: 82024 Buf domain 0 freebufs 15095 lofreebufs 219 hifreebufs 329 bufspace 536576 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 11 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1 (4096) dirtyq count 11 (245760) wakeup 0 lim 25 CPU 6, 1, 2, 6, 1, 1, 2, 0, 0, 1, 2, 4, Locked buffers: 0 space 0 Total buffers: 8114 space 536576 Buf domain 1 freebufs 13222 lofreebufs 219 hifreebufs 329 bufspace 37548032 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 31 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1832 (35160064) dirtyq count 31 (987136) wakeup 0 lim 25 CPU 17, 1, 0, 3, 1, 1, 11, 11, 0, 0, 1, 2, Locked buffers: 0 space 0 Total buffers: 1928 space 37548032 Buf domain 2 freebufs 13883 lofreebufs 219 hifreebufs 329 bufspace 15552512 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1241 (15482880) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 3, 0, 0, 4, 0, 0, 1, 0, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 1269 space 15552512 Buf domain 3 freebufs 15101 lofreebufs 219 hifreebufs 329 bufspace 217088 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 3 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 0 (0) dirtyq count 3 (61440) wakeup 0 lim 25 CPU 7, 3, 2, 7, 0, 0, 6, 0, 0, 1, 1, 2, Locked buffers: 0 space 0 Total buffers: 7345 space 217088 Buf domain 4 freebufs 12134 lofreebufs 219 hifreebufs 329 bufspace 72654848 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2987 (72560640) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 5, 1, 2, 2, 0, 0, 0, 1, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 3002 space 72654848 Buf domain 5 freebufs 14038 lofreebufs 219 hifreebufs 329 bufspace 9596928 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1085 (9494528) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 4, 0, 0, 2, 0, 1, 0, 0, 0, 0, 2, 0, Locked buffers: 0 space 0 Total buffers: 1105 space 9596928 Buf domain 6 freebufs 13991 lofreebufs 219 hifreebufs 329 bufspace 11194368 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1133 (11153408) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 2, 1, 0, 3, 0, 1, 0, 0, 0, 0, 0, 1, Locked buffers: 0 space 0 Total buffers: 1144 space 11194368 db:1:pho1> show page vm_cnt.v_free_count: 7716157 vm_cnt.v_inactive_count: 6307 vm_cnt.v_active_count: 11671 vm_cnt.v_laundry_count: 0 vm_cnt.v_wire_count: 391504 vm_cnt.v_free_reserved: 10650 vm_cnt.v_free_min: 51293 vm_cnt.v_free_target: 173222 vm_cnt.v_inactive_target: 259833 db:1:pho1> show pageq pq_free 7716157 dom 0 page_cnt 8128935 free 7716157 pq_act 11671 pq_inact 6307 pq_laund 0 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 001821 | 000000 11 (008192K) | 000034 | 000001 10 (004096K) | 000027 | 000000 09 (002048K) | 000015 | 000001 08 (001024K) | 000015 | 000001 07 (000512K) | 000026 | 000002 06 (000256K) | 000053 | 000002 05 (000128K) | 000123 | 000004 04 (000064K) | 000202 | 000007 03 (000032K) | 000493 | 000004 02 (000016K) | 000738 | 000000 01 (000008K) | 001639 | 000001 00 (000004K) | 000296 | 000001 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000001 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket FFS2 dinode 256 8225 3010 23313 0 61 FFS1 dinode 128 0 0 0 0 125 FFS inode 160 8225 3007 23313 0 61 swblk 136 0 0 0 0 61 swpctrie 144 0 0 0 0 61 selfd 64 124 2914 47982 0 253 rtentry 208 12 368 15 0 61 ripcb 488 1 1015 13 0 253 udplite_inpcb 488 0 0 0 0 253 sctp_asconf_ack 48 0 0 0 0 253 sctp_asconf 40 0 0 0 0 253 sctp_stream_msg_out 112 0 0 0 0 253 sctp_readq 152 0 0 0 0 253 sctp_chunk 152 0 0 0 0 253 sctp_raddr 736 0 0 0 0 253 sctp_laddr 48 0 830 4 0 253 sctp_asoc 2408 0 0 0 0 253 sctp_ep 1280 0 0 0 0 253 tcp_log_node 120 0 0 0 0 125 tcp_log_bucket 144 0 0 0 0 61 tcp_log 408 0 0 0 0 253 tcpreass 48 0 0 0 0 253 tfo_ccache_entries 80 0 0 0 0 125 tfo 4 0 0 0 0 253 sackhole 32 0 0 0 0 253 hostcache 96 1 286 1 0 253 syncache 168 0 759 3 0 253 tcptw 88 1 269 1 0 253 tcpcb 976 10 2014 18 0 253 tcp_inpcb 488 11 2013 18 0 253 udpcb 32 20 3080 221 0 253 udp_inpcb 488 20 3020 221 0 253 ipq 56 0 0 0 0 253 unpcb 256 22 3278 5798 0 253 IPsec SA lft_c 16 0 0 0 0 253 socket 872 55 3489 6062 0 253 KNOTE 160 0 1104 363076 0 62 itimer 352 0 0 0 0 29 ksiginfo 112 335 1555 106223 0 125 pipe 760 9 546 415534 0 14 AIOLIO 280 0 0 0 0 29 AIOCB 752 0 0 0 0 13 AIOP 32 0 0 0 0 253 AIO 208 0 0 0 0 61 Mountpoints 2896 4 107 195 0 3 procdesc 136 1 434 24 0 61 DIRHASH 1024 192 252 832 0 13 NCLNODE 744 0 0 0 0 13 LTS VFS Cache 368 0 0 0 0 29 L VFS Cache 328 0 0 0 0 29 STS VFS Cache 148 0 0 0 0 61 S VFS Cache 108 8370 8010 1758325 0 125 rentr 24 0 3154 2770 0 253 NAMEI 1024 1 207 10273824 0 14 BUF TRIE 144 699 105249 176608 0 61 VNODEPOLL 120 0 0 0 0 125 VNODE 632 9079 101927 1101160 0 145 vtnet_tx_hdr 24 0 0 0 0 253 crypto_session 24 0 0 0 0 253 cryptodesc 120 0 0 0 0 125 cryptop 128 0 0 0 0 125 g_bio 408 0 1161 531200 0 34 nvme_request 128 0 0 0 0 125 DMAR_MAP_ENTRY 120 0 0 0 0 125 ttyoutq 256 181 689 2770 0 62 ttyinq 160 345 639 5205 0 61 FPU_save_area 832 0 0 0 0 13 epoch_record pcpu 256 4 60 4 0 61 mbuf_jumbo_16k 16384 0 0 0 0 253 mbuf_jumbo_9k 9216 0 0 0 0 253 mbuf_jumbo_page 4096 0 506 4 0 253 mbuf_cluster 2048 8098 758 8511 0 253 mbuf 256 4616 4247 28628 0 253 mbuf_packet 256 6 3536 8395 0 253 audit_record 1280 0 0 0 0 9 domainset 40 0 0 0 0 253 cpuset 104 27 1492 27 0 125 THREAD 1440 478 6248 252114 0 20 PROC 1328 82 278 119195 0 9 MAC labels 40 0 0 0 0 253 pbuf 984 0 873 0 0 1 clpbuf 984 0 128 11967 4429 5 vnpbuf 984 0 0 0 0 13 mdpbuf 984 0 10 12102 0 1 nfspbuf 984 0 0 0 0 5 swwbuf 984 0 0 0 0 1 swrbuf 984 0 0 0 0 5 umtx_shm 88 0 765 35 0 125 umtx pi 96 0 164 1 0 125 rl_entry 40 327 2742 327 0 253 TURNSTILE 136 6727 353 6727 0 61 rangeset pctrie nodes 144 0 0 0 0 61 filedesc0 1104 83 469 119196 0 11 Files 80 135 4079 3452784 0 131 SLEEPQUEUE 88 6727 899 6727 0 125 65536 65536 2 1 14 0 1 65536 65536 1 7 14 0 1 65536 65536 3 8 63 0 1 65536 65536 2 1 3 0 1 65536 65536 4 7 2173 0 1 65536 65536 0 0 0 0 1 65536 65536 0 12 1076 0 1 65536 65536 2 0 2 0 1 32768 32768 12 7 27 0 1 32768 32768 1 8 105 0 1 32768 32768 1 20 5556 0 1 32768 32768 0 18 3221 0 1 32768 32768 12 14 2571 0 1 32768 32768 12 0 12 0 1 32768 32768 0 0 0 0 1 32768 32768 0 0 0 0 1 16384 16384 1 9 59 0 1 16384 16384 2 8 15 0 1 16384 16384 2 30 588 0 1 16384 16384 9 7 20 0 1 16384 16384 49 5 2879 0 1 16384 16384 4 0 4 0 1 16384 16384 1 0 1 0 1 16384 16384 0 0 0 0 1 8192 8192 13 24 3140 0 1 8192 8192 7 13 33 0 1 8192 8192 3 18 2339 0 1 8192 8192 1 4 5 0 1 8192 8192 21 18 1850 0 1 8192 8192 88 0 88 0 1 8192 8192 0 0 0 0 1 8192 8192 1 0 1 0 1 4096 4096 2 13 436 0 1 4096 4096 60 15 125 0 1 4096 4096 91 222 128375 0 1 4096 4096 2 16 500128 0 1 4096 4096 6 13 91564 0 1 4096 4096 353 18 5613 0 1 4096 4096 1 21 54204 0 1 4096 4096 0 1 12 0 1 2048 2048 3 57 720 0 5 2048 2048 99 55 154 0 5 2048 2048 1 85 545039 0 5 2048 2048 5 15 5 0 5 2048 2048 5 21 504 0 5 2048 2048 4 6 4 0 5 2048 2048 18 108 54258 0 5 2048 2048 2 14 3 0 5 1024 1024 2 142 1153 0 13 1024 1024 205 147 578 0 13 1024 1024 1 207 283230 0 13 1024 1024 500001 19 500001 0 13 1024 1024 33 463 3976 0 13 1024 1024 25 131 8296 0 13 1024 1024 18 86 41 0 13 1024 1024 5 151 5718 0 13 512 512 16 5500 39928 0 29 512 512 138 471 416183 0 29 512 512 384 197 67606 0 29 512 512 4 171 500022 0 29 512 512 94 256 6639 0 29 512 512 10 137 10 0 29 512 512 21 154 33 0 29 512 512 54 184 128 0 29 256 256 46 33389 97109 0 61 256 256 447 918 7894 0 61 256 256 55 935 147067 0 61 256 256 500315 745 882194 0 61 256 256 462 5583 39406 0 61 256 256 17 418 17 0 61 256 256 56 2329 6602 0 61 256 256 25 530 8896 0 61 128 128 20 1499 4244 0 125 128 128 444 1478 294235 0 125 128 128 104 1415 536825 0 125 128 128 14102 778 14132 0 125 128 128 2594 1281 4198 0 125 128 128 187 6571 28487 0 125 128 128 417 1350 1478 0 125 128 128 14387 1268 877078 0 125 64 64 38 3806 32331 0 253 64 64 8619 2789 1080617 0 253 64 64 920 2118 123041 0 253 64 64 500098 2660 620922 0 253 64 64 1350 2741 3113 0 253 64 64 67 2723 115 0 253 64 64 65 2477 157 0 253 64 64 9290 2614 18317 0 253 32 32 120 2980 36475 0 253 32 32 244 2856 2057 0 253 32 32 37 2319 2368 0 253 32 32 46 3054 17349 0 253 32 32 3602 3094 16106 0 253 32 32 11 2841 20 0 253 32 32 157 4679 504051 0 253 32 32 7280 1896 29596 0 253 16 16 21 3216 2393 0 253 16 16 191 3046 26045 0 253 16 16 85 3152 465080 0 253 16 16 49 3188 3567 0 253 16 16 3137 210007 1933316 0 253 16 16 29 1963 29 0 253 16 16 10 1733 11 0 253 16 16 512 2974 843639 0 253 mt_zone 24 427 2229 489 0 253 mt_stats_zone 64 427 2133 489 0 253 64 pcpu 8 3247 2129 3325 0 253 fakepg 104 0 1520 989 0 125 VMSPACE 2552 50 300 119054 0 4 MAP ENTRY 112 2290 22035 6226259 0 150 KMAP ENTRY 112 9 1249 36 0 125 MAP 232 2 65 2 0 61 RADIX NODE 144 12108 71580 5065451 0 67 VM OBJECT 256 508708 2117 2858249 0 67 vmem btag 56 17690 6005 25534 0 253 vmem 1856 0 1 0 0 5 256 Bucket 2048 2141 812 38449 0 8 128 Bucket 1024 839 1525 34338 0 18 64 Bucket 512 1070 435 22883 0 29 32 Bucket 256 642 1082 162723 0 63 16 Bucket 128 1451 1958 53268 0 126 12 Bucket 96 148 1410 3383 0 127 8 Bucket 64 630 3089 18594 0 253 6 Bucket 48 51 3020 7055 0 253 4 Bucket 32 965 2879 26992 0 253 UMA Hash 256 0 11 7 0 0 UMA Slabs 112 134650 21 136883 0 0 UMA Zones 1960 80 2 106 0 0 UMA Kegs 216 74 5 100 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket vm pgcache 104 33715 3279 11546544 253 buf free cache 984 8467 15440 153568 13 buffer arena-65 65536 0 0 3395 1 buffer arena-61 61440 0 0 3395 1 buffer arena-57 57344 0 0 3395 1 buffer arena-53 53248 0 0 3395 1 buffer arena-49 49152 0 0 3395 1 buffer arena-45 45056 0 0 3395 1 buffer arena-40 40960 0 0 3395 1 buffer arena-36 36864 0 0 3395 1 buffer arena-32 32768 5779 2023 46273 4 buffer arena-28 28672 0 0 3395 1 buffer arena-24 24576 0 0 3395 1 buffer arena-20 20480 0 0 3395 1 buffer arena-16 16384 120 240 7277 1 buffer arena-12 12288 0 0 3395 1 buffer arena-81 8192 0 0 3395 1 buffer arena-40 4096 0 0 3395 1 db:0:pho> acttrace Tracing command xargs pid 19330 tid 100497 td 0xfffff803979ae000 (CPU 9) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe0006bd1db0 vpanic() at vpanic+0x1ba/frame 0xfffffe0006bd1e00 panic() at panic+0x43/frame 0xfffffe0006bd1e60 dblfault_handler() at dblfault_handler+0x1de/frame 0xfffffe0006bd1f30 Xdblfault() at Xdblfault+0xc3/frame 0xfffffe0006bd1f30 --- trap 0x17, rip = 0xffffffff80ef9584, rsp = 0xfffffe00a7c00f80, rbp = 0xfffffe00a7c010b0 --- vm_fault_hold() at vm_fault_hold+0x14/frame 0xfffffe00a7c010b0 vm_fault() at vm_fault+0x60/frame 0xfffffe00a7c010f0 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a7c01140 trap() at trap+0x2b4/frame 0xfffffe00a7c01250 calltrap() at calltrap+0x8/frame 0xfffffe00a7c01250 --- trap 0xc, rip = 0xffffffff80f06a14, rsp = 0xfffffe00a7c01320, rbp = 0xfffffe00a7c01400 --- vm_map_lookup() at vm_map_lookup+0x294/frame 0xfffffe00a7c01400 vm_fault_hold() at vm_fault_hold+0x80/frame 0xfffffe00a7c01550 vm_fault() at vm_fault+0x60/frame 0xfffffe00a7c01590 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a7c015e0 trap() at trap+0x2b4/frame 0xfffffe00a7c016f0 calltrap() at calltrap+0x8/frame 0xfffffe00a7c016f0 --- trap 0xc, rip = 0x7ffffffcb001, rsp = 0xfffffe00a7c017c0, rbp = 0xfffffe00a7c01988 --- ??() at 0x7ffffffcb001/frame 0xfffffe00a7c01988 ??() at 0xfffff803e0c70000/frame 0xffffffff820be480 ??() at 0xfffff800036bf000/frame 0xfffff800036bf000 ??() at 0xfffff800036b7000/frame 0xffffffff81ea54c0 ll() at 0xb0000/frame 0xffffffff81ea6138 Tracing command idle pid 11 tid 100003 td 0xfffff800036bf000 (CPU 0) cpustop_handler() at cpustop_handler+0x2d/frame 0xffffffff82051b70 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xffffffff82051b90 trap() at trap+0x48/frame 0xffffffff82051ca0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff82051ca0 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe0076766900, rbp = 0xfffffe0076766900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800036ba5a0 (CPU 1) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b73df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b73e10 trap() at trap+0x48/frame 0xfffffe0006b73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b73f20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe007676b900, rbp = 0xfffffe007676b900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007676b900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007676b950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007676b970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007676b990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007676ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007676bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007676bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800036ba000 (CPU 2) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b7fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b7fe10 trap() at trap+0x48/frame 0xfffffe0006b7ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b7ff20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe0076770900, rbp = 0xfffffe0076770900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076770900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076770950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076770970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076770990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076770a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076770ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076770ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800036b95a0 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b8bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b8be10 trap() at trap+0x48/frame 0xfffffe0006b8bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b8bf20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe0076775900, rbp = 0xfffffe0076775900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076775900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076775950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076775970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076775990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076775a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076775ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076775ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800036b9000 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b97df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b97e10 trap() at trap+0x48/frame 0xfffffe0006b97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b97f20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe007677a900, rbp = 0xfffffe007677a900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677a900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677a950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677a970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677a990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007677aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800036b85a0 (CPU 5) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006ba3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006ba3e10 trap() at trap+0x48/frame 0xfffffe0006ba3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006ba3f20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe007677f900, rbp = 0xfffffe007677f900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677f900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677f950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677f970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677f990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007677fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800036b8000 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bafe10 trap() at trap+0x48/frame 0xfffffe0006baff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006baff20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe0076784900, rbp = 0xfffffe0076784900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076784900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076784950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076784970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076784990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076784a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076784ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076784ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800036d05a0 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bbbe10 trap() at trap+0x48/frame 0xfffffe0006bbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bbbf20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe0076789900, rbp = 0xfffffe0076789900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076789900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076789950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076789970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076789990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076789a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076789ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076789ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800036d0000 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bc7e10 trap() at trap+0x48/frame 0xfffffe0006bc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc7f20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe007678e900, rbp = 0xfffffe007678e900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007678e900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007678e950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007678e970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007678e990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007678ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007678eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007678eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800036cf000 (CPU 10) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bdfe10 trap() at trap+0x48/frame 0xfffffe0006bdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdff20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe0076798900, rbp = 0xfffffe0076798900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076798900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076798950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076798970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076798990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076798a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076798ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076798ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800036ce5a0 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bebe10 trap() at trap+0x48/frame 0xfffffe0006bebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bebf20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe007679d900, rbp = 0xfffffe007679d900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007679d900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007679d950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007679d970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007679d990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007679da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007679dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007679dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 19330 19329 14130 0 RV+ CPU 9 xargs 19329 19327 14130 0 D+ ppwait 0xfffff80397d074f0 xargs 19328 19327 14130 0 S+ pipewr 0xfffff8000ad12be0 find 19327 19303 14130 0 S+ wait 0xfffff8057538b000 sh 19303 19301 14130 0 S+ wait 0xfffff805753a0000 sh 19302 14130 14130 0 S+ piperd 0xfffff800113928e8 tee 19301 14130 14130 0 S+ wait 0xfffff80397d32a60 sh 18954 16369 16334 0 S nanslp 0xffffffff81e8f0b5 sleep 29060 28961 29060 0 S+ select 0xfffff80006089340 bash 28961 28960 28961 0 S+ pause 0xfffff8000ab2eb08 csh 28960 28857 28960 2006 S+ wait 0xfffff80003ff6530 su 28857 28856 28857 2006 Ss+ wait 0xfffff80011c3b530 bash 28856 28758 28758 2006 S select 0xfffff8000a18f340 sshd 28758 2273 28758 0 Ss select 0xfffff8000aace140 sshd 16372 16334 16334 0 S piperd 0xfffff8000aaf75f0 sh 16370 16334 16334 0 S piperd 0xfffff802acd1f000 awk 16369 16334 16334 0 S wait 0xfffff8000aabf000 sh 16334 1 16334 0 Ss wait 0xfffff8000a70f530 sh 14130 2348 14130 0 S+ wait 0xfffff8000abbda60 sh 2348 2346 2348 0 S+ wait 0xfffff8000a39f000 bash 2346 2345 2346 0 S+ pause 0xfffff8000a7105d8 csh 2345 2341 2345 2006 S+ wait 0xfffff8000a786530 su 2341 2340 2341 2006 Ss+ wait 0xfffff8000a711530 bash 2340 2337 2337 2006 S select 0xfffff800060893c0 sshd 2337 2273 2337 0 Ss select 0xfffff8000a18f540 sshd 2333 2332 2333 0 S+ ttyin 0xfffff8000618a0b0 csh 2332 1 2332 0 Ss+ wait 0xfffff802ac4b3530 login 2331 1 2331 0 Ss+ ttyin 0xfffff8000618a4b0 getty 2330 1 2330 0 Ss+ ttyin 0xfffff8000a3ef4b0 getty 2329 1 2329 0 Ss+ ttyin 0xfffff8000a3ef8b0 getty 2328 1 2328 0 Ss+ ttyin 0xfffff8000a3efcb0 getty 2327 1 2327 0 Ss+ ttyin 0xfffff8000a3f10b0 getty 2326 1 2326 0 Ss+ ttyin 0xfffff8000a3f14b0 getty 2325 1 2325 0 Ss+ ttyin 0xfffff8000a3f18b0 getty 2324 1 2324 0 Ss+ ttyin 0xfffff8000a3f1cb0 getty 2323 1 2323 0 Ss+ ttyin 0xfffff8000a3f30b0 getty 2277 1 2277 0 Ss nanslp 0xffffffff81e8f0b8 cron 2273 1 2273 0 Ss select 0xfffff800037dc9c0 sshd 2244 1 2244 123 Ss (threaded) ntpd 100197 S select 0xfffff800037dc940 ntpd 100385 S usem 0xfffff805f41c8000 ntpd 2183 1 2183 0 Ss rpcsvc 0xfffff80003da1360 NLM: master 2180 1 2180 0 Ss select 0xfffff80006070ac0 rpc.statd 2134 1 2134 0 Ss nanslp 0xffffffff81e8f0b2 watchdogd 2054 1 2054 0 Ss select 0xfffff800036bb1c0 rpcbind 2044 1 2044 0 Ss select 0xfffff8000a18f5c0 syslogd 1973 1 1973 0 Ss select 0xfffff8000607cec0 devd 1968 1 1968 65 Ss select 0xfffff8000aacec40 dhclient 1924 1 1924 0 Ss select 0xfffff8000607cf40 dhclient 1921 1 1921 0 Ss select 0xfffff80003dc1dc0 dhclient 34 0 0 0 DL syncer 0xffffffff820315c0 [syncer] 33 0 0 0 DL vlruwt 0xfffff8000a4dfa60 [vnlru] 32 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff82030a58 [bufdaemon] 100133 D - 0xffffffff81a0a8c0 [bufspacedaemon-0] 100134 D - 0xffffffff81a12b80 [bufspacedaemon-1] 100135 D - 0xffffffff81a1ae40 [bufspacedaemon-2] 100136 D - 0xffffffff81a23100 [bufspacedaemon-3] 100137 D - 0xffffffff81a2b3c0 [bufspacedaemon-4] 100138 D - 0xffffffff81a33680 [bufspacedaemon-5] 100139 D - 0xffffffff81a3b940 [bufspacedaemon-6] 100153 D sdflush 0xfffff8000ac054e8 [/ worker] 100195 D sdflush 0xfffff8000ac936e8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff8204d808 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff820b75d8 [dom0] 100131 D launds 0xffffffff820b75e4 [laundry: dom0] 100132 D umarcl 0xffffffff80ef5850 [uma] 29 0 0 0 DL idle 0xfffff8000a39f530 [enc_daemon1] 28 0 0 0 DL idle 0xfffff8000a39fa60 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81cee7a0 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff820b5cb0 [sctp_iterator] 25 0 0 0 DL - 0xffffffff8203045c [soaiod4] 24 0 0 0 DL - 0xffffffff8203045c [soaiod3] 23 0 0 0 DL - 0xffffffff8203045c [soaiod2] 22 0 0 0 DL - 0xffffffff8203045c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe009a19c460 [usbus0] 100097 D - 0xfffffe009a19c4b8 [usbus0] 100098 D - 0xfffffe009a19c510 [usbus0] 100099 D - 0xfffffe009a19c568 [usbus0] 100100 D - 0xfffffe009a19c5c0 [usbus0] 100102 D - 0xfffffe0006dd6d10 [usbus1] 100103 D - 0xfffffe0006dd6d68 [usbus1] 100104 D - 0xfffffe0006dd6dc0 [usbus1] 100105 D - 0xfffffe0006dd6e18 [usbus1] 100106 D - 0xfffffe0006dd6e70 [usbus1] 100107 D - 0xfffffe009a633d10 [usbus2] 100108 D - 0xfffffe009a633d68 [usbus2] 100109 D - 0xfffffe009a633dc0 [usbus2] 100110 D - 0xfffffe009a633e18 [usbus2] 100111 D - 0xfffffe009a633e70 [usbus2] 20 0 0 0 DL (threaded) [cam] 100091 D - 0xffffffff81bc9b40 [doneq0] 100092 D - 0xffffffff81bc9bc0 [doneq1] 100093 D - 0xffffffff81bc9c40 [doneq2] 100125 D - 0xffffffff81bc9a08 [scanner] 19 0 0 0 DL crypto_ 0xfffff8000394f450 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff8000394f3f0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff8000394f390 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff8000394f330 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff8000394f2d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff8000394f270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff8000394f210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff8000394f1b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff8000394f150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff8000394f0f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff8000394f090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff8000394f030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff82047df8 [crypto] 14 0 0 0 DL seqstat 0xfffff800038f5c88 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff82086140 [g_event] 100063 D - 0xffffffff82086150 [g_up] 100064 D - 0xffffffff82086138 [g_down] 12 0 0 0 WL (threaded) [intr] 100015 I [swi5: fast taskq] 100019 I [swi6: task queue] 100020 I [swi6: Giant taskq] 100047 I [swi1: netisr 0] 100048 I [swi4: clock (0)] 100049 I [swi4: clock (1)] 100050 I [swi4: clock (2)] 100051 I [swi4: clock (3)] 100052 I [swi4: clock (4)] 100053 I [swi4: clock (5)] 100054 I [swi4: clock (6)] 100055 I [swi4: clock (7)] 100056 I [swi4: clock (8)] 100057 I [swi4: clock (9)] 100058 I [swi4: clock (10)] 100059 I [swi4: clock (11)] 100060 I [swi3: vm] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100175 I [irq72: ioat0] 100176 I [irq73: ioat1] 100177 I [irq74: ioat2] 100178 I [irq75: ioat3] 100179 I [irq76: ioat4] 100180 I [irq77: ioat5] 100181 I [irq78: ioat6] 100182 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800036b7530 [init] 10 0 0 0 DL audit_w 0xffffffff820b69d0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff82086180 [swapper] 100016 D - 0xfffff8000370ae00 [config_0] 100017 D - 0xfffff8000370ad00 [kqueue_ctx taskq] 100018 D - 0xfffff8000370ac00 [aiod_kick taskq] 100021 D - 0xfffff8000370a900 [thread taskq] 100022 D - 0xfffff8000370a800 [if_io_tqg_0] 100023 D - 0xfffff8000370a700 [if_io_tqg_1] 100024 D - 0xfffff8000370a600 [if_io_tqg_2] 100025 D - 0xfffff8000370a500 [if_io_tqg_3] 100026 D - 0xfffff8000370a400 [if_io_tqg_4] 100027 D - 0xfffff8000370a300 [if_io_tqg_5] 100028 D - 0xfffff8000370a200 [if_io_tqg_6] 100029 D - 0xfffff8000370a100 [if_io_tqg_7] 100030 D - 0xfffff8000370a000 [if_io_tqg_8] 100031 D - 0xfffff80003709e00 [if_io_tqg_9] 100032 D - 0xfffff80003709d00 [if_io_tqg_10] 100033 D - 0xfffff80003709c00 [if_io_tqg_11] 100034 D - 0xfffff80003709b00 [softirq_0] 100035 D - 0xfffff80003709a00 [softirq_1] 100036 D - 0xfffff80003709900 [softirq_2] 100037 D - 0xfffff80003709800 [softirq_3] 100038 D - 0xfffff80003709700 [softirq_4] 100039 D - 0xfffff80003709600 [softirq_5] 100040 D - 0xfffff80003709500 [softirq_6] 100041 D - 0xfffff800037bf100 [softirq_7] 100042 D - 0xfffff800037bf000 [softirq_8] 100043 D - 0xfffff800037bde00 [softirq_9] 100044 D - 0xfffff800037bdd00 [softirq_10] 100045 D - 0xfffff800037bdc00 [softirq_11] 100046 D - 0xfffff80003805200 [if_config_tqg_0] 100061 D - 0xfffff80003805100 [firmware taskq] 100066 D - 0xfffff80003804e00 [crypto_0] 100067 D - 0xfffff80003804e00 [crypto_1] 100068 D - 0xfffff80003804e00 [crypto_2] 100069 D - 0xfffff80003804e00 [crypto_3] 100070 D - 0xfffff80003804e00 [crypto_4] 100071 D - 0xfffff80003804e00 [crypto_5] 100072 D - 0xfffff80003804e00 [crypto_6] 100073 D - 0xfffff80003804e00 [crypto_7] 100074 D - 0xfffff80003804e00 [crypto_8] 100075 D - 0xfffff80003804e00 [crypto_9] 100076 D - 0xfffff80003804e00 [crypto_10] 100077 D - 0xfffff80003804e00 [crypto_11] 100114 D - 0xfffff800061ada00 [mca taskq] 100121 D - 0xfffff8000a20cd00 [acpi_task_0] 100122 D - 0xfffff8000a20cd00 [acpi_task_1] 100123 D - 0xfffff8000a20cd00 [acpi_task_2] 100124 D - 0xfffff80003804c00 [CAM taskq] db:0:pho> allt Tracing command xargs pid 19330 tid 100497 td 0xfffff803979ae000 (CPU 9) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe0006bd1db0 vpanic() at vpanic+0x1ba/frame 0xfffffe0006bd1e00 panic() at panic+0x43/frame 0xfffffe0006bd1e60 dblfault_handler() at dblfault_handler+0x1de/frame 0xfffffe0006bd1f30 Xdblfault() at Xdblfault+0xc3/frame 0xfffffe0006bd1f30 --- trap 0x17, rip = 0xffffffff80ef9584, rsp = 0xfffffe00a7c00f80, rbp = 0xfffffe00a7c010b0 --- vm_fault_hold() at vm_fault_hold+0x14/frame 0xfffffe00a7c010b0 vm_fault() at vm_fault+0x60/frame 0xfffffe00a7c010f0 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a7c01140 trap() at trap+0x2b4/frame 0xfffffe00a7c01250 calltrap() at calltrap+0x8/frame 0xfffffe00a7c01250 --- trap 0xc, rip = 0xffffffff80f06a14, rsp = 0xfffffe00a7c01320, rbp = 0xfffffe00a7c01400 --- vm_map_lookup() at vm_map_lookup+0x294/frame 0xfffffe00a7c01400 vm_fault_hold() at vm_fault_hold+0x80/frame 0xfffffe00a7c01550 vm_fault() at vm_fault+0x60/frame 0xfffffe00a7c01590 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a7c015e0 trap() at trap+0x2b4/frame 0xfffffe00a7c016f0 calltrap() at calltrap+0x8/frame 0xfffffe00a7c016f0 --- trap 0xc, rip = 0x7ffffffcb001, rsp = 0xfffffe00a7c017c0, rbp = 0xfffffe00a7c01988 --- ??() at 0x7ffffffcb001/frame 0xfffffe00a7c01988 ??() at 0xfffff803e0c70000/frame 0xffffffff820be480 ??() at 0xfffff800036bf000/frame 0xfffff800036bf000 ??() at 0xfffff800036b7000/frame 0xffffffff81ea54c0 ll() at 0xb0000/frame 0xffffffff81ea6138 Tracing command xargs pid 19329 tid 100303 td 0xfffff802acd70000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a6b35820 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6b35850 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a6b35890 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a6b358d0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x185/frame 0xfffffe00a6b35940 fork_rfppwait() at fork_rfppwait+0x14a/frame 0xfffffe00a6b35990 amd64_syscall() at amd64_syscall+0x7e1/frame 0xfffffe00a6b35ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6b35ab0 --- syscall (19330), rip = 0x80038da8d, rsp = 0x7fffffffe620, rbp = 0x7fffffffe680 --- Tracing command find pid 19328 tid 100267 td 0xfffff802acd6e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a6a81650 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6a81680 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a6a816c0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a6a81720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6a81750 _sleep() at _sleep+0x2d0/frame 0xfffffe00a6a817f0 pipe_write() at pipe_write+0x9d3/frame 0xfffffe00a6a818b0 dofilewrite() at dofilewrite+0x91/frame 0xfffffe00a6a81900 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a6a81940 sys_write() at sys_write+0x84/frame 0xfffffe00a6a81990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6a81ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6a81ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8004291ea, rsp = 0x7fffffffe548, rbp = 0x7fffffffe570 --- Tracing command sh pid 19327 tid 100399 td 0xfffff8011964d000 sched_switch() at sched_switch+0x713/frame 0xfffffe02c507f570 mi_switch() at mi_switch+0x174/frame 0xfffffe02c507f5a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe02c507f5e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe02c507f640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe02c507f670 _sleep() at _sleep+0x2d0/frame 0xfffffe02c507f710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe02c507f7a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe02c507f990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe02c507fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02c507fab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040d9ea, rsp = 0x7fffffffe448, rbp = 0x7fffffffe500 --- Tracing command sh pid 19303 tid 100409 td 0xfffff801195515a0 sched_switch() at sched_switch+0x713/frame 0xfffffe02c4f21570 mi_switch() at mi_switch+0x174/frame 0xfffffe02c4f215a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe02c4f215e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe02c4f21640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe02c4f21670 _sleep() at _sleep+0x2d0/frame 0xfffffe02c4f21710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe02c4f217a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe02c4f21990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe02c4f21ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02c4f21ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040d9ea, rsp = 0x7fffffffe498, rbp = 0x7fffffffe550 --- Tracing command tee pid 19302 tid 100388 td 0xfffff801196075a0 sched_switch() at sched_switch+0x713/frame 0xfffffe02c4ec76b0 mi_switch() at mi_switch+0x174/frame 0xfffffe02c4ec76e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe02c4ec7720 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe02c4ec7780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe02c4ec77b0 _sleep() at _sleep+0x2d0/frame 0xfffffe02c4ec7850 pipe_read() at pipe_read+0x359/frame 0xfffffe02c4ec78b0 dofileread() at dofileread+0x81/frame 0xfffffe02c4ec7900 kern_readv() at kern_readv+0x4a/frame 0xfffffe02c4ec7940 sys_read() at sys_read+0x84/frame 0xfffffe02c4ec7990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe02c4ec7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02c4ec7ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80041d22a, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sh pid 19301 tid 100507 td 0xfffff803979b6000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a7c36570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a7c365a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a7c365e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a7c36640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7c36670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a7c36710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a7c367a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a7c36990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a7c36ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7c36ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040d9ea, rsp = 0x7fffffffadd8, rbp = 0x7fffffffae90 --- Tracing command sleep pid 18954 tid 100406 td 0xfffff801197115a0 sched_switch() at sched_switch+0x713/frame 0xfffffe02c4ed6720 mi_switch() at mi_switch+0x174/frame 0xfffffe02c4ed6750 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe02c4ed6790 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe02c4ed67f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe02c4ed6830 _sleep() at _sleep+0x265/frame 0xfffffe02c4ed68d0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe02c4ed6950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe02c4ed6990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe02c4ed6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02c4ed6ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003acb6a, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffe6f0 --- Tracing command bash pid 29060 tid 100213 td 0xfffff80003ab1000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a5373590 mi_switch() at mi_switch+0x174/frame 0xfffffe00a53735c0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a5373600 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a5373660 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5373690 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a53736f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a5373730 kern_select() at kern_select+0x953/frame 0xfffffe00a5373910 sys_pselect() at sys_pselect+0x127/frame 0xfffffe00a5373990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a5373ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5373ab0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x80051db0a, rsp = 0x7fffffffd638, rbp = 0x7fffffffd700 --- Tracing command csh pid 28961 tid 100285 td 0xfffff8000ab055a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a6adb760 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6adb790 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a6adb7d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a6adb830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6adb860 _sleep() at _sleep+0x2d0/frame 0xfffffe00a6adb900 kern_sigsuspend() at kern_sigsuspend+0xb4/frame 0xfffffe00a6adb960 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe00a6adb990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6adbab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6adbab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800491a6a, rsp = 0x7fffffffdff8, rbp = 0x7fffffffe080 --- Tracing command su pid 28960 tid 100254 td 0xfffff8000601e000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a6a40570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6a405a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a6a405e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a6a40640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6a40670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a6a40710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a6a407a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a6a40990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6a40ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6a40ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003f29ea, rsp = 0x7fffffffe5f8, rbp = 0x7fffffffeb40 --- Tracing command bash pid 28857 tid 100192 td 0xfffff8001180e000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a5303570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a53035a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a53035e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a5303640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5303670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a5303710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a53037a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a5303990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a5303ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5303ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80051d9ea, rsp = 0x7fffffffe7c8, rbp = 0x7fffffffe810 --- Tracing command sshd pid 28856 tid 100269 td 0xfffff802acc63000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a6a8b5d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6a8b600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a6a8b640 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a6a8b6a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6a8b6d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a6a8b730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a6a8b770 kern_select() at kern_select+0x953/frame 0xfffffe00a6a8b950 sys_select() at sys_select+0x56/frame 0xfffffe00a6a8b990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6a8bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6a8bab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80090a20a, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 28758 tid 100273 td 0xfffff802acdac5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a6a9f650 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6a9f680 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a6a9f6c0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a6a9f720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6a9f750 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a6a9f7b0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a6a9f7f0 kern_poll() at kern_poll+0x448/frame 0xfffffe00a6a9f970 sys_poll() at sys_poll+0x50/frame 0xfffffe00a6a9f990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6a9fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6a9fab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8008ac35a, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command sh pid 16372 tid 100228 td 0xfffff8000a3ae000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a53be6b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a53be6e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a53be720 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a53be780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a53be7b0 _sleep() at _sleep+0x2d0/frame 0xfffffe00a53be850 pipe_read() at pipe_read+0x359/frame 0xfffffe00a53be8b0 dofileread() at dofileread+0x81/frame 0xfffffe00a53be900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a53be940 sys_read() at sys_read+0x84/frame 0xfffffe00a53be990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a53beab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a53beab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047e22a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe330 --- Tracing command awk pid 16370 tid 100256 td 0xfffff8000ab315a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a6a4a6b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6a4a6e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a6a4a720 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a6a4a780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6a4a7b0 _sleep() at _sleep+0x2d0/frame 0xfffffe00a6a4a850 pipe_read() at pipe_read+0x359/frame 0xfffffe00a6a4a8b0 dofileread() at dofileread+0x81/frame 0xfffffe00a6a4a900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a6a4a940 sys_read() at sys_read+0x84/frame 0xfffffe00a6a4a990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6a4aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6a4aab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80048122a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe340 --- Tracing command sh pid 16369 tid 100162 td 0xfffff8000aad15a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a5231570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a52315a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a52315e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a5231640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5231670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a5231710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a52317a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a5231990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a5231ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5231ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040d9ea, rsp = 0x7fffffffe238, rbp = 0x7fffffffe2f0 --- Tracing command sh pid 16334 tid 100226 td 0xfffff8000af84000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a53b4570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a53b45a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a53b45e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a53b4640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a53b4670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a53b4710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a53b47a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a53b4990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a53b4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a53b4ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040d9ea, rsp = 0x7fffffffe4c8, rbp = 0x7fffffffe580 --- Tracing command sh pid 14130 tid 100214 td 0xfffff8000abcd5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a5378570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a53785a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a53785e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a5378640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5378670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a5378710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a53787a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a5378990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a5378ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5378ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040d9ea, rsp = 0x7fffffffb0f8, rbp = 0x7fffffffb1b0 --- Tracing command bash pid 2348 tid 100154 td 0xfffff8000a3af5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a5209570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a52095a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a52095e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a5209640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5209670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a5209710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a52097a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a5209990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a5209ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5209ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80051d9ea, rsp = 0x7fffffffe678, rbp = 0x7fffffffe6c0 --- Tracing command csh pid 2346 tid 100198 td 0xfffff8000af855a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a5328760 mi_switch() at mi_switch+0x174/frame 0xfffffe00a5328790 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a53287d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a5328830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5328860 _sleep() at _sleep+0x2d0/frame 0xfffffe00a5328900 kern_sigsuspend() at kern_sigsuspend+0xb4/frame 0xfffffe00a5328960 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe00a5328990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a5328ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5328ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800491a6a, rsp = 0x7fffffffdff8, rbp = 0x7fffffffe080 --- Tracing command su pid 2345 tid 100200 td 0xfffff802ac4b95a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a5332570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a53325a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a53325e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a5332640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5332670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a5332710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a53327a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a5332990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a5332ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5332ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003f29ea, rsp = 0x7fffffffe5f8, rbp = 0x7fffffffeb40 --- Tracing command bash pid 2341 tid 100163 td 0xfffff8000af87000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a5236570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a52365a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a52365e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a5236640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5236670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a5236710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a52367a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a5236990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a5236ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5236ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80051d9ea, rsp = 0x7fffffffe7c8, rbp = 0x7fffffffe810 --- Tracing command sshd pid 2340 tid 100189 td 0xfffff80003ab15a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a52e85d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a52e8600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a52e8640 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a52e86a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a52e86d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a52e8730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a52e8770 kern_select() at kern_select+0x953/frame 0xfffffe00a52e8950 sys_select() at sys_select+0x56/frame 0xfffffe00a52e8990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a52e8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a52e8ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80090a20a, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 2337 tid 100201 td 0xfffff802ac4b9000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a5337650 mi_switch() at mi_switch+0x174/frame 0xfffffe00a5337680 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a53376c0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a5337720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5337750 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a53377b0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a53377f0 kern_poll() at kern_poll+0x448/frame 0xfffffe00a5337970 sys_poll() at sys_poll+0x50/frame 0xfffffe00a5337990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a5337ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5337ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8008ac35a, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command csh pid 2333 tid 100167 td 0xfffff800037ce000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a524a630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a524a660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a524a6a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a524a700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a524a730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a524a790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a524a7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a524a820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a524a850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a524a8b0 dofileread() at dofileread+0x81/frame 0xfffffe00a524a900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a524a940 sys_read() at sys_read+0x84/frame 0xfffffe00a524a990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a524aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a524aab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80050222a, rsp = 0x7fffffffe1f8, rbp = 0x7fffffffe220 --- Tracing command login pid 2332 tid 100211 td 0xfffff8000a723000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a5369570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a53695a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a53695e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a5369640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5369670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a5369710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a53697a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a5369990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a5369ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5369ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003f49ea, rsp = 0x7fffffffeb48, rbp = 0x7fffffffed00 --- Tracing command getty pid 2331 tid 100210 td 0xfffff8000a7235a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a5364630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a5364660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a53646a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a5364700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5364730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a5364790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a53647c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a5364820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a5364850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a53648b0 dofileread() at dofileread+0x81/frame 0xfffffe00a5364900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a5364940 sys_read() at sys_read+0x84/frame 0xfffffe00a5364990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a5364ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5364ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2330 tid 100209 td 0xfffff802ac4c0000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a535f630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a535f660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a535f6a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a535f700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a535f730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a535f790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a535f7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a535f820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a535f850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a535f8b0 dofileread() at dofileread+0x81/frame 0xfffffe00a535f900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a535f940 sys_read() at sys_read+0x84/frame 0xfffffe00a535f990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a535fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a535fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2329 tid 100208 td 0xfffff802ac4c05a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a535a630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a535a660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a535a6a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a535a700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a535a730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a535a790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a535a7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a535a820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a535a850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a535a8b0 dofileread() at dofileread+0x81/frame 0xfffffe00a535a900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a535a940 sys_read() at sys_read+0x84/frame 0xfffffe00a535a990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a535aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a535aab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2328 tid 100207 td 0xfffff802ac4c1000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a5355630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a5355660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a53556a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a5355700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5355730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a5355790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a53557c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a5355820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a5355850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a53558b0 dofileread() at dofileread+0x81/frame 0xfffffe00a5355900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a5355940 sys_read() at sys_read+0x84/frame 0xfffffe00a5355990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a5355ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5355ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2327 tid 100206 td 0xfffff80003778000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a5350630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a5350660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a53506a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a5350700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5350730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a5350790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a53507c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a5350820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a5350850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a53508b0 dofileread() at dofileread+0x81/frame 0xfffffe00a5350900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a5350940 sys_read() at sys_read+0x84/frame 0xfffffe00a5350990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a5350ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5350ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2326 tid 100205 td 0xfffff800037785a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a534b630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a534b660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a534b6a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a534b700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a534b730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a534b790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a534b7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a534b820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a534b850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a534b8b0 dofileread() at dofileread+0x81/frame 0xfffffe00a534b900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a534b940 sys_read() at sys_read+0x84/frame 0xfffffe00a534b990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a534bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a534bab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2325 tid 100204 td 0xfffff8000377d000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a5346630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a5346660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a53466a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a5346700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5346730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a5346790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a53467c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a5346820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a5346850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a53468b0 dofileread() at dofileread+0x81/frame 0xfffffe00a5346900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a5346940 sys_read() at sys_read+0x84/frame 0xfffffe00a5346990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a5346ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5346ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2324 tid 100147 td 0xfffff80003781000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a3fe2630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a3fe2660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a3fe26a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a3fe2700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a3fe2730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a3fe2790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a3fe27c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a3fe2820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a3fe2850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a3fe28b0 dofileread() at dofileread+0x81/frame 0xfffffe00a3fe2900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a3fe2940 sys_read() at sys_read+0x84/frame 0xfffffe00a3fe2990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a3fe2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a3fe2ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2323 tid 100142 td 0xfffff8000611b000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a3fc9630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a3fc9660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a3fc96a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a3fc9700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a3fc9730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a3fc9790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a3fc97c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a3fc9820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a3fc9850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a3fc98b0 dofileread() at dofileread+0x81/frame 0xfffffe00a3fc9900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a3fc9940 sys_read() at sys_read+0x84/frame 0xfffffe00a3fc9990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a3fc9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a3fc9ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2277 tid 100196 td 0xfffff8000377d5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a531e720 mi_switch() at mi_switch+0x174/frame 0xfffffe00a531e750 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a531e790 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a531e7f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a531e830 _sleep() at _sleep+0x265/frame 0xfffffe00a531e8d0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00a531e950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00a531e990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a531eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a531eab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003dcb6a, rsp = 0x7fffffffead8, rbp = 0x7fffffffecc0 --- Tracing command sshd pid 2273 tid 100150 td 0xfffff8000a4f55a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a3ff15d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a3ff1600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a3ff1640 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a3ff16a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a3ff16d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a3ff1730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a3ff1770 kern_select() at kern_select+0x953/frame 0xfffffe00a3ff1950 sys_select() at sys_select+0x56/frame 0xfffffe00a3ff1990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a3ff1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a3ff1ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80090a20a, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6a0 --- Tracing command ntpd pid 2244 tid 100197 td 0xfffff8000af86000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a53235d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a5323600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a5323640 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a53236a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a53236d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a5323730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a5323770 kern_select() at kern_select+0x953/frame 0xfffffe00a5323950 sys_select() at sys_select+0x56/frame 0xfffffe00a5323990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a5323ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5323ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80083620a, rsp = 0x7fffffffdf18, rbp = 0x7fffffffdf50 --- Tracing command ntpd pid 2244 tid 100385 td 0xfffff805f61645a0 sched_switch() at sched_switch+0x713/frame 0xfffffe02c50706d0 mi_switch() at mi_switch+0x174/frame 0xfffffe02c5070700 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe02c5070740 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe02c50707a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe02c50707d0 _sleep() at _sleep+0x2d0/frame 0xfffffe02c5070870 umtxq_sleep() at umtxq_sleep+0x153/frame 0xfffffe02c50708d0 do_sem2_wait() at do_sem2_wait+0x26d/frame 0xfffffe02c5070940 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x76/frame 0xfffffe02c5070990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe02c5070ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02c5070ab0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80072a58a, rsp = 0x7fffdff7bed8, rbp = 0x7fffdff7bf50 --- Tracing command rpc.lockd pid 2183 tid 100174 td 0xfffff8000abce000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a526d4f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a526d520 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a526d560 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a526d5c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a526d600 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00a526d670 svc_run_internal() at svc_run_internal+0xa77/frame 0xfffffe00a526d7b0 svc_run() at svc_run+0x24e/frame 0xfffffe00a526d810 sys_nlm_syscall() at sys_nlm_syscall+0x77b/frame 0xfffffe00a526d990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a526dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a526dab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f862a, rsp = 0x7fffffffec08, rbp = 0x7fffffffecc0 --- Tracing command rpc.statd pid 2180 tid 100164 td 0xfffff8000af865a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a523b5b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a523b5e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a523b620 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a523b680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a523b6c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00a523b730 seltdwait() at seltdwait+0x6b/frame 0xfffffe00a523b770 kern_select() at kern_select+0x953/frame 0xfffffe00a523b950 sys_select() at sys_select+0x56/frame 0xfffffe00a523b990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a523bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a523bab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042d20a, rsp = 0x7fffffffea98, rbp = 0x7fffffffebe0 --- Tracing command watchdogd pid 2134 tid 100158 td 0xfffff8000abce5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a521d720 mi_switch() at mi_switch+0x174/frame 0xfffffe00a521d750 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a521d790 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a521d7f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a521d830 _sleep() at _sleep+0x265/frame 0xfffffe00a521d8d0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00a521d950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00a521d990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a521dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a521dab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c5b6a, rsp = 0x7fffffffea98, rbp = 0x7fffffffeae0 --- Tracing command rpcbind pid 2054 tid 100187 td 0xfffff8000a5315a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a52de630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a52de660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a52de6a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a52de700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a52de740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00a52de7b0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00a52de7f0 kern_poll() at kern_poll+0x448/frame 0xfffffe00a52de970 sys_poll() at sys_poll+0x50/frame 0xfffffe00a52de990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a52deab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a52deab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003d435a, rsp = 0x7fffffffca38, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2044 tid 100170 td 0xfffff8000a3af000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a52595d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a5259600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a5259640 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a52596a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a52596d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a5259730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a5259770 kern_select() at kern_select+0x953/frame 0xfffffe00a5259950 sys_select() at sys_select+0x56/frame 0xfffffe00a5259990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a5259ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5259ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043e20a, rsp = 0x7fffffffe748, rbp = 0x7fffffffecc0 --- Tracing command devd pid 1973 tid 100152 td 0xfffff8000abcf000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a3ffb5b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a3ffb5e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a3ffb620 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a3ffb680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a3ffb6c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00a3ffb730 seltdwait() at seltdwait+0x6b/frame 0xfffffe00a3ffb770 kern_select() at kern_select+0x953/frame 0xfffffe00a3ffb950 sys_select() at sys_select+0x56/frame 0xfffffe00a3ffb990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a3ffbab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a3ffbab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f530a, rsp = 0x7fffffffcb48, rbp = 0x7fffffffece0 --- Tracing command dhclient pid 1968 tid 100145 td 0xfffff800037ce5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a3fd8630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a3fd8660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a3fd86a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a3fd8700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a3fd8740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00a3fd87b0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00a3fd87f0 kern_poll() at kern_poll+0x448/frame 0xfffffe00a3fd8970 sys_poll() at sys_poll+0x50/frame 0xfffffe00a3fd8990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a3fd8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a3fd8ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f735a, rsp = 0x7fffffffec28, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1924 tid 100161 td 0xfffff8000601f000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a522c650 mi_switch() at mi_switch+0x174/frame 0xfffffe00a522c680 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a522c6c0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a522c720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a522c750 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a522c7b0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a522c7f0 kern_poll() at kern_poll+0x448/frame 0xfffffe00a522c970 sys_poll() at sys_poll+0x50/frame 0xfffffe00a522c990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a522cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a522cab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f735a, rsp = 0x7fffffffec38, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1921 tid 100169 td 0xfffff8000a4e9000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a52545d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a5254600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a5254640 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a52546a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a52546d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a5254730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a5254770 kern_select() at kern_select+0x953/frame 0xfffffe00a5254950 sys_select() at sys_select+0x56/frame 0xfffffe00a5254990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a5254ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5254ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80045520a, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffeaa0 --- Tracing command syncer pid 34 tid 100141 td 0xfffff8000a4f6000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a3fc48c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a3fc48f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a3fc4930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a3fc4970 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x185/frame 0xfffffe00a3fc49e0 sched_sync() at sched_sync+0x609/frame 0xfffffe00a3fc4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a3fc4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a3fc4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 33 tid 100140 td 0xfffff8000a4f65a0 sched_switch() at sched_switch+0x713/frame 0xfffffe009c5fd890 mi_switch() at mi_switch+0x174/frame 0xfffffe009c5fd8c0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe009c5fd900 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe009c5fd940 _sleep() at _sleep+0x279/frame 0xfffffe009c5fd9e0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe009c5fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe009c5fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009c5fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffff8000a4f7000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f2b8d0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f2b900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f2b940 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f2b980 _sleep() at _sleep+0x279/frame 0xfffffe0006f2ba20 buf_daemon() at buf_daemon+0xc8/frame 0xfffffe0006f2ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f2bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f2bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100133 td 0xfffff8000a15d5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ffa8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ffa8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ffa930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ffa970 _sleep() at _sleep+0x279/frame 0xfffffe0006ffaa10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006ffaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ffaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ffaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffff8000a15d000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006fff8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006fff8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006fff930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006fff970 _sleep() at _sleep+0x279/frame 0xfffffe0006fffa10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006fffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006fffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006fffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff8000a1555a0 sched_switch() at sched_switch+0x713/frame 0xfffffe009c3e48c0 mi_switch() at mi_switch+0x174/frame 0xfffffe009c3e48f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe009c3e4930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe009c3e4970 _sleep() at _sleep+0x279/frame 0xfffffe009c3e4a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe009c3e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009c3e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009c3e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff8000a155000 sched_switch() at sched_switch+0x713/frame 0xfffffe009c5298c0 mi_switch() at mi_switch+0x174/frame 0xfffffe009c5298f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe009c529930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe009c529970 _sleep() at _sleep+0x279/frame 0xfffffe009c529a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe009c529a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009c529ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009c529ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffff800061285a0 sched_switch() at sched_switch+0x713/frame 0xfffffe009c5ee8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe009c5ee8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe009c5ee930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe009c5ee970 _sleep() at _sleep+0x279/frame 0xfffffe009c5eea10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe009c5eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe009c5eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009c5eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffff8000a5395a0 sched_switch() at sched_switch+0x713/frame 0xfffffe009c5f38c0 mi_switch() at mi_switch+0x174/frame 0xfffffe009c5f38f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe009c5f3930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe009c5f3970 _sleep() at _sleep+0x279/frame 0xfffffe009c5f3a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe009c5f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009c5f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009c5f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffff8000a539000 sched_switch() at sched_switch+0x713/frame 0xfffffe009c5f88c0 mi_switch() at mi_switch+0x174/frame 0xfffffe009c5f88f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe009c5f8930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe009c5f8970 _sleep() at _sleep+0x279/frame 0xfffffe009c5f8a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe009c5f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009c5f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009c5f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100153 td 0xfffff8000aad25a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a52048f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a5204920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a5204960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a52049a0 _sleep() at _sleep+0x279/frame 0xfffffe00a5204a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00a5204a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a5204ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5204ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100195 td 0xfffff8001180d000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a52138f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a5213920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a5213960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a52139a0 _sleep() at _sleep+0x279/frame 0xfffffe00a5213a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00a5213a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a5213ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5213ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff8000a4f75a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f268c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f268f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f26930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f26960 _sleep() at _sleep+0x2da/frame 0xfffffe0006f26a00 vm_daemon() at vm_daemon+0xabf/frame 0xfffffe0006f26a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f26ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f26ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff8000a4f8000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f21560 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f21590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f215d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f21610 _sleep() at _sleep+0x279/frame 0xfffffe0006f216b0 vm_pageout_worker() at vm_pageout_worker+0x25e/frame 0xfffffe0006f21a30 vm_pageout() at vm_pageout+0x156/frame 0xfffffe0006f21a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f21ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f21ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100131 td 0xfffff8000a24c5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f306b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f306e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f30720 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f30750 _sleep() at _sleep+0x2da/frame 0xfffffe0006f307f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xbcb/frame 0xfffffe0006f30a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f30ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f30ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100132 td 0xfffff8000a24c000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ff58f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ff5920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ff5960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ff59a0 _sleep() at _sleep+0x279/frame 0xfffffe0006ff5a40 uma_reclaim_worker() at uma_reclaim_worker+0xda/frame 0xfffffe0006ff5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ff5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ff5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff8000a3b0000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f108b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f108e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f10920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f10950 _sleep() at _sleep+0x2da/frame 0xfffffe0006f109f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006f10a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f10ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f10ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff8000a3b05a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f0b8b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f0b8e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f0b920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f0b950 _sleep() at _sleep+0x2da/frame 0xfffffe0006f0b9f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006f0ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f0bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f0bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100120 td 0xfffff8000a2585a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006eed8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eed8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006eed930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006eed970 _sleep() at _sleep+0x279/frame 0xfffffe0006eeda10 random_kthread() at random_kthread+0x26a/frame 0xfffffe0006eeda70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eedab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eedab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff8000a259000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006edc910 mi_switch() at mi_switch+0x174/frame 0xfffffe0006edc940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006edc980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006edc9b0 _sleep() at _sleep+0x2da/frame 0xfffffe0006edca50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0006edca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006edcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006edcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff8000a15e000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ecb8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ecb910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ecb950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ecb990 _sleep() at _sleep+0x279/frame 0xfffffe0006ecba30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ecba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ecbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ecbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff8000a15e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ec68e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ec6910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ec6950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ec6990 _sleep() at _sleep+0x279/frame 0xfffffe0006ec6a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ec6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff8000a15f000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ec18e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ec1910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ec1950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ec1990 _sleep() at _sleep+0x279/frame 0xfffffe0006ec1a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ec1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff8000a15f5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ebc8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ebc910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ebc950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ebc990 _sleep() at _sleep+0x279/frame 0xfffffe0006ebca30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ebca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ebcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ebcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff80003e87000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e45930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e45960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e459a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e459d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e45a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e45a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e45ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e45ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff80003e865a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e4a930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e4a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e4a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4a9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e4aa30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e4aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff80003e86000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e4f930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e4f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e4f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4f9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e4fa30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e4fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff80003e855a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e54930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e54960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e549a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e549d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e54a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e54a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e54ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e54ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff80003e85000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e59930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e59960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e599a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e599d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e59a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e59a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e59ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e59ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff80003e7d000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e63930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e63960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e639a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e639d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e63a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e63a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e63ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e63ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff800060215a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e68930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e68960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e689a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e689d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e68a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e68a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e68ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e68ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff80006021000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e6d930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e6d960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e6d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e6d9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e6da30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e6da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e6dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e6dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff800060205a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e72930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e72960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e729a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e729d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e72a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e72a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e72ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e72ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff80006020000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e77930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e77960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e779a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e779d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e77a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e77a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e77ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e77ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff80006128000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e94930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e94960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e949d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e94a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e94a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e94ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e94ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff800061275a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e99930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e99960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e999d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e99a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e99a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e99ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e99ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff80006127000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e9e930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e9e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e9e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e9e9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e9ea30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e9ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e9eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e9eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff800061265a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ea3930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ea3960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ea39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ea39d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006ea3a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006ea3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff80006126000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ea8930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ea8960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ea89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ea89d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006ea8a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006ea8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff80003ab45a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e2c8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e2c910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e2c950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e2c980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e2ca20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e2ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e2cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff80003ab4000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e318e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e31910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e31950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e31980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e31a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e31a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e31ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff80003ab35a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e368e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e36910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e36950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e36980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e36a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e36a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e36ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff8000a256000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f068d0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f06900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f06940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f06970 _sleep() at _sleep+0x2da/frame 0xfffffe0006f06a10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe0006f06a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f06ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f06ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffff80003953000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e278c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e278f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e27930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e27960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e27a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e27a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e27ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e27ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffff800039535a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e228c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e228f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e22930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e22960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e22a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e22a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e22ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e22ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffff80003954000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e1d8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e1d8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e1d930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e1d960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e1da00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e1dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffff800039545a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e188c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e188f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e18930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e18960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e18a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e18a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e18ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffff80003955000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e138c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e138f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e13930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e13960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e13a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e13a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e13ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffff800039555a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e0e8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e0e8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e0e930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e0e960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e0ea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e0ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e0eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffff80003956000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e098c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e098f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e09930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e09960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e09a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e09ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffff800039565a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e048c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e048f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e04930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e04960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e04a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e04a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e04ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffff80003957000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005fd8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005fd8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005fd930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005fd960 _sleep() at _sleep+0x2da/frame 0xfffffe00005fda00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffff800038ca5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005f88c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f88f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005f8930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f8960 _sleep() at _sleep+0x2da/frame 0xfffffe00005f8a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffff80003948000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005f38c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f38f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005f3930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f3960 _sleep() at _sleep+0x2da/frame 0xfffffe00005f3a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffff800039485a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005ee8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ee8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ee930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ee960 _sleep() at _sleep+0x2da/frame 0xfffffe00005eea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffff80003949000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005e98f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e9920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005e9960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e9990 _sleep() at _sleep+0x2da/frame 0xfffffe00005e9a30 crypto_proc() at crypto_proc+0x2c4/frame 0xfffffe00005e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffff800038c95a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005a88f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005a8920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005a8960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a8990 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005a89f0 seq_eventthread() at seq_eventthread+0xdc/frame 0xfffffe00005a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff80003828000 sched_switch() at sched_switch+0x713/frame 0xfffffe000058d8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe000058d920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000058d960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000058d990 _sleep() at _sleep+0x2da/frame 0xfffffe000058da30 g_run_events() at g_run_events+0x4f/frame 0xfffffe000058da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff8000381d5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005928f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000592920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000592960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000592990 _sleep() at _sleep+0x2da/frame 0xfffffe0000592a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0000592a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe0000592a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000592ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000592ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffff800038ca000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005978f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000597920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000597960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000597990 _sleep() at _sleep+0x2da/frame 0xfffffe0000597a30 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe0000597a60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe0000597a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000597ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000597ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100015 td 0xfffff800036ce000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100019 td 0xfffff80003716000 sched_switch() at sched_switch+0x713/frame 0xfffffe00767c29e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00767c2a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00767c2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767c2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767c2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100020 td 0xfffff800037155a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00767c79e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00767c7a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00767c7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767c7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767c7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100047 td 0xfffff8000381c5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004ee9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00004eea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00004eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff8000381c000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004f39e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00004f3a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00004f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffff8000381b5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff8000381b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff8000381a5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff8000381a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff800038075a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff80003807000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff8000382b5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff8000382b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff8000382a5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff8000382a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff800038295a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffff80003829000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffff80003e88000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e3b9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e3ba10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e3ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e3bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e3bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff80003e875a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e409e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e40a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e40a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e40ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e40ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff80003e7d5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e5e9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e5ea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e5ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e5eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e5eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff800061255a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff80006125000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006eb29e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eb2a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006eb2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100175 td 0xfffff8000ad0d5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100176 td 0xfffff8000ad0d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100177 td 0xfffff8000ad0c5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100178 td 0xfffff8000ad0c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffff8000ad135a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffff8000ad13000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffff8000abcf5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffff800115015a0 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff800036bf000 (CPU 0) cpustop_handler() at cpustop_handler+0x2d/frame 0xffffffff82051b70 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xffffffff82051b90 trap() at trap+0x48/frame 0xffffffff82051ca0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff82051ca0 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe0076766900, rbp = 0xfffffe0076766900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800036ba5a0 (CPU 1) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b73df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b73e10 trap() at trap+0x48/frame 0xfffffe0006b73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b73f20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe007676b900, rbp = 0xfffffe007676b900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007676b900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007676b950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007676b970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007676b990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007676ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007676bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007676bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800036ba000 (CPU 2) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b7fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b7fe10 trap() at trap+0x48/frame 0xfffffe0006b7ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b7ff20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe0076770900, rbp = 0xfffffe0076770900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076770900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076770950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076770970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076770990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076770a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076770ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076770ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800036b95a0 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b8bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b8be10 trap() at trap+0x48/frame 0xfffffe0006b8bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b8bf20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe0076775900, rbp = 0xfffffe0076775900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076775900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076775950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076775970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076775990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076775a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076775ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076775ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800036b9000 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b97df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b97e10 trap() at trap+0x48/frame 0xfffffe0006b97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b97f20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe007677a900, rbp = 0xfffffe007677a900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677a900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677a950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677a970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677a990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007677aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800036b85a0 (CPU 5) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006ba3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006ba3e10 trap() at trap+0x48/frame 0xfffffe0006ba3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006ba3f20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe007677f900, rbp = 0xfffffe007677f900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677f900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677f950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677f970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677f990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007677fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800036b8000 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bafe10 trap() at trap+0x48/frame 0xfffffe0006baff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006baff20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe0076784900, rbp = 0xfffffe0076784900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076784900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076784950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076784970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076784990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076784a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076784ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076784ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800036d05a0 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bbbe10 trap() at trap+0x48/frame 0xfffffe0006bbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bbbf20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe0076789900, rbp = 0xfffffe0076789900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076789900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076789950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076789970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076789990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076789a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076789ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076789ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800036d0000 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bc7e10 trap() at trap+0x48/frame 0xfffffe0006bc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc7f20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe007678e900, rbp = 0xfffffe007678e900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007678e900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007678e950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007678e970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007678e990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007678ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007678eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007678eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800036cf5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0076793940 mi_switch() at mi_switch+0x174/frame 0xfffffe0076793970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe0076793990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076793a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076793ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076793ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800036cf000 (CPU 10) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bdfe10 trap() at trap+0x48/frame 0xfffffe0006bdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdff20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe0076798900, rbp = 0xfffffe0076798900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076798900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076798950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076798970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076798990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076798a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076798ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076798ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800036ce5a0 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bebe10 trap() at trap+0x48/frame 0xfffffe0006bebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bebf20 --- trap 0x13, rip = 0xffffffff81203946, rsp = 0xfffffe007679d900, rbp = 0xfffffe007679d900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007679d900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007679d950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007679d970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007679d990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007679da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007679dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007679dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800036bf5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0076761570 mi_switch() at mi_switch+0x174/frame 0xfffffe00767615a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767615e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe0076761640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0076761670 _sleep() at _sleep+0x2d0/frame 0xfffffe0076761710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00767617a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0076761990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0076761ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0076761ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b10ca, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffff800036c0000 sched_switch() at sched_switch+0x713/frame 0xfffffe007675c910 mi_switch() at mi_switch+0x174/frame 0xfffffe007675c940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe007675c980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe007675c9b0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe007675ca10 audit_worker() at audit_worker+0x93/frame 0xfffffe007675ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007675cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007675cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff820866c0 sched_switch() at sched_switch+0x713/frame 0xffffffff82710980 mi_switch() at mi_switch+0x174/frame 0xffffffff827109b0 sleepq_switch() at sleepq_switch+0x110/frame 0xffffffff827109f0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xffffffff82710a30 _sleep() at _sleep+0x279/frame 0xffffffff82710ad0 swapper() at swapper+0x77/frame 0xffffffff82710b20 mi_startup() at mi_startup+0x2ee/frame 0xffffffff82710b70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100016 td 0xfffff800036cd5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00767b3930 mi_switch() at mi_switch+0x174/frame 0xfffffe00767b3960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767b39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767b39d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00767b3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00767b3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767b3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767b3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff800036cd000 sched_switch() at sched_switch+0x713/frame 0xfffffe00767b8900 mi_switch() at mi_switch+0x174/frame 0xfffffe00767b8930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767b8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767b89a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767b8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767b8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767b8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767b8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffff800036c05a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00767bd900 mi_switch() at mi_switch+0x174/frame 0xfffffe00767bd930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767bd970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767bd9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767bda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767bda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767bdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767bdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff80003715000 sched_switch() at sched_switch+0x713/frame 0xfffffe00767cc900 mi_switch() at mi_switch+0x174/frame 0xfffffe00767cc930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767cc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767cc9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767cca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767cca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767ccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767ccab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff800037145a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000471930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000471960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004719a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004719d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000471a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000471a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000471ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000471ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff80003714000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000476930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000476960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004769a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004769d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000476a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000476a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000476ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000476ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff800037135a0 sched_switch() at sched_switch+0x713/frame 0xfffffe000047b930 mi_switch() at mi_switch+0x174/frame 0xfffffe000047b960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000047b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000047b9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000047ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000047ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000047bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000047bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003713000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000480930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000480960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004809a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004809d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000480a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000480a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000480ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000480ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff800037125a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000485930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000485960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004859a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004859d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000485a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000485a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000485ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000485ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003712000 sched_switch() at sched_switch+0x713/frame 0xfffffe000048a930 mi_switch() at mi_switch+0x174/frame 0xfffffe000048a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000048a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048a9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000048aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff8000374c5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe000048f930 mi_switch() at mi_switch+0x174/frame 0xfffffe000048f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000048f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048f9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000048fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff8000374c000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000494930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000494960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004949d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000494a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000494a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000494ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000494ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff8000374b5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000499930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000499960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004999d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000499a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000499a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000499ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000499ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff8000374b000 sched_switch() at sched_switch+0x713/frame 0xfffffe000049e930 mi_switch() at mi_switch+0x174/frame 0xfffffe000049e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000049e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000049e9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000049ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000049ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000049eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000049eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff8000374a5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004a3930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004a3960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004a39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a39d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004a3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff8000374a000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004a8930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004a8960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004a89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a89d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004a8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff800037495a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004ad930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004ad960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004ad9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004ad9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004ada40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff80003749000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004b2930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004b2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004b29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004b2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff800037165a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004b7930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004b7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004b79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004b7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff80003789000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004bc930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004bc960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004bc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004bc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004bca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800037865a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004c1930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004c1960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004c19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c19d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004c1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80003786000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004c6930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004c6960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004c69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c69d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004c6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800037815a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004cb930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004cb960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004cb9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004cb9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004cba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff800037e25a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004d0930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004d0960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004d09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d09d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004d0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff800037e2000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004d5930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004d5960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004d59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d59d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004d5a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff800037e15a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004da930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004da960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004da9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004da9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004daa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff800037e1000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004df930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004df960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004df9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004df9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004dfa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff800037e05a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004e4930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004e4960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004e49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e49d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004e4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff8000381d000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004e9930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004e9960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004e99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e99d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004e9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff800038285a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000588900 mi_switch() at mi_switch+0x174/frame 0xfffffe0000588930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000588970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005889a0 _sleep() at _sleep+0x2da/frame 0xfffffe0000588a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000588a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000588ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000588ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff800038c9000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005ad900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ad930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ad970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ad9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005ada40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff800038c85a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005b2900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005b2930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005b2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b29a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005b2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff800038c8000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005b7900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005b7930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005b7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b79a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005b7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff800038c75a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005bc900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005bc930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005bc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005bc9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005bca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff800038c7000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005c1900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c1930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005c1970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c19a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005c1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff800038c65a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005c6900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c6930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005c6970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c69a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005c6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff800038c6000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005cb900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005cb930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005cb970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005cb9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005cba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff8000394b5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005d0900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005d0930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005d0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d09a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff8000394b000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005d5900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005d5930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005d5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d59a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff8000394a5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005da900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005da930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005da970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005da9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005daa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff8000394a000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005df900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005df930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005df970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005df9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005dfa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff800039495a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005e4900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e4930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005e4970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e49a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005e4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff8000611b5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006eb7930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eb7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006eb79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eb79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006eb7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006eb7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff8000a258000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ef2930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ef2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ef29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ef29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006ef2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ef2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ef2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ef2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff8000a2575a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ef7930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ef7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ef79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ef79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006ef7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ef7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ef7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ef7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffff8000a257000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006efc930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006efc960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006efc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006efc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006efca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006efca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006efcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006efcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff8000a2565a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f01900 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f01930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f01970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f019a0 _sleep() at _sleep+0x2da/frame 0xfffffe0006f01a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0006f01a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f01ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f01ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 2309 out of 32623 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db> (kgdb) bt #0 doadump (textdump=0x0) at include/pcpu.h:246 #1 0xffffffff8049c4fb in db_dump (dummy=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #2 0xffffffff8049c2c9 in db_command (cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #3 0xffffffff804a1248 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #4 0xffffffff8049c2c9 in db_command (cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:482 #5 0xffffffff8049c044 in db_command_loop () at ../../../ddb/db_command.c:535 #6 0xffffffff8049f1ef in db_trap (type=, code=) at ../../../ddb/db_main.c:252 #7 0xffffffff80c1384c in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:692 #8 0xffffffff81099c31 in trap (frame=0xfffffe0006bd1ce0) at ../../../amd64/amd64/trap.c:621 #9 0xffffffff81071e85 in calltrap () at ../../../amd64/amd64/exception.S:232 #10 0xffffffff80c12f5b in kdb_enter (why=0xffffffff8132eb3f "panic", msg=) at include/cpufunc.h:65 #11 0xffffffff80bca7ea in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:894 #12 0xffffffff80bca563 in panic (fmt=) at ../../../kern/kern_shutdown.c:832 #13 0xffffffff8109a64e in dblfault_handler (frame=) at ../../../amd64/amd64/trap.c:1002 #14 0xffffffff81071fb3 in Xdblfault () at ../../../amd64/amd64/exception.S:294 #15 0xffffffff80ef9584 in vm_fault_hold (map=0xfffff803e0c70000, vaddr=0x0, fault_type=0x1, fault_flags=0x0, m_hold=0x0) at ../../../vm/vm_fault.c:562 #16 0xffffffff80ef9520 in vm_fault (map=0xfffff803e0c70000, vaddr=, fault_type=0x1, fault_flags=0x0) at ../../../vm/vm_fault.c:550 #17 0xffffffff8109a218 in trap_pfault (frame=0xfffffe00a7c01260, usermode=) at ../../../amd64/amd64/trap.c:846 #18 0xffffffff810996d4 in trap (frame=0xfffffe00a7c01260) at ../../../amd64/amd64/trap.c:443 #19 0xffffffff81071e85 in calltrap () at ../../../amd64/amd64/exception.S:232 #20 0xffffffff80f06a14 in vm_map_lookup (var_map=0xfffffe00a7c01500, vaddr=0x7ffffffcb000, fault_typea=0x14, out_entry=0xfffffe00a7c01508, object=0xfffffe00a7c014f0, pindex=0xfffffe00a7c014f8, out_prot=0xfffffe00a7c01527 "", wired=0xfffffe00a7c014cc) at ../../../vm/vm_map.c:4228 #21 0xffffffff80ef95f0 in vm_fault_hold (map=0xfffff803e0c70000, vaddr=0x7ffffffcb000, fault_type=0x4, fault_flags=0x0, m_hold=0x0) at ../../../vm/vm_fault.c:589 #22 0xffffffff80ef9520 in vm_fault (map=0xfffff803e0c70000, vaddr=, fault_type=0x4, fault_flags=0x0) at ../../../vm/vm_fault.c:550 #23 0xffffffff8109a218 in trap_pfault (frame=0xfffffe00a7c01700, usermode=) at ../../../amd64/amd64/trap.c:846 #24 0xffffffff810996d4 in trap (frame=0xfffffe00a7c01700) at ../../../amd64/amd64/trap.c:443 #25 0xffffffff81071e85 in calltrap () at ../../../amd64/amd64/exception.S:232 #26 0x00007ffffffcb001 in ?? () #27 0xfffffe00a7c01998 in ?? () #28 0x0000000020000000 in ?? () #29 0x7fffffffffffffff in ?? () #30 0xfffffe00a7c01990 in ?? () #31 0xfffffe00a7c01980 in ?? () #32 0xfffffe00a7c01988 in ?? () #33 0x0000000000000000 in ?? () Current language: auto; currently minimal (kgdb) f 20 #20 0xffffffff80f06a14 in vm_map_lookup (var_map=0xfffffe00a7c01500, vaddr=0x7ffffffcb000, fault_typea=0x14, out_entry=0xfffffe00a7c01508, object=0xfffffe00a7c014f0, pindex=0xfffffe00a7c014f8, out_prot=0xfffffe00a7c01527 "", wired=0xfffffe00a7c014cc) at ../../../vm/vm_map.c:4228 4228 if ((stack_entry->eflags & MAP_ENTRY_GROWS_DOWN) == 0 || (kgdb) l 4223 !vm_map_lookup_helper(map, addr, true, &gap_entry, &stack_entry)) 4224 return (KERN_FAILURE); 4225 if ((gap_entry->eflags & MAP_ENTRY_GUARD) == 0) 4226 return (KERN_SUCCESS); 4227 if ((gap_entry->eflags & MAP_ENTRY_STACK_GAP_DN) != 0) { 4228 if ((stack_entry->eflags & MAP_ENTRY_GROWS_DOWN) == 0 || 4229 stack_entry->start != gap_entry->end) 4230 return (KERN_FAILURE); 4231 grow_amount = round_page(stack_entry->start - addr); 4232 grow_down = true; (kgdb) info loc fault_type = 0x14 map = 0xfffff803e0c70000 entry = prot = size = cred = eobject = (kgdb) p *var_map $1 = 0xfffff803e0c70000 (kgdb) p *map $2 = {header = {prev = 0xfffff805f453f4d0, next = 0xfffff803e0d5d380, left = 0x0, right = 0x0, start = 0x800000000000, end = 0x1000, next_read = 0x0, max_free = 0x0, object = {vm_object = 0x0, sub_map = 0x0}, offset = 0x0, eflags = 0x80000, protection = 0x0, max_protection = 0x0, inheritance = 0x0, read_ahead = 0x0, wired_count = 0x0, cred = 0x0, wiring_thread = 0x0}, lock = {lock_object = {lo_name = 0xffffffff812defc7 "vm map (user)", lo_flags = 0x2330000, lo_data = 0x0, lo_witness = 0xfffff8087fd6b700}, sx_lock = 0x161}, system_mtx = {lock_object = { lo_name = 0xffffffff81294c73 "vm map (system)", lo_flags = 0x1430000, lo_data = 0x0, lo_witness = 0xfffff8087fd6b580}, mtx_lock = 0x0}, nentries = 0xb, size = 0x4c000, timestamp = 0xd, needs_wakeup = 0x0, system_map = 0x0, flags = 0x0, root = 0xfffff805754bda80, pmap = 0xfffff803e0c70130, anon_loc = 0x800202000, busy = 0x0} (kgdb) -- Test scenario: misc/beneath.sh