panic: epoch_wait() in the middle of an epoch section, vmcore.91 KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-CURRENT #0 r335606M: Sun Jun 24 21:30:41 CEST 2018 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on LLVM 6.0.0) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33175314432 (31638 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads arc4random: no preloaded entropy cache ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard Launching APs: 1 3 10 7 9 8 5 11 2 4 6 Timecounter "TSC-low" frequency 1750038560 Hz quality 1000 random: entropy device external interface module_register_init: MOD_LOAD (vesa, 0xffffffff810f66f0, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" kbd1 at kbdmux0 netmap: loaded module [ath_hal] loaded nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: attach_pre capping queues at 8 igb0: using 1024 tx descriptors and 1024 rx descriptors igb0: msix_init qsets capped at 8 igb0: pxm cpus: 6 queue msgs: 9 admincnt: 1 igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: using 6 rx queues 6 tx queues igb0: Using MSIX interrupts with 7 vectors igb0: allocated for 6 tx_queues igb0: allocated for 6 rx_queues igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: attach_pre capping queues at 8 igb1: using 1024 tx descriptors and 1024 rx descriptors igb1: msix_init qsets capped at 8 igb1: pxm cpus: 6 queue msgs: 9 admincnt: 1 igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: using 6 rx queues 6 tx queues igb1: Using MSIX interrupts with 7 vectors igb1: allocated for 6 tx_queues igb1: allocated for 6 rx_queues igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 p4tcc0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec arc4random: no preloaded entropy cache ugen2.1: at usbus2 ugen0.1: <0x8086 XHCI root HUB> at usbus0 ugen1.1: at usbus1 uhub0: on usbus2 uhub1: on usbus1 uhub2: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 Expensive timeout(9) function: 0xffffffff80487b70(0xfffffe009c61f000) 0.004650208 s ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 WARNING: WITNESS option enabled, expect reduced performance. Trying to mount root from ufs:/dev/gpt/work [rw]... WARNING: DIAGNOSTIC option enabled, expect reduced performance. Expensive timeout(9) function: 0xffffffff80a015d0(0xffffffff81af24b0) 0.007396389 s WARNING: / was not properly dismounted random: unblocking device. arc4random: no preloaded entropy cache Writing entropy file:. Setting hostname: mercat1.netperf.freebsd.org. lo0: link state changed to UP Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo igb0: flags=8843 metric 0 mtu 1500 options=e505bb ether 0c:c4:7a:a8:cd:da inet6 fe80::ec4:7aff:fea8:cdda%igb0 prefixlen 64 scopeid 0x1 nd6 options=21 media: Ethernet autoselect status: no carrier igb1: flags=8802 metric 0 mtu 1500 options=e505bb ether 0c:c4:7a:a8:cd:db nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e505bb ether 0c:c4:7a:a8:cd:db nd6 options=29 media: Ethernet autoselect status: no carrier ums0 on uhub5 ums0: on usbus0 Starting pflogd:ums0: 3 buttons and [Z] coordinates ID=0 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 24 Jun 21:34:29 ntpdate[535]: no servers can be used, exiting Starting rpcbind. Starting watchdogd. No core dumps found. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib 32-bit compatibility ldconfig path: /usr/lib32 NFS access cache time=60 Starting casperd. Link state changed to up lock order reversal: 1st 0xfffffe0000ea6c10 bufwait (bufwait) @ kern/vfs_bio.c:3916 2nd 0xfffff80009122a00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0xffffffff80c00a73 at witness_debugger+0x73 #1 0xffffffff80c008f4 at witness_checkorder+0xe34 #2 0xffffffff80b9ef58 at _sx_xlock+0x68 #3 0xffffffff80ebaf5d at ufsdirhash_add+0x4d #4 0xffffffff80ebfa7f at ufs_direnter+0x49f #5 0xffffffff80ec80a9 at ufs_mkdir+0x8b9 #6 0xffffffff811f5c3d at VOP_MKDIR_APV+0xfd #7 0xffffffff80c7c6ce at kern_mkdirat+0x1be #8 0xffffffff810740bc at amd64_syscall+0x29c #9 0xffffffff8104ef8d at fast_syscall_common+0x101 Clearing /tmp (X related). if_delmulti_locked: detaching ifnet instance 0xfffff80005146000 Starting statd. Starting lockd. Updating motd:. Mounting late file systems:. Configuring syscons: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Sun Jun 24 21:34 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Jun 24 21:35:43 mercat1 login[756]: ROOT LOGIN (root) ON ttyu1 Last login: Sun Jun 24 07:44:52 on ttyu1 FreeBSD 12.0-CURRENT (PHO) #0 r335606M: Sun Jun 24 21:30:41 CEST 2018 root@mercat1:~ # vi [?1h=~~~~~~~~~~~~~~~~~~~~~~/tmp/vi.K7U7vBfLf2: new file: line 1:q[?1l> [?1l>root@mercat1:~ # Jun 24 21:35:49 mercat1 su[815]: pho to root on /dev/pts/0 20180624 21:36:12 all (1/572): pfl2.sh lock order reversal: 1st 0xfffff80115cd0558 ufs (ufs) @ kern/vfs_lookup.c:671 2nd 0xfffffe0000f12238 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:282 3rd 0xfffff801a8f8f2e0 ufs (ufs) @ kern/vfs_subr.c:2572 stack backtrace: #0 0xffffffff80c00a73 at witness_debugger+0x73 #1 0xffffffff80c008f4 at witness_checkorder+0xe34 #2 0xffffffff80b6997b at lockmgr_xlock_hard+0x6b #3 0xffffffff80b6a385 at __lockmgr_args+0x545 #4 0xffffffff80eb5caf at ffs_lock+0xaf #5 0xffffffff811f6951 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c7f536 at _vn_lock+0x66 #7 0xffffffff80c6d808 at vget+0x98 #8 0xffffffff80c5f6b1 at vfs_hash_get+0xd1 #9 0xffffffff80eb14af at ffs_vgetf+0x3f #10 0xffffffff80ea7636 at softdep_sync_buf+0xd16 #11 0xffffffff80eb6aa4 at ffs_syncvnode+0x294 #12 0xffffffff80e8c0a6 at ffs_truncate+0x6f6 #13 0xffffffff80ebfc21 at ufs_direnter+0x641 #14 0xffffffff80ec8efc at ufs_makeinode+0x61c #15 0xffffffff80ec4d4f at ufs_mknod+0x3f #16 0xffffffff811f3ae7 at VOP_MKNOD_APV+0xf7 #17 0xffffffff80c77ec7 at kern_mkfifoat+0x227 Jun 24 21:37:28 mercat1 kernel: pid 3044 (rw), uid 2007 inumber 168101 on /mnt10: filesystem full Jun 24 21:38:30 mercat1 kernel: pid 3988 (rw), uid 2007 inumber 216772 on /mnt11: filesystem full Jun 24 21:38:30 mercat1 kernel: pid 3906 (rw), uid 2007 inumber 3219 on /mnt11: filesystem full Jun 24 21:40:37 mercat1 kernel: pid 4314 (rw), uid 2007 inumber 198002 on /mnt10: filesystem full Jun 24 21:42:25 mercat1 kernel: pid 4392 (rw), uid 2007 inumber 261529 on /mnt11: filesystem full Jun 24 21:42:26 mercat1 kernel: pid 4451 (mkdir), uid 2007 inumber 142512 on /mnt11: filesystem full Jun 24 21:43:23 mercat1 kernel: pid 5284 (rw), uid 2007 inumber 202439 on /mnt11: filesystem full Jun 24 21:43:28 mercat1 kernel: pid 5268 (rw), uid 2007 inumber 228012 on /mnt11: filesystem full 20180624 21:46:52 all (2/572): nfs12.sh 20180624 21:46:54 all (3/572): quota4.sh lock order reversal: 1st 0xfffff801159ba2e0 syncer (syncer) @ kern/vfs_subr.c:2153 2nd 0xfffff80366d59a48 ufs (ufs) @ kern/vfs_subr.c:2572 stack backtrace: #0 0xffffffff80c00a73 at witness_debugger+0x73 #1 0xffffffff80c008f4 at witness_checkorder+0xe34 #2 0xffffffff80b6997b at lockmgr_xlock_hard+0x6b #3 0xffffffff80b6a385 at __lockmgr_args+0x545 #4 0xffffffff80eb5caf at ffs_lock+0xaf #5 0xffffffff811f6951 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c7f536 at _vn_lock+0x66 #7 0xffffffff80c6d808 at vget+0x98 #8 0xffffffff80ec37a9 at qsync+0x79 #9 0xffffffff80eb44fc at ffs_sync+0x56c #10 0xffffffff80c74bef at sync_fsync+0xff #11 0xffffffff811f54cd at VOP_FSYNC_APV+0xfd #12 0xffffffff80c72a24 at sched_sync+0x284 #13 0xffffffff80b54a14 at fork_exit+0x84 #14 0xffffffff8104f65e at fork_trampoline+0xe lock order reversal: 1st 0xfffff80003cbc088 FFS (FFS Lock) @ ufs/ufs/ufs_quota.c:730 2nd 0xfffff80115e16000 struct mount mtx (struct mount mtx) @ ufs/ufs/ufs_quota.c:736 stack backtrace: #0 0xffffffff80c00a73 at witness_debugger+0x73 #1 0xffffffff80c008f4 at witness_checkorder+0xe34 #2 0xffffffff80b746bc at __mtx_lock_flags+0x9c #3 0xffffffff80ec2d7b at quotaoff_inchange+0x7b #4 0xffffffff80eb13ee at ffs_flushfiles+0x12e #5 0xffffffff80e943f2 at softdep_flushfiles+0x82 #6 0xffffffff80eb3aa9 at ffs_unmount+0xd9 #7 0xffffffff80c65aa9 at dounmount+0x519 #8 0xffffffff80c65500 at sys_unmount+0x310 #9 0xffffffff810740bc at amd64_syscall+0x29c #10 0xffffffff8104ef8d at fast_syscall_common+0x101 freework leak: 3/18. 20180624 21:49:07 all (4/572): graid1_5.sh GEOM_NOP: Device md11.nop created. GEOM_NOP: Device md12.nop created. GEOM_NOP: Device md11.nop removed. GEOM_NOP: Device md12.nop removed. 20180624 21:55:23 all (5/572): trim7.sh 20180624 21:55:25 all (6/572): fts3.sh 20180624 21:57:33 all (7/572): mmap29.sh 20180624 21:58:02 all (8/572): sendfile12.sh 20180624 22:00:49 all (9/572): mmap.sh 20180624 22:00:51 all (10/572): core3.sh Jun 24 22:00:53 mercat1 kernel: Failed to write core file for process core3 (error 5) Jun 24 22:01:24 mercat1 syslogd: last message repeated 5825 times Jun 24 22:03:34 mercat1 syslogd: last message repeated 24002 times Jun 24 22:10:52 mercat1 syslogd: last message repeated 86192 times GEOM leak: 5/78 20180624 22:20:52 all (11/572): nullfs14.sh 20180624 22:20:54 all (12/572): isofs.sh 20180624 22:20:55 all (13/572): suj18.sh Jun 24 22:20:59 mercat1 kernel: pid 99253 (rw), uid 2007 inumber 32769 on /mnt: filesystem full Jun 24 22:21:04 mercat1 kernel: pid 99254 (rw), uid 2007 inumber 9 on /mnt: filesystem full Jun 24 22:22:56 mercat1 kernel: pid 99296 (rw), uid 2007 inumber 65537 on /mnt: filesystem full Jun 24 22:23:04 mercat1 kernel: pid 99300 (rw), uid 2007 inumber 9369 on /mnt: filesystem full Jun 24 22:23:04 mercat1 kernel: pid 99294 (rw), uid 2007 inumber 109010 on /mnt: filesystem full Jun 24 22:25:02 mercat1 kernel: pid 99341 (rw), uid 2007 inumber 102875 on /mnt: filesystem full Jun 24 22:25:05 mercat1 kernel: pid 99351 (rw), uid 2007 inumber 102249 on /mnt: filesystem full Jun 24 22:25:05 mercat1 kernel: pid 99340 (mkdir), uid 2007 inumber 98805 on /mnt: filesystem full Jun 24 22:27:04 mercat1 kernel: pid 99404 (rw), uid 2007 inumber 101819 on /mnt: filesystem full Jun 24 22:27:04 mercat1 kernel: pid 99410 (mkdir), uid 2007 inumber 903 on /mnt: filesystem full Jun 24 22:27:08 mercat1 kernel: pid 99402 (rw), uid 2007 inumber 113190 on /mnt: filesystem full Jun 24 22:29:32 mercat1 kernel: pid 99432 (creat), uid 2007 inumber 392 on /mnt: filesystem full Jun 24 22:29:32 mercat1 kernel: pid 99431 (mkdir), uid 2007 inumber 100729 on /mnt: filesystem full Jun 24 22:29:32 mercat1 kernel: pid 99427 (rw), uid 2007 inumber 23061 on /mnt: filesystem full Jun 24 22:31:03 mercat1 kernel: pid 99470 (rw), uid 2007 inumber 103434 on /mnt: filesystem full Jun 24 22:31:03 mercat1 kernel: pid 99476 (rw), uid 2007 inumber 107081 on /mnt: filesystem full Jun 24 22:35:03 mercat1 kernel: pid 99590 (mkdir), uid 2007 inumber 98764 on /mnt: filesystem full Jun 24 22:35:03 mercat1 kernel: pid 99565 (creat), uid 2007 inumber 32807 on /mnt: filesystem full Jun 24 22:35:03 mercat1 kernel: pid 99559 (rw), uid 2007 inumber 34073 on /mnt: filesystem full Jun 24 22:37:05 mercat1 kernel: pid 99645 (rw), uid 2007 inumber 99341 on /mnt: filesystem full Jun 24 22:38:58 mercat1 kernel: pid 99666 (mkdir), uid 2007 inumber 1922 on /mnt: filesystem full 20180624 22:41:00 all (14/572): truncate3.sh 20180624 22:41:06 all (15/572): graid1_4.sh freework leak: 13/31. 20180624 22:53:36 all (16/572): flock.sh 20180624 22:54:39 all (17/572): mmap19.sh 20180624 22:54:52 all (18/572): sendfile14.sh panic: epoch_wait() in the middle of an epoch section cpuid = 9 time = 1529873723 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a78a93e0 vpanic() at vpanic+0x1a3/frame 0xfffffe00a78a9440 doadump() at doadump/frame 0xfffffe00a78a94c0 epoch_wait_preempt() at epoch_wait_preempt+0x2b1/frame 0xfffffe00a78a9520 pmap_remove_all() at pmap_remove_all+0x81b/frame 0xfffffe00a78a95b0 vm_page_try_to_free() at vm_page_try_to_free+0x84/frame 0xfffffe00a78a95d0 sendfile_free_mext() at sendfile_free_mext+0x10f/frame 0xfffffe00a78a9600 mb_free_ext() at mb_free_ext+0x9d/frame 0xfffffe00a78a9630 m_freem() at m_freem+0x48/frame 0xfffffe00a78a9650 sbflush_locked() at sbflush_locked+0x69/frame 0xfffffe00a78a9670 sbflush() at sbflush+0x2c/frame 0xfffffe00a78a9690 tcp_disconnect() at tcp_disconnect+0x6c/frame 0xfffffe00a78a96c0 tcp_usr_disconnect() at tcp_usr_disconnect+0x71/frame 0xfffffe00a78a96f0 soclose() at soclose+0xa5/frame 0xfffffe00a78a9760 closef() at closef+0x1f5/frame 0xfffffe00a78a97f0 fdescfree_fds() at fdescfree_fds+0x90/frame 0xfffffe00a78a9840 fdescfree() at fdescfree+0x480/frame 0xfffffe00a78a9900 exit1() at exit1+0x500/frame 0xfffffe00a78a9970 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00a78a9980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a78a9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a78a9ab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8007c7a8a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe200 --- KDB: enter: panic [ thread pid 41536 tid 101616 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 41536 tid 101616 td 0xfffff80647c46000 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a78a93e0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a78a9440 doadump() at doadump/frame 0xfffffe00a78a94c0 epoch_wait_preempt() at epoch_wait_preempt+0x2b1/frame 0xfffffe00a78a9520 pmap_remove_all() at pmap_remove_all+0x81b/frame 0xfffffe00a78a95b0 vm_page_try_to_free() at vm_page_try_to_free+0x84/frame 0xfffffe00a78a95d0 sendfile_free_mext() at sendfile_free_mext+0x10f/frame 0xfffffe00a78a9600 mb_free_ext() at mb_free_ext+0x9d/frame 0xfffffe00a78a9630 m_freem() at m_freem+0x48/frame 0xfffffe00a78a9650 sbflush_locked() at sbflush_locked+0x69/frame 0xfffffe00a78a9670 sbflush() at sbflush+0x2c/frame 0xfffffe00a78a9690 tcp_disconnect() at tcp_disconnect+0x6c/frame 0xfffffe00a78a96c0 tcp_usr_disconnect() at tcp_usr_disconnect+0x71/frame 0xfffffe00a78a96f0 soclose() at soclose+0xa5/frame 0xfffffe00a78a9760 closef() at closef+0x1f5/frame 0xfffffe00a78a97f0 fdescfree_fds() at fdescfree_fds+0x90/frame 0xfffffe00a78a9840 fdescfree() at fdescfree+0x480/frame 0xfffffe00a78a9900 exit1() at exit1+0x500/frame 0xfffffe00a78a9970 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00a78a9980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a78a9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a78a9ab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8007c7a8a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe200 --- db:1:pho1> show allpcpu Current CPU: 9 cpuid = 0 dynamic pcpu = 0xc43cc0 curthread = 0xfffff8000364c000: pid 11 tid 100003 "idle: cpu0" curpcb = 0xfffffe007895ab80 fpcurthread = none idlethread = 0xfffff8000364c000: tid 100003 "idle: cpu0" curpmap = 0xffffffff81ffca68 tssp = 0xffffffff820675a0 commontssp = 0xffffffff820675a0 rsp0 = 0xfffffe007895ab80 gs32p = 0xffffffff8206e1d8 ldt = 0xffffffff8206e218 tss = 0xffffffff8206e208 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe008561ecc0 curthread = 0xfffff80469e6e000: pid 41469 tid 100584 "md11" curpcb = 0xfffffe00a96aeb80 fpcurthread = none idlethread = 0xfffff8000364b580: tid 100004 "idle: cpu1" curpmap = 0xffffffff81ffca68 tssp = 0xffffffff82067608 commontssp = 0xffffffff82067608 rsp0 = 0xfffffe00a96aeb80 gs32p = 0xffffffff8206e240 ldt = 0xffffffff8206e280 tss = 0xffffffff8206e270 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe008562acc0 curthread = 0xfffff801e29db000: pid 41460 tid 100432 "md10" curpcb = 0xfffffe00a93bcb80 fpcurthread = none idlethread = 0xfffff8000364b000: tid 100005 "idle: cpu2" curpmap = 0xffffffff81ffca68 tssp = 0xffffffff82067670 commontssp = 0xffffffff82067670 rsp0 = 0xfffffe00a93bcb80 gs32p = 0xffffffff8206e2a8 ldt = 0xffffffff8206e2e8 tss = 0xffffffff8206e2d8 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe0085636cc0 curthread = 0xfffff8000364a580: pid 11 tid 100006 "idle: cpu3" curpcb = 0xfffffe0078969b80 fpcurthread = none idlethread = 0xfffff8000364a580: tid 100006 "idle: cpu3" curpmap = 0xffffffff81ffca68 tssp = 0xffffffff820676d8 commontssp = 0xffffffff820676d8 rsp0 = 0xfffffe0078969b80 gs32p = 0xffffffff8206e310 ldt = 0xffffffff8206e350 tss = 0xffffffff8206e340 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe0085642cc0 curthread = 0xfffff8000364a000: pid 11 tid 100007 "idle: cpu4" curpcb = 0xfffffe007896eb80 fpcurthread = none idlethread = 0xfffff8000364a000: tid 100007 "idle: cpu4" curpmap = 0xfffff804acc3b130 tssp = 0xffffffff82067740 commontssp = 0xffffffff82067740 rsp0 = 0xfffffe007896eb80 gs32p = 0xffffffff8206e378 ldt = 0xffffffff8206e3b8 tss = 0xffffffff8206e3a8 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe008564ecc0 curthread = 0xfffff801e232b000: pid 41477 tid 101589 "sendfile14" curpcb = 0xfffffe00a9767b80 fpcurthread = 0xfffff801e232b000: pid 41477 "sendfile14" idlethread = 0xfffff80003649580: tid 100008 "idle: cpu5" curpmap = 0xfffff804acc3b130 tssp = 0xffffffff820677a8 commontssp = 0xffffffff820677a8 rsp0 = 0xfffffe00a9767b80 gs32p = 0xffffffff8206e3e0 ldt = 0xffffffff8206e420 tss = 0xffffffff8206e410 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe008565acc0 curthread = 0xfffff80003649000: pid 11 tid 100009 "idle: cpu6" curpcb = 0xfffffe0078978b80 fpcurthread = none idlethread = 0xfffff80003649000: tid 100009 "idle: cpu6" curpmap = 0xffffffff81ffca68 tssp = 0xffffffff82067810 commontssp = 0xffffffff82067810 rsp0 = 0xfffffe0078978b80 gs32p = 0xffffffff8206e448 ldt = 0xffffffff8206e488 tss = 0xffffffff8206e478 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe0085666cc0 curthread = 0xfffff80251442580: pid 41517 tid 100963 "sendfile14" curpcb = 0xfffffe00a954eb80 fpcurthread = 0xfffff80251442580: pid 41517 "sendfile14" idlethread = 0xfffff8000365d580: tid 100010 "idle: cpu7" curpmap = 0xfffff80493835130 tssp = 0xffffffff82067878 commontssp = 0xffffffff82067878 rsp0 = 0xfffffe00a954eb80 gs32p = 0xffffffff8206e4b0 ldt = 0xffffffff8206e4f0 tss = 0xffffffff8206e4e0 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe007f12ecc0 curthread = 0xfffff8000365d000: pid 11 tid 100011 "idle: cpu8" curpcb = 0xfffffe0078982b80 fpcurthread = none idlethread = 0xfffff8000365d000: tid 100011 "idle: cpu8" curpmap = 0xffffffff81ffca68 tssp = 0xffffffff820678e0 commontssp = 0xffffffff820678e0 rsp0 = 0xfffffe0078982b80 gs32p = 0xffffffff8206e518 ldt = 0xffffffff8206e558 tss = 0xffffffff8206e548 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe007f13acc0 curthread = 0xfffff80647c46000: pid 41536 tid 101616 "sendfile14" curpcb = 0xfffffe00a78a9b80 fpcurthread = 0xfffff80647c46000: pid 41536 "sendfile14" idlethread = 0xfffff8000365c580: tid 100012 "idle: cpu9" curpmap = 0xfffff801e25a3130 tssp = 0xffffffff82067948 commontssp = 0xffffffff82067948 rsp0 = 0xfffffe00a78a9b80 gs32p = 0xffffffff8206e580 ldt = 0xffffffff8206e5c0 tss = 0xffffffff8206e5b0 curvnet = 0xfffff8000308c0c0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe007f146cc0 curthread = 0xfffff8000365c000: pid 11 tid 100013 "idle: cpu10" curpcb = 0xfffffe007898cb80 fpcurthread = none idlethread = 0xfffff8000365c000: tid 100013 "idle: cpu10" curpmap = 0xffffffff81ffca68 tssp = 0xffffffff820679b0 commontssp = 0xffffffff820679b0 rsp0 = 0xfffffe007898cb80 gs32p = 0xffffffff8206e5e8 ldt = 0xffffffff8206e628 tss = 0xffffffff8206e618 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe007f152cc0 curthread = 0xfffff8000376b000: pid 12 tid 100047 "swi1: netisr 0" curpcb = 0xfffffe0000437b80 fpcurthread = none idlethread = 0xfffff8000365b580: tid 100014 "idle: cpu11" curpmap = 0xffffffff81ffca68 tssp = 0xffffffff82067a18 commontssp = 0xffffffff82067a18 rsp0 = 0xfffffe0000437b80 gs32p = 0xffffffff8206e650 ldt = 0xffffffff8206e690 tss = 0xffffffff8206e680 curvnet = 0xfffff8000308c0c0 spin locks held: db:1:pho1> show alllocks Process 41554 (sendfile14) thread 0xfffff805678e0000 (101461) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff800095864e0) locked @ kern/uipc_sockbuf.c:285 Process 41553 (sendfile14) thread 0xfffff80007f99580 (101236) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009586848) locked @ kern/uipc_sockbuf.c:285 Process 41552 (sendfile14) thread 0xfffff8025f766580 (101587) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009586bb0) locked @ kern/uipc_sockbuf.c:285 Process 41551 (sendfile14) thread 0xfffff8066c4ba580 (101368) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff800095a6178) locked @ kern/uipc_sockbuf.c:285 Process 41550 (sendfile14) thread 0xfffff8001b817580 (101377) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80656685848) locked @ kern/uipc_sockbuf.c:285 Process 41547 (sendfile14) thread 0xfffff80823f4f580 (101612) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009848848) locked @ kern/uipc_sockbuf.c:285 Process 41546 (sendfile14) thread 0xfffff8000948c000 (101122) exclusive lockmgr ufs (ufs) r = 0 (0xfffff803243002e0) locked @ kern/vfs_vnops.c:862 Process 41545 (sendfile14) thread 0xfffff802c6abb580 (100513) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009d38178) locked @ kern/uipc_sockbuf.c:285 Process 41544 (sendfile14) thread 0xfffff80469e6d580 (101546) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80718a9a7d0) locked @ kern/vfs_subr.c:2572 Process 41543 (sendfile14) thread 0xfffff80115d90000 (101373) exclusive lockmgr ufs (ufs) r = 0 (0xfffff805b56032e0) locked @ kern/vfs_vnops.c:862 Process 41542 (sendfile14) thread 0xfffff8078e6b6000 (100581) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff806564a5178) locked @ kern/uipc_sockbuf.c:285 Process 41541 (sendfile14) thread 0xfffff8058539c000 (101563) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff806564a54e0) locked @ kern/uipc_sockbuf.c:285 Process 41540 (sendfile14) thread 0xfffff80115d84000 (101054) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff806564a5848) locked @ kern/uipc_sockbuf.c:285 Process 41539 (sendfile14) thread 0xfffff8045844c580 (101538) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff806564a5bb0) locked @ kern/uipc_sockbuf.c:285 Process 41538 (sendfile14) thread 0xfffff8064ac60580 (100975) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80656686178) locked @ kern/uipc_sockbuf.c:285 Process 41537 (sendfile14) thread 0xfffff805b5f79580 (101606) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff800095a7bb0) locked @ kern/uipc_sockbuf.c:285 Process 41536 (sendfile14) thread 0xfffff80647c46000 (101616) exclusive rw vm object (vm object) r = 0 (0xfffff801bb73e200) locked @ kern/kern_sendfile.c:146 exclusive sleep mutex vm page (vm page) r = 0 (0xffffffff81a44ec0) locked @ kern/kern_sendfile.c:131 exclusive sleep mutex so_rcv (so_rcv) r = 0 (0xfffff80009c40828) locked @ kern/uipc_sockbuf.c:1112 exclusive rw tcpinp (tcpinp) r = 0 (0xfffff8046be46020) locked @ netinet/tcp_usrreq.c:677 Process 41535 (sendfile14) thread 0xfffff8079a164000 (101124) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009c40bb0) locked @ kern/uipc_sockbuf.c:285 Process 41534 (sendfile14) thread 0xfffff801e290b000 (100877) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00046d00f8) locked @ kern/vfs_bio.c:3916 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80009d37a48) locked @ kern/vfs_vnops.c:862 Process 41533 (sendfile14) thread 0xfffff8011592d000 (101151) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff801150964e0) locked @ kern/uipc_sockbuf.c:285 Process 41532 (sendfile14) thread 0xfffff80358834580 (101175) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff8000955bbb0) locked @ kern/uipc_sockbuf.c:285 Process 41531 (sendfile14) thread 0xfffff801e29dc580 (101541) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009c9e4e0) locked @ kern/uipc_sockbuf.c:285 Process 41530 (sendfile14) thread 0xfffff80115145580 (100957) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009c9e848) locked @ kern/uipc_sockbuf.c:285 Process 41529 (sendfile14) thread 0xfffff8051e31c580 (100721) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009a33178) locked @ kern/uipc_sockbuf.c:285 Process 41528 (sendfile14) thread 0xfffff8060cf3c000 (101703) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009a33848) locked @ kern/uipc_sockbuf.c:285 Process 41527 (sendfile14) thread 0xfffff801e26a9580 (101014) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff8046be5c848) locked @ kern/uipc_sockbuf.c:285 Process 41526 (sendfile14) thread 0xfffff801e26aa000 (101069) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff8046be5cbb0) locked @ kern/uipc_sockbuf.c:285 Process 41525 (sendfile14) thread 0xfffff8025ba81000 (101335) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff8046be5d178) locked @ kern/uipc_sockbuf.c:285 Process 41524 (sendfile14) thread 0xfffff80117c90000 (100171) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff8046be5d4e0) locked @ kern/uipc_sockbuf.c:285 Process 41523 (sendfile14) thread 0xfffff8000964f000 (101143) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff8046be5d848) locked @ kern/uipc_sockbuf.c:285 Process 41522 (sendfile14) thread 0xfffff800568d2580 (101555) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff8046be5dbb0) locked @ kern/uipc_sockbuf.c:285 Process 41521 (sendfile14) thread 0xfffff80530a1c580 (101013) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff8046be5e178) locked @ kern/uipc_sockbuf.c:285 Process 41520 (sendfile14) thread 0xfffff8026885d580 (101473) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009d4f178) locked @ kern/uipc_sockbuf.c:285 Process 41519 (sendfile14) thread 0xfffff801a8829580 (101479) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8004213e7d0) locked @ kern/vfs_vnops.c:862 Process 41518 (sendfile14) thread 0xfffff801e232d580 (101141) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009d4f848) locked @ kern/uipc_sockbuf.c:285 Process 41517 (sendfile14) thread 0xfffff80251442580 (100963) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0005547460) locked @ kern/vfs_bio.c:3916 exclusive lockmgr ufs (ufs) r = 0 (0xfffff804f7f30a48) locked @ kern/vfs_vnops.c:862 Process 41516 (sendfile14) thread 0xfffff80009485580 (100760) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff806564a6bb0) locked @ kern/uipc_sockbuf.c:285 Process 41515 (sendfile14) thread 0xfffff80063ccb000 (100818) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009d4fbb0) locked @ kern/uipc_sockbuf.c:285 Process 41514 (sendfile14) thread 0xfffff80250a59000 (101344) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff8000955a178) locked @ kern/uipc_sockbuf.c:285 Process 41513 (sendfile14) thread 0xfffff8033ecca580 (101075) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009c464e0) locked @ kern/uipc_sockbuf.c:285 Process 41512 (sendfile14) thread 0xfffff80567edd580 (101420) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009c46848) locked @ kern/uipc_sockbuf.c:285 Process 41511 (sendfile14) thread 0xfffff800568d4580 (100453) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009c46bb0) locked @ kern/uipc_sockbuf.c:285 Process 41510 (sendfile14) thread 0xfffff80125892580 (100772) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009d204e0) locked @ kern/uipc_sockbuf.c:285 Process 41509 (sendfile14) thread 0xfffff801a863a000 (101480) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80164a764e0) locked @ kern/uipc_sockbuf.c:285 Process 41508 (sendfile14) thread 0xfffff801e232c000 (101530) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80164a76848) locked @ kern/uipc_sockbuf.c:285 Process 41507 (sendfile14) thread 0xfffff801a8484000 (100285) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80164a76bb0) locked @ kern/uipc_sockbuf.c:285 Process 41506 (sendfile14) thread 0xfffff80252205000 (101512) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80164fdf178) locked @ kern/uipc_sockbuf.c:285 Process 41505 (sendfile14) thread 0xfffff801a835f580 (101590) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80164fdf4e0) locked @ kern/uipc_sockbuf.c:285 Process 41503 (sendfile14) thread 0xfffff80718b8f000 (101332) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009d20bb0) locked @ kern/uipc_sockbuf.c:285 Process 41502 (sendfile14) thread 0xfffff804cb1b0000 (101650) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009d0f178) locked @ kern/uipc_sockbuf.c:285 Process 41501 (sendfile14) thread 0xfffff801e232d000 (101520) exclusive lockmgr ufs (ufs) r = 0 (0xfffff801f2661a48) locked @ kern/vfs_vnops.c:862 Process 41500 (sendfile14) thread 0xfffff801a882a000 (101382) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009d0f848) locked @ kern/uipc_sockbuf.c:285 Process 41499 (sendfile14) thread 0xfffff8012cfad580 (101266) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80009d0fbb0) locked @ kern/uipc_sockbuf.c:285 Process 41478 (sendfile14) thread 0xfffff801671af000 (100397) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xfffff80164b88268) locked @ kern/uipc_sockbuf.c:282 Process 41478 (sendfile14) thread 0xfffff808271ed000 (100555) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xfffff806564a6268) locked @ kern/uipc_sockbuf.c:282 Process 41478 (sendfile14) thread 0xfffff801e290a580 (100701) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xfffff80009d21268) locked @ kern/uipc_sockbuf.c:282 Process 41478 (sendfile14) thread 0xfffff803662f4000 (100715) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xfffff8046be5e5d0) locked @ kern/uipc_sockbuf.c:282 Process 41478 (sendfile14) thread 0xfffff80786507580 (100789) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xfffff801152c9268) locked @ kern/uipc_sockbuf.c:282 Process 41478 (sendfile14) thread 0xfffff803bb885580 (100810) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xfffff80049a3aca0) locked @ kern/uipc_sockbuf.c:282 Process 41478 (sendfile14) thread 0xfffff8066c031000 (100824) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xfffff800095a6938) locked @ kern/uipc_sockbuf.c:282 Process 41477 (sendfile14) thread 0xfffff801a85e0580 (101450) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xfffff80009d3aca0) locked @ kern/uipc_sockbuf.c:282 Process 41477 (sendfile14) thread 0xfffff801e232b000 (101589) shared lockmgr ufs (ufs) r = 0 (0xfffff805fc17e7d0) locked @ kern/kern_sendfile.c:697 exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xfffff800099f85d0) locked @ kern/uipc_sockbuf.c:282 Process 41477 (sendfile14) thread 0xfffff805cdee2580 (101595) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xfffff800095a65d0) locked @ kern/uipc_sockbuf.c:282 Process 41477 (sendfile14) thread 0xfffff80479afa000 (101610) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xfffff80009d215d0) locked @ kern/uipc_sockbuf.c:282 Process 41477 (sendfile14) thread 0xfffff8067b2f3580 (101620) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xfffff80049a3a5d0) locked @ kern/uipc_sockbuf.c:282 Process 41477 (sendfile14) thread 0xfffff807480a1580 (101642) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xfffff80009d395d0) locked @ kern/uipc_sockbuf.c:282 Process 41469 (md11) thread 0xfffff80469e6e000 (100584) exclusive rw vm object (vm object) r = 0 (0xfffff8045f62ce00) locked @ dev/md/md.c:1069 Process 41460 (md10) thread 0xfffff801e29db000 (100432) exclusive rw Per-Filesystem Softdep Lock (Per-Filesystem Softdep Lock) r = 0 (0xfffff8028f593400) locked @ ufs/ffs/ffs_softdep.c:10999 Process 41441 (tee) thread 0xfffff800096b5000 (101641) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00030e2be8) locked @ kern/vfs_bio.c:1670 exclusive lockmgr ufs (ufs) r = 0 (0xfffff801a832a068) locked @ kern/vfs_vnops.c:862 Process 812 (sshd) thread 0xfffff80009486000 (100182) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe000462f1a8) locked @ kern/vfs_bio.c:1670 shared lockmgr ufs (ufs) r = 0 (0xfffff80009d08a48) locked @ kern/vfs_subr.c:2572 Process 12 (intr) thread 0xfffff8000376b000 (100047) exclusive sleep mutex so_rcv (so_rcv) r = 0 (0xfffff800095864c0) locked @ netinet/tcp_input.c:1901 exclusive rw tcpinp (tcpinp) r = 0 (0xfffff8046b3aa3f0) locked @ netinet/in_pcb.c:2394 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff80009d089e0: tag ufs, type VREG usecount 14, writecount 0, refcount 17 flags (VV_TEXT|VI_ACTIVE) v_object 0xfffff80009c30200 ref 10 pages 14 cleanbuf 2 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80b698bb at lockmgr_slock_hard+0x32b #1 0xffffffff80b6a3b1 at __lockmgr_args+0x571 #2 0xffffffff80eb5caf at ffs_lock+0xaf #3 0xffffffff811f6951 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c7f536 at _vn_lock+0x66 #5 0xffffffff80c6d808 at vget+0x98 #6 0xffffffff80ed7f30 at vm_fault_hold+0xdf0 #7 0xffffffff80ed70f0 at vm_fault+0x60 #8 0xffffffff810738d8 at trap_pfault+0x188 #9 0xffffffff81072f5a at trap+0x45a #10 0xffffffff8104e6ac at calltrap+0x8 ino 49278604, on dev gpt/work vnode 0xfffff801a832a000: tag ufs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80461351400 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff800096b5000 (pid 41441, tee, tid 101641) #0 0xffffffff80b69cca at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b6a385 at __lockmgr_args+0x545 #2 0xffffffff80eb5caf at ffs_lock+0xaf #3 0xffffffff811f6951 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c7f536 at _vn_lock+0x66 #5 0xffffffff80c820f4 at vn_write+0x194 #6 0xffffffff80c81b93 at vn_io_fault_doio+0x43 #7 0xffffffff80c7fbd1 at vn_io_fault1+0x171 #8 0xffffffff80c7dfc5 at vn_io_fault+0x195 #9 0xffffffff80c05ba7 at dofilewrite+0x97 #10 0xffffffff80c057ca at kern_writev+0x4a #11 0xffffffff80c05776 at sys_write+0x86 #12 0xffffffff810740bc at amd64_syscall+0x29c #13 0xffffffff8104ef8d at fast_syscall_common+0x101 ino 321027, on dev gpt/tmp vnode 0xfffff801f26619e0: tag ufs, type VREG usecount 1, writecount 1, refcount 2459 flags (VI_ACTIVE) v_object 0xfffff802d18c6a00 ref 0 pages 107824 cleanbuf 2457 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff801e232d000 (pid 41501, sendfile14, tid 101520) #0 0xffffffff80b69cca at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b6a385 at __lockmgr_args+0x545 #2 0xffffffff80eb5caf at ffs_lock+0xaf #3 0xffffffff811f6951 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c7f536 at _vn_lock+0x66 #5 0xffffffff80c820f4 at vn_write+0x194 #6 0xffffffff80c81b93 at vn_io_fault_doio+0x43 #7 0xffffffff80c7fbd1 at vn_io_fault1+0x171 #8 0xffffffff80c7dfc5 at vn_io_fault+0x195 #9 0xffffffff80c05ba7 at dofilewrite+0x97 #10 0xffffffff80c057ca at kern_writev+0x4a #11 0xffffffff80c05776 at sys_write+0x86 #12 0xffffffff810740bc at amd64_syscall+0x29c #13 0xffffffff8104ef8d at fast_syscall_common+0x101 ino 34, on dev md10a vnode 0xfffff805fc17e768: tag ufs, type VREG usecount 2, writecount 1, refcount 5 flags (VI_ACTIVE) v_object 0xfffff805b5c05200 ref 1 pages 556 cleanbuf 2 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80b698bb at lockmgr_slock_hard+0x32b #1 0xffffffff80b6a3b1 at __lockmgr_args+0x571 #2 0xffffffff80eb5caf at ffs_lock+0xaf #3 0xffffffff811f6951 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c7f536 at _vn_lock+0x66 #5 0xffffffff80b930f3 at vn_sendfile+0x563 #6 0xffffffff80b94a5f at sendfile+0x12f #7 0xffffffff810740bc at amd64_syscall+0x29c #8 0xffffffff8104ef8d at fast_syscall_common+0x101 ino 11, on dev md10a vnode 0xfffff8004213e768: tag ufs, type VREG usecount 1, writecount 1, refcount 2475 flags (VI_ACTIVE) v_object 0xfffff80009a86e00 ref 0 pages 95032 cleanbuf 2473 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff801a8829580 (pid 41519, sendfile14, tid 101479) #0 0xffffffff80b69cca at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b6a385 at __lockmgr_args+0x545 #2 0xffffffff80eb5caf at ffs_lock+0xaf #3 0xffffffff811f6951 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c7f536 at _vn_lock+0x66 #5 0xffffffff80c820f4 at vn_write+0x194 #6 0xffffffff80c81b93 at vn_io_fault_doio+0x43 #7 0xffffffff80c7fbd1 at vn_io_fault1+0x171 #8 0xffffffff80c7dfc5 at vn_io_fault+0x195 #9 0xffffffff80c05ba7 at dofilewrite+0x97 #10 0xffffffff80c057ca at kern_writev+0x4a #11 0xffffffff80c05776 at sys_write+0x86 #12 0xffffffff810740bc at amd64_syscall+0x29c #13 0xffffffff8104ef8d at fast_syscall_common+0x101 ino 40, on dev md10a vnode 0xfffff80009d379e0: tag ufs, type VREG usecount 1, writecount 1, refcount 7169 flags (VI_ACTIVE) v_object 0xfffff801e2d61600 ref 0 pages 104744 cleanbuf 7167 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff801e290b000 (pid 41534, sendfile14, tid 100877) #0 0xffffffff80b69cca at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b6a385 at __lockmgr_args+0x545 #2 0xffffffff80eb5caf at ffs_lock+0xaf #3 0xffffffff811f6951 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c7f536 at _vn_lock+0x66 #5 0xffffffff80c820f4 at vn_write+0x194 #6 0xffffffff80c81b93 at vn_io_fault_doio+0x43 #7 0xffffffff80c7fbd1 at vn_io_fault1+0x171 #8 0xffffffff80c7dfc5 at vn_io_fault+0x195 #9 0xffffffff80c05ba7 at dofilewrite+0x97 #10 0xffffffff80c057ca at kern_writev+0x4a #11 0xffffffff80c05776 at sys_write+0x86 #12 0xffffffff810740bc at amd64_syscall+0x29c #13 0xffffffff8104ef8d at fast_syscall_common+0x101 ino 55, on dev md10a vnode 0xfffff805b5603278: tag ufs, type VREG usecount 1, writecount 1, refcount 2455 flags (VI_ACTIVE) v_object 0xfffff80147d0da00 ref 0 pages 106416 cleanbuf 2453 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80115d90000 (pid 41543, sendfile14, tid 101373) #0 0xffffffff80b69cca at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b6a385 at __lockmgr_args+0x545 #2 0xffffffff80eb5caf at ffs_lock+0xaf #3 0xffffffff811f6951 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c7f536 at _vn_lock+0x66 #5 0xffffffff80c820f4 at vn_write+0x194 #6 0xffffffff80c81b93 at vn_io_fault_doio+0x43 #7 0xffffffff80c7fbd1 at vn_io_fault1+0x171 #8 0xffffffff80c7dfc5 at vn_io_fault+0x195 #9 0xffffffff80c05ba7 at dofilewrite+0x97 #10 0xffffffff80c057ca at kern_writev+0x4a #11 0xffffffff80c05776 at sys_write+0x86 #12 0xffffffff810740bc at amd64_syscall+0x29c #13 0xffffffff8104ef8d at fast_syscall_common+0x101 ino 64, on dev md10a vnode 0xfffff80718a9a768: tag ufs, type VREG usecount 1, writecount 1, refcount 2195 flags (VI_ACTIVE) v_object 0xfffff80009399900 ref 0 pages 98064 cleanbuf 2191 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff80469e6d580 (pid 41544, sendfile14, tid 101546) #0 0xffffffff80b69cca at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b6a385 at __lockmgr_args+0x545 #2 0xffffffff80eb5caf at ffs_lock+0xaf #3 0xffffffff811f6951 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c7f536 at _vn_lock+0x66 #5 0xffffffff80c820f4 at vn_write+0x194 #6 0xffffffff80c81b93 at vn_io_fault_doio+0x43 #7 0xffffffff80c7fbd1 at vn_io_fault1+0x171 #8 0xffffffff80c7dfc5 at vn_io_fault+0x195 #9 0xffffffff80c05ba7 at dofilewrite+0x97 #10 0xffffffff80c057ca at kern_writev+0x4a #11 0xffffffff80c05776 at sys_write+0x86 #12 0xffffffff810740bc at amd64_syscall+0x29c #13 0xffffffff8104ef8d at fast_syscall_common+0x101 ino 65, on dev md10a vnode 0xfffff80324300278: tag ufs, type VREG usecount 1, writecount 1, refcount 2595 flags (VI_ACTIVE) v_object 0xfffff805c1392d00 ref 0 pages 61464 cleanbuf 2592 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8000948c000 (pid 41546, sendfile14, tid 101122) #0 0xffffffff80b69cca at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b6a385 at __lockmgr_args+0x545 #2 0xffffffff80eb5caf at ffs_lock+0xaf #3 0xffffffff811f6951 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c7f536 at _vn_lock+0x66 #5 0xffffffff80c820f4 at vn_write+0x194 #6 0xffffffff80c81b93 at vn_io_fault_doio+0x43 #7 0xffffffff80c7fbd1 at vn_io_fault1+0x171 #8 0xffffffff80c7dfc5 at vn_io_fault+0x195 #9 0xffffffff80c05ba7 at dofilewrite+0x97 #10 0xffffffff80c057ca at kern_writev+0x4a #11 0xffffffff80c05776 at sys_write+0x86 #12 0xffffffff810740bc at amd64_syscall+0x29c #13 0xffffffff8104ef8d at fast_syscall_common+0x101 ino 67, on dev md10a vnode 0xfffff804f7f309e0: tag ufs, type VREG usecount 1, writecount 1, refcount 2381 flags (VI_ACTIVE) v_object 0xfffff8066c993900 ref 0 pages 115488 cleanbuf 2373 dirtybuf 6 lock type ufs: EXCL by thread 0xfffff80251442580 (pid 41517, sendfile14, tid 100963) #0 0xffffffff80b69cca at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b6a385 at __lockmgr_args+0x545 #2 0xffffffff80eb5caf at ffs_lock+0xaf #3 0xffffffff811f6951 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c7f536 at _vn_lock+0x66 #5 0xffffffff80c820f4 at vn_write+0x194 #6 0xffffffff80c81b93 at vn_io_fault_doio+0x43 #7 0xffffffff80c7fbd1 at vn_io_fault1+0x171 #8 0xffffffff80c7dfc5 at vn_io_fault+0x195 #9 0xffffffff80c05ba7 at dofilewrite+0x97 #10 0xffffffff80c057ca at kern_writev+0x4a #11 0xffffffff80c05776 at sys_write+0x86 #12 0xffffffff810740bc at amd64_syscall+0x29c #13 0xffffffff8104ef8d at fast_syscall_common+0x101 ino 51, on dev md11a db:1:pho1> show allchains chain 1: thread 101236 (pid 41553, sendfile14) sleeping on 0xfffff800095868a4 "sbwait" chain 2: thread 101587 (pid 41552, sendfile14) sleeping on 0xfffff80009586c0c "sbwait" chain 3: thread 101368 (pid 41551, sendfile14) sleeping on 0xfffff800095a61d4 "sbwait" chain 4: thread 101377 (pid 41550, sendfile14) sleeping on 0xfffff806566858a4 "sbwait" chain 5: thread 101612 (pid 41547, sendfile14) sleeping on 0xfffff800098488a4 "sbwait" chain 6: thread 101122 (pid 41546, sendfile14) blocked on lockmgr bufwaitEXCL thread 100877 (pid 41534, sendfile14) sleeping on 0xfffffe00046d0078 "biowr" chain 7: thread 100513 (pid 41545, sendfile14) sleeping on 0xfffff80009d381d4 "sbwait" chain 8: thread 101546 (pid 41544, sendfile14) blocked on lockmgr bufwaitEXCL thread 100877 (pid 41534, sendfile14) sleeping on 0xfffffe00046d0078 "biowr" chain 9: thread 101373 (pid 41543, sendfile14) blocked on lockmgr bufwaitEXCL thread 100877 (pid 41534, sendfile14) sleeping on 0xfffffe00046d0078 "biowr" chain 10: thread 100581 (pid 41542, sendfile14) sleeping on 0xfffff806564a51d4 "sbwait" chain 11: thread 101563 (pid 41541, sendfile14) sleeping on 0xfffff806564a553c "sbwait" chain 12: thread 101054 (pid 41540, sendfile14) sleeping on 0xfffff806564a58a4 "sbwait" chain 13: thread 101538 (pid 41539, sendfile14) sleeping on 0xfffff806564a5c0c "sbwait" chain 14: thread 100975 (pid 41538, sendfile14) sleeping on 0xfffff806566861d4 "sbwait" chain 15: thread 101606 (pid 41537, sendfile14) sleeping on 0xfffff800095a7c0c "sbwait" chain 16: thread 101124 (pid 41535, sendfile14) sleeping on 0xfffff80009c40c0c "sbwait" chain 17: thread 100877 (pid 41534, sendfile14) sleeping on 0xfffffe00046d0078 "biowr" chain 18: thread 101151 (pid 41533, sendfile14) sleeping on 0xfffff8011509653c "sbwait" chain 19: thread 101175 (pid 41532, sendfile14) sleeping on 0xfffff8000955bc0c "sbwait" chain 20: thread 101541 (pid 41531, sendfile14) sleeping on 0xfffff80009c9e53c "sbwait" chain 21: thread 100957 (pid 41530, sendfile14) sleeping on 0xfffff80009c9e8a4 "sbwait" chain 22: thread 100721 (pid 41529, sendfile14) sleeping on 0xfffff80009a331d4 "sbwait" chain 23: thread 101703 (pid 41528, sendfile14) sleeping on 0xfffff80009a338a4 "sbwait" chain 24: thread 101014 (pid 41527, sendfile14) sleeping on 0xfffff8046be5c8a4 "sbwait" chain 25: thread 101069 (pid 41526, sendfile14) sleeping on 0xfffff8046be5cc0c "sbwait" chain 26: thread 101335 (pid 41525, sendfile14) sleeping on 0xfffff8046be5d1d4 "sbwait" chain 27: thread 100171 (pid 41524, sendfile14) sleeping on 0xfffff8046be5d53c "sbwait" chain 28: thread 101143 (pid 41523, sendfile14) sleeping on 0xfffff8046be5d8a4 "sbwait" chain 29: thread 101555 (pid 41522, sendfile14) sleeping on 0xfffff8046be5dc0c "sbwait" chain 30: thread 101013 (pid 41521, sendfile14) sleeping on 0xfffff8046be5e1d4 "sbwait" chain 31: thread 101473 (pid 41520, sendfile14) sleeping on 0xfffff80009d4f1d4 "sbwait" chain 32: thread 101479 (pid 41519, sendfile14) blocked on lockmgr bufwaitEXCL thread 100877 (pid 41534, sendfile14) sleeping on 0xfffffe00046d0078 "biowr" chain 33: thread 101141 (pid 41518, sendfile14) sleeping on 0xfffff80009d4f8a4 "sbwait" chain 34: thread 100760 (pid 41516, sendfile14) sleeping on 0xfffff806564a6c0c "sbwait" chain 35: thread 100818 (pid 41515, sendfile14) sleeping on 0xfffff80009d4fc0c "sbwait" chain 36: thread 101344 (pid 41514, sendfile14) sleeping on 0xfffff8000955a1d4 "sbwait" chain 37: thread 101075 (pid 41513, sendfile14) sleeping on 0xfffff80009c4653c "sbwait" chain 38: thread 101420 (pid 41512, sendfile14) sleeping on 0xfffff80009c468a4 "sbwait" chain 39: thread 100453 (pid 41511, sendfile14) sleeping on 0xfffff80009c46c0c "sbwait" chain 40: thread 100772 (pid 41510, sendfile14) sleeping on 0xfffff80009d2053c "sbwait" chain 41: thread 101480 (pid 41509, sendfile14) sleeping on 0xfffff80164a7653c "sbwait" chain 42: thread 101530 (pid 41508, sendfile14) sleeping on 0xfffff80164a768a4 "sbwait" chain 43: thread 100285 (pid 41507, sendfile14) sleeping on 0xfffff80164a76c0c "sbwait" chain 44: thread 101512 (pid 41506, sendfile14) sleeping on 0xfffff80164fdf1d4 "sbwait" chain 45: thread 101590 (pid 41505, sendfile14) sleeping on 0xfffff80164fdf53c "sbwait" chain 46: thread 100532 (pid 41504, sendfile14) sleeping on 0xfffff80009d20838 "accept" chain 47: thread 101332 (pid 41503, sendfile14) sleeping on 0xfffff80009d20c0c "sbwait" chain 48: thread 101650 (pid 41502, sendfile14) sleeping on 0xfffff80009d0f1d4 "sbwait" chain 49: thread 101520 (pid 41501, sendfile14) blocked on lockmgr bufwaitEXCL thread 100877 (pid 41534, sendfile14) sleeping on 0xfffffe00046d0078 "biowr" chain 50: thread 101382 (pid 41500, sendfile14) sleeping on 0xfffff80009d0f8a4 "sbwait" chain 51: thread 101266 (pid 41499, sendfile14) sleeping on 0xfffff80009d0fc0c "sbwait" chain 52: thread 100511 (pid 41498, sendfile14) sleeping on 0xfffff801e2968a50 "wait" chain 53: thread 100698 (pid 41478, sendfile14) blocked on lockmgr (null)EXCL chain 54: thread 100397 (pid 41478, sendfile14) sleeping on 0xfffff80164b882c4 "sbwait" chain 55: thread 100555 (pid 41478, sendfile14) sleeping on 0xfffff806564a62c4 "sbwait" chain 56: thread 100701 (pid 41478, sendfile14) sleeping on 0xfffff80009d212c4 "sbwait" chain 57: thread 100715 (pid 41478, sendfile14) sleeping on 0xfffff8046be5e62c "sbwait" chain 58: thread 100789 (pid 41478, sendfile14) sleeping on 0xfffff801152c92c4 "sbwait" chain 59: thread 100810 (pid 41478, sendfile14) sleeping on 0xfffff80049a3acfc "sbwait" chain 60: thread 100824 (pid 41478, sendfile14) sleeping on 0xfffff800095a6994 "sbwait" chain 61: thread 100613 (pid 41477, sendfile14) sleeping on 0xfffff801b9103f00 "uwait" chain 62: thread 101430 (pid 41477, sendfile14) sleeping on 0xffffffff81df1e94 "nanslp" chain 63: thread 101450 (pid 41477, sendfile14) sleeping on 0xfffff80009d3acfc "sbwait" chain 64: thread 101595 (pid 41477, sendfile14) sleeping on 0xfffff800095a662c "sbwait" chain 65: thread 101596 (pid 41477, sendfile14) sleeping on 0xffffffff81df1e97 "nanslp" chain 66: thread 101610 (pid 41477, sendfile14) sleeping on 0xfffff80009d2162c "sbwait" chain 67: thread 101621 (pid 41477, sendfile14) sleeping on 0xffffffff81df1e9a "nanslp" chain 68: thread 101632 (pid 41477, sendfile14) sleeping on 0xffffffff81df1e93 "nanslp" chain 69: thread 101642 (pid 41477, sendfile14) sleeping on 0xfffff80009d3962c "sbwait" chain 70: thread 101644 (pid 41477, sendfile14) sleeping on 0xffffffff81df1e97 "nanslp" chain 71: thread 101658 (pid 41477, sendfile14) sleeping on 0xffffffff81df1e92 "nanslp" chain 72: thread 101663 (pid 41477, sendfile14) sleeping on 0xffffffff81df1e92 "nanslp" chain 73: thread 101668 (pid 41477, sendfile14) sleeping on 0xffffffff81df1e93 "nanslp" chain 74: thread 101690 (pid 41477, sendfile14) sleeping on 0xffffffff81df1e94 "nanslp" chain 75: thread 101695 (pid 41477, sendfile14) sleeping on 0xffffffff81df1e92 "nanslp" chain 76: thread 101711 (pid 41477, sendfile14) sleeping on 0xffffffff81df1e96 "nanslp" chain 77: thread 101712 (pid 41477, sendfile14) sleeping on 0xffffffff81df1e94 "nanslp" chain 78: thread 101299 (pid 41442, sh) sleeping on 0xfffff801a8f685d0 "pause" chain 79: thread 101641 (pid 41441, tee) sleeping on 0xfffffe00030e2b68 "biord" chain 80: thread 100880 (pid 41440, sh) sleeping on 0xfffff801850d7a50 "wait" chain 81: thread 100205 (pid 819, sh) sleeping on 0xfffff80009779528 "wait" chain 82: thread 100181 (pid 817, bash) sleeping on 0xfffff80005166840 "select" chain 83: thread 100204 (pid 815, csh) sleeping on 0xfffff800050ef0a8 "pause" chain 84: thread 100167 (pid 814, su) sleeping on 0xfffff80009420000 "wait" chain 85: thread 100173 (pid 813, bash) sleeping on 0xfffff800050ef528 "wait" chain 86: thread 100182 (pid 812, sshd) sleeping on 0xfffffe000462f128 "biord" chain 87: thread 100160 (pid 809, sshd) sleeping on 0xfffff800051acec0 "select" chain 88: thread 100164 (pid 806, csh) sleeping on 0xfffff800051cecb0 "ttyin" chain 89: thread 100179 (pid 801, dhclient) sleeping on 0xfffff80003cabd40 "select" chain 90: thread 100198 (pid 756, login) sleeping on 0xfffff80115669a50 "wait" chain 91: thread 100197 (pid 755, getty) sleeping on 0xfffff800051cf0b0 "ttyin" chain 92: thread 100196 (pid 754, getty) sleeping on 0xfffff8000921e8b0 "ttyin" chain 93: thread 100195 (pid 753, getty) sleeping on 0xfffff8000921ecb0 "ttyin" chain 94: thread 100194 (pid 752, getty) sleeping on 0xfffff8000921f0b0 "ttyin" chain 95: thread 100193 (pid 751, getty) sleeping on 0xfffff8000921f4b0 "ttyin" chain 96: thread 100192 (pid 750, getty) sleeping on 0xfffff8000921f8b0 "ttyin" chain 97: thread 100191 (pid 749, getty) sleeping on 0xfffff8000921fcb0 "ttyin" chain 98: thread 100190 (pid 748, getty) sleeping on 0xfffff800092200b0 "ttyin" chain 99: thread 100141 (pid 747, getty) sleeping on 0xfffff800092204b0 "ttyin" chain 100: thread 100185 (pid 711, cron) sleeping on 0xffffffff81df1e9a "nanslp" chain 101: thread 100186 (pid 707, sshd) sleeping on 0xfffff800095d2e40 "select" chain 102: thread 100146 (pid 640, NLM: master) sleeping on 0xfffff8000970a860 "rpcsvc" chain 103: thread 100148 (pid 637, rpc.statd) sleeping on 0xfffff800030d64c0 "select" chain 104: thread 100161 (pid 598, dhclient) sleeping on 0xfffff800090b4cc0 "select" chain 105: thread 100144 (pid 595, dhclient) sleeping on 0xfffff800037308c0 "select" chain 106: thread 100176 (pid 590, casperd) sleeping on 0xfffff80003cabdc0 "select" chain 107: thread 100157 (pid 589, casperd) sleeping on 0xfffff80003cabe40 "select" chain 108: thread 100158 (pid 549, watchdogd) sleeping on 0xffffffff81df1e9b "nanslp" chain 109: thread 100149 (pid 538, rpcbind) sleeping on 0xfffff800037309c0 "select" chain 110: thread 100145 (pid 533, syslogd) sleeping on 0xfffff8000515e8c0 "select" chain 111: thread 100154 (pid 458, devd) sleeping on 0xfffff80003cabec0 "select" chain 112: thread 100133 (pid 33, syncer) sleeping on 0xffffffff81f94300 "syncer" chain 113: thread 100132 (pid 32, vnlru) sleeping on 0xfffff8000906c000 "vlruwt" chain 114: thread 100130 (pid 31, bufdaemon) sleeping on 0xffffffff81f937a0 "qsleep" chain 115: thread 100134 (pid 31, bufspacedaemon-0) sleeping on 0xffffffff81a0a600 "-" chain 116: thread 100135 (pid 31, bufspacedaemon-1) sleeping on 0xffffffff81a128c0 "-" chain 117: thread 100136 (pid 31, bufspacedaemon-2) sleeping on 0xffffffff81a1ab80 "-" chain 118: thread 100137 (pid 31, bufspacedaemon-3) sleeping on 0xffffffff81a22e40 "-" chain 119: thread 100138 (pid 31, bufspacedaemon-4) sleeping on 0xffffffff81a2b100 "-" chain 120: thread 100139 (pid 31, bufspacedaemon-5) sleeping on 0xffffffff81a333c0 "-" chain 121: thread 100140 (pid 31, bufspacedaemon-6) sleeping on 0xffffffff81a3b680 "-" chain 122: thread 100152 (pid 31, / worker) sleeping on 0xfffff800097996e8 "sdflush" chain 123: thread 100162 (pid 31, /tmp worker) sleeping on 0xfffff8000983a2e8 "sdflush" chain 124: thread 100155 (pid 31, /mnt worker) sleeping on 0xfffff8028f5934e8 "sdflush" chain 125: thread 100222 (pid 31, /mnt11 worker) sleeping on 0xfffff807cb22e2e8 "sdflush" chain 126: thread 100128 (pid 30, vmdaemon) sleeping on 0xffffffff81fb06c0 "psleep" chain 127: thread 100127 (pid 29, dom0) sleeping on 0xffffffff82020dd8 "psleep" chain 128: thread 100129 (pid 29, laundry: dom0) sleeping on 0xffffffff82020de4 "launds" chain 129: thread 100131 (pid 29, uma) sleeping on 0xffffffff80ed3ec0 "umarcl" chain 130: thread 100126 (pid 28, enc_daemon1) sleeping on 0xfffff80007f88000 "idle" chain 131: thread 100125 (pid 27, enc_daemon0) sleeping on 0xfffff80007f88528 "idle" chain 132: thread 100122 (pid 26, rand_harvestq) sleeping on 0xffffffff81cc1da0 "-" chain 133: thread 100118 (pid 25, sctp_iterator) sleeping on 0xffffffff8201f5c0 "waiting_for_work" chain 134: thread 100117 (pid 24, soaiod4) sleeping on 0xffffffff81f9319c "-" chain 135: thread 100116 (pid 23, soaiod3) sleeping on 0xffffffff81f9319c "-" chain 136: thread 100115 (pid 22, soaiod2) sleeping on 0xffffffff81f9319c "-" chain 137: thread 100114 (pid 21, soaiod1) sleeping on 0xffffffff81f9319c "-" chain 138: thread 100095 (pid 20, usbus0) sleeping on 0xfffffe009c7e7460 "-" chain 139: thread 100096 (pid 20, usbus0) sleeping on 0xfffffe009c7e74b8 "-" chain 140: thread 100097 (pid 20, usbus0) sleeping on 0xfffffe009c7e7510 "-" chain 141: thread 100098 (pid 20, usbus0) sleeping on 0xfffffe009c7e7568 "-" chain 142: thread 100099 (pid 20, usbus0) sleeping on 0xfffffe009c7e75c0 "-" chain 143: thread 100101 (pid 20, usbus1) sleeping on 0xfffffe009a5f6d10 "-" chain 144: thread 100102 (pid 20, usbus1) sleeping on 0xfffffe009a5f6d68 "-" chain 145: thread 100103 (pid 20, usbus1) sleeping on 0xfffffe009a5f6dc0 "-" chain 146: thread 100104 (pid 20, usbus1) sleeping on 0xfffffe009a5f6e18 "-" chain 147: thread 100105 (pid 20, usbus1) sleeping on 0xfffffe009a5f6e70 "-" chain 148: thread 100106 (pid 20, usbus2) sleeping on 0xfffffe009a5d6d10 "-" chain 149: thread 100107 (pid 20, usbus2) sleeping on 0xfffffe009a5d6d68 "-" chain 150: thread 100108 (pid 20, usbus2) sleeping on 0xfffffe009a5d6dc0 "-" chain 151: thread 100109 (pid 20, usbus2) sleeping on 0xfffffe009a5d6e18 "-" chain 152: thread 100110 (pid 20, usbus2) sleeping on 0xfffffe009a5d6e70 "-" chain 153: thread 100090 (pid 19, doneq0) sleeping on 0xffffffff81b9d0c0 "-" chain 154: thread 100091 (pid 19, doneq1) sleeping on 0xffffffff81b9d140 "-" chain 155: thread 100092 (pid 19, doneq2) sleeping on 0xffffffff81b9d1c0 "-" chain 156: thread 100124 (pid 19, scanner) sleeping on 0xffffffff81b9cf88 "-" chain 157: thread 100089 (pid 18, crypto returns 11) sleeping on 0xfffff80003810450 "crypto_ret_wait" chain 158: thread 100088 (pid 17, crypto returns 10) sleeping on 0xfffff800038103f0 "crypto_ret_wait" chain 159: thread 100087 (pid 16, crypto returns 9) sleeping on 0xfffff80003810390 "crypto_ret_wait" chain 160: thread 100086 (pid 15, crypto returns 8) sleeping on 0xfffff80003810330 "crypto_ret_wait" chain 161: thread 100085 (pid 14, crypto returns 7) sleeping on 0xfffff800038102d0 "crypto_ret_wait" chain 162: thread 100084 (pid 9, crypto returns 6) sleeping on 0xfffff80003810270 "crypto_ret_wait" chain 163: thread 100083 (pid 8, crypto returns 5) sleeping on 0xfffff80003810210 "crypto_ret_wait" chain 164: thread 100082 (pid 7, crypto returns 4) sleeping on 0xfffff800038101b0 "crypto_ret_wait" chain 165: thread 100081 (pid 6, crypto returns 3) sleeping on 0xfffff80003810150 "crypto_ret_wait" chain 166: thread 100080 (pid 5, crypto returns 2) sleeping on 0xfffff800038100f0 "crypto_ret_wait" chain 167: thread 100079 (pid 4, crypto returns 1) sleeping on 0xfffff80003810090 "crypto_ret_wait" chain 168: thread 100078 (pid 3, crypto returns 0) sleeping on 0xfffff80003810030 "crypto_ret_wait" chain 169: thread 100077 (pid 2, crypto) sleeping on 0xffffffff81faac88 "crypto_wait" chain 170: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81ffbe10 "-" chain 171: thread 100063 (pid 13, g_up) sleeping on 0xffffffff81ffbe20 "-" chain 172: thread 100064 (pid 13, g_down) sleeping on 0xffffffff81ffbe08 "-" chain 173: thread 100002 (pid 1, init) sleeping on 0xfffff80003648528 "wait" chain 174: thread 100001 (pid 10, audit) sleeping on 0xffffffff820202d0 "audit_worker_cv" chain 175: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81ffbe50 "swapin" chain 176: thread 100016 (pid 0, thread taskq) sleeping on 0xfffff80003686e00 "-" chain 177: thread 100018 (pid 0, aiod_kick taskq) sleeping on 0xfffff80003686c00 "-" chain 178: thread 100019 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff80003686b00 "-" chain 179: thread 100021 (pid 0, if_io_tqg_0) sleeping on 0xfffff80003632e00 "-" chain 180: thread 100022 (pid 0, if_io_tqg_1) sleeping on 0xfffff80003632d00 "-" chain 181: thread 100023 (pid 0, if_io_tqg_2) sleeping on 0xfffff80003632c00 "-" chain 182: thread 100024 (pid 0, if_io_tqg_3) sleeping on 0xfffff80003632b00 "-" chain 183: thread 100025 (pid 0, if_io_tqg_4) sleeping on 0xfffff80003632a00 "-" chain 184: thread 100026 (pid 0, if_io_tqg_5) sleeping on 0xfffff80003632900 "-" chain 185: thread 100027 (pid 0, if_io_tqg_6) sleeping on 0xfffff80003632800 "-" chain 186: thread 100028 (pid 0, if_io_tqg_7) sleeping on 0xfffff80003632700 "-" chain 187: thread 100029 (pid 0, if_io_tqg_8) sleeping on 0xfffff80003632600 "-" chain 188: thread 100030 (pid 0, if_io_tqg_9) sleeping on 0xfffff80003632500 "-" chain 189: thread 100031 (pid 0, if_io_tqg_10) sleeping on 0xfffff80003632400 "-" chain 190: thread 100032 (pid 0, if_io_tqg_11) sleeping on 0xfffff80003632300 "-" chain 191: thread 100033 (pid 0, config_0) sleeping on 0xfffff80003632200 "-" chain 192: thread 100034 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003723100 "-" chain 193: thread 100035 (pid 0, softirq_0) sleeping on 0xfffff80003723000 "-" chain 194: thread 100036 (pid 0, softirq_1) sleeping on 0xfffff80003722e00 "-" chain 195: thread 100037 (pid 0, softirq_2) sleeping on 0xfffff80003722d00 "-" chain 196: thread 100038 (pid 0, softirq_3) sleeping on 0xfffff80003722c00 "-" chain 197: thread 100039 (pid 0, softirq_4) sleeping on 0xfffff80003722b00 "-" chain 198: thread 100040 (pid 0, softirq_5) sleeping on 0xfffff80003722a00 "-" chain 199: thread 100041 (pid 0, softirq_6) sleeping on 0xfffff80003722900 "-" chain 200: thread 100042 (pid 0, softirq_7) sleeping on 0xfffff80003722800 "-" chain 201: thread 100043 (pid 0, softirq_8) sleeping on 0xfffff80003722700 "-" chain 202: thread 100044 (pid 0, softirq_9) sleeping on 0xfffff80003722600 "-" chain 203: thread 100045 (pid 0, softirq_10) sleeping on 0xfffff80003722500 "-" chain 204: thread 100046 (pid 0, softirq_11) sleeping on 0xfffff80003722400 "-" chain 205: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003798100 "-" chain 206: thread 100065 (pid 0, crypto_0) sleeping on 0xfffff80003797e00 "-" chain 207: thread 100066 (pid 0, crypto_1) sleeping on 0xfffff80003797e00 "-" chain 208: thread 100067 (pid 0, crypto_2) sleeping on 0xfffff80003797e00 "-" chain 209: thread 100068 (pid 0, crypto_3) sleeping on 0xfffff80003797e00 "-" chain 210: thread 100069 (pid 0, crypto_4) sleeping on 0xfffff80003797e00 "-" chain 211: thread 100070 (pid 0, crypto_5) sleeping on 0xfffff80003797e00 "-" chain 212: thread 100071 (pid 0, crypto_6) sleeping on 0xfffff80003797e00 "-" chain 213: thread 100072 (pid 0, crypto_7) sleeping on 0xfffff80003797e00 "-" chain 214: thread 100073 (pid 0, crypto_8) sleeping on 0xfffff80003797e00 "-" chain 215: thread 100074 (pid 0, crypto_9) sleeping on 0xfffff80003797e00 "-" chain 216: thread 100075 (pid 0, crypto_10) sleeping on 0xfffff80003797e00 "-" chain 217: thread 100076 (pid 0, crypto_11) sleeping on 0xfffff80003797e00 "-" chain 218: thread 100113 (pid 0, mca taskq) sleeping on 0xfffff80003797800 "-" chain 219: thread 100119 (pid 0, acpi_task_0) sleeping on 0xfffff8000901bd00 "-" chain 220: thread 100120 (pid 0, acpi_task_1) sleeping on 0xfffff8000901bd00 "-" chain 221: thread 100121 (pid 0, acpi_task_2) sleeping on 0xfffff8000901bd00 "-" chain 222: thread 100123 (pid 0, CAM taskq) sleeping on 0xfffff80003797b00 "-" db:1:pho1> show mount 0xfffff80009372000 /dev/gpt/work on / (ufs) 0xfffff80009373000 devfs on /dev (devfs) 0xfffff800098bc000 /dev/gpt/tmp on /tmp (ufs) 0xfffff8044eb02000 /dev/md10a on /mnt (ufs) 0xfffff805d701e000 /dev/md11a on /mnt11 (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 53964 Buf domain 0 freebufs 7867 lofreebufs 219 hifreebufs 329 bufspace 238092288 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 18 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7062 (231407616) dirtyq count 18 (589824) wakeup 0 lim 25 CPU 23, 1, 15, 8, 23, 22, 16, 14, 11, 15, 20, 17, Locked buffers: 1 space 32768 Total buffers: 34631 space 238092288 Buf domain 1 freebufs 7927 lofreebufs 219 hifreebufs 329 bufspace 235896832 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 18 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7056 (231010304) dirtyq count 18 (561152) wakeup 0 lim 25 CPU 7, 0, 19, 19, 19, 21, 6, 12, 13, 3, 2, 11, Locked buffers: 0 space 0 Total buffers: 30561 space 235896832 Buf domain 2 freebufs 7941 lofreebufs 219 hifreebufs 329 bufspace 235581440 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 29 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 6991 (229052416) dirtyq count 29 (892928) wakeup 0 lim 25 CPU 18, 24, 8, 5, 10, 5, 6, 4, 1, 2, 17, 22, Locked buffers: 50 space 1638400 Total buffers: 7584 space 235581440 Buf domain 3 freebufs 7899 lofreebufs 219 hifreebufs 329 bufspace 237015040 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 15 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7058 (231247872) dirtyq count 15 (491520) wakeup 0 lim 25 CPU 23, 6, 20, 18, 7, 3, 21, 5, 18, 5, 14, 21, Locked buffers: 0 space 0 Total buffers: 7429 space 237015040 Buf domain 4 freebufs 7779 lofreebufs 219 hifreebufs 329 bufspace 240889856 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 18 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7159 (234500096) dirtyq count 18 (589824) wakeup 0 lim 25 CPU 16, 15, 0, 1, 17, 5, 24, 22, 17, 18, 23, 14, Locked buffers: 6 space 196608 Total buffers: 10662 space 240889856 Buf domain 5 freebufs 7909 lofreebufs 219 hifreebufs 329 bufspace 236617728 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 26 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7091 (232357888) dirtyq count 29 (860160) wakeup 0 lim 25 CPU 21, 16, 2, 20, 4, 7, 2, 8, 2, 13, 3, 5, Locked buffers: 5 space 155648 Total buffers: 7616 space 236617728 Buf domain 6 freebufs 7940 lofreebufs 219 hifreebufs 329 bufspace 235614208 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7105 (232730624) dirtyq count 0 (0) wakeup 0 lim 25 CPU 7, 9, 9, 2, 9, 22, 0, 11, 3, 3, 3, 10, Locked buffers: 0 space 0 Total buffers: 7448 space 235614208 db:1:pho1> show page vm_cnt.v_free_count: 194212 vm_cnt.v_inactive_count: 1242868 vm_cnt.v_active_count: 6094762 vm_cnt.v_laundry_count: 76 vm_cnt.v_wire_count: 594550 vm_cnt.v_free_reserved: 10650 vm_cnt.v_free_min: 51292 vm_cnt.v_free_target: 173218 vm_cnt.v_inactive_target: 259827 db:1:pho1> show pageq pq_free 194212 dom 0 page_cnt 8128712 free 194212 pq_act 6094762 pq_inact 1242868 pq_laund 76 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000352 | 000000 02 (000016K) | 002017 | 000000 01 (000008K) | 004583 | 000000 00 (000004K) | 050899 | 004558 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000001 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000001 | 000000 db:0:pho> acttrace Tracing command sendfile14 pid 41536 tid 101616 td 0xfffff80647c46000 (CPU 9) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a78a93e0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a78a9440 doadump() at doadump/frame 0xfffffe00a78a94c0 epoch_wait_preempt() at epoch_wait_preempt+0x2b1/frame 0xfffffe00a78a9520 pmap_remove_all() at pmap_remove_all+0x81b/frame 0xfffffe00a78a95b0 vm_page_try_to_free() at vm_page_try_to_free+0x84/frame 0xfffffe00a78a95d0 sendfile_free_mext() at sendfile_free_mext+0x10f/frame 0xfffffe00a78a9600 mb_free_ext() at mb_free_ext+0x9d/frame 0xfffffe00a78a9630 m_freem() at m_freem+0x48/frame 0xfffffe00a78a9650 sbflush_locked() at sbflush_locked+0x69/frame 0xfffffe00a78a9670 sbflush() at sbflush+0x2c/frame 0xfffffe00a78a9690 tcp_disconnect() at tcp_disconnect+0x6c/frame 0xfffffe00a78a96c0 tcp_usr_disconnect() at tcp_usr_disconnect+0x71/frame 0xfffffe00a78a96f0 soclose() at soclose+0xa5/frame 0xfffffe00a78a9760 closef() at closef+0x1f5/frame 0xfffffe00a78a97f0 fdescfree_fds() at fdescfree_fds+0x90/frame 0xfffffe00a78a9840 fdescfree() at fdescfree+0x480/frame 0xfffffe00a78a9900 exit1() at exit1+0x500/frame 0xfffffe00a78a9970 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00a78a9980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a78a9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a78a9ab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8007c7a8a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe200 --- Tracing command sendfile14 pid 41517 tid 100963 td 0xfffff80251442580 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071f5df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071f5e10 trap() at trap+0x49/frame 0xfffffe00071f5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071f5f20 --- trap 0x13, rip = 0xffffffff80e8200f, rsp = 0xfffffe00a954e260, rbp = 0xfffffe00a954e2c0 --- ffs_alloc() at ffs_alloc+0x36f/frame 0xfffffe00a954e2c0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00a954e460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a954e500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a954e610 vn_write() at vn_write+0x26b/frame 0xfffffe00a954e690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a954e6f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a954e830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a954e8a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a954e8f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a954e930 sys_write() at sys_write+0x86/frame 0xfffffe00a954e980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a954eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a954eab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80083bb6a, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41477 tid 101589 td 0xfffff801e232b000 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071dddf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071dde10 trap() at trap+0x49/frame 0xfffffe00071ddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071ddf20 --- trap 0x13, rip = 0xffffffff80ed1d01, rsp = 0xfffffe00a97675f0, rbp = 0xfffffe00a9767650 --- uma_zalloc_arg() at uma_zalloc_arg+0x41/frame 0xfffffe00a9767650 vn_sendfile() at vn_sendfile+0x1083/frame 0xfffffe00a97678f0 sendfile() at sendfile+0x12f/frame 0xfffffe00a9767980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9767ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9767ab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8006fd8aa, rsp = 0x7fffdf1f6d98, rbp = 0x7fffdf1f6ef0 --- Tracing command sendfile14 pid 41477 tid 101620 td 0xfffff8067b2f3580 (CPU -1) sched_switch() at sched_switch+0x942/frame 0xfffffe00aa87c490 mi_switch() at mi_switch+0x178/frame 0xfffffe00aa87c4c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa87c500 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00aa87c560 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa87c590 _sleep() at _sleep+0x39c/frame 0xfffffe00aa87c630 sbwait() at sbwait+0x68/frame 0xfffffe00aa87c650 vn_sendfile() at vn_sendfile+0x4ab/frame 0xfffffe00aa87c8f0 sendfile() at sendfile+0x12f/frame 0xfffffe00aa87c980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00aa87cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa87cab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8006fd8aa, rsp = 0x7fffde7f1d98, rbp = 0x7fffde7f1ef0 --- Tracing command md11 pid 41469 tid 100584 td 0xfffff80469e6e000 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00007ffdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00007ffe10 trap() at trap+0x49/frame 0xfffffe00007fff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00007fff20 --- trap 0x13, rip = 0xffffffff80c024cb, rsp = 0xfffffe00a96ae8c0, rbp = 0xfffffe00a96ae910 --- witness_assert() at witness_assert+0x5b/frame 0xfffffe00a96ae910 vm_page_grab() at vm_page_grab+0x102/frame 0xfffffe00a96ae990 mdstart_swap() at mdstart_swap+0x14d/frame 0xfffffe00a96aea10 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00a96aea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a96aeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a96aeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md10 pid 41460 tid 100432 td 0xfffff801e29db000 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071b9df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071b9e10 trap() at trap+0x49/frame 0xfffffe00071b9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071b9f20 --- trap 0x13, rip = 0xffffffff80b9e494, rsp = 0xfffffe00a93bc700, rbp = 0xfffffe00a93bc700 --- critical_enter() at critical_enter+0x14/frame 0xfffffe00a93bc700 uma_zfree_arg() at uma_zfree_arg+0x185/frame 0xfffffe00a93bc760 free() at free+0xa5/frame 0xfffffe00a93bc7a0 free_newblk() at free_newblk+0x1fc/frame 0xfffffe00a93bc7d0 free_newblk() at free_newblk+0x1fc/frame 0xfffffe00a93bc800 handle_bufwait() at handle_bufwait+0x93/frame 0xfffffe00a93bc850 handle_written_inodeblock() at handle_written_inodeblock+0x479/frame 0xfffffe00a93bc8a0 softdep_disk_write_complete() at softdep_disk_write_complete+0x44a/frame 0xfffffe00a93bc900 bufdone() at bufdone+0x392/frame 0xfffffe00a93bc970 g_io_deliver() at g_io_deliver+0x29c/frame 0xfffffe00a93bc9c0 g_io_deliver() at g_io_deliver+0x29c/frame 0xfffffe00a93bca10 md_kthread() at md_kthread+0x23d/frame 0xfffffe00a93bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a93bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a93bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100047 td 0xfffff8000376b000 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000ce1df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000ce1e10 trap() at trap+0x49/frame 0xfffffe0000ce1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000ce1f20 --- trap 0x13, rip = 0xffffffff80bc43ab, rsp = 0xfffffe00004375d0, rbp = 0xfffffe0000437600 --- sched_add() at sched_add+0x3b/frame 0xfffffe0000437600 setrunnable() at setrunnable+0x8f/frame 0xfffffe0000437620 sleepq_broadcast() at sleepq_broadcast+0xe8/frame 0xfffffe0000437660 wakeup() at wakeup+0x1d/frame 0xfffffe0000437680 sowakeup() at sowakeup+0x6a/frame 0xfffffe00004376b0 tcp_do_segment() at tcp_do_segment+0x2db3/frame 0xfffffe00004377b0 tcp_input() at tcp_input+0x10a0/frame 0xfffffe0000437900 ip_input() at ip_input+0x3f7/frame 0xfffffe0000437960 swi_net() at swi_net+0x1b9/frame 0xfffffe00004379e0 intr_event_execute_handlers() at intr_event_execute_handlers+0x99/frame 0xfffffe0000437a20 ithread_loop() at ithread_loop+0xb7/frame 0xfffffe0000437a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000437ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000437ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff8000364c000 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81fb49f0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xffffffff81fb4a10 trap() at trap+0x49/frame 0xffffffff81fb4b20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fb4b20 --- trap 0x13, rip = 0xffffffff811da862, rsp = 0xfffffe007895a990, rbp = 0xfffffe007895a9a0 --- cpu_idle() at cpu_idle+0xc2/frame 0xfffffe007895a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff8000364a580 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071c5df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071c5e10 trap() at trap+0x49/frame 0xfffffe00071c5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071c5f20 --- trap 0x13, rip = 0xffffffff811da166, rsp = 0xfffffe0078969910, rbp = 0xfffffe0078969910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078969910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe0078969960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078969980 cpu_idle() at cpu_idle+0x95/frame 0xfffffe00789699a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078969a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078969ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078969ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80003649000 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071e9df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071e9e10 trap() at trap+0x49/frame 0xfffffe00071e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071e9f20 --- trap 0x13, rip = 0xffffffff80bc2234, rsp = 0xfffffe0078978830, rbp = 0xfffffe00789788e0 --- cpu_search_highest() at cpu_search_highest+0x54/frame 0xfffffe00789788e0 cpu_search_highest() at cpu_search_highest+0x10a/frame 0xfffffe00789789a0 sched_idletd() at sched_idletd+0x3c7/frame 0xfffffe0078978a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078978ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078978ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff8000365d000 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cbddf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cbde10 trap() at trap+0x49/frame 0xfffffe0000cbdf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cbdf20 --- trap 0x13, rip = 0xffffffff811da862, rsp = 0xfffffe0078982990, rbp = 0xfffffe00789829a0 --- cpu_idle() at cpu_idle+0xc2/frame 0xfffffe00789829a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078982a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078982ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078982ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000365c000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cd5df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cd5e10 trap() at trap+0x49/frame 0xfffffe0000cd5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cd5f20 --- trap 0x13, rip = 0xffffffff811da166, rsp = 0xfffffe007898c910, rbp = 0xfffffe007898c910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007898c910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007898c960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007898c980 cpu_idle() at cpu_idle+0x95/frame 0xfffffe007898c9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007898ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007898cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007898cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 41554 41504 819 0 R+ sendfile14 41553 41504 819 0 S+ sbwait 0xfffff800095868a4 sendfile14 41552 41504 819 0 S+ sbwait 0xfffff80009586c0c sendfile14 41551 41504 819 0 S+ sbwait 0xfffff800095a61d4 sendfile14 41550 41504 819 0 S+ sbwait 0xfffff806566858a4 sendfile14 41547 41498 819 0 S+ sbwait 0xfffff800098488a4 sendfile14 41546 41498 819 0 D+ getblk 0xfffffe00046d00f8 sendfile14 41545 41498 819 0 S+ sbwait 0xfffff80009d381d4 sendfile14 41544 41498 819 0 D+ getblk 0xfffffe00046d00f8 sendfile14 41543 41498 819 0 D+ getblk 0xfffffe00046d00f8 sendfile14 41542 41498 819 0 S+ sbwait 0xfffff806564a51d4 sendfile14 41541 41498 819 0 S+ sbwait 0xfffff806564a553c sendfile14 41540 41498 819 0 S+ sbwait 0xfffff806564a58a4 sendfile14 41539 41498 819 0 S+ sbwait 0xfffff806564a5c0c sendfile14 41538 41498 819 0 S+ sbwait 0xfffff806566861d4 sendfile14 41537 41498 819 0 S+ sbwait 0xfffff800095a7c0c sendfile14 41536 41498 819 0 RE+ CPU 9 sendfile14 41535 41498 819 0 S+ sbwait 0xfffff80009c40c0c sendfile14 41534 41498 819 0 D+ biowr 0xfffffe00046d0078 sendfile14 41533 41498 819 0 S+ sbwait 0xfffff8011509653c sendfile14 41532 41498 819 0 S+ sbwait 0xfffff8000955bc0c sendfile14 41531 41498 819 0 S+ sbwait 0xfffff80009c9e53c sendfile14 41530 41498 819 0 S+ sbwait 0xfffff80009c9e8a4 sendfile14 41529 41498 819 0 S+ sbwait 0xfffff80009a331d4 sendfile14 41528 41498 819 0 S+ sbwait 0xfffff80009a338a4 sendfile14 41527 41498 819 0 S+ sbwait 0xfffff8046be5c8a4 sendfile14 41526 41498 819 0 S+ sbwait 0xfffff8046be5cc0c sendfile14 41525 41498 819 0 S+ sbwait 0xfffff8046be5d1d4 sendfile14 41524 41498 819 0 S+ sbwait 0xfffff8046be5d53c sendfile14 41523 41498 819 0 S+ sbwait 0xfffff8046be5d8a4 sendfile14 41522 41498 819 0 S+ sbwait 0xfffff8046be5dc0c sendfile14 41521 41498 819 0 S+ sbwait 0xfffff8046be5e1d4 sendfile14 41520 41498 819 0 S+ sbwait 0xfffff80009d4f1d4 sendfile14 41519 41498 819 0 D+ getblk 0xfffffe00046d00f8 sendfile14 41518 41498 819 0 S+ sbwait 0xfffff80009d4f8a4 sendfile14 41517 41504 819 0 R+ CPU 7 sendfile14 41516 41504 819 0 S+ sbwait 0xfffff806564a6c0c sendfile14 41515 41498 819 0 S+ sbwait 0xfffff80009d4fc0c sendfile14 41514 41498 819 0 S+ sbwait 0xfffff8000955a1d4 sendfile14 41513 41504 819 0 S+ sbwait 0xfffff80009c4653c sendfile14 41512 41504 819 0 S+ sbwait 0xfffff80009c468a4 sendfile14 41511 41504 819 0 S+ sbwait 0xfffff80009c46c0c sendfile14 41510 41504 819 0 S+ sbwait 0xfffff80009d2053c sendfile14 41509 41504 819 0 S+ sbwait 0xfffff80164a7653c sendfile14 41508 41504 819 0 S+ sbwait 0xfffff80164a768a4 sendfile14 41507 41504 819 0 S+ sbwait 0xfffff80164a76c0c sendfile14 41506 41504 819 0 S+ sbwait 0xfffff80164fdf1d4 sendfile14 41505 41504 819 0 S+ sbwait 0xfffff80164fdf53c sendfile14 41504 41477 819 0 S+ accept 0xfffff80009d20838 sendfile14 41503 41498 819 0 S+ sbwait 0xfffff80009d20c0c sendfile14 41502 41498 819 0 S+ sbwait 0xfffff80009d0f1d4 sendfile14 41501 41498 819 0 D+ getblk 0xfffffe00046d00f8 sendfile14 41500 41498 819 0 S+ sbwait 0xfffff80009d0f8a4 sendfile14 41499 41498 819 0 S+ sbwait 0xfffff80009d0fc0c sendfile14 41498 41478 819 0 S+ wait 0xfffff801e2968a50 sendfile14 41478 41442 819 0 S+ (threaded) sendfile14 100698 S uwait 0xfffff80009701700 sendfile14 100397 S sbwait 0xfffff80164b882c4 sendfile14 100555 S sbwait 0xfffff806564a62c4 sendfile14 100701 S sbwait 0xfffff80009d212c4 sendfile14 100715 S sbwait 0xfffff8046be5e62c sendfile14 100789 S sbwait 0xfffff801152c92c4 sendfile14 100810 S sbwait 0xfffff80049a3acfc sendfile14 100824 S sbwait 0xfffff800095a6994 sendfile14 41477 41442 819 0 R+ (threaded) sendfile14 100613 S uwait 0xfffff801b9103f00 sendfile14 101430 S nanslp 0xffffffff81df1e94 sendfile14 101450 S sbwait 0xfffff80009d3acfc sendfile14 101589 Run CPU 5 sendfile14 101595 S sbwait 0xfffff800095a662c sendfile14 101596 S nanslp 0xffffffff81df1e97 sendfile14 101610 S sbwait 0xfffff80009d2162c sendfile14 101620 Run CPU -1 sendfile14 101621 S nanslp 0xffffffff81df1e9a sendfile14 101632 S nanslp 0xffffffff81df1e93 sendfile14 101642 S sbwait 0xfffff80009d3962c sendfile14 101644 S nanslp 0xffffffff81df1e97 sendfile14 101658 S nanslp 0xffffffff81df1e92 sendfile14 101663 S nanslp 0xffffffff81df1e92 sendfile14 101668 S nanslp 0xffffffff81df1e93 sendfile14 101690 S nanslp 0xffffffff81df1e94 sendfile14 101695 S nanslp 0xffffffff81df1e92 sendfile14 101711 S nanslp 0xffffffff81df1e96 sendfile14 101712 S nanslp 0xffffffff81df1e94 sendfile14 41469 0 0 0 RL CPU 1 [md11] 41460 0 0 0 RL CPU 2 [md10] 41442 41440 819 0 S+ pause 0xfffff801a8f685d0 sh 41441 819 819 0 D+ biord 0xfffffe00030e2b68 tee 41440 819 819 0 S+ wait 0xfffff801850d7a50 sh 819 817 819 0 S+ wait 0xfffff80009779528 sh 817 815 817 0 S+ select 0xfffff80005166840 bash 815 814 815 0 SW+ pause 0xfffff800050ef0a8 csh 814 813 814 2006 SW+ wait 0xfffff80009420000 su 813 812 813 2006 SWs+ wait 0xfffff800050ef528 bash 812 809 809 2006 D biord 0xfffffe000462f128 sshd 809 707 809 0 Ss select 0xfffff800051acec0 sshd 806 756 806 0 S+ ttyin 0xfffff800051cecb0 csh 801 1 801 65 Ss select 0xfffff80003cabd40 dhclient 756 1 756 0 SWs+ wait 0xfffff80115669a50 login 755 1 755 0 Ss+ ttyin 0xfffff800051cf0b0 getty 754 1 754 0 Ss+ ttyin 0xfffff8000921e8b0 getty 753 1 753 0 Ss+ ttyin 0xfffff8000921ecb0 getty 752 1 752 0 Ss+ ttyin 0xfffff8000921f0b0 getty 751 1 751 0 Ss+ ttyin 0xfffff8000921f4b0 getty 750 1 750 0 Ss+ ttyin 0xfffff8000921f8b0 getty 749 1 749 0 Ss+ ttyin 0xfffff8000921fcb0 getty 748 1 748 0 Ss+ ttyin 0xfffff800092200b0 getty 747 1 747 0 Ss+ ttyin 0xfffff800092204b0 getty 711 1 711 0 Ss nanslp 0xffffffff81df1e9a cron 707 1 707 0 Ss select 0xfffff800095d2e40 sshd 640 1 640 0 Ss rpcsvc 0xfffff8000970a860 NLM: master 637 1 637 0 Ss select 0xfffff800030d64c0 rpc.statd 598 1 598 0 Ss select 0xfffff800090b4cc0 dhclient 595 1 595 0 Ss select 0xfffff800037308c0 dhclient 590 1 590 0 Ss select 0xfffff80003cabdc0 casperd 589 1 589 0 Ss select 0xfffff80003cabe40 casperd 549 1 549 0 Ss nanslp 0xffffffff81df1e9b watchdogd 538 1 538 0 Ss select 0xfffff800037309c0 rpcbind 533 1 533 0 Ss select 0xfffff8000515e8c0 syslogd 458 1 458 0 Ss select 0xfffff80003cabec0 devd 33 0 0 0 DL syncer 0xffffffff81f94300 [syncer] 32 0 0 0 DL vlruwt 0xfffff8000906c000 [vnlru] 31 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff81f937a0 [bufdaemon] 100134 D - 0xffffffff81a0a600 [bufspacedaemon-0] 100135 D - 0xffffffff81a128c0 [bufspacedaemon-1] 100136 D - 0xffffffff81a1ab80 [bufspacedaemon-2] 100137 D - 0xffffffff81a22e40 [bufspacedaemon-3] 100138 D - 0xffffffff81a2b100 [bufspacedaemon-4] 100139 D - 0xffffffff81a333c0 [bufspacedaemon-5] 100140 D - 0xffffffff81a3b680 [bufspacedaemon-6] 100152 D sdflush 0xfffff800097996e8 [/ worker] 100162 D sdflush 0xfffff8000983a2e8 [/tmp worker] 100155 D sdflush 0xfffff8028f5934e8 [/mnt worker] 100222 D sdflush 0xfffff807cb22e2e8 [/mnt11 worker] 30 0 0 0 DL psleep 0xffffffff81fb06c0 [vmdaemon] 29 0 0 0 DL (threaded) [pagedaemon] 100127 D psleep 0xffffffff82020dd8 [dom0] 100129 D launds 0xffffffff82020de4 [laundry: dom0] 100131 D umarcl 0xffffffff80ed3ec0 [uma] 28 0 0 0 DL idle 0xfffff80007f88000 [enc_daemon1] 27 0 0 0 DL idle 0xfffff80007f88528 [enc_daemon0] 26 0 0 0 DL - 0xffffffff81cc1da0 [rand_harvestq] 25 0 0 0 DL waiting 0xffffffff8201f5c0 [sctp_iterator] 24 0 0 0 DL - 0xffffffff81f9319c [soaiod4] 23 0 0 0 DL - 0xffffffff81f9319c [soaiod3] 22 0 0 0 DL - 0xffffffff81f9319c [soaiod2] 21 0 0 0 DL - 0xffffffff81f9319c [soaiod1] 20 0 0 0 DL (threaded) [usb] 100095 D - 0xfffffe009c7e7460 [usbus0] 100096 D - 0xfffffe009c7e74b8 [usbus0] 100097 D - 0xfffffe009c7e7510 [usbus0] 100098 D - 0xfffffe009c7e7568 [usbus0] 100099 D - 0xfffffe009c7e75c0 [usbus0] 100101 D - 0xfffffe009a5f6d10 [usbus1] 100102 D - 0xfffffe009a5f6d68 [usbus1] 100103 D - 0xfffffe009a5f6dc0 [usbus1] 100104 D - 0xfffffe009a5f6e18 [usbus1] 100105 D - 0xfffffe009a5f6e70 [usbus1] 100106 D - 0xfffffe009a5d6d10 [usbus2] 100107 D - 0xfffffe009a5d6d68 [usbus2] 100108 D - 0xfffffe009a5d6dc0 [usbus2] 100109 D - 0xfffffe009a5d6e18 [usbus2] 100110 D - 0xfffffe009a5d6e70 [usbus2] 19 0 0 0 DL (threaded) [cam] 100090 D - 0xffffffff81b9d0c0 [doneq0] 100091 D - 0xffffffff81b9d140 [doneq1] 100092 D - 0xffffffff81b9d1c0 [doneq2] 100124 D - 0xffffffff81b9cf88 [scanner] 18 0 0 0 DL crypto_ 0xfffff80003810450 [crypto returns 11] 17 0 0 0 DL crypto_ 0xfffff800038103f0 [crypto returns 10] 16 0 0 0 DL crypto_ 0xfffff80003810390 [crypto returns 9] 15 0 0 0 DL crypto_ 0xfffff80003810330 [crypto returns 8] 14 0 0 0 DL crypto_ 0xfffff800038102d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003810270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003810210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff800038101b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003810150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff800038100f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003810090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003810030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81faac88 [crypto] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff81ffbe10 [g_event] 100063 D - 0xffffffff81ffbe20 [g_up] 100064 D - 0xffffffff81ffbe08 [g_down] 12 0 0 0 RL (threaded) [intr] 100015 I [swi6: Giant taskq] 100017 I [swi5: fast taskq] 100020 I [swi6: task queue] 100047 Run CPU 11 [swi1: netisr 0] 100048 I [swi4: clock (0)] 100049 I [swi4: clock (1)] 100050 I [swi4: clock (2)] 100051 I [swi4: clock (3)] 100052 I [swi4: clock (4)] 100053 I [swi4: clock (5)] 100054 I [swi4: clock (6)] 100055 I [swi4: clock (7)] 100056 I [swi4: clock (8)] 100057 I [swi4: clock (9)] 100058 I [swi4: clock (10)] 100059 I [swi4: clock (11)] 100060 I [swi3: vm] 100093 I [irq264: ahci0] 100094 I [irq19: xhci0] 100100 I [irq18: ehci0 ehci1] 100111 I [irq279: ahci1] 100112 I [swi0: uart uart] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff80003648528 [init] 10 0 0 0 DL audit_w 0xffffffff820202d0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81ffbe50 [swapper] 100016 D - 0xfffff80003686e00 [thread taskq] 100018 D - 0xfffff80003686c00 [aiod_kick taskq] 100019 D - 0xfffff80003686b00 [kqueue_ctx taskq] 100021 D - 0xfffff80003632e00 [if_io_tqg_0] 100022 D - 0xfffff80003632d00 [if_io_tqg_1] 100023 D - 0xfffff80003632c00 [if_io_tqg_2] 100024 D - 0xfffff80003632b00 [if_io_tqg_3] 100025 D - 0xfffff80003632a00 [if_io_tqg_4] 100026 D - 0xfffff80003632900 [if_io_tqg_5] 100027 D - 0xfffff80003632800 [if_io_tqg_6] 100028 D - 0xfffff80003632700 [if_io_tqg_7] 100029 D - 0xfffff80003632600 [if_io_tqg_8] 100030 D - 0xfffff80003632500 [if_io_tqg_9] 100031 D - 0xfffff80003632400 [if_io_tqg_10] 100032 D - 0xfffff80003632300 [if_io_tqg_11] 100033 D - 0xfffff80003632200 [config_0] 100034 D - 0xfffff80003723100 [if_config_tqg_0] 100035 D - 0xfffff80003723000 [softirq_0] 100036 D - 0xfffff80003722e00 [softirq_1] 100037 D - 0xfffff80003722d00 [softirq_2] 100038 D - 0xfffff80003722c00 [softirq_3] 100039 D - 0xfffff80003722b00 [softirq_4] 100040 D - 0xfffff80003722a00 [softirq_5] 100041 D - 0xfffff80003722900 [softirq_6] 100042 D - 0xfffff80003722800 [softirq_7] 100043 D - 0xfffff80003722700 [softirq_8] 100044 D - 0xfffff80003722600 [softirq_9] 100045 D - 0xfffff80003722500 [softirq_10] 100046 D - 0xfffff80003722400 [softirq_11] 100061 D - 0xfffff80003798100 [firmware taskq] 100065 D - 0xfffff80003797e00 [crypto_0] 100066 D - 0xfffff80003797e00 [crypto_1] 100067 D - 0xfffff80003797e00 [crypto_2] 100068 D - 0xfffff80003797e00 [crypto_3] 100069 D - 0xfffff80003797e00 [crypto_4] 100070 D - 0xfffff80003797e00 [crypto_5] 100071 D - 0xfffff80003797e00 [crypto_6] 100072 D - 0xfffff80003797e00 [crypto_7] 100073 D - 0xfffff80003797e00 [crypto_8] 100074 D - 0xfffff80003797e00 [crypto_9] 100075 D - 0xfffff80003797e00 [crypto_10] 100076 D - 0xfffff80003797e00 [crypto_11] 100113 D - 0xfffff80003797800 [mca taskq] 100119 D - 0xfffff8000901bd00 [acpi_task_0] 100120 D - 0xfffff8000901bd00 [acpi_task_1] 100121 D - 0xfffff8000901bd00 [acpi_task_2] 100123 D - 0xfffff80003797b00 [CAM taskq] db:0:pho> allt Tracing command sendfile14 pid 41554 tid 101461 td 0xfffff805678e0000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a97f3610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a97f3640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a97f3680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a97f36e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a97f3710 _sleep() at _sleep+0x39c/frame 0xfffffe00a97f37b0 sbwait() at sbwait+0x68/frame 0xfffffe00a97f37d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a97f3890 soreceive() at soreceive+0x59/frame 0xfffffe00a97f38b0 dofileread() at dofileread+0x95/frame 0xfffffe00a97f38f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a97f3930 sys_read() at sys_read+0x86/frame 0xfffffe00a97f3980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a97f3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a97f3ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41553 tid 101236 td 0xfffff80007f99580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a55ad610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a55ad640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a55ad680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a55ad6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a55ad710 _sleep() at _sleep+0x39c/frame 0xfffffe00a55ad7b0 sbwait() at sbwait+0x68/frame 0xfffffe00a55ad7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a55ad890 soreceive() at soreceive+0x59/frame 0xfffffe00a55ad8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a55ad8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a55ad930 sys_read() at sys_read+0x86/frame 0xfffffe00a55ad980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a55adab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a55adab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41552 tid 101587 td 0xfffff8025f766580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a933a610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a933a640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a933a680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a933a6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a933a710 _sleep() at _sleep+0x39c/frame 0xfffffe00a933a7b0 sbwait() at sbwait+0x68/frame 0xfffffe00a933a7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a933a890 soreceive() at soreceive+0x59/frame 0xfffffe00a933a8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a933a8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a933a930 sys_read() at sys_read+0x86/frame 0xfffffe00a933a980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a933aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a933aab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41551 tid 101368 td 0xfffff8066c4ba580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a964a610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a964a640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a964a680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a964a6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a964a710 _sleep() at _sleep+0x39c/frame 0xfffffe00a964a7b0 sbwait() at sbwait+0x68/frame 0xfffffe00a964a7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a964a890 soreceive() at soreceive+0x59/frame 0xfffffe00a964a8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a964a8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a964a930 sys_read() at sys_read+0x86/frame 0xfffffe00a964a980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a964aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a964aab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41550 tid 101377 td 0xfffff8001b817580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a92b8610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a92b8640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a92b8680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a92b86e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a92b8710 _sleep() at _sleep+0x39c/frame 0xfffffe00a92b87b0 sbwait() at sbwait+0x68/frame 0xfffffe00a92b87d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a92b8890 soreceive() at soreceive+0x59/frame 0xfffffe00a92b88b0 dofileread() at dofileread+0x95/frame 0xfffffe00a92b88f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a92b8930 sys_read() at sys_read+0x86/frame 0xfffffe00a92b8980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a92b8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a92b8ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41547 tid 101612 td 0xfffff80823f4f580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a933f610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a933f640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a933f680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a933f6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a933f710 _sleep() at _sleep+0x39c/frame 0xfffffe00a933f7b0 sbwait() at sbwait+0x68/frame 0xfffffe00a933f7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a933f890 soreceive() at soreceive+0x59/frame 0xfffffe00a933f8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a933f8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a933f930 sys_read() at sys_read+0x86/frame 0xfffffe00a933f980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a933fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a933fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41546 tid 101122 td 0xfffff8000948c000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a5561e00 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5561e30 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5561e70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a5561ea0 sleeplk() at sleeplk+0x149/frame 0xfffffe00a5561f00 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a5561f80 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a5562020 getblkx() at getblkx+0x12d/frame 0xfffffe00a5562100 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a5562170 ffs_update() at ffs_update+0x115/frame 0xfffffe00a55621f0 ffs_syncvnode() at ffs_syncvnode+0x430/frame 0xfffffe00a5562260 ffs_truncate() at ffs_truncate+0x6f6/frame 0xfffffe00a5562460 ffs_write() at ffs_write+0x558/frame 0xfffffe00a5562500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a5562610 vn_write() at vn_write+0x26b/frame 0xfffffe00a5562690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a55626f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a5562830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a55628a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a55628f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a5562930 sys_write() at sys_write+0x86/frame 0xfffffe00a5562980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5562ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5562ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80083bb6a, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41545 tid 100513 td 0xfffff802c6abb580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a5558610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5558640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5558680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a55586e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5558710 _sleep() at _sleep+0x39c/frame 0xfffffe00a55587b0 sbwait() at sbwait+0x68/frame 0xfffffe00a55587d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a5558890 soreceive() at soreceive+0x59/frame 0xfffffe00a55588b0 dofileread() at dofileread+0x95/frame 0xfffffe00a55588f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a5558930 sys_read() at sys_read+0x86/frame 0xfffffe00a5558980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5558ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5558ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41544 tid 101546 td 0xfffff80469e6d580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a957ae00 mi_switch() at mi_switch+0x178/frame 0xfffffe00a957ae30 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a957ae70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a957aea0 sleeplk() at sleeplk+0x149/frame 0xfffffe00a957af00 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a957af80 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a957b020 getblkx() at getblkx+0x12d/frame 0xfffffe00a957b100 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a957b170 ffs_update() at ffs_update+0x115/frame 0xfffffe00a957b1f0 ffs_syncvnode() at ffs_syncvnode+0x430/frame 0xfffffe00a957b260 ffs_truncate() at ffs_truncate+0x6f6/frame 0xfffffe00a957b460 ffs_write() at ffs_write+0x558/frame 0xfffffe00a957b500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a957b610 vn_write() at vn_write+0x26b/frame 0xfffffe00a957b690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a957b6f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a957b830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a957b8a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a957b8f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a957b930 sys_write() at sys_write+0x86/frame 0xfffffe00a957b980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a957bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a957bab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80083bb6a, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41543 tid 101373 td 0xfffff80115d90000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9361e00 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9361e30 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9361e70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a9361ea0 sleeplk() at sleeplk+0x149/frame 0xfffffe00a9361f00 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a9361f80 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a9362020 getblkx() at getblkx+0x12d/frame 0xfffffe00a9362100 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a9362170 ffs_update() at ffs_update+0x115/frame 0xfffffe00a93621f0 ffs_syncvnode() at ffs_syncvnode+0x4ad/frame 0xfffffe00a9362260 ffs_truncate() at ffs_truncate+0x6f6/frame 0xfffffe00a9362460 ffs_write() at ffs_write+0x558/frame 0xfffffe00a9362500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a9362610 vn_write() at vn_write+0x26b/frame 0xfffffe00a9362690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a93626f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a9362830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a93628a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a93628f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a9362930 sys_write() at sys_write+0x86/frame 0xfffffe00a9362980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9362ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9362ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80083bb6a, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41542 tid 100581 td 0xfffff8078e6b6000 sched_switch() at sched_switch+0x942/frame 0xfffffe00aa8c7610 mi_switch() at mi_switch+0x178/frame 0xfffffe00aa8c7640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa8c7680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00aa8c76e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa8c7710 _sleep() at _sleep+0x39c/frame 0xfffffe00aa8c77b0 sbwait() at sbwait+0x68/frame 0xfffffe00aa8c77d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00aa8c7890 soreceive() at soreceive+0x59/frame 0xfffffe00aa8c78b0 dofileread() at dofileread+0x95/frame 0xfffffe00aa8c78f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa8c7930 sys_read() at sys_read+0x86/frame 0xfffffe00aa8c7980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00aa8c7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa8c7ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41541 tid 101563 td 0xfffff8058539c000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7872610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7872640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7872680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a78726e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7872710 _sleep() at _sleep+0x39c/frame 0xfffffe00a78727b0 sbwait() at sbwait+0x68/frame 0xfffffe00a78727d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a7872890 soreceive() at soreceive+0x59/frame 0xfffffe00a78728b0 dofileread() at dofileread+0x95/frame 0xfffffe00a78728f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7872930 sys_read() at sys_read+0x86/frame 0xfffffe00a7872980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7872ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7872ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41540 tid 101054 td 0xfffff80115d84000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a966d610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a966d640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a966d680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a966d6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a966d710 _sleep() at _sleep+0x39c/frame 0xfffffe00a966d7b0 sbwait() at sbwait+0x68/frame 0xfffffe00a966d7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a966d890 soreceive() at soreceive+0x59/frame 0xfffffe00a966d8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a966d8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a966d930 sys_read() at sys_read+0x86/frame 0xfffffe00a966d980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a966dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a966dab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41539 tid 101538 td 0xfffff8045844c580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a787c610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a787c640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a787c680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a787c6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a787c710 _sleep() at _sleep+0x39c/frame 0xfffffe00a787c7b0 sbwait() at sbwait+0x68/frame 0xfffffe00a787c7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a787c890 soreceive() at soreceive+0x59/frame 0xfffffe00a787c8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a787c8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a787c930 sys_read() at sys_read+0x86/frame 0xfffffe00a787c980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a787cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a787cab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41538 tid 100975 td 0xfffff8064ac60580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9562610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9562640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9562680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a95626e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a9562710 _sleep() at _sleep+0x39c/frame 0xfffffe00a95627b0 sbwait() at sbwait+0x68/frame 0xfffffe00a95627d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a9562890 soreceive() at soreceive+0x59/frame 0xfffffe00a95628b0 dofileread() at dofileread+0x95/frame 0xfffffe00a95628f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a9562930 sys_read() at sys_read+0x86/frame 0xfffffe00a9562980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9562ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9562ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41537 tid 101606 td 0xfffff805b5f79580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a969f610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a969f640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a969f680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a969f6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a969f710 _sleep() at _sleep+0x39c/frame 0xfffffe00a969f7b0 sbwait() at sbwait+0x68/frame 0xfffffe00a969f7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a969f890 soreceive() at soreceive+0x59/frame 0xfffffe00a969f8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a969f8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a969f930 sys_read() at sys_read+0x86/frame 0xfffffe00a969f980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a969fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a969fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41536 tid 101616 td 0xfffff80647c46000 (CPU 9) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a78a93e0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a78a9440 doadump() at doadump/frame 0xfffffe00a78a94c0 epoch_wait_preempt() at epoch_wait_preempt+0x2b1/frame 0xfffffe00a78a9520 pmap_remove_all() at pmap_remove_all+0x81b/frame 0xfffffe00a78a95b0 vm_page_try_to_free() at vm_page_try_to_free+0x84/frame 0xfffffe00a78a95d0 sendfile_free_mext() at sendfile_free_mext+0x10f/frame 0xfffffe00a78a9600 mb_free_ext() at mb_free_ext+0x9d/frame 0xfffffe00a78a9630 m_freem() at m_freem+0x48/frame 0xfffffe00a78a9650 sbflush_locked() at sbflush_locked+0x69/frame 0xfffffe00a78a9670 sbflush() at sbflush+0x2c/frame 0xfffffe00a78a9690 tcp_disconnect() at tcp_disconnect+0x6c/frame 0xfffffe00a78a96c0 tcp_usr_disconnect() at tcp_usr_disconnect+0x71/frame 0xfffffe00a78a96f0 soclose() at soclose+0xa5/frame 0xfffffe00a78a9760 closef() at closef+0x1f5/frame 0xfffffe00a78a97f0 fdescfree_fds() at fdescfree_fds+0x90/frame 0xfffffe00a78a9840 fdescfree() at fdescfree+0x480/frame 0xfffffe00a78a9900 exit1() at exit1+0x500/frame 0xfffffe00a78a9970 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00a78a9980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a78a9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a78a9ab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8007c7a8a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe200 --- Tracing command sendfile14 pid 41535 tid 101124 td 0xfffff8079a164000 sched_switch() at sched_switch+0x942/frame 0xfffffe00aa813610 mi_switch() at mi_switch+0x178/frame 0xfffffe00aa813640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa813680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00aa8136e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa813710 _sleep() at _sleep+0x39c/frame 0xfffffe00aa8137b0 sbwait() at sbwait+0x68/frame 0xfffffe00aa8137d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00aa813890 soreceive() at soreceive+0x59/frame 0xfffffe00aa8138b0 dofileread() at dofileread+0x95/frame 0xfffffe00aa8138f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa813930 sys_read() at sys_read+0x86/frame 0xfffffe00aa813980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00aa813ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa813ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41534 tid 100877 td 0xfffff801e290b000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a968ffc0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a968fff0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9690030 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a9690060 _sleep() at _sleep+0x3a9/frame 0xfffffe00a9690100 bufwait() at bufwait+0xc4/frame 0xfffffe00a9690140 bufwrite() at bufwrite+0x248/frame 0xfffffe00a9690190 ffs_update() at ffs_update+0x2b1/frame 0xfffffe00a96901f0 ffs_syncvnode() at ffs_syncvnode+0x4ad/frame 0xfffffe00a9690260 ffs_truncate() at ffs_truncate+0x6f6/frame 0xfffffe00a9690460 ffs_write() at ffs_write+0x558/frame 0xfffffe00a9690500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a9690610 vn_write() at vn_write+0x26b/frame 0xfffffe00a9690690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a96906f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a9690830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a96908a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a96908f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a9690930 sys_write() at sys_write+0x86/frame 0xfffffe00a9690980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9690ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9690ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80083bb6a, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41533 tid 101151 td 0xfffff8011592d000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a97d5610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a97d5640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a97d5680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a97d56e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a97d5710 _sleep() at _sleep+0x39c/frame 0xfffffe00a97d57b0 sbwait() at sbwait+0x68/frame 0xfffffe00a97d57d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a97d5890 soreceive() at soreceive+0x59/frame 0xfffffe00a97d58b0 dofileread() at dofileread+0x95/frame 0xfffffe00a97d58f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a97d5930 sys_read() at sys_read+0x86/frame 0xfffffe00a97d5980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a97d5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a97d5ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41532 tid 101175 td 0xfffff80358834580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a5481610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5481640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5481680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a54816e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5481710 _sleep() at _sleep+0x39c/frame 0xfffffe00a54817b0 sbwait() at sbwait+0x68/frame 0xfffffe00a54817d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a5481890 soreceive() at soreceive+0x59/frame 0xfffffe00a54818b0 dofileread() at dofileread+0x95/frame 0xfffffe00a54818f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a5481930 sys_read() at sys_read+0x86/frame 0xfffffe00a5481980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5481ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5481ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41531 tid 101541 td 0xfffff801e29dc580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7985610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7985640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7985680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a79856e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7985710 _sleep() at _sleep+0x39c/frame 0xfffffe00a79857b0 sbwait() at sbwait+0x68/frame 0xfffffe00a79857d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a7985890 soreceive() at soreceive+0x59/frame 0xfffffe00a79858b0 dofileread() at dofileread+0x95/frame 0xfffffe00a79858f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7985930 sys_read() at sys_read+0x86/frame 0xfffffe00a7985980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7985ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7985ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41530 tid 100957 td 0xfffff80115145580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9640610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9640640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9640680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a96406e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a9640710 _sleep() at _sleep+0x39c/frame 0xfffffe00a96407b0 sbwait() at sbwait+0x68/frame 0xfffffe00a96407d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a9640890 soreceive() at soreceive+0x59/frame 0xfffffe00a96408b0 dofileread() at dofileread+0x95/frame 0xfffffe00a96408f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a9640930 sys_read() at sys_read+0x86/frame 0xfffffe00a9640980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9640ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9640ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41529 tid 100721 td 0xfffff8051e31c580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7921610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7921640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7921680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a79216e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7921710 _sleep() at _sleep+0x39c/frame 0xfffffe00a79217b0 sbwait() at sbwait+0x68/frame 0xfffffe00a79217d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a7921890 soreceive() at soreceive+0x59/frame 0xfffffe00a79218b0 dofileread() at dofileread+0x95/frame 0xfffffe00a79218f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7921930 sys_read() at sys_read+0x86/frame 0xfffffe00a7921980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7921ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7921ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41528 tid 101703 td 0xfffff8060cf3c000 sched_switch() at sched_switch+0x942/frame 0xfffffe00aa85e610 mi_switch() at mi_switch+0x178/frame 0xfffffe00aa85e640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa85e680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00aa85e6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa85e710 _sleep() at _sleep+0x39c/frame 0xfffffe00aa85e7b0 sbwait() at sbwait+0x68/frame 0xfffffe00aa85e7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00aa85e890 soreceive() at soreceive+0x59/frame 0xfffffe00aa85e8b0 dofileread() at dofileread+0x95/frame 0xfffffe00aa85e8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa85e930 sys_read() at sys_read+0x86/frame 0xfffffe00aa85e980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00aa85eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa85eab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41527 tid 101014 td 0xfffff801e26a9580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a975d610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a975d640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a975d680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a975d6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a975d710 _sleep() at _sleep+0x39c/frame 0xfffffe00a975d7b0 sbwait() at sbwait+0x68/frame 0xfffffe00a975d7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a975d890 soreceive() at soreceive+0x59/frame 0xfffffe00a975d8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a975d8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a975d930 sys_read() at sys_read+0x86/frame 0xfffffe00a975d980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a975dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a975dab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41526 tid 101069 td 0xfffff801e26aa000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9785610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9785640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9785680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a97856e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a9785710 _sleep() at _sleep+0x39c/frame 0xfffffe00a97857b0 sbwait() at sbwait+0x68/frame 0xfffffe00a97857d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a9785890 soreceive() at soreceive+0x59/frame 0xfffffe00a97858b0 dofileread() at dofileread+0x95/frame 0xfffffe00a97858f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a9785930 sys_read() at sys_read+0x86/frame 0xfffffe00a9785980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9785ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9785ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41525 tid 101335 td 0xfffff8025ba81000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a97ad610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a97ad640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a97ad680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a97ad6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a97ad710 _sleep() at _sleep+0x39c/frame 0xfffffe00a97ad7b0 sbwait() at sbwait+0x68/frame 0xfffffe00a97ad7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a97ad890 soreceive() at soreceive+0x59/frame 0xfffffe00a97ad8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a97ad8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a97ad930 sys_read() at sys_read+0x86/frame 0xfffffe00a97ad980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a97adab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a97adab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41524 tid 100171 td 0xfffff80117c90000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a93c1610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a93c1640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a93c1680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a93c16e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a93c1710 _sleep() at _sleep+0x39c/frame 0xfffffe00a93c17b0 sbwait() at sbwait+0x68/frame 0xfffffe00a93c17d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a93c1890 soreceive() at soreceive+0x59/frame 0xfffffe00a93c18b0 dofileread() at dofileread+0x95/frame 0xfffffe00a93c18f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a93c1930 sys_read() at sys_read+0x86/frame 0xfffffe00a93c1980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a93c1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a93c1ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41523 tid 101143 td 0xfffff8000964f000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a54ae610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a54ae640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a54ae680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a54ae6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a54ae710 _sleep() at _sleep+0x39c/frame 0xfffffe00a54ae7b0 sbwait() at sbwait+0x68/frame 0xfffffe00a54ae7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a54ae890 soreceive() at soreceive+0x59/frame 0xfffffe00a54ae8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a54ae8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a54ae930 sys_read() at sys_read+0x86/frame 0xfffffe00a54ae980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a54aeab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a54aeab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41522 tid 101555 td 0xfffff800568d2580 sched_switch() at sched_switch+0x942/frame 0xfffffe00aa8a9610 mi_switch() at mi_switch+0x178/frame 0xfffffe00aa8a9640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa8a9680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00aa8a96e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa8a9710 _sleep() at _sleep+0x39c/frame 0xfffffe00aa8a97b0 sbwait() at sbwait+0x68/frame 0xfffffe00aa8a97d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00aa8a9890 soreceive() at soreceive+0x59/frame 0xfffffe00aa8a98b0 dofileread() at dofileread+0x95/frame 0xfffffe00aa8a98f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa8a9930 sys_read() at sys_read+0x86/frame 0xfffffe00aa8a9980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00aa8a9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa8a9ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41521 tid 101013 td 0xfffff80530a1c580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a92c7610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a92c7640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a92c7680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a92c76e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a92c7710 _sleep() at _sleep+0x39c/frame 0xfffffe00a92c77b0 sbwait() at sbwait+0x68/frame 0xfffffe00a92c77d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a92c7890 soreceive() at soreceive+0x59/frame 0xfffffe00a92c78b0 dofileread() at dofileread+0x95/frame 0xfffffe00a92c78f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a92c7930 sys_read() at sys_read+0x86/frame 0xfffffe00a92c7980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a92c7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a92c7ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41520 tid 101473 td 0xfffff8026885d580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a97a3610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a97a3640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a97a3680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a97a36e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a97a3710 _sleep() at _sleep+0x39c/frame 0xfffffe00a97a37b0 sbwait() at sbwait+0x68/frame 0xfffffe00a97a37d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a97a3890 soreceive() at soreceive+0x59/frame 0xfffffe00a97a38b0 dofileread() at dofileread+0x95/frame 0xfffffe00a97a38f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a97a3930 sys_read() at sys_read+0x86/frame 0xfffffe00a97a3980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a97a3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a97a3ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41519 tid 101479 td 0xfffff801a8829580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9575e70 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9575ea0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9575ee0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a9575f10 sleeplk() at sleeplk+0x149/frame 0xfffffe00a9575f70 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a9575ff0 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a9576090 getblkx() at getblkx+0x12d/frame 0xfffffe00a9576170 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a95761e0 ffs_update() at ffs_update+0x115/frame 0xfffffe00a9576260 ffs_truncate() at ffs_truncate+0xca9/frame 0xfffffe00a9576460 ffs_write() at ffs_write+0x558/frame 0xfffffe00a9576500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a9576610 vn_write() at vn_write+0x26b/frame 0xfffffe00a9576690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a95766f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a9576830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a95768a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a95768f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a9576930 sys_write() at sys_write+0x86/frame 0xfffffe00a9576980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9576ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9576ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80083bb6a, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41518 tid 101141 td 0xfffff801e232d580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9367610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9367640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9367680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a93676e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a9367710 _sleep() at _sleep+0x39c/frame 0xfffffe00a93677b0 sbwait() at sbwait+0x68/frame 0xfffffe00a93677d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a9367890 soreceive() at soreceive+0x59/frame 0xfffffe00a93678b0 dofileread() at dofileread+0x95/frame 0xfffffe00a93678f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a9367930 sys_read() at sys_read+0x86/frame 0xfffffe00a9367980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9367ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9367ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41517 tid 100963 td 0xfffff80251442580 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071f5df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071f5e10 trap() at trap+0x49/frame 0xfffffe00071f5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071f5f20 --- trap 0x13, rip = 0xffffffff80e8200f, rsp = 0xfffffe00a954e260, rbp = 0xfffffe00a954e2c0 --- ffs_alloc() at ffs_alloc+0x36f/frame 0xfffffe00a954e2c0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00a954e460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a954e500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a954e610 vn_write() at vn_write+0x26b/frame 0xfffffe00a954e690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a954e6f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a954e830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a954e8a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a954e8f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a954e930 sys_write() at sys_write+0x86/frame 0xfffffe00a954e980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a954eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a954eab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80083bb6a, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41516 tid 100760 td 0xfffff80009485580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a5599610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5599640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5599680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a55996e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5599710 _sleep() at _sleep+0x39c/frame 0xfffffe00a55997b0 sbwait() at sbwait+0x68/frame 0xfffffe00a55997d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a5599890 soreceive() at soreceive+0x59/frame 0xfffffe00a55998b0 dofileread() at dofileread+0x95/frame 0xfffffe00a55998f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a5599930 sys_read() at sys_read+0x86/frame 0xfffffe00a5599980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5599ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5599ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41515 tid 100818 td 0xfffff80063ccb000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9290610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9290640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9290680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a92906e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a9290710 _sleep() at _sleep+0x39c/frame 0xfffffe00a92907b0 sbwait() at sbwait+0x68/frame 0xfffffe00a92907d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a9290890 soreceive() at soreceive+0x59/frame 0xfffffe00a92908b0 dofileread() at dofileread+0x95/frame 0xfffffe00a92908f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a9290930 sys_read() at sys_read+0x86/frame 0xfffffe00a9290980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9290ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9290ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41514 tid 101344 td 0xfffff80250a59000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a973f610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a973f640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a973f680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a973f6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a973f710 _sleep() at _sleep+0x39c/frame 0xfffffe00a973f7b0 sbwait() at sbwait+0x68/frame 0xfffffe00a973f7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a973f890 soreceive() at soreceive+0x59/frame 0xfffffe00a973f8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a973f8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a973f930 sys_read() at sys_read+0x86/frame 0xfffffe00a973f980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a973fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a973fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41513 tid 101075 td 0xfffff8033ecca580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a793a610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a793a640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a793a680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a793a6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a793a710 _sleep() at _sleep+0x39c/frame 0xfffffe00a793a7b0 sbwait() at sbwait+0x68/frame 0xfffffe00a793a7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a793a890 soreceive() at soreceive+0x59/frame 0xfffffe00a793a8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a793a8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a793a930 sys_read() at sys_read+0x86/frame 0xfffffe00a793a980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a793aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a793aab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41512 tid 101420 td 0xfffff80567edd580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a979e610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a979e640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a979e680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a979e6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a979e710 _sleep() at _sleep+0x39c/frame 0xfffffe00a979e7b0 sbwait() at sbwait+0x68/frame 0xfffffe00a979e7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a979e890 soreceive() at soreceive+0x59/frame 0xfffffe00a979e8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a979e8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a979e930 sys_read() at sys_read+0x86/frame 0xfffffe00a979e980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a979eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a979eab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41511 tid 100453 td 0xfffff800568d4580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9427610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9427640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9427680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a94276e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a9427710 _sleep() at _sleep+0x39c/frame 0xfffffe00a94277b0 sbwait() at sbwait+0x68/frame 0xfffffe00a94277d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a9427890 soreceive() at soreceive+0x59/frame 0xfffffe00a94278b0 dofileread() at dofileread+0x95/frame 0xfffffe00a94278f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a9427930 sys_read() at sys_read+0x86/frame 0xfffffe00a9427980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9427ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9427ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41510 tid 100772 td 0xfffff80125892580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7890610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7890640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7890680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a78906e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7890710 _sleep() at _sleep+0x39c/frame 0xfffffe00a78907b0 sbwait() at sbwait+0x68/frame 0xfffffe00a78907d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a7890890 soreceive() at soreceive+0x59/frame 0xfffffe00a78908b0 dofileread() at dofileread+0x95/frame 0xfffffe00a78908f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7890930 sys_read() at sys_read+0x86/frame 0xfffffe00a7890980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7890ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7890ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41509 tid 101480 td 0xfffff801a863a000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9717610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9717640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9717680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a97176e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a9717710 _sleep() at _sleep+0x39c/frame 0xfffffe00a97177b0 sbwait() at sbwait+0x68/frame 0xfffffe00a97177d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a9717890 soreceive() at soreceive+0x59/frame 0xfffffe00a97178b0 dofileread() at dofileread+0x95/frame 0xfffffe00a97178f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a9717930 sys_read() at sys_read+0x86/frame 0xfffffe00a9717980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9717ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9717ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41508 tid 101530 td 0xfffff801e232c000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a944f610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a944f640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a944f680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a944f6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a944f710 _sleep() at _sleep+0x39c/frame 0xfffffe00a944f7b0 sbwait() at sbwait+0x68/frame 0xfffffe00a944f7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a944f890 soreceive() at soreceive+0x59/frame 0xfffffe00a944f8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a944f8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a944f930 sys_read() at sys_read+0x86/frame 0xfffffe00a944f980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a944fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a944fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41507 tid 100285 td 0xfffff801a8484000 sched_switch() at sched_switch+0x942/frame 0xfffffe00aa89f610 mi_switch() at mi_switch+0x178/frame 0xfffffe00aa89f640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa89f680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00aa89f6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa89f710 _sleep() at _sleep+0x39c/frame 0xfffffe00aa89f7b0 sbwait() at sbwait+0x68/frame 0xfffffe00aa89f7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00aa89f890 soreceive() at soreceive+0x59/frame 0xfffffe00aa89f8b0 dofileread() at dofileread+0x95/frame 0xfffffe00aa89f8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa89f930 sys_read() at sys_read+0x86/frame 0xfffffe00aa89f980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00aa89fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa89fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41506 tid 101512 td 0xfffff80252205000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9695610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9695640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9695680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a96956e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a9695710 _sleep() at _sleep+0x39c/frame 0xfffffe00a96957b0 sbwait() at sbwait+0x68/frame 0xfffffe00a96957d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a9695890 soreceive() at soreceive+0x59/frame 0xfffffe00a96958b0 dofileread() at dofileread+0x95/frame 0xfffffe00a96958f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a9695930 sys_read() at sys_read+0x86/frame 0xfffffe00a9695980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9695ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9695ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41505 tid 101590 td 0xfffff801a835f580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a55a8610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a55a8640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a55a8680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a55a86e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a55a8710 _sleep() at _sleep+0x39c/frame 0xfffffe00a55a87b0 sbwait() at sbwait+0x68/frame 0xfffffe00a55a87d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a55a8890 soreceive() at soreceive+0x59/frame 0xfffffe00a55a88b0 dofileread() at dofileread+0x95/frame 0xfffffe00a55a88f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a55a8930 sys_read() at sys_read+0x86/frame 0xfffffe00a55a8980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a55a8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a55a8ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41504 tid 100532 td 0xfffff8051e31c000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a926d690 mi_switch() at mi_switch+0x178/frame 0xfffffe00a926d6c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a926d700 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a926d760 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a926d790 _sleep() at _sleep+0x39c/frame 0xfffffe00a926d830 solisten_dequeue() at solisten_dequeue+0xa8/frame 0xfffffe00a926d880 kern_accept4() at kern_accept4+0x1a9/frame 0xfffffe00a926d920 accept1() at accept1+0x60/frame 0xfffffe00a926d980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a926dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a926dab0 --- syscall (30, FreeBSD ELF64, sys_accept), rip = 0x8007c7dfa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41503 tid 101332 td 0xfffff80718b8f000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a794e610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a794e640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a794e680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a794e6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a794e710 _sleep() at _sleep+0x39c/frame 0xfffffe00a794e7b0 sbwait() at sbwait+0x68/frame 0xfffffe00a794e7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a794e890 soreceive() at soreceive+0x59/frame 0xfffffe00a794e8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a794e8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a794e930 sys_read() at sys_read+0x86/frame 0xfffffe00a794e980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a794eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a794eab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41502 tid 101650 td 0xfffff804cb1b0000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7886610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7886640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7886680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a78866e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7886710 _sleep() at _sleep+0x39c/frame 0xfffffe00a78867b0 sbwait() at sbwait+0x68/frame 0xfffffe00a78867d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a7886890 soreceive() at soreceive+0x59/frame 0xfffffe00a78868b0 dofileread() at dofileread+0x95/frame 0xfffffe00a78868f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7886930 sys_read() at sys_read+0x86/frame 0xfffffe00a7886980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7886ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7886ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41501 tid 101520 td 0xfffff801e232d000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a5453e00 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5453e30 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5453e70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a5453ea0 sleeplk() at sleeplk+0x149/frame 0xfffffe00a5453f00 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a5453f80 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a5454020 getblkx() at getblkx+0x12d/frame 0xfffffe00a5454100 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a5454170 ffs_update() at ffs_update+0x115/frame 0xfffffe00a54541f0 ffs_syncvnode() at ffs_syncvnode+0x4ad/frame 0xfffffe00a5454260 ffs_truncate() at ffs_truncate+0x6f6/frame 0xfffffe00a5454460 ffs_write() at ffs_write+0x558/frame 0xfffffe00a5454500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a5454610 vn_write() at vn_write+0x26b/frame 0xfffffe00a5454690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a54546f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a5454830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a54548a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a54548f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a5454930 sys_write() at sys_write+0x86/frame 0xfffffe00a5454980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5454ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5454ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80083bb6a, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41500 tid 101382 td 0xfffff801a882a000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a93b2610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a93b2640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a93b2680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a93b26e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a93b2710 _sleep() at _sleep+0x39c/frame 0xfffffe00a93b27b0 sbwait() at sbwait+0x68/frame 0xfffffe00a93b27d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a93b2890 soreceive() at soreceive+0x59/frame 0xfffffe00a93b28b0 dofileread() at dofileread+0x95/frame 0xfffffe00a93b28f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a93b2930 sys_read() at sys_read+0x86/frame 0xfffffe00a93b2980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a93b2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a93b2ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41499 tid 101266 td 0xfffff8012cfad580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a925e610 mi_switch() at mi_switch+0x178/frame 0xfffffe00a925e640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a925e680 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a925e6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a925e710 _sleep() at _sleep+0x39c/frame 0xfffffe00a925e7b0 sbwait() at sbwait+0x68/frame 0xfffffe00a925e7d0 soreceive_generic() at soreceive_generic+0x285/frame 0xfffffe00a925e890 soreceive() at soreceive+0x59/frame 0xfffffe00a925e8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a925e8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a925e930 sys_read() at sys_read+0x86/frame 0xfffffe00a925e980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a925eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a925eab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80083bbaa, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41498 tid 100511 td 0xfffff807ab8bc000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a78c2560 mi_switch() at mi_switch+0x178/frame 0xfffffe00a78c2590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a78c25d0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a78c2630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a78c2660 _sleep() at _sleep+0x39c/frame 0xfffffe00a78c2700 kern_wait6() at kern_wait6+0x4c4/frame 0xfffffe00a78c2790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a78c2980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a78c2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a78c2ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8007c7b9a, rsp = 0x7fffffffe2f8, rbp = 0x7fffffffe330 --- Tracing command sendfile14 pid 41478 tid 100698 td 0xfffff800568d3580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a953a6d0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a953a700 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a953a740 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a953a7a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a953a7d0 _sleep() at _sleep+0x39c/frame 0xfffffe00a953a870 umtxq_sleep() at umtxq_sleep+0x163/frame 0xfffffe00a953a8d0 do_wait() at do_wait+0x20d/frame 0xfffffe00a953a940 __umtx_op_wait() at __umtx_op_wait+0x4d/frame 0xfffffe00a953a980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a953aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a953aab0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80066230c, rsp = 0x7fffffffe5f8, rbp = 0x7fffffffe680 --- Tracing command sendfile14 pid 41478 tid 100397 td 0xfffff801671af000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a79b7490 mi_switch() at mi_switch+0x178/frame 0xfffffe00a79b74c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a79b7500 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a79b7560 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a79b7590 _sleep() at _sleep+0x39c/frame 0xfffffe00a79b7630 sbwait() at sbwait+0x68/frame 0xfffffe00a79b7650 vn_sendfile() at vn_sendfile+0x4ab/frame 0xfffffe00a79b78f0 sendfile() at sendfile+0x12f/frame 0xfffffe00a79b7980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a79b7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a79b7ab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8006fd8aa, rsp = 0x7fffdfbfbd98, rbp = 0x7fffdfbfbef0 --- Tracing command sendfile14 pid 41478 tid 100555 td 0xfffff808271ed000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9553490 mi_switch() at mi_switch+0x178/frame 0xfffffe00a95534c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9553500 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a9553560 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a9553590 _sleep() at _sleep+0x39c/frame 0xfffffe00a9553630 sbwait() at sbwait+0x68/frame 0xfffffe00a9553650 vn_sendfile() at vn_sendfile+0x4ab/frame 0xfffffe00a95538f0 sendfile() at sendfile+0x12f/frame 0xfffffe00a9553980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9553ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9553ab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8006fd8aa, rsp = 0x7fffdf5f8d98, rbp = 0x7fffdf5f8ef0 --- Tracing command sendfile14 pid 41478 tid 100701 td 0xfffff801e290a580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a92bd490 mi_switch() at mi_switch+0x178/frame 0xfffffe00a92bd4c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a92bd500 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a92bd560 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a92bd590 _sleep() at _sleep+0x39c/frame 0xfffffe00a92bd630 sbwait() at sbwait+0x68/frame 0xfffffe00a92bd650 vn_sendfile() at vn_sendfile+0x4ab/frame 0xfffffe00a92bd8f0 sendfile() at sendfile+0x12f/frame 0xfffffe00a92bd980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a92bdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a92bdab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8006fd8aa, rsp = 0x7fffdedf4d98, rbp = 0x7fffdedf4ef0 --- Tracing command sendfile14 pid 41478 tid 100715 td 0xfffff803662f4000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a96a9490 mi_switch() at mi_switch+0x178/frame 0xfffffe00a96a94c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a96a9500 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a96a9560 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a96a9590 _sleep() at _sleep+0x39c/frame 0xfffffe00a96a9630 sbwait() at sbwait+0x68/frame 0xfffffe00a96a9650 vn_sendfile() at vn_sendfile+0x4ab/frame 0xfffffe00a96a98f0 sendfile() at sendfile+0x12f/frame 0xfffffe00a96a9980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a96a9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a96a9ab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8006fd8aa, rsp = 0x7fffdebf3d98, rbp = 0x7fffdebf3ef0 --- Tracing command sendfile14 pid 41478 tid 100789 td 0xfffff80786507580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a54bd490 mi_switch() at mi_switch+0x178/frame 0xfffffe00a54bd4c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a54bd500 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a54bd560 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a54bd590 _sleep() at _sleep+0x39c/frame 0xfffffe00a54bd630 sbwait() at sbwait+0x68/frame 0xfffffe00a54bd650 vn_sendfile() at vn_sendfile+0x4ab/frame 0xfffffe00a54bd8f0 sendfile() at sendfile+0x12f/frame 0xfffffe00a54bd980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a54bdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a54bdab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8006fd8aa, rsp = 0x7fffde5f0d98, rbp = 0x7fffde5f0ef0 --- Tracing command sendfile14 pid 41478 tid 100810 td 0xfffff803bb885580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a96e0490 mi_switch() at mi_switch+0x178/frame 0xfffffe00a96e04c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a96e0500 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a96e0560 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a96e0590 _sleep() at _sleep+0x39c/frame 0xfffffe00a96e0630 sbwait() at sbwait+0x68/frame 0xfffffe00a96e0650 vn_sendfile() at vn_sendfile+0x4ab/frame 0xfffffe00a96e08f0 sendfile() at sendfile+0x12f/frame 0xfffffe00a96e0980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a96e0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a96e0ab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8006fd8aa, rsp = 0x7fffde3efd98, rbp = 0x7fffde3efef0 --- Tracing command sendfile14 pid 41478 tid 100824 td 0xfffff8066c031000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a92ea490 mi_switch() at mi_switch+0x178/frame 0xfffffe00a92ea4c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a92ea500 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a92ea560 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a92ea590 _sleep() at _sleep+0x39c/frame 0xfffffe00a92ea630 sbwait() at sbwait+0x68/frame 0xfffffe00a92ea650 vn_sendfile() at vn_sendfile+0x4ab/frame 0xfffffe00a92ea8f0 sendfile() at sendfile+0x12f/frame 0xfffffe00a92ea980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a92eaab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a92eaab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8006fd8aa, rsp = 0x7fffde1eed98, rbp = 0x7fffde1eeef0 --- Tracing command sendfile14 pid 41477 tid 100613 td 0xfffff805cdee2000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a97a86d0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a97a8700 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a97a8740 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a97a87a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a97a87d0 _sleep() at _sleep+0x39c/frame 0xfffffe00a97a8870 umtxq_sleep() at umtxq_sleep+0x163/frame 0xfffffe00a97a88d0 do_wait() at do_wait+0x20d/frame 0xfffffe00a97a8940 __umtx_op_wait() at __umtx_op_wait+0x4d/frame 0xfffffe00a97a8980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a97a8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a97a8ab0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80066230c, rsp = 0x7fffffffe5f8, rbp = 0x7fffffffe680 --- Tracing command sendfile14 pid 41477 tid 101430 td 0xfffff801e26aa580 sched_switch() at sched_switch+0x942/frame 0xfffffe00aa890700 mi_switch() at mi_switch+0x178/frame 0xfffffe00aa890730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa890770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00aa8907d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa890810 _sleep() at _sleep+0x33b/frame 0xfffffe00aa8908b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00aa890940 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe00aa890980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00aa890ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa890ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8007c7d1a, rsp = 0x7fffdf5f8e98, rbp = 0x7fffdf5f8ec0 --- Tracing command sendfile14 pid 41477 tid 101450 td 0xfffff801a85e0580 sched_switch() at sched_switch+0x942/frame 0xfffffe00aa895490 mi_switch() at mi_switch+0x178/frame 0xfffffe00aa8954c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa895500 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00aa895560 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa895590 _sleep() at _sleep+0x39c/frame 0xfffffe00aa895630 sbwait() at sbwait+0x68/frame 0xfffffe00aa895650 vn_sendfile() at vn_sendfile+0x4ab/frame 0xfffffe00aa8958f0 sendfile() at sendfile+0x12f/frame 0xfffffe00aa895980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00aa895ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa895ab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8006fd8aa, rsp = 0x7fffdf3f7d98, rbp = 0x7fffdf3f7ef0 --- Tracing command sendfile14 pid 41477 tid 101589 td 0xfffff801e232b000 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071dddf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071dde10 trap() at trap+0x49/frame 0xfffffe00071ddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071ddf20 --- trap 0x13, rip = 0xffffffff80ed1d01, rsp = 0xfffffe00a97675f0, rbp = 0xfffffe00a9767650 --- uma_zalloc_arg() at uma_zalloc_arg+0x41/frame 0xfffffe00a9767650 vn_sendfile() at vn_sendfile+0x1083/frame 0xfffffe00a97678f0 sendfile() at sendfile+0x12f/frame 0xfffffe00a9767980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9767ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9767ab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8006fd8aa, rsp = 0x7fffdf1f6d98, rbp = 0x7fffdf1f6ef0 --- Tracing command sendfile14 pid 41477 tid 101595 td 0xfffff805cdee2580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a976c490 mi_switch() at mi_switch+0x178/frame 0xfffffe00a976c4c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a976c500 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a976c560 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a976c590 _sleep() at _sleep+0x39c/frame 0xfffffe00a976c630 sbwait() at sbwait+0x68/frame 0xfffffe00a976c650 vn_sendfile() at vn_sendfile+0x4ab/frame 0xfffffe00a976c8f0 sendfile() at sendfile+0x12f/frame 0xfffffe00a976c980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a976cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a976cab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8006fd8aa, rsp = 0x7fffdeff5d98, rbp = 0x7fffdeff5ef0 --- Tracing command sendfile14 pid 41477 tid 101596 td 0xfffff805cdee3580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a78d6700 mi_switch() at mi_switch+0x178/frame 0xfffffe00a78d6730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a78d6770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a78d67d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a78d6810 _sleep() at _sleep+0x33b/frame 0xfffffe00a78d68b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00a78d6940 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe00a78d6980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a78d6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a78d6ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8007c7d1a, rsp = 0x7fffdedf4e98, rbp = 0x7fffdedf4ec0 --- Tracing command sendfile14 pid 41477 tid 101610 td 0xfffff80479afa000 sched_switch() at sched_switch+0x942/frame 0xfffffe00aa877490 mi_switch() at mi_switch+0x178/frame 0xfffffe00aa8774c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa877500 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00aa877560 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa877590 _sleep() at _sleep+0x39c/frame 0xfffffe00aa877630 sbwait() at sbwait+0x68/frame 0xfffffe00aa877650 vn_sendfile() at vn_sendfile+0x4ab/frame 0xfffffe00aa8778f0 sendfile() at sendfile+0x12f/frame 0xfffffe00aa877980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00aa877ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa877ab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8006fd8aa, rsp = 0x7fffde9f2d98, rbp = 0x7fffde9f2ef0 --- Tracing command sendfile14 pid 41477 tid 101620 td 0xfffff8067b2f3580 (CPU -1) sched_switch() at sched_switch+0x942/frame 0xfffffe00aa87c490 mi_switch() at mi_switch+0x178/frame 0xfffffe00aa87c4c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa87c500 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00aa87c560 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa87c590 _sleep() at _sleep+0x39c/frame 0xfffffe00aa87c630 sbwait() at sbwait+0x68/frame 0xfffffe00aa87c650 vn_sendfile() at vn_sendfile+0x4ab/frame 0xfffffe00aa87c8f0 sendfile() at sendfile+0x12f/frame 0xfffffe00aa87c980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00aa87cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa87cab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8006fd8aa, rsp = 0x7fffde7f1d98, rbp = 0x7fffde7f1ef0 --- Tracing command sendfile14 pid 41477 tid 101621 td 0xfffff80298668000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a92cc700 mi_switch() at mi_switch+0x178/frame 0xfffffe00a92cc730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a92cc770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a92cc7d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a92cc810 _sleep() at _sleep+0x33b/frame 0xfffffe00a92cc8b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00a92cc940 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe00a92cc980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a92ccab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a92ccab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8007c7d1a, rsp = 0x7fffde5f0e98, rbp = 0x7fffde5f0ec0 --- Tracing command sendfile14 pid 41477 tid 101632 td 0xfffff8025b905000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a92d1700 mi_switch() at mi_switch+0x178/frame 0xfffffe00a92d1730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a92d1770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a92d17d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a92d1810 _sleep() at _sleep+0x33b/frame 0xfffffe00a92d18b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00a92d1940 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe00a92d1980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a92d1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a92d1ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8007c7d1a, rsp = 0x7fffde3efe98, rbp = 0x7fffde3efec0 --- Tracing command sendfile14 pid 41477 tid 101642 td 0xfffff807480a1580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a92d6490 mi_switch() at mi_switch+0x178/frame 0xfffffe00a92d64c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a92d6500 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a92d6560 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a92d6590 _sleep() at _sleep+0x39c/frame 0xfffffe00a92d6630 sbwait() at sbwait+0x68/frame 0xfffffe00a92d6650 vn_sendfile() at vn_sendfile+0x4ab/frame 0xfffffe00a92d68f0 sendfile() at sendfile+0x12f/frame 0xfffffe00a92d6980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a92d6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a92d6ab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8006fd8aa, rsp = 0x7fffde1eed98, rbp = 0x7fffde1eeef0 --- Tracing command sendfile14 pid 41477 tid 101644 td 0xfffff80158b0e000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a96bd700 mi_switch() at mi_switch+0x178/frame 0xfffffe00a96bd730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a96bd770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a96bd7d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a96bd810 _sleep() at _sleep+0x33b/frame 0xfffffe00a96bd8b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00a96bd940 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe00a96bd980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a96bdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a96bdab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8007c7d1a, rsp = 0x7fffddfede98, rbp = 0x7fffddfedec0 --- Tracing command sendfile14 pid 41477 tid 101658 td 0xfffff8011592c580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9744700 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9744730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9744770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a97447d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a9744810 _sleep() at _sleep+0x33b/frame 0xfffffe00a97448b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00a9744940 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe00a9744980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9744ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9744ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8007c7d1a, rsp = 0x7fffdd9eae98, rbp = 0x7fffdd9eaec0 --- Tracing command sendfile14 pid 41477 tid 101663 td 0xfffff805b5f79000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9749700 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9749730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9749770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a97497d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a9749810 _sleep() at _sleep+0x33b/frame 0xfffffe00a97498b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00a9749940 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe00a9749980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9749ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9749ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8007c7d1a, rsp = 0x7fffdd7e9e98, rbp = 0x7fffdd7e9ec0 --- Tracing command sendfile14 pid 41477 tid 101668 td 0xfffff801a8ae8000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a974e700 mi_switch() at mi_switch+0x178/frame 0xfffffe00a974e730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a974e770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a974e7d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a974e810 _sleep() at _sleep+0x33b/frame 0xfffffe00a974e8b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00a974e940 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe00a974e980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a974eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a974eab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8007c7d1a, rsp = 0x7fffdd5e8e98, rbp = 0x7fffdd5e8ec0 --- Tracing command sendfile14 pid 41477 tid 101690 td 0xfffff801a8d2e000 sched_switch() at sched_switch+0x942/frame 0xfffffe00aa836700 mi_switch() at mi_switch+0x178/frame 0xfffffe00aa836730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa836770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00aa8367d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa836810 _sleep() at _sleep+0x33b/frame 0xfffffe00aa8368b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00aa836940 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe00aa836980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00aa836ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa836ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8007c7d1a, rsp = 0x7fffdd1e6e98, rbp = 0x7fffdd1e6ec0 --- Tracing command sendfile14 pid 41477 tid 101695 td 0xfffff80009706580 sched_switch() at sched_switch+0x942/frame 0xfffffe00aa83b700 mi_switch() at mi_switch+0x178/frame 0xfffffe00aa83b730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa83b770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00aa83b7d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa83b810 _sleep() at _sleep+0x33b/frame 0xfffffe00aa83b8b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00aa83b940 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe00aa83b980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00aa83bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa83bab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8007c7d1a, rsp = 0x7fffdcfe5e98, rbp = 0x7fffdcfe5ec0 --- Tracing command sendfile14 pid 41477 tid 101711 td 0xfffff8026885d000 sched_switch() at sched_switch+0x942/frame 0xfffffe00aa840700 mi_switch() at mi_switch+0x178/frame 0xfffffe00aa840730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa840770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00aa8407d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa840810 _sleep() at _sleep+0x33b/frame 0xfffffe00aa8408b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00aa840940 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe00aa840980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00aa840ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa840ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8007c7d1a, rsp = 0x7fffdcde4e98, rbp = 0x7fffdcde4ec0 --- Tracing command sendfile14 pid 41477 tid 101712 td 0xfffff801689e1580 sched_switch() at sched_switch+0x942/frame 0xfffffe00aa8cc700 mi_switch() at mi_switch+0x178/frame 0xfffffe00aa8cc730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa8cc770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00aa8cc7d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa8cc810 _sleep() at _sleep+0x33b/frame 0xfffffe00aa8cc8b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00aa8cc940 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe00aa8cc980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00aa8ccab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa8ccab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8007c7d1a, rsp = 0x7fffdcbe3e98, rbp = 0x7fffdcbe3ec0 --- Tracing command md11 pid 41469 tid 100584 td 0xfffff80469e6e000 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00007ffdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00007ffe10 trap() at trap+0x49/frame 0xfffffe00007fff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00007fff20 --- trap 0x13, rip = 0xffffffff80c024cb, rsp = 0xfffffe00a96ae8c0, rbp = 0xfffffe00a96ae910 --- witness_assert() at witness_assert+0x5b/frame 0xfffffe00a96ae910 vm_page_grab() at vm_page_grab+0x102/frame 0xfffffe00a96ae990 mdstart_swap() at mdstart_swap+0x14d/frame 0xfffffe00a96aea10 md_kthread() at md_kthread+0x1fe/frame 0xfffffe00a96aea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a96aeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a96aeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md10 pid 41460 tid 100432 td 0xfffff801e29db000 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071b9df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071b9e10 trap() at trap+0x49/frame 0xfffffe00071b9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071b9f20 --- trap 0x13, rip = 0xffffffff80b9e494, rsp = 0xfffffe00a93bc700, rbp = 0xfffffe00a93bc700 --- critical_enter() at critical_enter+0x14/frame 0xfffffe00a93bc700 uma_zfree_arg() at uma_zfree_arg+0x185/frame 0xfffffe00a93bc760 free() at free+0xa5/frame 0xfffffe00a93bc7a0 free_newblk() at free_newblk+0x1fc/frame 0xfffffe00a93bc7d0 free_newblk() at free_newblk+0x1fc/frame 0xfffffe00a93bc800 handle_bufwait() at handle_bufwait+0x93/frame 0xfffffe00a93bc850 handle_written_inodeblock() at handle_written_inodeblock+0x479/frame 0xfffffe00a93bc8a0 softdep_disk_write_complete() at softdep_disk_write_complete+0x44a/frame 0xfffffe00a93bc900 bufdone() at bufdone+0x392/frame 0xfffffe00a93bc970 g_io_deliver() at g_io_deliver+0x29c/frame 0xfffffe00a93bc9c0 g_io_deliver() at g_io_deliver+0x29c/frame 0xfffffe00a93bca10 md_kthread() at md_kthread+0x23d/frame 0xfffffe00a93bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a93bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a93bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 41442 tid 101299 td 0xfffff8031e265000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a5486750 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5486780 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a54867c0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a5486820 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5486850 _sleep() at _sleep+0x39c/frame 0xfffffe00a54868f0 kern_sigsuspend() at kern_sigsuspend+0xb4/frame 0xfffffe00a5486950 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe00a5486980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5486ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5486ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8003fec1a, rsp = 0x7fffffffe398, rbp = 0x7fffffffe450 --- Tracing command tee pid 41441 tid 101641 td 0xfffff800096b5000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a97f7f20 mi_switch() at mi_switch+0x178/frame 0xfffffe00a97f7f50 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a97f7f90 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a97f7fc0 _sleep() at _sleep+0x3a9/frame 0xfffffe00a97f8060 bufwait() at bufwait+0x84/frame 0xfffffe00a97f80a0 breadn_flags() at breadn_flags+0x1df/frame 0xfffffe00a97f8110 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00a97f8180 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00a97f8200 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00a97f8250 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00a97f82c0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xdb1/frame 0xfffffe00a97f8460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a97f8500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a97f8610 vn_write() at vn_write+0x26b/frame 0xfffffe00a97f8690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a97f86f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a97f8830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a97f88a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a97f88f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a97f8930 sys_write() at sys_write+0x86/frame 0xfffffe00a97f8980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a97f8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a97f8ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800411b6a, rsp = 0x7fffffffe6d8, rbp = 0x7fffffffe720 --- Tracing command sh pid 41440 tid 100880 td 0xfffff801e26a8580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9613560 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9613590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a96135d0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a9613630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a9613660 _sleep() at _sleep+0x39c/frame 0xfffffe00a9613700 kern_wait6() at kern_wait6+0x4c4/frame 0xfffffe00a9613790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a9613980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9613ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9613ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003feb9a, rsp = 0x7fffffffe298, rbp = 0x7fffffffe350 --- Tracing command sh pid 819 tid 100205 td 0xfffff800097d4000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a5549560 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5549590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a55495d0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a5549630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5549660 _sleep() at _sleep+0x39c/frame 0xfffffe00a5549700 kern_wait6() at kern_wait6+0x4c4/frame 0xfffffe00a5549790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a5549980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5549ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5549ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003feb9a, rsp = 0x7fffffffe5b8, rbp = 0x7fffffffe670 --- Tracing command bash pid 817 tid 100181 td 0xfffff80009486580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a54d1580 mi_switch() at mi_switch+0x178/frame 0xfffffe00a54d15b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a54d15f0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a54d1650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a54d1680 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a54d16e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a54d1720 kern_select() at kern_select+0x8c0/frame 0xfffffe00a54d1900 sys_pselect() at sys_pselect+0x127/frame 0xfffffe00a54d1980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a54d1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a54d1ab0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x800afacba, rsp = 0x7fffffffd638, rbp = 0x7fffffffd700 --- Tracing command csh pid 815 tid 100204 td 0xfffff80009c58000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a78a8c00 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a78a8c10 trap() at trap+0x5c/frame 0xfffffe00a78a8d20 calltrap() at calltrap+0x8/frame 0xfffffe00a78a8d20 --- trap 0xc, rip = 0xffffffff8104d236, rsp = 0xfffffe00a78a8df0, rbp = 0xfffffe00a78a8e00 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a78a8e00 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a78a8ea0 db_command() at db_command+0x279/frame 0xfffffe00a78a8f70 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a78a9010 db_command() at db_command+0x279/frame 0xfffffe00a78a90e0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a78a90f0 db_trap() at db_trap+0xef/frame 0xfffffe00a78a9180 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a78a91f0 trap() at trap+0x815/frame 0xfffffe00a78a9300 calltrap() at calltrap+0x8/frame 0xfffffe00a78a9300 --- trap 0x3, rip = 0xffffffff80bde7cb, rsp = 0xfffffe00a78a93d0, rbp = 0xfffffe00a78a93e0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a78a93e0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a78a9440 doadump() at doadump/frame 0xfffffe00a78a94c0 epoch_wait_preempt() at epoch_wait_preempt+0x2b1/frame 0xfffffe00a78a9520 pmap_remove_all() at pmap_remove_all+0x81b/frame 0xfffffe00a78a95b0 vm_page_try_to_free() at vm_page_try_to_free+0x84/frame 0xfffffe00a78a95d0 sendfile_free_mext() at sendfile_free_mext+0x10f/frame 0xfffffe00a78a9600 mb_free_ext() at mb_free_ext+0x9d/frame 0xfffffe00a78a9630 m_freem() at m_freem+0x48/frame 0xfffffe00a78a9650 sbflush_locked() at sbflush_locked+0x69/frame 0xfffffe00a78a9670 sbflush() at sbflush+0x2c/frame 0xfffffe00a78a9690 tcp_disconnect() at tcp_disconnect+0x6c/frame 0xfffffe00a78a96c0 tcp_usr_disconnect() at tcp_usr_disconnect+0x71/frame 0xfffffe00a78a96f0 soclose() at soclose+0xa5/frame 0xfffffe00a78a9760 closef() at closef+0x1f5/frame 0xfffffe00a78a97f0 fdescfree_fds() at fdescfree_fds+0x90/frame 0xfffffe00a78a9840 fdescfree() at fdescfree+0x480/frame 0xfffffe00a78a9900 exit1() at exit1+0x500/frame 0xfffffe00a78a9970 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00a78a9980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a78a9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a78a9ab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8007c7a8a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe200 --- Tracing command su pid 814 tid 100167 td 0xfffff8000942a580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a78a8c00 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a78a8c10 trap() at trap+0x5c/frame 0xfffffe00a78a8d20 calltrap() at calltrap+0x8/frame 0xfffffe00a78a8d20 --- trap 0xc, rip = 0xffffffff8104d236, rsp = 0xfffffe00a78a8df0, rbp = 0xfffffe00a78a8e00 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a78a8e00 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a78a8ea0 db_command() at db_command+0x279/frame 0xfffffe00a78a8f70 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a78a9010 db_command() at db_command+0x279/frame 0xfffffe00a78a90e0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a78a90f0 db_trap() at db_trap+0xef/frame 0xfffffe00a78a9180 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a78a91f0 trap() at trap+0x815/frame 0xfffffe00a78a9300 calltrap() at calltrap+0x8/frame 0xfffffe00a78a9300 --- trap 0x3, rip = 0xffffffff80bde7cb, rsp = 0xfffffe00a78a93d0, rbp = 0xfffffe00a78a93e0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a78a93e0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a78a9440 doadump() at doadump/frame 0xfffffe00a78a94c0 epoch_wait_preempt() at epoch_wait_preempt+0x2b1/frame 0xfffffe00a78a9520 pmap_remove_all() at pmap_remove_all+0x81b/frame 0xfffffe00a78a95b0 vm_page_try_to_free() at vm_page_try_to_free+0x84/frame 0xfffffe00a78a95d0 sendfile_free_mext() at sendfile_free_mext+0x10f/frame 0xfffffe00a78a9600 mb_free_ext() at mb_free_ext+0x9d/frame 0xfffffe00a78a9630 m_freem() at m_freem+0x48/frame 0xfffffe00a78a9650 sbflush_locked() at sbflush_locked+0x69/frame 0xfffffe00a78a9670 sbflush() at sbflush+0x2c/frame 0xfffffe00a78a9690 tcp_disconnect() at tcp_disconnect+0x6c/frame 0xfffffe00a78a96c0 tcp_usr_disconnect() at tcp_usr_disconnect+0x71/frame 0xfffffe00a78a96f0 soclose() at soclose+0xa5/frame 0xfffffe00a78a9760 closef() at closef+0x1f5/frame 0xfffffe00a78a97f0 fdescfree_fds() at fdescfree_fds+0x90/frame 0xfffffe00a78a9840 fdescfree() at fdescfree+0x480/frame 0xfffffe00a78a9900 exit1() at exit1+0x500/frame 0xfffffe00a78a9970 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00a78a9980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a78a9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a78a9ab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8007c7a8a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe200 --- Tracing command bash pid 813 tid 100173 td 0xfffff80009c58580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a78a8c00 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a78a8c10 trap() at trap+0x5c/frame 0xfffffe00a78a8d20 calltrap() at calltrap+0x8/frame 0xfffffe00a78a8d20 --- trap 0xc, rip = 0xffffffff8104d236, rsp = 0xfffffe00a78a8df0, rbp = 0xfffffe00a78a8e00 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a78a8e00 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a78a8ea0 db_command() at db_command+0x279/frame 0xfffffe00a78a8f70 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a78a9010 db_command() at db_command+0x279/frame 0xfffffe00a78a90e0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a78a90f0 db_trap() at db_trap+0xef/frame 0xfffffe00a78a9180 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a78a91f0 trap() at trap+0x815/frame 0xfffffe00a78a9300 calltrap() at calltrap+0x8/frame 0xfffffe00a78a9300 --- trap 0x3, rip = 0xffffffff80bde7cb, rsp = 0xfffffe00a78a93d0, rbp = 0xfffffe00a78a93e0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a78a93e0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a78a9440 doadump() at doadump/frame 0xfffffe00a78a94c0 epoch_wait_preempt() at epoch_wait_preempt+0x2b1/frame 0xfffffe00a78a9520 pmap_remove_all() at pmap_remove_all+0x81b/frame 0xfffffe00a78a95b0 vm_page_try_to_free() at vm_page_try_to_free+0x84/frame 0xfffffe00a78a95d0 sendfile_free_mext() at sendfile_free_mext+0x10f/frame 0xfffffe00a78a9600 mb_free_ext() at mb_free_ext+0x9d/frame 0xfffffe00a78a9630 m_freem() at m_freem+0x48/frame 0xfffffe00a78a9650 sbflush_locked() at sbflush_locked+0x69/frame 0xfffffe00a78a9670 sbflush() at sbflush+0x2c/frame 0xfffffe00a78a9690 tcp_disconnect() at tcp_disconnect+0x6c/frame 0xfffffe00a78a96c0 tcp_usr_disconnect() at tcp_usr_disconnect+0x71/frame 0xfffffe00a78a96f0 soclose() at soclose+0xa5/frame 0xfffffe00a78a9760 closef() at closef+0x1f5/frame 0xfffffe00a78a97f0 fdescfree_fds() at fdescfree_fds+0x90/frame 0xfffffe00a78a9840 fdescfree() at fdescfree+0x480/frame 0xfffffe00a78a9900 exit1() at exit1+0x500/frame 0xfffffe00a78a9970 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00a78a9980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a78a9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a78a9ab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8007c7a8a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe200 --- Tracing command sshd pid 812 tid 100182 td 0xfffff80009486000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a54d6400 mi_switch() at mi_switch+0x178/frame 0xfffffe00a54d6430 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a54d6470 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a54d64a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00a54d6540 bufwait() at bufwait+0x84/frame 0xfffffe00a54d6580 breadn_flags() at breadn_flags+0x1df/frame 0xfffffe00a54d65f0 vfs_bio_getpages() at vfs_bio_getpages+0x2d2/frame 0xfffffe00a54d66d0 ffs_getpages() at ffs_getpages+0x78/frame 0xfffffe00a54d66f0 VOP_GETPAGES_APV() at VOP_GETPAGES_APV+0xfd/frame 0xfffffe00a54d6720 vnode_pager_getpages() at vnode_pager_getpages+0x6d/frame 0xfffffe00a54d6790 vm_pager_get_pages() at vm_pager_get_pages+0x4d/frame 0xfffffe00a54d67d0 vm_fault_hold() at vm_fault_hold+0xf12/frame 0xfffffe00a54d6910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a54d6950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a54d69a0 trap() at trap+0x45a/frame 0xfffffe00a54d6ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a54d6ab0 --- trap 0xc, rip = 0x241c90, rsp = 0x7fffffffa5a8, rbp = 0x7fffffffa5f0 --- Tracing command sshd pid 809 tid 100160 td 0xfffff80009651000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a546d640 mi_switch() at mi_switch+0x178/frame 0xfffffe00a546d670 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a546d6b0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a546d710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a546d740 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a546d7a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a546d7e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe00a546d960 sys_poll() at sys_poll+0x50/frame 0xfffffe00a546d980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a546dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a546dab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8008134ea, rsp = 0x7fffffffe5c8, rbp = 0x7fffffffe600 --- Tracing command csh pid 806 tid 100164 td 0xfffff80009488000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a547c620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a547c650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a547c690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a547c6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a547c720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a547c780 tty_wait() at tty_wait+0x42/frame 0xfffffe00a547c7b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe00a547c820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a547c850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe00a547c8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a547c8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a547c930 sys_read() at sys_read+0x86/frame 0xfffffe00a547c980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a547cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a547cab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004f5baa, rsp = 0x7fffffffe1f8, rbp = 0x7fffffffe220 --- Tracing command dhclient pid 801 tid 100179 td 0xfffff8000976e000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a54c7620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a54c7650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a54c7690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a54c76f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a54c7730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe00a54c77a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00a54c77e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe00a54c7960 sys_poll() at sys_poll+0x50/frame 0xfffffe00a54c7980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a54c7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a54c7ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003e74ea, rsp = 0x7fffffffec48, rbp = 0x7fffffffec80 --- Tracing command login pid 756 tid 100198 td 0xfffff80115606580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a78a8c00 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a78a8c10 trap() at trap+0x5c/frame 0xfffffe00a78a8d20 calltrap() at calltrap+0x8/frame 0xfffffe00a78a8d20 --- trap 0xc, rip = 0xffffffff8104d236, rsp = 0xfffffe00a78a8df0, rbp = 0xfffffe00a78a8e00 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a78a8e00 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a78a8ea0 db_command() at db_command+0x279/frame 0xfffffe00a78a8f70 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a78a9010 db_command() at db_command+0x279/frame 0xfffffe00a78a90e0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a78a90f0 db_trap() at db_trap+0xef/frame 0xfffffe00a78a9180 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a78a91f0 trap() at trap+0x815/frame 0xfffffe00a78a9300 calltrap() at calltrap+0x8/frame 0xfffffe00a78a9300 --- trap 0x3, rip = 0xffffffff80bde7cb, rsp = 0xfffffe00a78a93d0, rbp = 0xfffffe00a78a93e0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a78a93e0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a78a9440 doadump() at doadump/frame 0xfffffe00a78a94c0 epoch_wait_preempt() at epoch_wait_preempt+0x2b1/frame 0xfffffe00a78a9520 pmap_remove_all() at pmap_remove_all+0x81b/frame 0xfffffe00a78a95b0 vm_page_try_to_free() at vm_page_try_to_free+0x84/frame 0xfffffe00a78a95d0 sendfile_free_mext() at sendfile_free_mext+0x10f/frame 0xfffffe00a78a9600 mb_free_ext() at mb_free_ext+0x9d/frame 0xfffffe00a78a9630 m_freem() at m_freem+0x48/frame 0xfffffe00a78a9650 sbflush_locked() at sbflush_locked+0x69/frame 0xfffffe00a78a9670 sbflush() at sbflush+0x2c/frame 0xfffffe00a78a9690 tcp_disconnect() at tcp_disconnect+0x6c/frame 0xfffffe00a78a96c0 tcp_usr_disconnect() at tcp_usr_disconnect+0x71/frame 0xfffffe00a78a96f0 soclose() at soclose+0xa5/frame 0xfffffe00a78a9760 closef() at closef+0x1f5/frame 0xfffffe00a78a97f0 fdescfree_fds() at fdescfree_fds+0x90/frame 0xfffffe00a78a9840 fdescfree() at fdescfree+0x480/frame 0xfffffe00a78a9900 exit1() at exit1+0x500/frame 0xfffffe00a78a9970 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00a78a9980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a78a9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a78a9ab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8007c7a8a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe200 --- Tracing command getty pid 755 tid 100197 td 0xfffff80115607000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a5521620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5521650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5521690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a55216f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5521720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a5521780 tty_wait() at tty_wait+0x42/frame 0xfffffe00a55217b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe00a5521820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a5521850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe00a55218b0 dofileread() at dofileread+0x95/frame 0xfffffe00a55218f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a5521930 sys_read() at sys_read+0x86/frame 0xfffffe00a5521980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5521ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5521ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 754 tid 100196 td 0xfffff80115607580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a551c620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a551c650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a551c690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a551c6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a551c720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a551c780 tty_wait() at tty_wait+0x42/frame 0xfffffe00a551c7b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe00a551c820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a551c850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe00a551c8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a551c8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a551c930 sys_read() at sys_read+0x86/frame 0xfffffe00a551c980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a551cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a551cab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 753 tid 100195 td 0xfffff80115684000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a5517620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5517650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5517690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a55176f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5517720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a5517780 tty_wait() at tty_wait+0x42/frame 0xfffffe00a55177b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe00a5517820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a5517850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe00a55178b0 dofileread() at dofileread+0x95/frame 0xfffffe00a55178f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a5517930 sys_read() at sys_read+0x86/frame 0xfffffe00a5517980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5517ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5517ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 752 tid 100194 td 0xfffff80115684580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a5512620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5512650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5512690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a55126f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5512720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a5512780 tty_wait() at tty_wait+0x42/frame 0xfffffe00a55127b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe00a5512820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a5512850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe00a55128b0 dofileread() at dofileread+0x95/frame 0xfffffe00a55128f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a5512930 sys_read() at sys_read+0x86/frame 0xfffffe00a5512980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5512ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5512ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 751 tid 100193 td 0xfffff80115685000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a550d620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a550d650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a550d690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a550d6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a550d720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a550d780 tty_wait() at tty_wait+0x42/frame 0xfffffe00a550d7b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe00a550d820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a550d850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe00a550d8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a550d8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a550d930 sys_read() at sys_read+0x86/frame 0xfffffe00a550d980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a550dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a550dab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 750 tid 100192 td 0xfffff800096b6580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a5508620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5508650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5508690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a55086f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5508720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a5508780 tty_wait() at tty_wait+0x42/frame 0xfffffe00a55087b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe00a5508820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a5508850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe00a55088b0 dofileread() at dofileread+0x95/frame 0xfffffe00a55088f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a5508930 sys_read() at sys_read+0x86/frame 0xfffffe00a5508980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5508ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5508ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 749 tid 100191 td 0xfffff800096f9000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a5503620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5503650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5503690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a55036f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5503720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a5503780 tty_wait() at tty_wait+0x42/frame 0xfffffe00a55037b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe00a5503820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a5503850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe00a55038b0 dofileread() at dofileread+0x95/frame 0xfffffe00a55038f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a5503930 sys_read() at sys_read+0x86/frame 0xfffffe00a5503980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5503ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5503ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 748 tid 100190 td 0xfffff800096f9580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a54fe620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a54fe650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a54fe690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a54fe6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a54fe720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a54fe780 tty_wait() at tty_wait+0x42/frame 0xfffffe00a54fe7b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe00a54fe820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a54fe850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe00a54fe8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a54fe8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a54fe930 sys_read() at sys_read+0x86/frame 0xfffffe00a54fe980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a54feab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a54feab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 747 tid 100141 td 0xfffff8000942b580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a540e620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a540e650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a540e690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a540e6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a540e720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a540e780 tty_wait() at tty_wait+0x42/frame 0xfffffe00a540e7b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe00a540e820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a540e850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe00a540e8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a540e8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a540e930 sys_read() at sys_read+0x86/frame 0xfffffe00a540e980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a540eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a540eab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command cron pid 711 tid 100185 td 0xfffff80009705580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a54e5700 mi_switch() at mi_switch+0x178/frame 0xfffffe00a54e5730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a54e5770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a54e57d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a54e5810 _sleep() at _sleep+0x33b/frame 0xfffffe00a54e58b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00a54e5940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00a54e5980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a54e5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a54e5ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003ccd1a, rsp = 0x7fffffffeae8, rbp = 0x7fffffffece0 --- Tracing command sshd pid 707 tid 100186 td 0xfffff80009705000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a54ea5c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a54ea5f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a54ea630 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a54ea690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a54ea6c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a54ea720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a54ea760 kern_select() at kern_select+0x8c0/frame 0xfffffe00a54ea940 sys_select() at sys_select+0x56/frame 0xfffffe00a54ea980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a54eaab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a54eaab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800874b8a, rsp = 0x7fffffffe698, rbp = 0x7fffffffe6d0 --- Tracing command rpc.lockd pid 640 tid 100146 td 0xfffff800090a2000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a54274d0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5427500 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5427540 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a54275a0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a54275e0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe00a5427650 svc_run_internal() at svc_run_internal+0x39e/frame 0xfffffe00a5427790 svc_run() at svc_run+0x1fe/frame 0xfffffe00a54277f0 sys_nlm_syscall() at sys_nlm_syscall+0x7af/frame 0xfffffe00a5427980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5427ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5427ab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002ee56a, rsp = 0x7fffffffec28, rbp = 0x7fffffffece0 --- Tracing command rpc.statd pid 637 tid 100148 td 0xfffff80009488580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a54315a0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a54315d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5431610 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a5431670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a54316b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe00a5431720 seltdwait() at seltdwait+0x6b/frame 0xfffffe00a5431760 kern_select() at kern_select+0x8c0/frame 0xfffffe00a5431940 sys_select() at sys_select+0x56/frame 0xfffffe00a5431980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5431ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5431ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800421b8a, rsp = 0x7fffffffeab8, rbp = 0x7fffffffec00 --- Tracing command dhclient pid 598 tid 100161 td 0xfffff80009707000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a5472640 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5472670 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a54726b0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a5472710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a5472740 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a54727a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a54727e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe00a5472960 sys_poll() at sys_poll+0x50/frame 0xfffffe00a5472980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5472ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5472ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003e74ea, rsp = 0x7fffffffec58, rbp = 0x7fffffffec80 --- Tracing command dhclient pid 595 tid 100144 td 0xfffff80009651580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a541d5c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a541d5f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a541d630 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a541d690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a541d6c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a541d720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a541d760 kern_select() at kern_select+0x8c0/frame 0xfffffe00a541d940 sys_select() at sys_select+0x56/frame 0xfffffe00a541d980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a541dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a541dab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800448b8a, rsp = 0x7fffffffea08, rbp = 0x7fffffffeac0 --- Tracing command casperd pid 590 tid 100176 td 0xfffff80007f8a000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a54b85c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a54b85f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a54b8630 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a54b8690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a54b86c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a54b8720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a54b8760 kern_select() at kern_select+0x8c0/frame 0xfffffe00a54b8940 sys_select() at sys_select+0x56/frame 0xfffffe00a54b8980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a54b8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a54b8ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800851b8a, rsp = 0x7fffffffe7f8, rbp = 0x7fffffffece0 --- Tracing command casperd pid 589 tid 100157 td 0xfffff80007f96000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a545e5c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a545e5f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a545e630 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a545e690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a545e6c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a545e720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a545e760 kern_select() at kern_select+0x8c0/frame 0xfffffe00a545e940 sys_select() at sys_select+0x56/frame 0xfffffe00a545e980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a545eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a545eab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800851b8a, rsp = 0x7fffffffe658, rbp = 0x7fffffffe720 --- Tracing command watchdogd pid 549 tid 100158 td 0xfffff80007f8a580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a5463700 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5463730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5463770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a54637d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a5463810 _sleep() at _sleep+0x33b/frame 0xfffffe00a54638b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00a5463940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00a5463980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5463ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5463ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003b5d1a, rsp = 0x7fffffffeab8, rbp = 0x7fffffffeb00 --- Tracing command rpcbind pid 538 tid 100149 td 0xfffff800096b6000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a5436620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5436650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5436690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a54366f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a5436730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe00a54367a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00a54367e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe00a5436960 sys_poll() at sys_poll+0x50/frame 0xfffffe00a5436980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5436ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5436ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003c54ea, rsp = 0x7fffffffca58, rbp = 0x7fffffffec70 --- Tracing command syslogd pid 533 tid 100145 td 0xfffff8000511f580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a54225c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a54225f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5422630 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a5422690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a54226c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a5422720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a5422760 kern_select() at kern_select+0x8c0/frame 0xfffffe00a5422940 sys_select() at sys_select+0x56/frame 0xfffffe00a5422980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a5422ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a5422ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800432b8a, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffece0 --- Tracing command devd pid 458 tid 100154 td 0xfffff8000942b000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a544f5a0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a544f5d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a544f610 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a544f670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a544f6b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe00a544f720 seltdwait() at seltdwait+0x6b/frame 0xfffffe00a544f760 kern_select() at kern_select+0x8c0/frame 0xfffffe00a544f940 sys_select() at sys_select+0x56/frame 0xfffffe00a544f980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a544fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a544fab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f5caa, rsp = 0x7fffffffcb58, rbp = 0x7fffffffed00 --- Tracing command syncer pid 33 tid 100133 td 0xfffff800090a2580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005e68c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005e68f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e6930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005e6970 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x1f1/frame 0xfffffe00005e69e0 sched_sync() at sched_sync+0x609/frame 0xfffffe00005e6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 32 tid 100132 td 0xfffff800090a4000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005e1880 mi_switch() at mi_switch+0x178/frame 0xfffffe00005e18b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e18f0 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005e1930 _sleep() at _sleep+0x34d/frame 0xfffffe00005e19d0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe00005e1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100130 td 0xfffff800090a4580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005d78d0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005d7900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d7940 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005d7980 _sleep() at _sleep+0x34d/frame 0xfffffe00005d7a20 buf_daemon() at buf_daemon+0xd8/frame 0xfffffe00005d7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100134 td 0xfffff80009396000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005eb8c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005eb8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005eb930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005eb970 _sleep() at _sleep+0x34d/frame 0xfffffe00005eba10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00005eba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005ebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005ebab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100135 td 0xfffff80009395580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005f08c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005f08f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f0930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005f0970 _sleep() at _sleep+0x34d/frame 0xfffffe00005f0a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00005f0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100136 td 0xfffff80009395000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005f58c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005f58f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f5930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005f5970 _sleep() at _sleep+0x34d/frame 0xfffffe00005f5a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00005f5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100137 td 0xfffff80009394580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005fa8c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005fa8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005fa930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005fa970 _sleep() at _sleep+0x34d/frame 0xfffffe00005faa10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00005faa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005faab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005faab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100138 td 0xfffff80009394000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005ff8c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005ff8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ff930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005ff970 _sleep() at _sleep+0x34d/frame 0xfffffe00005ffa10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00005ffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005ffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005ffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100139 td 0xfffff80009393580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a54048c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a54048f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5404930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00a5404970 _sleep() at _sleep+0x34d/frame 0xfffffe00a5404a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a5404a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a5404ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5404ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100140 td 0xfffff80009393000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a54098c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a54098f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5409930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00a5409970 _sleep() at _sleep+0x34d/frame 0xfffffe00a5409a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a5409a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a5409ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5409ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100152 td 0xfffff8000511f000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a54458f0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5445920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5445960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00a54459a0 _sleep() at _sleep+0x34d/frame 0xfffffe00a5445a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00a5445a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a5445ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5445ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100162 td 0xfffff80009487580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a54688f0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a5468920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a5468960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00a54689a0 _sleep() at _sleep+0x34d/frame 0xfffffe00a5468a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00a5468a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a5468ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5468ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100155 td 0xfffff801a81ce000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a543b8f0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a543b920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a543b960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00a543b9a0 _sleep() at _sleep+0x34d/frame 0xfffffe00a543ba40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00a543ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a543bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a543bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100222 td 0xfffff801a8cc8000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a79cb8f0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a79cb920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a79cb960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00a79cb9a0 _sleep() at _sleep+0x34d/frame 0xfffffe00a79cba40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00a79cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a79cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a79cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 30 tid 100128 td 0xfffff800090a6000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005cd8b0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005cd8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005cd920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005cd950 _sleep() at _sleep+0x3a9/frame 0xfffffe00005cd9f0 vm_daemon() at vm_daemon+0x85/frame 0xfffffe00005cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005cdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 29 tid 100127 td 0xfffff800090a6580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005c8520 mi_switch() at mi_switch+0x178/frame 0xfffffe00005c8550 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c8590 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005c85d0 _sleep() at _sleep+0x34d/frame 0xfffffe00005c8670 vm_pageout_worker() at vm_pageout_worker+0x26e/frame 0xfffffe00005c8a50 vm_pageout() at vm_pageout+0x133/frame 0xfffffe00005c8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 29 tid 100129 td 0xfffff80005120580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005d26b0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005d26e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d2720 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d2750 _sleep() at _sleep+0x3a9/frame 0xfffffe00005d27f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xe59/frame 0xfffffe00005d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 29 tid 100131 td 0xfffff80005120000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005dc8f0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005dc920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005dc960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005dc9a0 _sleep() at _sleep+0x34d/frame 0xfffffe00005dca40 uma_reclaim_worker() at uma_reclaim_worker+0xda/frame 0xfffffe00005dca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005dcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005dcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 28 tid 100126 td 0xfffff80007f96580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005c38b0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005c38e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c3920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c3950 _sleep() at _sleep+0x3a9/frame 0xfffffe00005c39f0 enc_daemon() at enc_daemon+0x1df/frame 0xfffffe00005c3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 27 tid 100125 td 0xfffff80007f97000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005be8b0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005be8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005be920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005be950 _sleep() at _sleep+0x3a9/frame 0xfffffe00005be9f0 enc_daemon() at enc_daemon+0x1df/frame 0xfffffe00005bea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005beab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005beab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 26 tid 100122 td 0xfffff80003737580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005af8c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005af8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005af930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005af970 _sleep() at _sleep+0x34d/frame 0xfffffe00005afa10 random_kthread() at random_kthread+0x57/frame 0xfffffe00005afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 25 tid 100118 td 0xfffff80003743580 sched_switch() at sched_switch+0x942/frame 0xfffffe000059b910 mi_switch() at mi_switch+0x178/frame 0xfffffe000059b940 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000059b980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000059b9b0 _sleep() at _sleep+0x3a9/frame 0xfffffe000059ba50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe000059ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000059bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000059bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 24 tid 100117 td 0xfffff80007f97580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005958e0 mi_switch() at mi_switch+0x178/frame 0xfffffe0000595910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000595950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0000595990 _sleep() at _sleep+0x34d/frame 0xfffffe0000595a30 soaio_kproc_loop() at soaio_kproc_loop+0x196/frame 0xfffffe0000595a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000595ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000595ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 23 tid 100116 td 0xfffff80007f98000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005908e0 mi_switch() at mi_switch+0x178/frame 0xfffffe0000590910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000590950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0000590990 _sleep() at _sleep+0x34d/frame 0xfffffe0000590a30 soaio_kproc_loop() at soaio_kproc_loop+0x196/frame 0xfffffe0000590a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000590ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000590ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 22 tid 100115 td 0xfffff80007f98580 sched_switch() at sched_switch+0x942/frame 0xfffffe000058b8e0 mi_switch() at mi_switch+0x178/frame 0xfffffe000058b910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000058b950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe000058b990 _sleep() at _sleep+0x34d/frame 0xfffffe000058ba30 soaio_kproc_loop() at soaio_kproc_loop+0x196/frame 0xfffffe000058ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 21 tid 100114 td 0xfffff80007f99000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005868e0 mi_switch() at mi_switch+0x178/frame 0xfffffe0000586910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000586950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0000586990 _sleep() at _sleep+0x34d/frame 0xfffffe0000586a30 soaio_kproc_loop() at soaio_kproc_loop+0x196/frame 0xfffffe0000586a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000586ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000586ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100095 td 0xfffff80003d8e000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000527920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000527950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000527990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005279c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000527a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000527a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000527ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000527ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100096 td 0xfffff80003d8d580 sched_switch() at sched_switch+0x942/frame 0xfffffe000052c920 mi_switch() at mi_switch+0x178/frame 0xfffffe000052c950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000052c990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000052c9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe000052ca30 usb_process() at usb_process+0x12b/frame 0xfffffe000052ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000052cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000052cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100097 td 0xfffff80003d8d000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000531920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000531950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000531990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005319c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000531a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000531a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000531ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000531ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100098 td 0xfffff80003d8c580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000536920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000536950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000536990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005369c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000536a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000536a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000536ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000536ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100099 td 0xfffff80003d8c000 sched_switch() at sched_switch+0x942/frame 0xfffffe000053b920 mi_switch() at mi_switch+0x178/frame 0xfffffe000053b950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000053b990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000053b9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe000053ba30 usb_process() at usb_process+0x12b/frame 0xfffffe000053ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000053bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000053bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100101 td 0xfffff80003d84000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000545920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000545950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000545990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005459c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000545a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000545a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000545ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000545ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100102 td 0xfffff80005122580 sched_switch() at sched_switch+0x942/frame 0xfffffe000054a920 mi_switch() at mi_switch+0x178/frame 0xfffffe000054a950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000054a990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000054a9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe000054aa30 usb_process() at usb_process+0x12b/frame 0xfffffe000054aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000054aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000054aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100103 td 0xfffff80005122000 sched_switch() at sched_switch+0x942/frame 0xfffffe000054f920 mi_switch() at mi_switch+0x178/frame 0xfffffe000054f950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000054f990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000054f9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe000054fa30 usb_process() at usb_process+0x12b/frame 0xfffffe000054fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000054fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000054fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100104 td 0xfffff80005121580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000554920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000554950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000554990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005549c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000554a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000554a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000554ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000554ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100105 td 0xfffff80005121000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000559920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000559950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000559990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005599c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000559a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000559a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000559ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000559ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100106 td 0xfffff800039b2000 sched_switch() at sched_switch+0x942/frame 0xfffffe000055e920 mi_switch() at mi_switch+0x178/frame 0xfffffe000055e950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000055e990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000055e9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe000055ea30 usb_process() at usb_process+0x12b/frame 0xfffffe000055ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000055eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000055eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100107 td 0xfffff800039b1580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000563920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000563950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000563990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005639c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000563a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000563a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000563ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000563ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100108 td 0xfffff800039b1000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000568920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000568950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000568990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005689c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000568a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000568a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000568ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000568ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100109 td 0xfffff800039b0580 sched_switch() at sched_switch+0x942/frame 0xfffffe000056d920 mi_switch() at mi_switch+0x178/frame 0xfffffe000056d950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000056d990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000056d9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe000056da30 usb_process() at usb_process+0x12b/frame 0xfffffe000056da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000056dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000056dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100110 td 0xfffff800039b0000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000572920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000572950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000572990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005729c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000572a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000572a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000572ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000572ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 19 tid 100090 td 0xfffff80003816580 sched_switch() at sched_switch+0x942/frame 0xfffffe000050e8e0 mi_switch() at mi_switch+0x178/frame 0xfffffe000050e910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000050e950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000050e980 _sleep() at _sleep+0x3a9/frame 0xfffffe000050ea20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe000050ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000050eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000050eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 19 tid 100091 td 0xfffff80003816000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005138e0 mi_switch() at mi_switch+0x178/frame 0xfffffe0000513910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000513950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000513980 _sleep() at _sleep+0x3a9/frame 0xfffffe0000513a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0000513a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000513ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000513ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 19 tid 100092 td 0xfffff800039b2580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005188e0 mi_switch() at mi_switch+0x178/frame 0xfffffe0000518910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000518950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000518980 _sleep() at _sleep+0x3a9/frame 0xfffffe0000518a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0000518a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000518ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000518ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 19 tid 100124 td 0xfffff800090a7000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005b98d0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005b9900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005b9940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b9970 _sleep() at _sleep+0x3a9/frame 0xfffffe00005b9a10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe00005b9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 18 tid 100089 td 0xfffff80003817000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005098c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005098f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000509930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000509960 _sleep() at _sleep+0x3a9/frame 0xfffffe0000509a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000509a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000509ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000509ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 17 tid 100088 td 0xfffff80003817580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005048c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005048f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000504930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000504960 _sleep() at _sleep+0x3a9/frame 0xfffffe0000504a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000504a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000504ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000504ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 16 tid 100087 td 0xfffff80003818000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004ff8c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00004ff8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004ff930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004ff960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004ffa00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004ffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004ffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004ffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 15 tid 100086 td 0xfffff80003818580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004fa8c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00004fa8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004fa930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004fa960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004faa00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004faa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004faab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004faab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 14 tid 100085 td 0xfffff80003819000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004f58c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00004f58f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004f5930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004f5960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004f5a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004f5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004f5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100084 td 0xfffff80003819580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004f08c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00004f08f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004f0930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004f0960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004f0a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004f0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004f0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004f0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100083 td 0xfffff8000381a000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004eb8c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00004eb8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004eb930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004eb960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004eba00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004eba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004ebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004ebab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100082 td 0xfffff80003807580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004e68c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00004e68f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004e6930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e6960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004e6a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004e6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100081 td 0xfffff80003808000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004e18c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00004e18f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004e1930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e1960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004e1a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004e1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100080 td 0xfffff80003808580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004dc8c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00004dc8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004dc930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004dc960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004dca00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004dca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004dcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004dcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100079 td 0xfffff80003809000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004d78c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00004d78f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004d7930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d7960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004d7a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004d7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100078 td 0xfffff80003809580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004d28c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00004d28f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004d2930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d2960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004d2a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100077 td 0xfffff8000380a000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004cd8f0 mi_switch() at mi_switch+0x178/frame 0xfffffe00004cd920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004cd960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004cd990 _sleep() at _sleep+0x3a9/frame 0xfffffe00004cda30 crypto_proc() at crypto_proc+0x2d4/frame 0xfffffe00004cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004cdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff80003777580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004828f0 mi_switch() at mi_switch+0x178/frame 0xfffffe0000482920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000482960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000482990 _sleep() at _sleep+0x3a9/frame 0xfffffe0000482a30 g_run_events() at g_run_events+0x4f/frame 0xfffffe0000482a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000482ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000482ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff80003777000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004878f0 mi_switch() at mi_switch+0x178/frame 0xfffffe0000487920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000487960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000487990 _sleep() at _sleep+0x3a9/frame 0xfffffe0000487a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0000487a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe0000487a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000487ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000487ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffff8000376b580 sched_switch() at sched_switch+0x942/frame 0xfffffe000048c8e0 mi_switch() at mi_switch+0x178/frame 0xfffffe000048c910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000048c950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048c980 _sleep() at _sleep+0x3a9/frame 0xfffffe000048ca20 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe000048ca60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe000048ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100015 td 0xfffff8000365b000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789969f0 mi_switch() at mi_switch+0x178/frame 0xfffffe0078996a20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe0078996a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078996ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078996ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100017 td 0xfffff8000365a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100020 td 0xfffff8000369a580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789af9f0 mi_switch() at mi_switch+0x178/frame 0xfffffe00789afa20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe00789afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100047 td 0xfffff8000376b000 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000ce1df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000ce1e10 trap() at trap+0x49/frame 0xfffffe0000ce1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000ce1f20 --- trap 0x13, rip = 0xffffffff80bc43ab, rsp = 0xfffffe00004375d0, rbp = 0xfffffe0000437600 --- sched_add() at sched_add+0x3b/frame 0xfffffe0000437600 setrunnable() at setrunnable+0x8f/frame 0xfffffe0000437620 sleepq_broadcast() at sleepq_broadcast+0xe8/frame 0xfffffe0000437660 wakeup() at wakeup+0x1d/frame 0xfffffe0000437680 sowakeup() at sowakeup+0x6a/frame 0xfffffe00004376b0 tcp_do_segment() at tcp_do_segment+0x2db3/frame 0xfffffe00004377b0 tcp_input() at tcp_input+0x10a0/frame 0xfffffe0000437900 ip_input() at ip_input+0x3f7/frame 0xfffffe0000437960 swi_net() at swi_net+0x1b9/frame 0xfffffe00004379e0 intr_event_execute_handlers() at intr_event_execute_handlers+0x99/frame 0xfffffe0000437a20 ithread_loop() at ithread_loop+0xb7/frame 0xfffffe0000437a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000437ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000437ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff8000376a580 sched_switch() at sched_switch+0x942/frame 0xfffffe000043c9f0 mi_switch() at mi_switch+0x178/frame 0xfffffe000043ca20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe000043ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000043cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000043cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffff8000376a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff80003769580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff80003769000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff80003768580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff80003768000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff8000375c580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff8000375c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff8000377a580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff8000377a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff80003779580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff80003779000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffff80003778580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100093 td 0xfffff80003d8f000 sched_switch() at sched_switch+0x942/frame 0xfffffe000051d9f0 mi_switch() at mi_switch+0x178/frame 0xfffffe000051da20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe000051da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000051dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000051dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffff80003d8e580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005229f0 mi_switch() at mi_switch+0x178/frame 0xfffffe0000522a20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe0000522a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000522ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000522ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100100 td 0xfffff80003d84580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005409f0 mi_switch() at mi_switch+0x178/frame 0xfffffe0000540a20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe0000540a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000540ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000540ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100111 td 0xfffff800039af580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100112 td 0xfffff800039af000 sched_switch() at sched_switch+0x942/frame 0xfffffe000057c9f0 mi_switch() at mi_switch+0x178/frame 0xfffffe000057ca20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe000057ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000057cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000057cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff8000364c000 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81fb49f0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xffffffff81fb4a10 trap() at trap+0x49/frame 0xffffffff81fb4b20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fb4b20 --- trap 0x13, rip = 0xffffffff811da862, rsp = 0xfffffe007895a990, rbp = 0xfffffe007895a9a0 --- cpu_idle() at cpu_idle+0xc2/frame 0xfffffe007895a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff8000364b580 sched_switch() at sched_switch+0x942/frame 0xfffffe007895f970 mi_switch() at mi_switch+0x178/frame 0xfffffe007895f9a0 sched_idletd() at sched_idletd+0xb8/frame 0xfffffe007895fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff8000364b000 sched_switch() at sched_switch+0x942/frame 0xfffffe0078964950 mi_switch() at mi_switch+0x178/frame 0xfffffe0078964980 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe00789649a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078964a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078964ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078964ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff8000364a580 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071c5df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071c5e10 trap() at trap+0x49/frame 0xfffffe00071c5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071c5f20 --- trap 0x13, rip = 0xffffffff811da166, rsp = 0xfffffe0078969910, rbp = 0xfffffe0078969910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078969910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe0078969960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078969980 cpu_idle() at cpu_idle+0x95/frame 0xfffffe00789699a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078969a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078969ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078969ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff8000364a000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071d1df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071d1e10 trap() at trap+0x49/frame 0xfffffe00071d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071d1f20 --- trap 0x13, rip = 0xffffffff8104af04, rsp = 0xfffffe007896e898, rbp = 0xfffffe007896e970 --- sw1() at sw1/frame 0xfffffe007896e970 mi_switch() at mi_switch+0x178/frame 0xfffffe007896e9a0 sched_idletd() at sched_idletd+0xb8/frame 0xfffffe007896ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007896eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007896eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff80003649580 sched_switch() at sched_switch+0x942/frame 0xfffffe0078973970 mi_switch() at mi_switch+0x178/frame 0xfffffe00789739a0 sched_idletd() at sched_idletd+0xb8/frame 0xfffffe0078973a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078973ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078973ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80003649000 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071e9df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071e9e10 trap() at trap+0x49/frame 0xfffffe00071e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071e9f20 --- trap 0x13, rip = 0xffffffff80bc2234, rsp = 0xfffffe0078978830, rbp = 0xfffffe00789788e0 --- cpu_search_highest() at cpu_search_highest+0x54/frame 0xfffffe00789788e0 cpu_search_highest() at cpu_search_highest+0x10a/frame 0xfffffe00789789a0 sched_idletd() at sched_idletd+0x3c7/frame 0xfffffe0078978a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078978ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078978ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff8000365d580 sched_switch() at sched_switch+0x942/frame 0xfffffe007897d970 mi_switch() at mi_switch+0x178/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0xb8/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff8000365d000 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cbddf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cbde10 trap() at trap+0x49/frame 0xfffffe0000cbdf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cbdf20 --- trap 0x13, rip = 0xffffffff811da862, rsp = 0xfffffe0078982990, rbp = 0xfffffe00789829a0 --- cpu_idle() at cpu_idle+0xc2/frame 0xfffffe00789829a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078982a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078982ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078982ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff8000365c580 sched_switch() at sched_switch+0x942/frame 0xfffffe0078987970 mi_switch() at mi_switch+0x178/frame 0xfffffe00789879a0 sched_idletd() at sched_idletd+0xb8/frame 0xfffffe0078987a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078987ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078987ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000365c000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cd5df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cd5e10 trap() at trap+0x49/frame 0xfffffe0000cd5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cd5f20 --- trap 0x13, rip = 0xffffffff811da166, rsp = 0xfffffe007898c910, rbp = 0xfffffe007898c910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007898c910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007898c960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007898c980 cpu_idle() at cpu_idle+0x95/frame 0xfffffe007898c9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007898ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007898cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007898cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000365b580 sched_switch() at sched_switch+0x942/frame 0xfffffe0078991950 mi_switch() at mi_switch+0x178/frame 0xfffffe0078991980 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe00789919a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078991a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078991ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078991ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff8000364c580 sched_switch() at sched_switch+0x942/frame 0xfffffe0078955560 mi_switch() at mi_switch+0x178/frame 0xfffffe0078955590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789555d0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe0078955630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0078955660 _sleep() at _sleep+0x39c/frame 0xfffffe0078955700 kern_wait6() at kern_wait6+0x4c4/frame 0xfffffe0078955790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0078955980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe0078955ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0078955ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2a714a, rsp = 0x7fffffffe788, rbp = 0x7fffffffe7f0 --- Tracing command audit pid 10 tid 100001 td 0xfffff8000364d000 sched_switch() at sched_switch+0x942/frame 0xfffffe0078950900 mi_switch() at mi_switch+0x178/frame 0xfffffe0078950930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0078950970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789509a0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0078950a10 audit_worker() at audit_worker+0x93/frame 0xfffffe0078950a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078950ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078950ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81ffc3a0 sched_switch() at sched_switch+0x942/frame 0xffffffff827d39d0 mi_switch() at mi_switch+0x178/frame 0xffffffff827d3a00 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffffff827d3a40 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xffffffff827d3a80 _sleep() at _sleep+0x34d/frame 0xffffffff827d3b20 swapper() at swapper+0x247/frame 0xffffffff827d3b70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100016 td 0xfffff8000365a580 sched_switch() at sched_switch+0x942/frame 0xfffffe007899b900 mi_switch() at mi_switch+0x178/frame 0xfffffe007899b930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe007899b970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe007899b9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe007899ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe007899ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007899bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007899bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffff8000364d580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789a5900 mi_switch() at mi_switch+0x178/frame 0xfffffe00789a5930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789a5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789a59a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00789a5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00789a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789a5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff8000369b000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789aa900 mi_switch() at mi_switch+0x178/frame 0xfffffe00789aa930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789aa970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789aa9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00789aaa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00789aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789aaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff8000369a000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789b4920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789b4950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789b4990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789b49c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789b4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789b4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789b4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789b4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff80003699580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789b9920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789b9950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789b9990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789b99c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789b9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789b9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789b9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789b9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff80003699000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789be920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789be950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789be990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789be9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789bea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789bea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789beab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789beab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff80003698580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789c3920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789c3950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789c3990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789c39c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789c3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789c3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789c3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789c3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003698000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789c8920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789c8950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789c8990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789c89c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789c8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789c8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789c8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789c8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff80003697580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789cd920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789cd950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789cd990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789cd9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789cda40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789cdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003697000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789d2920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789d2950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789d2990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789d29c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789d2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789d2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff800036a4580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789d7920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789d7950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789d7990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789d79c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789d7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789d7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789d7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789d7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff800036a4000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789dc920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789dc950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789dc990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789dc9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789dca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789dca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789dcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789dcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff800036a3580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789e1920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789e1950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789e1990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789e19c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789e1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789e1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789e1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789e1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff800036a3000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789e6920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789e6950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789e6990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789e69c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789e6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789e6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789e6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789e6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff800036a2580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789eb920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789eb950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789eb990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789eb9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789eba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789eba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789ebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789ebab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff800036a2000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789f0920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789f0950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789f0990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789f09c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789f0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789f0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789f0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789f0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff80003737000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789f5920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789f5950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789f5990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789f59c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789f5a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789f5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789f5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff80003736580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789fa920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789fa950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789fa990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789fa9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789faa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789faa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789faab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789faab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff80003736000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789ff920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789ff950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789ff990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789ff9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789ffa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789ffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789ffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789ffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff80003735580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000405920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000405950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000405990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004059c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000405a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000405a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000405ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000405ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff80003735000 sched_switch() at sched_switch+0x942/frame 0xfffffe000040a920 mi_switch() at mi_switch+0x178/frame 0xfffffe000040a950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000040a990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000040a9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe000040aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000040aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000040aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000040aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80003734580 sched_switch() at sched_switch+0x942/frame 0xfffffe000040f920 mi_switch() at mi_switch+0x178/frame 0xfffffe000040f950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000040f990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000040f9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe000040fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000040fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000040fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000040fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff80003734000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000414920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000414950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000414990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004149c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000414a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000414a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000414ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000414ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff80003728580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000419920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000419950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000419990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004199c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000419a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000419a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000419ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000419ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff80003728000 sched_switch() at sched_switch+0x942/frame 0xfffffe000041e920 mi_switch() at mi_switch+0x178/frame 0xfffffe000041e950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000041e990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000041e9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe000041ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000041ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000041eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000041eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff80003745580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000423920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000423950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000423990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004239c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000423a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000423a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000423ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000423ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff80003745000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000428920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000428950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000428990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004289c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000428a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000428a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000428ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000428ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff80003744580 sched_switch() at sched_switch+0x942/frame 0xfffffe000042d920 mi_switch() at mi_switch+0x178/frame 0xfffffe000042d950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000042d990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000042d9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe000042da40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000042da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000042dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000042dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff80003744000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000432920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000432950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000432990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004329c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000432a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000432a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000432ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000432ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80003778000 sched_switch() at sched_switch+0x942/frame 0xfffffe000047d900 mi_switch() at mi_switch+0x178/frame 0xfffffe000047d930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000047d970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000047d9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe000047da40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000047da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000047dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000047dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff80003807000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000491900 mi_switch() at mi_switch+0x178/frame 0xfffffe0000491930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000491970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004919a0 _sleep() at _sleep+0x3a9/frame 0xfffffe0000491a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000491a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000491ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000491ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003806580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000496900 mi_switch() at mi_switch+0x178/frame 0xfffffe0000496930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000496970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004969a0 _sleep() at _sleep+0x3a9/frame 0xfffffe0000496a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000496a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000496ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000496ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003806000 sched_switch() at sched_switch+0x942/frame 0xfffffe000049b900 mi_switch() at mi_switch+0x178/frame 0xfffffe000049b930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000049b970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000049b9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe000049ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000049ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000049bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000049bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff80003805580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004a0900 mi_switch() at mi_switch+0x178/frame 0xfffffe00004a0930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a09a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004a0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004a0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff80003805000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004a5900 mi_switch() at mi_switch+0x178/frame 0xfffffe00004a5930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a59a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004a5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff80003804580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004aa900 mi_switch() at mi_switch+0x178/frame 0xfffffe00004aa930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004aa970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004aa9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004aaa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004aaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff80003804000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004af900 mi_switch() at mi_switch+0x178/frame 0xfffffe00004af930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004af970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004af9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004afa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff80003803580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004b4900 mi_switch() at mi_switch+0x178/frame 0xfffffe00004b4930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b4970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b49a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004b4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004b4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80003803000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004b9900 mi_switch() at mi_switch+0x178/frame 0xfffffe00004b9930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b9970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b99a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004b9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004b9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff8000380b580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004be900 mi_switch() at mi_switch+0x178/frame 0xfffffe00004be930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004be970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004be9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004bea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004bea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004beab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004beab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff8000380b000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004c3900 mi_switch() at mi_switch+0x178/frame 0xfffffe00004c3930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c39a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004c3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004c3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff8000380a580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004c8900 mi_switch() at mi_switch+0x178/frame 0xfffffe00004c8930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c89a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004c8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004c8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100113 td 0xfffff8000381a580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000581920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000581950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000581990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005819c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000581a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0000581a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000581ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000581ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100119 td 0xfffff80003743000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005a0920 mi_switch() at mi_switch+0x178/frame 0xfffffe00005a0950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005a0990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a09c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00005a0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00005a0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffff80003742580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005a5920 mi_switch() at mi_switch+0x178/frame 0xfffffe00005a5950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005a5990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a59c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00005a5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00005a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff80003742000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005aa920 mi_switch() at mi_switch+0x178/frame 0xfffffe00005aa950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005aa990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005aa9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00005aaa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00005aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005aaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffff800090a7580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005b4900 mi_switch() at mi_switch+0x178/frame 0xfffffe00005b4930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005b4970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b49a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00005b4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 1650 out of 32621 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 9 [root@mercat1 /usr/src/sys/amd64/compile/PHO]# /usr/libexec/kgdb kernel /var/crash/vmcore.91 GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"...BFD: /usr/src/sys/amd64/compile/PHO/kernel: invalid relocation type 37 BFD: BFD 2.17.50 [FreeBSD] 2007-07-03 assertion fail /usr/src/gnu/usr.bin/binutils/libbfd/../../../../contrib/binutils/bfd/elf64-x86-64.c:276 BFD: /usr/src/sys/amd64/compile/PHO/kernel: invalid relocation type 37 BFD: BFD 2.17.50 [FreeBSD] 2007-07-03 assertion fail /usr/src/gnu/usr.bin/binutils/libbfd/../../../../contrib/binutils/bfd/elf64-x86-64.c:276 Cannot access memory at address 0x0 (kgdb) -- Test scenario: misc/sendfile14.sh