GENERIC HEAD from 2011-11-27 11:15:59 UTC, r228020M, vmcore.2 KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2011 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r228020M: Mon Nov 28 21:56:04 CET 2011 pho@x4.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 10 Model = 2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3963461632 (3779 MB) : Trying to mount root from ufs:/dev/ada0s3a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ada0s3a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s3a: clean, 810074 free (978 frags, 101137 blocks, 0.1% fragmentation) /dev/ada0s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1f: clean, 132660 free (4260 frags, 16050 blocks, 0.4% fragmentation) /dev/ada0s1g: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1g: clean, 114671061 free (1245 frags, 14333727 blocks, 0.0% fragmentation) /dev/ada0s3d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s3d: clean, 6663630 free (97142 frags, 820811 blocks, 1.0% fragmentation) /dev/ada0s3e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s3e: clean, 21527542 free (6326 frags, 2690152 blocks, 0.0% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=3 inet 127.0.0.1 netmask 0xff000000 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0xa nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 tentative scopeid 0x1 nd6 options=29 media: Ethernet autoselect (none) status: no carrier fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 Starting devd. Starting Network: usbus0. Starting Network: usbus1. Starting Network: usbus2. Starting Network: usbus3. Starting Network: usbus4. Starting Network: usbus5. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 re0: link state changed to UP ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib 32-bit compatibility ldconfig path: /usr/lib32 Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xffffff80ee9d12d0 bufwait (bufwait) @ kern/vfs_bio.c:2658 2nd 0xfffffe0005643200 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a kdb_backtrace() at kdb_backtrace+0x37 _witness_debugger() at _witness_debugger+0x2c witness_checkorder() at witness_checkorder+0x854 _sx_xlock() at _sx_xlock+0x55 ufsdirhash_acquire() at ufsdirhash_acquire+0x44 ufsdirhash_add() at ufsdirhash_add+0x19 ufs_direnter() at ufs_direnter+0x6a0 ufs_mkdir() at ufs_mkdir+0x4b4 VOP_MKDIR_APV() at VOP_MKDIR_APV+0xb9 kern_mkdirat() at kern_mkdirat+0x284 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8009408ec, rsp = 0x7fffffffd788, rbp = 0x800c07050 --- Clearing /tmp (X related). Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Configuring syscons: keymap blanktime. Starting sshd. Could not load host key: /etc/ssh/ssh_host_ecdsa_key Starting cron. Starting default moused. Expensive timeout(9) function: 0xffffffff80687cd0(0xffffffff81389cc0) 0.012602439 s Starting inetd. Mon Nov 28 22:08:14 CET 2011 FreeBSD/amd64 (x4.osted.lan) (console) login: Nov 29 00:10:11 x4 sshd[2337]: error: Could not load host key: /etc/ssh/ssh_host_ecdsa_key Nov 29 00:10:20 x4 su: pho to root on /dev/pts/0 Nov 29 00:10:32 x4 sshd[2841]: error: Could not load host key: /etc/ssh/ssh_host_ecdsa_key Nov 29 00:12:05 x4 sshd[18245]: error: Could not load host key: /etc/ssh/ssh_host_ecdsa_key Nov 29 00:12:05 x4 sshd[18253]: error: Could not load host key: /etc/ssh/ssh_host_ecdsa_key Nov 29 00:12:05 x4 sshd[18255]: error: Could not load host key: /etc/ssh/ssh_host_ecdsa_key lock order reversal: 1st 0xfffffe0005e58098 ufs (ufs) @ kern/vfs_subr.c:2167 2nd 0xffffff80eea8ae88 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:260 3rd 0xfffffe0054565800 ufs (ufs) @ kern/vfs_subr.c:2167 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a kdb_backtrace() at kdb_backtrace+0x37 _witness_debugger() at _witness_debugger+0x2c witness_checkorder() at witness_checkorder+0x854 __lockmgr_args() at __lockmgr_args+0xddd ffs_lock() at ffs_lock+0x9c VOP_LOCK1_APV() at VOP_LOCK1_APV+0x9b _vn_lock() at _vn_lock+0x57 vget() at vget+0x7b vfs_hash_get() at vfs_hash_get+0xd5 ffs_vgetf() at ffs_vgetf+0x48 softdep_sync_buf() at softdep_sync_buf+0x56a ffs_syncvnode() at ffs_syncvnode+0x2b3 ffs_sync() at ffs_sync+0x216 dounmount() at dounmount+0x27b sys_unmount() at sys_unmount+0x280 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8008afc1c, rsp = 0x7fffffffcec8, rbp = 0x800c08010 --- lock order reversal: 1st 0xfffffe0005e5b310 ufs (ufs) @ kern/vfs_mount.c:1209 2nd 0xfffffe0005443588 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1371 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a kdb_backtrace() at kdb_backtrace+0x37 _witness_debugger() at _witness_debugger+0x2c witness_checkorder() at witness_checkorder+0x854 __lockmgr_args() at __lockmgr_args+0xddd vop_stdlock() at vop_stdlock+0x39 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x9b _vn_lock() at _vn_lock+0x57 ffs_flushfiles() at ffs_flushfiles+0x109 softdep_flushfiles() at softdep_flushfiles+0x63 ffs_unmount() at ffs_unmount+0x1d3 dounmount() at dounmount+0x297 sys_unmount() at sys_unmount+0x280 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8008afc1c, rsp = 0x7fffffffced8, rbp = 0x800c08010 --- kernel trap 12 with interrupts disabled Fatal trap 12: page fault while in kernel mode cpuid = 1; apic id = 01 fault virtual address = 0xffffff8115136d78 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff80b0e916 stack pointer = 0x28:0xffffff81150dc910 frame pointer = 0x28:0xffffff81150dc980 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = resume, IOPL = 0 current process = 40836 (syscall4) [ thread pid 40836 tid 31236771 ] Stopped at done_store_dr+0x33: movq 0x68(%r8),%rcx db> run pho db:0:pho> bt Tracing pid 40836 tid 31236771 td 0xfffffe000bed7000 done_store_dr() at done_store_dr+0x33 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _sleep() at _sleep+0x369 __umtx_op_wake_umutex() at __umtx_op_wake_umutex+0x1a4 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80085f9bc, rsp = 0x7ffffe7f3ef8, rbp = 0x80100a000 --- db:0:bt> show allpcpu Current CPU: 1 cpuid = 0 dynamic pcpu = 0x4c6700 curthread = 0xfffffe00028fe8c0: pid 12 "swi4: clock" curpcb = 0xffffff800024bd10 fpcurthread = none idlethread = 0xfffffe00028fd460: tid 100003 "idle: cpu0" curpmap = 0xffffffff81146a50 tssp = 0xffffffff8135bb60 commontssp = 0xffffffff8135bb60 rsp0 = 0xffffff800024bd10 gs32p = 0xffffffff81359cb8 ldt = 0xffffffff81359cf8 tss = 0xffffffff81359ce8 spin locks held: cpuid = 1 dynamic pcpu = 0xffffff807f10b700 curthread = 0xfffffe000bed7000: pid 40836 "syscall4" curpcb = 0xffffff81150dcd10 fpcurthread = none idlethread = 0xfffffe00028fd000: tid 100004 "idle: cpu1" curpmap = 0xfffffe0005717d70 tssp = 0xffffffff8135bbc8 commontssp = 0xffffffff8135bbc8 rsp0 = 0xffffff81150dcd10 gs32p = 0xffffffff81359d20 ldt = 0xffffffff81359d60 tss = 0xffffffff81359d50 spin locks held: cpuid = 2 dynamic pcpu = 0xffffff807f112700 curthread = 0xfffffe000bf4b000: pid 40836 "syscall4" curpcb = 0xffffff8115299d10 fpcurthread = none idlethread = 0xfffffe00029088c0: tid 100005 "idle: cpu2" curpmap = 0xfffffe0005717d70 tssp = 0xffffffff8135bc30 commontssp = 0xffffffff8135bc30 rsp0 = 0xffffff8115299d10 gs32p = 0xffffffff81359d88 ldt = 0xffffffff81359dc8 tss = 0xffffffff81359db8 spin locks held: cpuid = 3 dynamic pcpu = 0xffffff807f119700 curthread = 0xfffffe0002917460: pid 12 "swi4: clock" curpcb = 0xffffff800025ad10 fpcurthread = none idlethread = 0xfffffe0002908460: tid 100006 "idle: cpu3" curpmap = 0xffffffff81146a50 tssp = 0xffffffff8135bc98 commontssp = 0xffffffff8135bc98 rsp0 = 0xffffff800025ad10 gs32p = 0xffffffff81359df0 ldt = 0xffffffff81359e30 tss = 0xffffffff81359e20 spin locks held: db:0:allpcpu> show alllocks Process 40836 (syscall4) thread 0xfffffe000bf4b000 (31237315) exclusive sleep mutex umtxql (umtxql) r = 0 (0xffffffff81152670) locked @ kern/kern_umtx.c:287 db:0:alllocks> show lockedvnods Locked vnodes db:0:lockedvnods> show mount 0xfffffe000561cac8 /dev/ada0s3a on / (ufs) 0xfffffe000561d000 devfs on /dev (devfs) 0xfffffe0005746730 /dev/ada0s1f on /home (ufs) 0xfffffe000561c730 /dev/ada0s1g on /tmp (ufs) 0xfffffe000561c398 /dev/ada0s3d on /usr (ufs) 0xfffffe000561c000 /dev/ada0s3e on /var (ufs) 0xfffffe000561d398 /dev/md5a on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 40836 30210 67343 65534 R+ (threaded) syscall4 31237862 S nanslp 0xffffffff8114ae28 syscall4 31237861 S nanslp 0xffffffff8114ae28 syscall4 31237860 S nanslp 0xffffffff8114ae28 syscall4 31237859 S nanslp 0xffffffff8114ae28 syscall4 31237858 S nanslp 0xffffffff8114ae28 syscall4 31237857 S nanslp 0xffffffff8114ae28 syscall4 31237856 S nanslp 0xffffffff8114ae28 syscall4 31237855 S nanslp 0xffffffff8114ae28 syscall4 31237854 S nanslp 0xffffffff8114ae28 syscall4 31237853 S nanslp 0xffffffff8114ae28 syscall4 31237852 S nanslp 0xffffffff8114ae28 syscall4 31237851 S nanslp 0xffffffff8114ae28 syscall4 31237850 S nanslp 0xffffffff8114ae28 syscall4 31237849 S nanslp 0xffffffff8114ae28 syscall4 31237848 S nanslp 0xffffffff8114ae28 syscall4 31237847 S nanslp 0xffffffff8114ae28 syscall4 31237846 S nanslp 0xffffffff8114ae28 syscall4 31237845 S nanslp 0xffffffff8114ae28 syscall4 31237844 CanRun syscall4 31237843 RunQ syscall4 31237842 RunQ syscall4 31237841 RunQ syscall4 31237840 RunQ syscall4 31237839 RunQ syscall4 31237838 RunQ syscall4 31237837 RunQ syscall4 31237322 RunQ syscall4 31237317 RunQ syscall4 31237316 RunQ syscall4 31237315 Run CPU 2 syscall4 31237313 RunQ syscall4 31237311 RunQ syscall4 31237310 RunQ syscall4 31237309 RunQ syscall4 31237308 RunQ syscall4 31237307 RunQ syscall4 31237305 RunQ syscall4 31236788 Run CPU 255 syscall4 31236787 RunQ syscall4 31236780 RunQ syscall4 31236771 D umtxqb 0xffffffff81152670 syscall4 31236768 RunQ syscall4 31236250 RunQ syscall4 31236239 RunQ syscall4 31236233 RunQ syscall4 31236225 RunQ syscall4 31236182 RunQ syscall4 31235674 RunQ syscall4 31235673 RunQ syscall4 31235440 S umtxn 0xfffffe0005f29000 syscall4 31235174 RunQ syscall4 31236475 S uwait 0xfffffe0005a23500 syscall4 40750 2885 40750 1001 S+ nanslp 0xffffffff8114ae28 sleep 40283 18314 18306 1001 S nanslp 0xffffffff8114ae28 sleep 30211 92755 67343 0 S+ nanslp 0xffffffff8114ae28 sleep 30210 92755 67343 65534 S+ wait 0xfffffe00057e5910 syscall4 92788 0 0 0 DL mdwait 0xfffffe0005e96000 [md5] 92755 67343 67343 0 S+ wait 0xfffffe00544f3910 sh 67343 67318 67343 0 S+ wait 0xfffffe0005a0c000 sh 67318 2345 67318 0 S+ wait 0xfffffe005422a910 bash 18315 18306 18306 1001 S piperd 0xfffffe0005ec35b0 awk 18314 18306 18306 1001 S wait 0xfffffe0005932000 sh 18306 18305 18306 1001 Ss wait 0xfffffe0005d48000 sh 18305 18255 18255 1001 S select 0xfffffe00057ed740 sshd 18303 18300 18303 1001 Ss+ select 0xfffffe0054198040 top 18300 18253 18253 1001 S select 0xfffffe00057ed9c0 sshd 18291 18290 18291 1001 Ss kqread 0xfffffe0004c14a00 tail 18290 18245 18245 1001 S select 0xfffffe00028ec040 sshd 18255 2004 18255 0 Ss select 0xfffffe0054198640 sshd 18253 2004 18253 0 Ss select 0xfffffe00057ed5c0 sshd 18245 2004 18245 0 Ss select 0xfffffe00541981c0 sshd 2885 2882 2885 1001 Ss+ wait 0xfffffe00057a7910 bash 2882 2841 2841 1001 S select 0xfffffe0005d279c0 sshd 2841 2004 2841 0 Ss select 0xfffffe00057ed3c0 sshd 2496 1 2496 0 DLs aiordy 0xfffffe0005d56460 [aiod4] 2495 1 2495 0 DLs aiordy 0xfffffe00056f48c0 [aiod3] 2494 1 2494 0 DLs aiordy 0xfffffe000565a460 [aiod2] 2493 1 2493 0 DLs aiordy 0xfffffe00058fc8c0 [aiod1] 2345 2344 2345 0 S+ pause 0xfffffe0005d4c528 csh 2344 2340 2344 1001 S+ wait 0xfffffe0005d4c910 su 2340 2339 2340 1001 Ss+ wait 0xfffffe0005cec910 bash 2339 2337 2337 1001 S select 0xfffffe0005d27840 sshd 2337 2004 2337 0 Ss select 0xfffffe0005d27940 sshd 2127 1 2127 0 Ss+ ttyin 0xfffffe00054318a8 getty 2126 1 2126 0 Ss+ ttyin 0xfffffe0005431ca8 getty 2125 1 2125 0 Ss+ ttyin 0xfffffe00054320a8 getty 2124 1 2124 0 Ss+ ttyin 0xfffffe00054324a8 getty 2123 1 2123 0 Ss+ ttyin 0xfffffe00029404a8 getty 2122 1 2122 0 Ss+ ttyin 0xfffffe0002940ca8 getty 2121 1 2121 0 Ss+ ttyin 0xfffffe0002b194a8 getty 2120 1 2120 0 Ss+ ttyin 0xfffffe00029408a8 getty 2119 1 2119 0 Ss+ ttyin 0xfffffe0002b190a8 getty 2080 1 2080 0 Ss select 0xfffffe0005996140 inetd 2047 1 2047 0 Ss select 0xfffffe00028ed3c0 moused 2023 1 2023 0 Ss nanslp 0xffffffff8114ae28 cron 2016 1 2016 25 Ss pause 0xfffffe0005929528 sendmail 2012 1 2012 0 Ss select 0xfffffe00028ed4c0 sendmail 2004 1 2004 0 Ss select 0xfffffe00028ed540 sshd 1958 1 1958 0 Ss select 0xfffffe00059961c0 ntpd 1829 1828 1828 0 S (threaded) nfsd 100143 S rpcsvc 0xfffffe0005570220 nfsd: service 100142 S rpcsvc 0xfffffe00059f12a0 nfsd: service 100141 S rpcsvc 0xfffffe00059f1320 nfsd: service 100115 S rpcsvc 0xfffffe00055702a0 nfsd: master 1828 1 1828 0 Ss select 0xfffffe00028ec340 nfsd 1819 1 1819 0 Ss select 0xfffffe00028ec3c0 mountd 1721 1 1721 0 Ss select 0xfffffe00059962c0 rpcbind 1695 1 1695 0 Ss select 0xfffffe00028edbc0 syslogd 1490 1 1490 0 Ss select 0xfffffe00028ec6c0 devd 18 0 0 0 DL sdflush 0xffffffff8133fb98 [softdepflush] 17 0 0 0 DL syncer 0xffffffff81336a20 [syncer] 16 0 0 0 RL [vnlru] 9 0 0 0 DL psleep 0xffffffff813364a8 [bufdaemon] 8 0 0 0 DL pgzero 0xffffffff81349a3c [pagezero] 7 0 0 0 DL psleep 0xffffffff81348ce8 [vmdaemon] 6 0 0 0 DL psleep 0xffffffff81348cac [pagedaemon] 5 0 0 0 DL ccb_scan 0xffffffff8110a7e0 [xpt_thrd] 4 0 0 0 DL waiting_ 0xffffffff81339a80 [sctp_iterator] 3 0 0 0 DL - 0xfffffe000502f048 [fdc0] 2 0 0 0 SL - 0xffffff8000866000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xffffff8000863e18 [usbus5] 100057 D - 0xffffff8000863dc0 [usbus5] 100056 D - 0xffffff8000863d68 [usbus5] 100055 D - 0xffffff8000863d10 [usbus5] 100053 D - 0xffffff800085b460 [usbus4] 100052 D - 0xffffff800085b408 [usbus4] 100051 D - 0xffffff800085b3b0 [usbus4] 100050 D - 0xffffff800085b358 [usbus4] 100049 D - 0xffffff8000858460 [usbus3] 100048 D - 0xffffff8000858408 [usbus3] 100047 D - 0xffffff80008583b0 [usbus3] 100046 D - 0xffffff8000858358 [usbus3] 100045 D - 0xffffff8000855460 [usbus2] 100044 D - 0xffffff8000855408 [usbus2] 100043 D - 0xffffff80008553b0 [usbus2] 100042 D - 0xffffff8000855358 [usbus2] 100040 D - 0xffffff8000852460 [usbus1] 100039 D - 0xffffff8000852408 [usbus1] 100038 D - 0xffffff80008523b0 [usbus1] 100037 D - 0xffffff8000852358 [usbus1] 100035 D - 0xffffff800084f460 [usbus0] 100034 D - 0xffffff800084f408 [usbus0] 100033 D - 0xffffff800084f3b0 [usbus0] 100032 D - 0xffffff800084f358 [usbus0] 14 0 0 0 DL - 0xffffffff81149ac4 [yarrow] 13 0 0 0 DL (threaded) [geom] 100015 D - 0xffffffff81145f30 [g_down] 100014 D - 0xffffffff81145f28 [g_up] 100013 D - 0xffffffff81145f18 [g_event] 12 0 0 0 RL (threaded) [intr] 100066 I [irq12: psm0] 100065 I [irq1: atkbd0] 100063 I [swi0: uart] 100060 I [irq20: fwohci0] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100026 I [swi5: +] 100021 I [swi2: cambio] 100019 I [swi6: task queue] 100018 I [swi6: Giant taskq] 100012 I [swi3: vm] 100011 Run CPU 3 [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 Run CPU 0 [swi4: clock] 100007 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xfffffe00028fb910 [init] 10 0 0 0 DL audit_wo 0xffffffff8133eb10 [audit] 0 0 0 0 DLs (threaded) [kernel] 100176 D - 0xfffffe0005571880 [aiod_bio taskq] 100077 D - 0xfffffe0005553a00 [mca taskq] 100067 D - 0xffffffff81149ac4 [deadlkres] 100061 D - 0xfffffe0005004b80 [fw0_taskq] 100027 D - 0xfffffe0002a6ab00 [thread taskq] 100025 D - 0xfffffe0002a6ac00 [acpi_task_2] 100024 D - 0xfffffe0002a6ac00 [acpi_task_1] 100023 D - 0xfffffe0002a6ac00 [acpi_task_0] 100022 D - 0xfffffe0002a6ac80 [kqueue taskq] 100020 D - 0xfffffe0002a6ad00 [ffs_trim taskq] 100016 D - 0xfffffe00028cea00 [firmware taskq] 100000 D sched 0xffffffff81146060 [swapper] db:0:ps> allt Tracing command syscall4 pid 40836 tid 31237862 td 0xfffffe0005fd6460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffff97cbf28, rbp = 0x801014008 --- Tracing command syscall4 pid 40836 tid 31237861 td 0xfffffe0005f10460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffff99ccf28, rbp = 0x801013c08 --- Tracing command syscall4 pid 40836 tid 31237860 td 0xfffffe0005f5c8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffff9bcdf28, rbp = 0x801013808 --- Tracing command syscall4 pid 40836 tid 31237859 td 0xfffffe0005d7a460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffff9dcef28, rbp = 0x801013408 --- Tracing command syscall4 pid 40836 tid 31237858 td 0xfffffe00542218c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffff9fcff28, rbp = 0x801013008 --- Tracing command syscall4 pid 40836 tid 31237857 td 0xfffffe00545e0460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffa1d0f28, rbp = 0x801012c08 --- Tracing command syscall4 pid 40836 tid 31237856 td 0xfffffe00545da8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffa3d1f28, rbp = 0x801012808 --- Tracing command syscall4 pid 40836 tid 31237855 td 0xfffffe00542268c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffa5d2f28, rbp = 0x801012408 --- Tracing command syscall4 pid 40836 tid 31237854 td 0xfffffe0005f048c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffa7d3f28, rbp = 0x801012008 --- Tracing command syscall4 pid 40836 tid 31237853 td 0xfffffe0005f19000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffa9d4f28, rbp = 0x801011c08 --- Tracing command syscall4 pid 40836 tid 31237852 td 0xfffffe000565b460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffabd5f28, rbp = 0x801011808 --- Tracing command syscall4 pid 40836 tid 31237851 td 0xfffffe005424c460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffadd6f28, rbp = 0x801011408 --- Tracing command syscall4 pid 40836 tid 31237850 td 0xfffffe000bfb9460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffafd7f28, rbp = 0x801011008 --- Tracing command syscall4 pid 40836 tid 31237849 td 0xfffffe0005d568c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffb1d8f28, rbp = 0x801010c08 --- Tracing command syscall4 pid 40836 tid 31237848 td 0xfffffe005423b000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffb3d9f28, rbp = 0x801010808 --- Tracing command syscall4 pid 40836 tid 31237847 td 0xfffffe006a2a0460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffb5daf28, rbp = 0x801010408 --- Tracing command syscall4 pid 40836 tid 31237846 td 0xfffffe00544e88c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffb7dbf28, rbp = 0x801010008 --- Tracing command syscall4 pid 40836 tid 31237845 td 0xfffffe0054753460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffb9dcf28, rbp = 0x80100fc08 --- Tracing command syscall4 pid 40836 tid 31237844 td 0xfffffe006a150460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffbbddf28, rbp = 0x80100f808 --- Tracing command syscall4 pid 40836 tid 31237843 td 0xfffffe00545e28c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffbddef28, rbp = 0x80100f408 --- Tracing command syscall4 pid 40836 tid 31237842 td 0xfffffe0005f05000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffbfdff28, rbp = 0x80100f008 --- Tracing command syscall4 pid 40836 tid 31237841 td 0xfffffe00542258c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffc1e0f28, rbp = 0x80100ec08 --- Tracing command syscall4 pid 40836 tid 31237840 td 0xfffffe0054534000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffc3e1f28, rbp = 0x80100e808 --- Tracing command syscall4 pid 40836 tid 31237839 td 0xfffffe0005f9d8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffc5e2f28, rbp = 0x80100e408 --- Tracing command syscall4 pid 40836 tid 31237838 td 0xfffffe0005fdc000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffc7e3f28, rbp = 0x80100e008 --- Tracing command syscall4 pid 40836 tid 31237837 td 0xfffffe006a2a48c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffc9e4f28, rbp = 0x80100dc08 --- Tracing command syscall4 pid 40836 tid 31237322 td 0xfffffe0005f8d8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffcbe5f28, rbp = 0x80100d808 --- Tracing command syscall4 pid 40836 tid 31237317 td 0xfffffe000565b000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffcde6f28, rbp = 0x80100d408 --- Tracing command syscall4 pid 40836 tid 31237316 td 0xfffffe0005f06000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffcfe7f28, rbp = 0x80100d008 --- Tracing command syscall4 pid 40836 tid 31237315 td 0xfffffe000bf4b000 cpustop_handler() at cpustop_handler+0x2b ipi_nmi_handler() at ipi_nmi_handler+0x50 trap() at trap+0x1a8 nmi_calltrap() at nmi_calltrap+0x8 --- trap 0x13, rip = 0xffffffff80b7bad7, rsp = 0xffffff800021afe0, rbp = 0xffffff8115299930 --- get_tsc() at get_tsc+0x7 thread_lock_flags_() at thread_lock_flags_+0x11a sleepq_signal() at sleepq_signal+0xa5 wakeup_one() at wakeup_one+0x27 _do_lock_normal() at _do_lock_normal+0x615 do_lock_umutex() at do_lock_umutex+0x17c __umtx_op_wait_umutex() at __umtx_op_wait_umutex+0x63 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80085f9bc, rsp = 0x7ffffd1e8ea8, rbp = 0x1dca4c3 --- Tracing command syscall4 pid 40836 tid 31237313 td 0xfffffe006a113460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffd3e9f28, rbp = 0x80100c808 --- Tracing command syscall4 pid 40836 tid 31237311 td 0xfffffe00544f8460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x31a _do_lock_normal() at _do_lock_normal+0x67d do_lock_umutex() at do_lock_umutex+0x17c __umtx_op_wait_umutex() at __umtx_op_wait_umutex+0x63 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80085f9bc, rsp = 0x7ffffd5eaea8, rbp = 0x1dca4bf --- Tracing command syscall4 pid 40836 tid 31237310 td 0xfffffe0005f5d8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffd7ebf28, rbp = 0x80100c008 --- Tracing command syscall4 pid 40836 tid 31237309 td 0xfffffe006a1c3460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffd9ecf28, rbp = 0x80100bc08 --- Tracing command syscall4 pid 40836 tid 31237308 td 0xfffffe0005f348c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffdbedf28, rbp = 0x80100b808 --- Tracing command syscall4 pid 40836 tid 31237307 td 0xfffffe00545e1000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x31a _do_lock_normal() at _do_lock_normal+0x67d do_lock_umutex() at do_lock_umutex+0x17c __umtx_op_wait_umutex() at __umtx_op_wait_umutex+0x63 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80085f9bc, rsp = 0x7ffffddeeea8, rbp = 0x1dca4bb --- Tracing command syscall4 pid 40836 tid 31237305 td 0xfffffe006a1138c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b5367c, rsp = 0x7ffffdfeff28, rbp = 0x80100b008 --- Tracing command syscall4 pid 40836 tid 31236788 td 0xfffffe00545dd8c0 Tracing command sleep pid 40750 tid 31233068 td 0xfffffe0005d378c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x80092f67c, rsp = 0x7fffffffd998, rbp = 0x7fffffffda10 --- Tracing command sleep pid 40283 tid 31221619 td 0xfffffe0005f57000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x80092f67c, rsp = 0x7fffffffdb58, rbp = 0x7fffffffdbd0 --- Tracing command sleep pid 30211 tid 30931388 td 0xfffffe006a2a7000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x80092f67c, rsp = 0x7fffffffd688, rbp = 0x7fffffffd700 --- Tracing command syscall4 pid 30210 tid 30932674 td 0xfffffe0005f26460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x31a kern_wait() at kern_wait+0x3eb sys_wait4() at sys_wait4+0x35 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800ae699c, rsp = 0x7fffffffd518, rbp = 0x7fffffffd740 --- Tracing command md5 pid 92788 tid 27602041 td 0xfffffe0005f2f8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _sleep() at _sleep+0x369 md_kthread() at md_kthread+0x16a fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff811532ad00, rbp = 0 --- Tracing command sh pid 92755 tid 27576754 td 0xfffffe0005f4e000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x31a kern_wait() at kern_wait+0x3eb sys_wait4() at sys_wait4+0x35 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d5799c, rsp = 0x7fffffffd458, rbp = 0x7fffffffd628 --- Tracing command sh pid 67343 tid 7374560 td 0xfffffe0005f26000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x31a kern_wait() at kern_wait+0x3eb sys_wait4() at sys_wait4+0x35 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d5799c, rsp = 0x7fffffffd398, rbp = 0x7fffffffd568 --- Tracing command bash pid 67318 tid 7376899 td 0xfffffe0005f6e8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x31a kern_wait() at kern_wait+0x3eb sys_wait4() at sys_wait4+0x35 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800cab99c, rsp = 0x7fffffffd648, rbp = 0x801140e40 --- Tracing command awk pid 18315 tid 492113 td 0xfffffe0005a208c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x31a pipe_read() at pipe_read+0x4a3 dofileread() at dofileread+0xa1 kern_readv() at kern_readv+0x6c sys_read() at sys_read+0x55 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b91a7c, rsp = 0x7fffffffd858, rbp = 0x800dc7c40 --- Tracing command sh pid 18314 tid 492128 td 0xfffffe0005f9f460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x31a kern_wait() at kern_wait+0x3eb sys_wait4() at sys_wait4+0x35 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d5799c, rsp = 0x7fffffffd6c8, rbp = 0x7fffffffd898 --- Tracing command sh pid 18306 tid 492151 td 0xfffffe005423a000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x31a kern_wait() at kern_wait+0x3eb sys_wait4() at sys_wait4+0x35 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d5799c, rsp = 0x7fffffffd9b8, rbp = 0 --- Tracing command sshd pid 18305 tid 499193 td 0xfffffe0005f39460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac kern_select() at kern_select+0x6f0 sys_select() at sys_select+0x5d amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8025079fc, rsp = 0x7fffffffcc68, rbp = 0x7fffffffccf0 --- Tracing command top pid 18303 tid 498455 td 0xfffffe0005f05460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _cv_timedwait_sig() at _cv_timedwait_sig+0x18c seltdwait() at seltdwait+0x56 kern_select() at kern_select+0x6f0 sys_select() at sys_select+0x5d amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800fd29fc, rsp = 0x7fffffffd9b8, rbp = 0x3 --- Tracing command sshd pid 18300 tid 490604 td 0xfffffe005421e460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac kern_select() at kern_select+0x6f0 sys_select() at sys_select+0x5d amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8025079fc, rsp = 0x7fffffffcc68, rbp = 0x7fffffffccf0 --- Tracing command tail pid 18291 tid 499067 td 0xfffffe0005eff8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_kevent() at kern_kevent+0x331 sys_kevent() at sys_kevent+0x90 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (363, FreeBSD ELF64, sys_kevent), rip = 0x8009345ac, rsp = 0x7fffffffd9f8, rbp = 0x800c07148 --- Tracing command sshd pid 18290 tid 499132 td 0xfffffe0005f108c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac kern_select() at kern_select+0x6f0 sys_select() at sys_select+0x5d amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8025079fc, rsp = 0x7fffffffcc68, rbp = 0x7fffffffccf0 --- Tracing command sshd pid 18255 tid 472260 td 0xfffffe0005f03000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac sys_poll() at sys_poll+0x2b6 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8024a432c, rsp = 0x7fffffffcd08, rbp = 0x803017190 --- Tracing command sshd pid 18253 tid 472710 td 0xfffffe0005f99000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac sys_poll() at sys_poll+0x2b6 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8024a432c, rsp = 0x7fffffffcd08, rbp = 0x803017190 --- Tracing command sshd pid 18245 tid 476339 td 0xfffffe0005f53000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac sys_poll() at sys_poll+0x2b6 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8024a432c, rsp = 0x7fffffffcd08, rbp = 0x803017190 --- Tracing command bash pid 2885 tid 104214 td 0xfffffe00058d58c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x31a kern_wait() at kern_wait+0x3eb sys_wait4() at sys_wait4+0x35 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800cab99c, rsp = 0x7fffffffd558, rbp = 0x8010b91e0 --- Tracing command sshd pid 2882 tid 109246 td 0xfffffe00056a2460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac kern_select() at kern_select+0x6f0 sys_select() at sys_select+0x5d amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8025079fc, rsp = 0x7fffffffcc68, rbp = 0x7fffffffccf0 --- Tracing command sshd pid 2841 tid 107902 td 0xfffffe0005f638c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac sys_poll() at sys_poll+0x2b6 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8024a432c, rsp = 0x7fffffffcd08, rbp = 0x803017190 --- Tracing command aiod4 pid 2496 tid 100173 td 0xfffffe0005d56460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_timedwait() at sleepq_timedwait+0x4d _sleep() at _sleep+0x352 aio_daemon() at aio_daemon+0x643 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8115118d00, rbp = 0 --- Tracing command aiod3 pid 2495 tid 100113 td 0xfffffe00056f48c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_timedwait() at sleepq_timedwait+0x4d _sleep() at _sleep+0x352 aio_daemon() at aio_daemon+0x643 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8114fecd00, rbp = 0 --- Tracing command aiod2 pid 2494 tid 100082 td 0xfffffe000565a460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_timedwait() at sleepq_timedwait+0x4d _sleep() at _sleep+0x352 aio_daemon() at aio_daemon+0x643 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8114f51d00, rbp = 0 --- Tracing command aiod1 pid 2493 tid 100137 td 0xfffffe00058fc8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_timedwait() at sleepq_timedwait+0x4d _sleep() at _sleep+0x352 aio_daemon() at aio_daemon+0x643 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8115064d00, rbp = 0 --- Tracing command csh pid 2345 tid 100151 td 0xfffffe000553f000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x31a kern_sigsuspend() at kern_sigsuspend+0x9b sys_sigsuspend() at sys_sigsuspend+0x34 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800d6dadc, rsp = 0x7fffffffd328, rbp = 0x801413400 --- Tracing command su pid 2344 tid 100150 td 0xfffffe000553f460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x31a kern_wait() at kern_wait+0x3eb sys_wait4() at sys_wait4+0x35 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800ef999c, rsp = 0x7fffffffd468, rbp = 0x929 --- Tracing command bash pid 2340 tid 100167 td 0xfffffe0005ce2460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x31a kern_wait() at kern_wait+0x3eb sys_wait4() at sys_wait4+0x35 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800cab99c, rsp = 0x7fffffffd8c8, rbp = 0x8010b9240 --- Tracing command sshd pid 2339 tid 100105 td 0xfffffe000555b460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac kern_select() at kern_select+0x6f0 sys_select() at sys_select+0x5d amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8025079fc, rsp = 0x7fffffffcc68, rbp = 0x7fffffffccf0 --- Tracing command sshd pid 2337 tid 100166 td 0xfffffe0005ce28c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac sys_poll() at sys_poll+0x2b6 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8024a432c, rsp = 0x7fffffffcd08, rbp = 0x803017190 --- Tracing command getty pid 2127 tid 100078 td 0xfffffe000565b8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e tty_wait() at tty_wait+0x48 ttydisc_read() at ttydisc_read+0x2f1 ttydev_read() at ttydev_read+0xab devfs_read_f() at devfs_read_f+0x88 dofileread() at dofileread+0xa1 kern_readv() at kern_readv+0x6c sys_read() at sys_read+0x55 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b64a7c, rsp = 0x7fffffffdca8, rbp = 0x3 --- Tracing command getty pid 2126 tid 100090 td 0xfffffe0005659000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e tty_wait() at tty_wait+0x48 ttydisc_read() at ttydisc_read+0x2f1 ttydev_read() at ttydev_read+0xab devfs_read_f() at devfs_read_f+0x88 dofileread() at dofileread+0xa1 kern_readv() at kern_readv+0x6c sys_read() at sys_read+0x55 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b64a7c, rsp = 0x7fffffffdca8, rbp = 0x3 --- Tracing command getty pid 2125 tid 100130 td 0xfffffe00059f4460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e tty_wait() at tty_wait+0x48 ttydisc_read() at ttydisc_read+0x2f1 ttydev_read() at ttydev_read+0xab devfs_read_f() at devfs_read_f+0x88 dofileread() at dofileread+0xa1 kern_readv() at kern_readv+0x6c sys_read() at sys_read+0x55 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b64a7c, rsp = 0x7fffffffdca8, rbp = 0x3 --- Tracing command getty pid 2124 tid 100101 td 0xfffffe000555c8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e tty_wait() at tty_wait+0x48 ttydisc_read() at ttydisc_read+0x2f1 ttydev_read() at ttydev_read+0xab devfs_read_f() at devfs_read_f+0x88 dofileread() at dofileread+0xa1 kern_readv() at kern_readv+0x6c sys_read() at sys_read+0x55 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b64a7c, rsp = 0x7fffffffdca8, rbp = 0x3 --- Tracing command getty pid 2123 tid 100102 td 0xfffffe000555c460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e tty_wait() at tty_wait+0x48 ttydisc_read() at ttydisc_read+0x2f1 ttydev_read() at ttydev_read+0xab devfs_read_f() at devfs_read_f+0x88 dofileread() at dofileread+0xa1 kern_readv() at kern_readv+0x6c sys_read() at sys_read+0x55 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b64a7c, rsp = 0x7fffffffdca8, rbp = 0x3 --- Tracing command getty pid 2122 tid 100092 td 0xfffffe0005658460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e tty_wait() at tty_wait+0x48 ttydisc_read() at ttydisc_read+0x2f1 ttydev_read() at ttydev_read+0xab devfs_read_f() at devfs_read_f+0x88 dofileread() at dofileread+0xa1 kern_readv() at kern_readv+0x6c sys_read() at sys_read+0x55 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b64a7c, rsp = 0x7fffffffdca8, rbp = 0x3 --- Tracing command getty pid 2121 tid 100084 td 0xfffffe00055418c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e tty_wait() at tty_wait+0x48 ttydisc_read() at ttydisc_read+0x2f1 ttydev_read() at ttydev_read+0xab devfs_read_f() at devfs_read_f+0x88 dofileread() at dofileread+0xa1 kern_readv() at kern_readv+0x6c sys_read() at sys_read+0x55 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b64a7c, rsp = 0x7fffffffdca8, rbp = 0x3 --- Tracing command getty pid 2120 tid 100098 td 0xfffffe00056b48c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e tty_wait() at tty_wait+0x48 ttydisc_read() at ttydisc_read+0x2f1 ttydev_read() at ttydev_read+0xab devfs_read_f() at devfs_read_f+0x88 dofileread() at dofileread+0xa1 kern_readv() at kern_readv+0x6c sys_read() at sys_read+0x55 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b64a7c, rsp = 0x7fffffffdca8, rbp = 0x3 --- Tracing command getty pid 2119 tid 100093 td 0xfffffe0005658000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e tty_wait() at tty_wait+0x48 ttydisc_read() at ttydisc_read+0x2f1 ttydev_read() at ttydev_read+0xab devfs_read_f() at devfs_read_f+0x88 dofileread() at dofileread+0xa1 kern_readv() at kern_readv+0x6c sys_read() at sys_read+0x55 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b64a7c, rsp = 0x7fffffffdca8, rbp = 0x3 --- Tracing command inetd pid 2080 tid 100129 td 0xfffffe00059f48c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac kern_select() at kern_select+0x6f0 sys_select() at sys_select+0x5d amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800f7a9fc, rsp = 0x7fffffffcd78, rbp = 0x1 --- Tracing command moused pid 2047 tid 100111 td 0xfffffe00056b4460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac kern_select() at kern_select+0x6f0 sys_select() at sys_select+0x5d amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800d8a9fc, rsp = 0x7fffffffd858, rbp = 0x7fffffffdf31 --- Tracing command cron pid 2023 tid 100124 td 0xfffffe00056a2000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x24d kern_nanosleep() at kern_nanosleep+0x118 sys_nanosleep() at sys_nanosleep+0x6e amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800d5167c, rsp = 0x7fffffffdae8, rbp = 0x3c --- Tracing command sendmail pid 2016 tid 100112 td 0xfffffe00056b4000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x31a kern_sigsuspend() at kern_sigsuspend+0x9b sys_sigsuspend() at sys_sigsuspend+0x34 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x801360adc, rsp = 0x7fffffffbdb8, rbp = 0x1 --- Tracing command sendmail pid 2012 tid 100099 td 0xfffffe000555d460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _cv_timedwait_sig() at _cv_timedwait_sig+0x18c seltdwait() at seltdwait+0x56 kern_select() at kern_select+0x6f0 sys_select() at sys_select+0x5d amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8014039fc, rsp = 0x7fffffffb228, rbp = 0x7fffffffb2c0 --- Tracing command sshd pid 2004 tid 100107 td 0xfffffe00055568c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac kern_select() at kern_select+0x6f0 sys_select() at sys_select+0x5d amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8025079fc, rsp = 0x7fffffffcd88, rbp = 0x2 --- Tracing command ntpd pid 1958 tid 100128 td 0xfffffe00059f5000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac kern_select() at kern_select+0x6f0 sys_select() at sys_select+0x5d amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80137b9fc, rsp = 0x7fffffffdbd8, rbp = 0x7fffffffdd08 --- Tracing command nfsd pid 1829 tid 100143 td 0xfffffe0005a168c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _cv_timedwait_sig() at _cv_timedwait_sig+0x18c svc_run_internal() at svc_run_internal+0x81a svc_thread_start() at svc_thread_start+0xb fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0xc, rip = 0x8008b071c, rsp = 0x7fffffffd698, rbp = 0x5 --- Tracing command nfsd pid 1829 tid 100142 td 0xfffffe0005a20000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _cv_timedwait_sig() at _cv_timedwait_sig+0x18c svc_run_internal() at svc_run_internal+0x81a svc_thread_start() at svc_thread_start+0xb fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0xc, rip = 0x8008b071c, rsp = 0x7fffffffd698, rbp = 0x5 --- Tracing command nfsd pid 1829 tid 100141 td 0xfffffe0005a20460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _cv_timedwait_sig() at _cv_timedwait_sig+0x18c svc_run_internal() at svc_run_internal+0x81a svc_thread_start() at svc_thread_start+0xb fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0xc, rip = 0x8008b071c, rsp = 0x7fffffffd698, rbp = 0x5 --- Tracing command nfsd pid 1829 tid 100115 td 0xfffffe00056f4000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _cv_timedwait_sig() at _cv_timedwait_sig+0x18c svc_run_internal() at svc_run_internal+0x81a svc_run() at svc_run+0x8f nfsrvd_nfsd() at nfsrvd_nfsd+0x1c7 nfssvc_nfsd() at nfssvc_nfsd+0x9b sys_nfssvc() at sys_nfssvc+0xab amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (155, FreeBSD ELF64, sys_nfssvc), rip = 0x8008b071c, rsp = 0x7fffffffd698, rbp = 0x5 --- Tracing command nfsd pid 1828 tid 100081 td 0xfffffe000565a8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac kern_select() at kern_select+0x6f0 sys_select() at sys_select+0x5d amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8009529fc, rsp = 0x7fffffffd938, rbp = 0x7fffffffdc10 --- Tracing command mountd pid 1819 tid 100126 td 0xfffffe00059f58c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac kern_select() at kern_select+0x6f0 sys_select() at sys_select+0x5d amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b699fc, rsp = 0x7fffffffdb88, rbp = 0x801086060 --- Tracing command rpcbind pid 1721 tid 100096 td 0xfffffe0005653000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _cv_timedwait_sig() at _cv_timedwait_sig+0x18c seltdwait() at seltdwait+0x56 sys_poll() at sys_poll+0x2b6 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800d0f32c, rsp = 0x7fffffffba58, rbp = 0x8010640c0 --- Tracing command syslogd pid 1695 tid 100117 td 0xfffffe0005712460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac kern_select() at kern_select+0x6f0 sys_select() at sys_select+0x5d amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b679fc, rsp = 0x7fffffffd128, rbp = 0x80108c0d0 --- Tracing command devd pid 1490 tid 100083 td 0xfffffe000565a000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _cv_wait_sig() at _cv_wait_sig+0x17e seltdwait() at seltdwait+0xac kern_select() at kern_select+0x6f0 sys_select() at sys_select+0x5d amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x449a3c, rsp = 0x7fffffffd838, rbp = 0x7fffffffd850 --- Tracing command softdepflush pid 18 tid 100076 td 0xfffffe0005542000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_timedwait() at sleepq_timedwait+0x4d _sleep() at _sleep+0x352 softdep_flush() at softdep_flush+0x264 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112c30d00, rbp = 0 --- Tracing command syncer pid 17 tid 100075 td 0xfffffe0005542460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_timedwait() at sleepq_timedwait+0x4d _cv_timedwait() at _cv_timedwait+0x18c sched_sync() at sched_sync+0x541 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112c2bd00, rbp = 0 --- Tracing command vnlru pid 16 tid 100074 td 0xfffffe00055428c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_timedwait() at sleepq_timedwait+0x4d _sleep() at _sleep+0x352 vnlru_proc() at vnlru_proc+0x586 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112c26d00, rbp = 0 --- Tracing command bufdaemon pid 9 tid 100073 td 0xfffffe0005544000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_timedwait() at sleepq_timedwait+0x4d _sleep() at _sleep+0x352 buf_daemon() at buf_daemon+0x192 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112c21d00, rbp = 0 --- Tracing command pagezero pid 8 tid 100072 td 0xfffffe0005268000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_timedwait() at sleepq_timedwait+0x4d _sleep() at _sleep+0x352 vm_pagezero() at vm_pagezero+0x73 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112c1cd00, rbp = 0 --- Tracing command vmdaemon pid 7 tid 100071 td 0xfffffe0005268460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _sleep() at _sleep+0x369 vm_daemon() at vm_daemon+0x4d fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112c17d00, rbp = 0 --- Tracing command pagedaemon pid 6 tid 100070 td 0xfffffe00052688c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_timedwait() at sleepq_timedwait+0x4d _sleep() at _sleep+0x352 vm_pageout() at vm_pageout+0x8cb fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112c12d00, rbp = 0 --- Tracing command xpt_thrd pid 5 tid 100069 td 0xfffffe000526a000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _sleep() at _sleep+0x369 xpt_scanner_thread() at xpt_scanner_thread+0xd5 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112badd00, rbp = 0 --- Tracing command sctp_iterator pid 4 tid 100068 td 0xfffffe000526a460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _sleep() at _sleep+0x369 sctp_iterator_thread() at sctp_iterator_thread+0x3f fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112ba8d00, rbp = 0 --- Tracing command fdc0 pid 3 tid 100064 td 0xfffffe000526c8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_timedwait() at sleepq_timedwait+0x4d _sleep() at _sleep+0x352 fdc_thread() at fdc_thread+0x74a fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112b90d00, rbp = 0 --- Tracing command fw0_probe pid 2 tid 100062 td 0xfffffe000526d460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x31a fw_bus_probe_thread() at fw_bus_probe_thread+0xbc fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112b78d00, rbp = 0 --- Tracing command usb pid 15 tid 100058 td 0xfffffe0004e00000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112817d00, rbp = 0 --- Tracing command usb pid 15 tid 100057 td 0xfffffe0004e00460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112812d00, rbp = 0 --- Tracing command usb pid 15 tid 100056 td 0xfffffe0004e008c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff811280dd00, rbp = 0 --- Tracing command usb pid 15 tid 100055 td 0xfffffe0004e01000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112808d00, rbp = 0 --- Tracing command usb pid 15 tid 100053 td 0xfffffe0004e018c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff811267bd00, rbp = 0 --- Tracing command usb pid 15 tid 100052 td 0xfffffe0004e02000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112676d00, rbp = 0 --- Tracing command usb pid 15 tid 100051 td 0xfffffe0004e02460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112671d00, rbp = 0 --- Tracing command usb pid 15 tid 100050 td 0xfffffe0004e028c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff811266cd00, rbp = 0 --- Tracing command usb pid 15 tid 100049 td 0xfffffe0004d42000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112623d00, rbp = 0 --- Tracing command usb pid 15 tid 100048 td 0xfffffe0004d42460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff811261ed00, rbp = 0 --- Tracing command usb pid 15 tid 100047 td 0xfffffe0004d428c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112619d00, rbp = 0 --- Tracing command usb pid 15 tid 100046 td 0xfffffe0004d43000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112614d00, rbp = 0 --- Tracing command usb pid 15 tid 100045 td 0xfffffe0004d43460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff81125cbd00, rbp = 0 --- Tracing command usb pid 15 tid 100044 td 0xfffffe0004d438c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff81125c6d00, rbp = 0 --- Tracing command usb pid 15 tid 100043 td 0xfffffe0004d45000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff81125c1d00, rbp = 0 --- Tracing command usb pid 15 tid 100042 td 0xfffffe0004d45460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff81125bcd00, rbp = 0 --- Tracing command usb pid 15 tid 100040 td 0xfffffe0004d46000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff811256ed00, rbp = 0 --- Tracing command usb pid 15 tid 100039 td 0xfffffe0004d00000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112569d00, rbp = 0 --- Tracing command usb pid 15 tid 100038 td 0xfffffe0004d00460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112564d00, rbp = 0 --- Tracing command usb pid 15 tid 100037 td 0xfffffe0004d008c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff811255fd00, rbp = 0 --- Tracing command usb pid 15 tid 100035 td 0xfffffe0004d01460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112511d00, rbp = 0 --- Tracing command usb pid 15 tid 100034 td 0xfffffe0004d018c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff811250cd00, rbp = 0 --- Tracing command usb pid 15 tid 100033 td 0xfffffe0004d03000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112507d00, rbp = 0 --- Tracing command usb pid 15 tid 100032 td 0xfffffe0004d03460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a usb_process() at usb_process+0x16b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112502d00, rbp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xfffffe00029318c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_timedwait() at sleepq_timedwait+0x4d _sleep() at _sleep+0x352 random_kthread() at random_kthread+0x1ad fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8000278d00, rbp = 0 --- Tracing command geom pid 13 tid 100015 td 0xfffffe0002915000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _sleep() at _sleep+0x369 g_io_schedule_down() at g_io_schedule_down+0x228 g_down_procbody() at g_down_procbody+0x72 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff800026ed00, rbp = 0 --- Tracing command geom pid 13 tid 100014 td 0xfffffe0002915460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _sleep() at _sleep+0x369 g_io_schedule_up() at g_io_schedule_up+0x10a g_up_procbody() at g_up_procbody+0x72 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8000269d00, rbp = 0 --- Tracing command geom pid 13 tid 100013 td 0xfffffe00029158c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _sleep() at _sleep+0x369 g_run_events() at g_run_events+0x4a8 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8000264d00, rbp = 0 --- Tracing command intr pid 12 tid 100066 td 0xfffffe000526c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100065 td 0xfffffe000526c460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea ithread_loop() at ithread_loop+0x25d fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112b95d00, rbp = 0 --- Tracing command intr pid 12 tid 100063 td 0xfffffe000526d000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea ithread_loop() at ithread_loop+0x25d fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112b81d00, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffffe0004d46460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea ithread_loop() at ithread_loop+0x25d fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112844d00, rbp = 0 --- Tracing command intr pid 12 tid 100059 td 0xfffffe0004d468c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea ithread_loop() at ithread_loop+0x25d fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff811283fd00, rbp = 0 --- Tracing command intr pid 12 tid 100054 td 0xfffffe0004e01460 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xfffffe0004d458c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea ithread_loop() at ithread_loop+0x25d fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff81125b7d00, rbp = 0 --- Tracing command intr pid 12 tid 100036 td 0xfffffe0004d01000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea ithread_loop() at ithread_loop+0x25d fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff811255ad00, rbp = 0 --- Tracing command intr pid 12 tid 100031 td 0xfffffe0004d038c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea ithread_loop() at ithread_loop+0x25d fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff81124fdd00, rbp = 0 --- Tracing command intr pid 12 tid 100030 td 0xfffffe0002933460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea ithread_loop() at ithread_loop+0x25d fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff80003bdd00, rbp = 0 --- Tracing command intr pid 12 tid 100029 td 0xfffffe00029338c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea ithread_loop() at ithread_loop+0x25d fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff80003b8d00, rbp = 0 --- Tracing command intr pid 12 tid 100028 td 0xfffffe0002ae9000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea ithread_loop() at ithread_loop+0x25d fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff80002afd00, rbp = 0 --- Tracing command intr pid 12 tid 100026 td 0xfffffe0002ae98c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100021 td 0xfffffe0002930460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea ithread_loop() at ithread_loop+0x25d fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff800028cd00, rbp = 0 --- Tracing command intr pid 12 tid 100019 td 0xfffffe0002931000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea ithread_loop() at ithread_loop+0x25d fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8000282d00, rbp = 0 --- Tracing command intr pid 12 tid 100018 td 0xfffffe0002931460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea ithread_loop() at ithread_loop+0x25d fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff800027dd00, rbp = 0 --- Tracing command intr pid 12 tid 100012 td 0xfffffe0002917000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xfffffe0002917460 cpustop_handler() at cpustop_handler+0x2b ipi_nmi_handler() at ipi_nmi_handler+0x50 trap() at trap+0x1a8 nmi_calltrap() at nmi_calltrap+0x8 --- trap 0x13, rip = 0xffffffff80b7c525, rsp = 0xffffff8000221fe0, rbp = 0xffffff800025a9b0 --- DELAY() at DELAY+0xc5 _mtx_lock_spin() at _mtx_lock_spin+0x6a _mtx_lock_spin_flags() at _mtx_lock_spin_flags+0x115 sched_add() at sched_add+0xcf setrunnable() at setrunnable+0xc0 sleepq_timeout() at sleepq_timeout+0x8f softclock() at softclock+0x2f1 intr_event_execute_handlers() at intr_event_execute_handlers+0x66 ithread_loop() at ithread_loop+0xb2 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff800025ad00, rbp = 0 --- Tracing command intr pid 12 tid 100010 td 0xfffffe00029178c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea ithread_loop() at ithread_loop+0x25d fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8000255d00, rbp = 0 --- Tracing command intr pid 12 tid 100009 td 0xfffffe00028fe460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea ithread_loop() at ithread_loop+0x25d fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8000250d00, rbp = 0 --- Tracing command intr pid 12 tid 100008 td 0xfffffe00028fe8c0 cpustop_handler() at cpustop_handler+0x2b ipi_nmi_handler() at ipi_nmi_handler+0x50 trap() at trap+0x1a8 nmi_calltrap() at nmi_calltrap+0x8 --- trap 0x13, rip = 0xffffffff80b7c507, rsp = 0xffffffff81369640, rbp = 0xffffff800024b9b0 --- DELAY() at DELAY+0xa7 _mtx_lock_spin() at _mtx_lock_spin+0x6a _mtx_lock_spin_flags() at _mtx_lock_spin_flags+0x115 sched_add() at sched_add+0xcf setrunnable() at setrunnable+0xc0 sleepq_timeout() at sleepq_timeout+0x8f softclock() at softclock+0x2f1 intr_event_execute_handlers() at intr_event_execute_handlers+0x66 ithread_loop() at ithread_loop+0xb2 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff800024bd00, rbp = 0 --- Tracing command intr pid 12 tid 100007 td 0xfffffe0002908000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea ithread_loop() at ithread_loop+0x25d fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8000246d00, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe0002908460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sched_idletd() at sched_idletd+0x2b0 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8000241d00, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe00029088c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sched_idletd() at sched_idletd+0x2b0 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff800023cd00, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe00028fd000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sched_idletd() at sched_idletd+0x11b fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8000237d00, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe00028fd460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea critical_exit() at critical_exit+0xa3 lapic_handle_timer() at lapic_handle_timer+0x96 Xtimerint() at Xtimerint+0x88 --- interrupt, rip = 0xffffffff80b1658a, rsp = 0xffffff8000232b50, rbp = 0xffffff8000232b70 --- cpu_idle_mwait() at cpu_idle_mwait+0x5a sched_idletd() at sched_idletd+0x27e fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8000232d00, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe00028fd8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_catch_signals() at sleepq_catch_signals+0x2a2 sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x31a kern_wait() at kern_wait+0x3eb sys_wait4() at sys_wait4+0x35 amd64_syscall() at amd64_syscall+0x27b Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x412f9c, rsp = 0x7fffffffd7a8, rbp = 0x7b --- Tracing command audit pid 10 tid 100001 td 0xfffffe00028fe000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _cv_wait() at _cv_wait+0x17a audit_worker() at audit_worker+0x77 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8000228d00, rbp = 0 --- Tracing command kernel pid 0 tid 100176 td 0xfffffe0005ce9460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _sleep() at _sleep+0x369 taskqueue_thread_loop() at taskqueue_thread_loop+0xb7 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8115127d00, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffffe000555d8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _sleep() at _sleep+0x369 taskqueue_thread_loop() at taskqueue_thread_loop+0xb7 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112c35d00, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe000526a8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_timedwait() at sleepq_timedwait+0x4d _sleep() at _sleep+0x352 deadlkres() at deadlkres+0x2ac fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112ba3d00, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe000526d8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d msleep_spin() at msleep_spin+0x209 taskqueue_thread_loop() at taskqueue_thread_loop+0x5f fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8112ab3d00, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe0002ae9460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _sleep() at _sleep+0x369 taskqueue_thread_loop() at taskqueue_thread_loop+0xb7 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff80002aad00, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe0002aec000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d msleep_spin() at msleep_spin+0x209 taskqueue_thread_loop() at taskqueue_thread_loop+0x5f fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff80002a0d00, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe0002aec460 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d msleep_spin() at msleep_spin+0x209 taskqueue_thread_loop() at taskqueue_thread_loop+0x5f fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff800029bd00, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe0002aec8c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d msleep_spin() at msleep_spin+0x209 taskqueue_thread_loop() at taskqueue_thread_loop+0x5f fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8000296d00, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe0002930000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _sleep() at _sleep+0x369 taskqueue_thread_loop() at taskqueue_thread_loop+0xb7 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8000291d00, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe00029308c0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _sleep() at _sleep+0x369 taskqueue_thread_loop() at taskqueue_thread_loop+0xb7 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8000287d00, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe0002933000 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_wait() at sleepq_wait+0x4d _sleep() at _sleep+0x369 taskqueue_thread_loop() at taskqueue_thread_loop+0xb7 fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8000273d00, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff811464f0 sched_switch() at sched_switch+0x157 mi_switch() at mi_switch+0x1ea sleepq_switch() at sleepq_switch+0x123 sleepq_timedwait() at sleepq_timedwait+0x4d _sleep() at _sleep+0x352 scheduler() at scheduler+0x2a1 mi_startup() at mi_startup+0x77 btext() at btext+0x2c db:0:allt> call doadump Dumping 567 out of 3947 MB:..3%..12%..23%..32%..43%..51%..63%..71%..82%..91% Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP timeout stopping cpus cpu_reset_proxy: Stopped CPU 1 (kgdb) bt #0 doadump (textdump=0x28fc000) at ../../../kern/kern_shutdown.c:261 #1 0xffffffff802f440c in db_fncall (dummy1=Variable "dummy1" is not available. ) at ../../../ddb/db_command.c:572 #2 0xffffffff802f46bd in db_command (last_cmdp=0xffffffff8110bf40, cmd_table=Variable "cmd_table" is not available. ) at ../../../ddb/db_command.c:448 #3 0xffffffff802f9133 in db_script_exec (scriptname=0xffffffff8110c7e0 "doadump", warnifnotfound=0x1) at ../../../ddb/db_script.c:302 #4 0xffffffff802f4741 in db_command (last_cmdp=0xffffffff8110bf40, cmd_table=Variable "cmd_table" is not available. ) at ../../../ddb/db_command.c:448 #5 0xffffffff802f4990 in db_command_loop () at ../../../ddb/db_command.c:501 #6 0xffffffff802f6ae9 in db_trap (type=Variable "type" is not available. ) at ../../../ddb/db_main.c:229 #7 0xffffffff8086e5f1 in kdb_trap (type=0xc, code=0x0, tf=0xffffff81150dc860) at ../../../kern/subr_kdb.c:625 #8 0xffffffff80b26ddd in trap_fatal (frame=0xffffff81150dc860, eva=Variable "eva" is not available. ) at ../../../amd64/amd64/trap.c:814 #9 0xffffffff80b27485 in trap (frame=0xffffff81150dc860) at ../../../amd64/amd64/trap.c:322 #10 0xffffffff80b115ff in calltrap () at ../../../amd64/amd64/exception.S:228 #11 0xffffffff80b0e916 in done_store_dr () at ../../../amd64/amd64/cpu_switch.S:127 #12 0xffffffff808612f7 in sched_switch (td=0xfffffe000bed7000, newtd=0xfffffe00545dd8c0, flags=Variable "flags" is not available. ) at ../../../kern/sched_ule.c:1853 #13 0xffffffff80840f4a in mi_switch (flags=0x104, newtd=0x0) at ../../../kern/kern_synch.c:465 #14 0xffffffff808799a3 in sleepq_switch (wchan=0xffffffff81152670, pri=0x0) at ../../../kern/subr_sleepqueue.c:538 #15 0xffffffff8087a5dd in sleepq_wait (wchan=0xffffffff81152670, pri=0x0) at ../../../kern/subr_sleepqueue.c:617 #16 0xffffffff80841709 in _sleep (ident=0xffffffff81152670, lock=0xffffffff81152670, priority=Variable "priority" is not available. ) at ../../../kern/kern_synch.c:234 #17 0xffffffff8084ebe4 in __umtx_op_wake_umutex (td=Variable "td" is not available. ) at ../../../kern/kern_umtx.c:327 #18 0xffffffff80b2651b in amd64_syscall (td=0xfffffe000bed7000, traced=0x0) at subr_syscall.c:131 #19 0xffffffff80b118e7 in Xfast_syscall () at ../../../amd64/amd64/exception.S:387 #20 0x000000080085f9bc in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 11 #11 0xffffffff80b0e916 in done_store_dr () at ../../../amd64/amd64/cpu_switch.S:127 127 movq TD_PCB(%rsi),%r8 Current language: auto; currently asm (kgdb) l 122 xorl %eax,%eax 123 movq %rax,PCPU(FPCURTHREAD) 124 1: 125 126 /* Save is done. Now fire up new thread. Leave old vmspace. */ 127 movq TD_PCB(%rsi),%r8 128 129 /* switch address space */ 130 movq PCB_CR3(%r8),%rcx 131 movq %cr3,%rax (kgdb) info registers rax 0xffffffff808612f7 0xffffffff808612f7 rbx 0xfffffe000bed7000 0xfffffe000bed7000 rcx 0xffffffff811622b0 0xffffffff811622b0 rdx 0xffffffff811951d8 0xffffffff811951d8 rsi 0xfffffe00545dd8c0 0xfffffe00545dd8c0 rdi 0xfffffe000bed7000 0xfffffe000bed7000 rbp 0xffffff81150dc980 0xffffff81150dc980 rsp 0xffffff81150dc928 0xffffff81150dc928 r8 0xffffff8115136d10 0xffffff8115136d10 r9 0xe 0xe r10 0x0 0x0 r11 0x1e000000 0x1e000000 r12 0xfffffe00545dd8c0 0xfffffe00545dd8c0 r13 0xffffffff81161d80 0xffffffff81161d80 r14 0x0 0x0 r15 0xfffffe000bed7428 0xfffffe000bed7428 rip 0xffffffff80b0e916 0xffffffff80b0e916 eflags 0x10007 0x10007 cs 0x20 0x20 ss 0x28 0x28 ds 0x0 0x0 es 0x0 0x0 fs 0x0 0x0 gs 0x0 0x0 (kgdb) f 18 #18 0xffffffff80b2651b in amd64_syscall (td=0xfffffe000bed7000, traced=0x0) at subr_syscall.c:131 131 error = (sa->callp->sy_call)(td, sa->args); (kgdb) p sa $3 = {code = 0x1c6, callp = 0xffffffff810b8740, args = {0x801040060, 0x12, 0x0, 0x0, 0x0, 0xa, 0xffffff81150dcc40, 0xffffffff8080c1c9}, narg = 0x5} (kgdb) p sa->callp->sy_call $6 = (sy_call_t *) 0xffffffff8084caa0 (kgdb) l *done_store_dr+0x33 0xffffffff80b0e916 is at ../../../amd64/amd64/cpu_switch.S:130. 125 126 /* Save is done. Now fire up new thread. Leave old vmspace. */ 127 movq TD_PCB(%rsi),%r8 128 129 /* switch address space */ 130 movq PCB_CR3(%r8),%rcx 131 movq %cr3,%rax 132 cmpq %rcx,%rax /* Same address space? */ 133 jne swinact 134 SETLK %rdx, TD_LOCK(%rdi) /* Release the old thread */ (kgdb) f 12 #12 0xffffffff808612f7 in sched_switch (td=0xfffffe000bed7000, newtd=0xfffffe00545dd8c0, flags=Variable "flags" is not available. ) at ../../../kern/sched_ule.c:1853 1853 cpu_switch(td, newtd, mtx); (kgdb) p *newtd $1 = {td_lock = 0xffffffff81161d80, td_proc = 0xfffffe0005758910, td_plist = {tqe_next = 0xfffffe0005d36460, tqe_prev = 0xfffffe006a1138d0}, td_runq = {tqe_next = 0xfffffe006a1c3460, tqe_prev = 0xffffffff811622b0}, td_slpq = {tqe_next = 0xfffffe006a1138c0, tqe_prev = 0xfffffe0005d378f0}, td_lockq = {tqe_next = 0xfffffe00056598c0, tqe_prev = 0xffffff8114f7e9a0}, td_hash = { le_next = 0x0, le_prev = 0xffffff80006af5a0}, td_cpuset = 0xfffffe00028e8dc8, td_sel = 0xfffffe00028ed880, td_sleepqueue = 0xfffffe0005f6bc80, td_turnstile = 0xfffffe0005f12240, td_umtxq = 0xfffffe00545df500, td_tid = 0x1dca2b4, td_sigqueue = {sq_signals = {__bits = {0x0, 0x0, 0x0, 0x0}}, sq_kill = {__bits = {0x0, 0x0, 0x0, 0x0}}, sq_list = {tqh_first = 0x0, tqh_last = 0xfffffe00545dd970}, sq_proc = 0xfffffe0005758910, sq_flags = 0x1}, td_lend_user_pri = 0xff, td_flags = 0x14, td_inhibitors = 0x0, td_pflags = 0x0, td_dupfd = 0x0, td_sqqueue = 0x0, td_wchan = 0x0, td_wmesg = 0x0, td_lastcpu = 0x0, td_oncpu = 0xff, td_owepreempt = 0x0, td_tsqueue = 0x0, td_locks = 0x0, td_rw_rlocks = 0x0, td_lk_slocks = 0x0, td_blocked = 0x0, td_lockname = 0x0, td_contested = {lh_first = 0x0}, td_sleeplocks = 0xffffffff812d9420, td_intr_nesting_level = 0x0, td_pinned = 0x0, td_ucred = 0xfffffe0005728300, td_estcpu = 0x0, td_slptick = 0x0, td_blktick = 0x0, td_swvoltick = 0x2683810, td_ru = {ru_utime = {tv_sec = 0x0, tv_usec = 0x0}, ru_stime = {tv_sec = 0x0, tv_usec = 0x0}, ru_maxrss = 0x0, ru_ixrss = 0x0, ru_idrss = 0x0, ru_isrss = 0x0, ru_minflt = 0x1, ru_majflt = 0x0, ru_nswap = 0x0, ru_inblock = 0x0, ru_oublock = 0x0, ru_msgsnd = 0x0, ru_msgrcv = 0x0, ru_nsignals = 0x0, ru_nvcsw = 0x1, ru_nivcsw = 0x0}, td_rux = {rux_runtime = 0x0, rux_uticks = 0x0, rux_sticks = 0x0, rux_iticks = 0x0, rux_uu = 0x0, rux_su = 0x0, rux_tu = 0x0}, td_incruntime = 0x9086, td_runtime = 0x9086, td_pticks = 0x0, td_sticks = 0x0, td_iticks = 0x0, td_uticks = 0x0, td_intrval = 0x0, td_oldsigmask = {__bits = {0x0, 0x0, 0x0, 0x0}}, td_sigmask = {__bits = {0x0, 0x0, 0x0, 0x0}}, td_generation = 0x1, td_sigstk = {ss_sp = 0x0, ss_size = 0x0, ss_flags = 0x0}, td_xsig = 0x0, td_profil_addr = 0x0, td_profil_ticks = 0x0, td_name = "syscall4", '\0' , td_fpop = 0x0, td_dbgflags = 0x0, td_dbgksi = {ksi_link = {tqe_next = 0x0, tqe_prev = 0x0}, ksi_info = { si_signo = 0x0, si_errno = 0x0, si_code = 0x0, si_pid = 0x0, si_uid = 0x0, si_status = 0x0, si_addr = 0x0, si_value = {sival_int = 0x0, sival_ptr = 0x0, sigval_int = 0x0, sigval_ptr = 0x0}, _reason = { _fault = {_trapno = 0x0}, _timer = {_timerid = 0x0, _overrun = 0x0}, _mesgq = {_mqd = 0x0}, _poll = {_band = 0x0}, __spare__ = {__spare1__ = 0x0, __spare2__ = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}}, ksi_flags = 0x0, ksi_sigq = 0x0}, td_ng_outbound = 0x0, td_osd = {osd_nslots = 0x0, osd_slots = 0x0, osd_next = {le_next = 0x0, le_prev = 0x0}}, td_map_def_user = 0x0, td_dbg_forked = 0x0, td_rqindex = 0xe, td_base_pri = 0x98, td_priority = 0x98, td_pri_class = 0x3, td_user_pri = 0xae, td_base_user_pri = 0xae, td_pcb = 0xffffff8115136d10, td_state = TDS_RUNNING, td_retval = {0x0, 0x0}, td_slpcallout = {c_links = {sle = {sle_next = 0xfffffe006a113c38}, tqe = {tqe_next = 0xfffffe006a113c38, tqe_prev = 0xffffff80ee90a1c0}}, c_time = 0x2683812, c_arg = 0xfffffe00545dd8c0, c_func = 0xffffffff808794b0 , c_lock = 0x0, c_flags = 0x12, c_cpu = 0x0}, td_frame = 0xffffff8115136c50, td_kstack_obj = 0xfffffe00c0f32540, td_kstack = 0xffffff8115133000, td_kstack_pages = 0x4, td_critnest = 0x1, td_md = {md_spinlock_count = 0x1, md_saved_flags = 0x246}, td_sched = 0xfffffe00545ddce8, td_ar = 0x0, td_lprof = {{lh_first = 0x0}, {lh_first = 0x0}}, td_dtrace = 0x0, td_errno = 0x4, td_vnet = 0x0, td_vnet_lpush = 0x0, td_intr_frame = 0x0} (kgdb) p *newtd->td_proc $2 = {p_list = {le_next = 0xfffffe0054568910, le_prev = 0xffffffff81149460}, p_threads = {tqh_first = 0xfffffe0005fd6460, tqh_last = 0xfffffe0005a218d0}, p_slock = {lock_object = { lo_name = 0xffffffff80d4abc2 "process slock", lo_flags = 0xb0000, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x4}, p_ucred = 0xfffffe0005728300, p_fd = 0xfffffe000561a200, p_fdtol = 0x0, p_stats = 0xfffffe0005928600, p_limit = 0xfffffe0005b1ae00, p_limco = {c_links = {sle = {sle_next = 0x0}, tqe = {tqe_next = 0x0, tqe_prev = 0x0}}, c_time = 0x0, c_arg = 0x0, c_func = 0, c_lock = 0xfffffe0005758a08, c_flags = 0x0, c_cpu = 0x0}, p_sigacts = 0xfffffe0005e07000, p_flag = 0x10000182, p_state = PRS_NORMAL, p_pid = 0x9f84, p_hash = {le_next = 0x0, le_prev = 0xffffff80006abc20}, p_pglist = {le_next = 0x0, le_prev = 0xfffffe00057e59d8}, p_pptr = 0xfffffe00057e5910, p_sibling = {le_next = 0x0, le_prev = 0xfffffe00057e5a00}, p_children = {lh_first = 0x0}, p_mtx = {lock_object = { lo_name = 0xffffffff80d4abb5 "process lock", lo_flags = 0x1430000, lo_data = 0x0, lo_witness = 0xffffff8000688400}, mtx_lock = 0x4}, p_ksi = 0xfffffe0005471690, p_sigqueue = {sq_signals = {__bits = { 0x0, 0x0, 0x0, 0x0}}, sq_kill = {__bits = {0x0, 0x0, 0x0, 0x0}}, sq_list = {tqh_first = 0x0, tqh_last = 0xfffffe0005758a50}, sq_proc = 0xfffffe0005758910, sq_flags = 0x1}, p_oppid = 0x0, p_dbg_child = 0x0, p_vmspace = 0xfffffe0005717c40, p_swtick = 0x268380e, p_realtimer = {it_interval = {tv_sec = 0x0, tv_usec = 0x0}, it_value = {tv_sec = 0x9dc2, tv_usec = 0x8146c}}, p_ru = {ru_utime = { tv_sec = 0x0, tv_usec = 0x0}, ru_stime = {tv_sec = 0x0, tv_usec = 0x0}, ru_maxrss = 0x0, ru_ixrss = 0x0, ru_idrss = 0x0, ru_isrss = 0x0, ru_minflt = 0x0, ru_majflt = 0x0, ru_nswap = 0x0, ru_inblock = 0x0, ru_oublock = 0x0, ru_msgsnd = 0x0, ru_msgrcv = 0x0, ru_nsignals = 0x0, ru_nvcsw = 0x0, ru_nivcsw = 0x0}, p_rux = {rux_runtime = 0x0, rux_uticks = 0x0, rux_sticks = 0x0, rux_iticks = 0x0, rux_uu = 0x0, rux_su = 0x0, rux_tu = 0x0}, p_crux = {rux_runtime = 0x0, rux_uticks = 0x0, rux_sticks = 0x0, rux_iticks = 0x0, rux_uu = 0x0, rux_su = 0x0, rux_tu = 0x0}, p_profthreads = 0x0, p_exitthreads = 0x0, p_traceflag = 0x0, p_tracevp = 0x0, p_tracecred = 0x0, p_textvp = 0xfffffe000b789768, p_lock = 0x0, p_sigiolst = {slh_first = 0x0}, p_sigparent = 0x14, p_sig = 0x0, p_code = 0x0, p_stops = 0x0, p_stype = 0x0, p_step = 0x0, p_pfsflags = 0x0, p_nlminfo = 0x0, p_aioinfo = 0x0, p_singlethread = 0x0, p_suspcount = 0x0, p_xthread = 0x0, p_boundary_count = 0x0, p_pendingcnt = 0x0, p_itimers = 0x0, p_procdesc = 0x0, p_magic = 0xbeefface, p_osrel = 0xf4241, p_comm = "syscall4", '\0' , p_pgrp = 0xfffffe0054509400, p_sysent = 0xffffffff810f2280, p_args = 0xfffffe000562d3a0, p_cpulimit = 0x7fffffffffffffff, p_nice = 0x0, p_fibnum = 0x0, p_xstat = 0x0, p_klist = {kl_list = {slh_first = 0x0}, kl_lock = 0xffffffff80803600 , kl_unlock = 0xffffffff80803620 , kl_assert_locked = 0xffffffff80803900 , kl_assert_unlocked = 0xffffffff808038e0 , kl_lockarg = 0xfffffe0005758a08}, p_numthreads = 0x34, p_md = {md_ldt = 0x0, md_ldt_sd = {sd_lolimit = 0x0, sd_lobase = 0x0, sd_type = 0x0, sd_dpl = 0x0, sd_p = 0x0, sd_hilimit = 0x0, sd_xx0 = 0x0, sd_gran = 0x0, sd_hibase = 0x0, sd_xx1 = 0x0, sd_mbz = 0x0, sd_xx2 = 0x0}}, p_itcallout = {c_links = {sle = {sle_next = 0x0}, tqe = {tqe_next = 0x0, tqe_prev = 0xffffff80ee90e050}}, c_time = 0x2683bfb, c_arg = 0xfffffe0005758910, c_func = 0xffffffff8084a450 , c_lock = 0x0, c_flags = 0x16, c_cpu = 0x0}, p_acflag = 0x1, p_peers = 0x0, p_leader = 0xfffffe0005758910, p_emuldata = 0x0, p_label = 0x0, p_sched = 0xfffffe0005758d98, p_ktr = {stqh_first = 0x0, stqh_last = 0xfffffe0005758d48}, p_mqnotifier = {lh_first = 0x0}, p_dtrace = 0x0, p_pwait = { cv_description = 0xffffffff80d4b61c "ppwait", cv_waiters = 0x0}, p_dbgwait = {cv_description = 0xffffffff80d4b623 "dbgwait", cv_waiters = 0x0}, p_prev_runtime = 0x0, p_racct = 0x0} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/kern/kern_umtx.c =================================================================== --- /usr/src/sys/kern/kern_umtx.c (revision 228020) +++ /usr/src/sys/kern/kern_umtx.c (working copy) @@ -2441,7 +2441,7 @@ do_rw_rdlock(struct thread *td, struct urwlock *rw uint32_t flags, wrflags; int32_t state, oldstate; int32_t blocked_readers; - int error; + int error, loops; uq = td->td_umtxq; flags = fuword32(&rwlock->rw_flags); @@ -2453,6 +2453,7 @@ do_rw_rdlock(struct thread *td, struct urwlock *rw if (!(fflag & URWLOCK_PREFER_READER) && !(flags & URWLOCK_PREFER_READER)) wrflags |= URWLOCK_WRITE_WAITERS; + loops = 0; for (;;) { state = fuword32(__DEVOLATILE(int32_t *, &rwlock->rw_state)); /* try to lock it */ @@ -2496,6 +2497,10 @@ do_rw_rdlock(struct thread *td, struct urwlock *rw umtxq_lock(&uq->uq_key); umtxq_unbusy(&uq->uq_key); umtxq_unlock(&uq->uq_key); + if (loops++) { + umtx_key_release(&uq->uq_key); + return (EINVAL); + } continue; } @@ -2577,7 +2582,7 @@ do_rw_wrlock(struct thread *td, struct urwlock *rw int32_t state, oldstate; int32_t blocked_writers; int32_t blocked_readers; - int error; + int error, loops; uq = td->td_umtxq; flags = fuword32(&rwlock->rw_flags); @@ -2586,6 +2591,7 @@ do_rw_wrlock(struct thread *td, struct urwlock *rw return (error); blocked_readers = 0; + loops = 0; for (;;) { state = fuword32(__DEVOLATILE(int32_t *, &rwlock->rw_state)); while (!(state & URWLOCK_WRITE_OWNER) && URWLOCK_READER_COUNT(state) == 0) { @@ -2633,6 +2639,10 @@ do_rw_wrlock(struct thread *td, struct urwlock *rw umtxq_lock(&uq->uq_key); umtxq_unbusy(&uq->uq_key); umtxq_unlock(&uq->uq_key); + if (loops++) { + umtx_key_release(&uq->uq_key); + return (EINVAL); + } continue; } sleep: @@ -2898,6 +2908,20 @@ sys__umtx_unlock(struct thread *td, struct _umtx_u return do_unlock_umtx(td, uap->umtx, td->td_tid); } +inline int +umtx_copyin_timeout(const void *addr, struct timespec *tsp) +{ + int error; + + error = copyin(addr, tsp, sizeof(struct timespec)); + if (error == 0) + if (tsp->tv_sec < 0 || + tsp->tv_nsec >= 1000000000 || + tsp->tv_nsec < 0) + error = EINVAL; + return (error); +} + static int __umtx_op_lock_umtx(struct thread *td, struct _umtx_op_args *uap) { @@ -2908,13 +2932,9 @@ __umtx_op_lock_umtx(struct thread *td, struct _umt if (uap->uaddr2 == NULL) ts = NULL; else { - error = copyin(uap->uaddr2, &timeout, sizeof(timeout)); + error = umtx_copyin_timeout(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) { - return (EINVAL); - } ts = &timeout; } return (do_lock_umtx(td, uap->obj, uap->val, ts)); @@ -2935,12 +2955,9 @@ __umtx_op_wait(struct thread *td, struct _umtx_op_ if (uap->uaddr2 == NULL) ts = NULL; else { - error = copyin(uap->uaddr2, &timeout, sizeof(timeout)); + error = umtx_copyin_timeout(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) - return (EINVAL); ts = &timeout; } return do_wait(td, uap->obj, uap->val, ts, 0, 0); @@ -2955,12 +2972,9 @@ __umtx_op_wait_uint(struct thread *td, struct _umt if (uap->uaddr2 == NULL) ts = NULL; else { - error = copyin(uap->uaddr2, &timeout, sizeof(timeout)); + error = umtx_copyin_timeout(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) - return (EINVAL); ts = &timeout; } return do_wait(td, uap->obj, uap->val, ts, 1, 0); @@ -2975,12 +2989,9 @@ __umtx_op_wait_uint_private(struct thread *td, str if (uap->uaddr2 == NULL) ts = NULL; else { - error = copyin(uap->uaddr2, &timeout, sizeof(timeout)); + error = umtx_copyin_timeout(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) - return (EINVAL); ts = &timeout; } return do_wait(td, uap->obj, uap->val, ts, 1, 1); @@ -3034,14 +3045,9 @@ __umtx_op_lock_umutex(struct thread *td, struct _u if (uap->uaddr2 == NULL) ts = NULL; else { - error = copyin(uap->uaddr2, &timeout, - sizeof(timeout)); + error = umtx_copyin_timeout(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) { - return (EINVAL); - } ts = &timeout; } return do_lock_umutex(td, uap->obj, ts, 0); @@ -3063,14 +3069,9 @@ __umtx_op_wait_umutex(struct thread *td, struct _u if (uap->uaddr2 == NULL) ts = NULL; else { - error = copyin(uap->uaddr2, &timeout, - sizeof(timeout)); + error = umtx_copyin_timeout(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) { - return (EINVAL); - } ts = &timeout; } return do_lock_umutex(td, uap->obj, ts, _UMUTEX_WAIT); @@ -3104,14 +3105,9 @@ __umtx_op_cv_wait(struct thread *td, struct _umtx_ if (uap->uaddr2 == NULL) ts = NULL; else { - error = copyin(uap->uaddr2, &timeout, - sizeof(timeout)); + error = umtx_copyin_timeout(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) { - return (EINVAL); - } ts = &timeout; } return (do_cv_wait(td, uap->obj, uap->uaddr1, ts, uap->val)); @@ -3139,14 +3135,9 @@ __umtx_op_rw_rdlock(struct thread *td, struct _umt if (uap->uaddr2 == NULL) { error = do_rw_rdlock(td, uap->obj, uap->val, 0); } else { - error = copyin(uap->uaddr2, &timeout, - sizeof(timeout)); + error = umtx_copyin_timeout(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) { - return (EINVAL); - } error = do_rw_rdlock2(td, uap->obj, uap->val, &timeout); } return (error); @@ -3162,14 +3153,9 @@ __umtx_op_rw_wrlock(struct thread *td, struct _umt if (uap->uaddr2 == NULL) { error = do_rw_wrlock(td, uap->obj, 0); } else { - error = copyin(uap->uaddr2, &timeout, - sizeof(timeout)); + error = umtx_copyin_timeout(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) { - return (EINVAL); - } error = do_rw_wrlock2(td, uap->obj, &timeout); } @@ -3192,14 +3178,9 @@ __umtx_op_sem_wait(struct thread *td, struct _umtx if (uap->uaddr2 == NULL) ts = NULL; else { - error = copyin(uap->uaddr2, &timeout, - sizeof(timeout)); + error = umtx_copyin_timeout(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) { - return (EINVAL); - } ts = &timeout; } return (do_sem_wait(td, uap->obj, ts)); @@ -3274,8 +3255,14 @@ copyin_timeout32(void *addr, struct timespec *tsp) error = copyin(addr, &ts32, sizeof(struct timespec32)); if (error == 0) { - tsp->tv_sec = ts32.tv_sec; - tsp->tv_nsec = ts32.tv_nsec; + if (ts32.tv_sec < 0 || + ts32.tv_nsec >= 1000000000 || + ts32.tv_nsec < 0) + error = EINVAL; + else { + tsp->tv_sec = ts32.tv_sec; + tsp->tv_nsec = ts32.tv_nsec; + } } return (error); } @@ -3293,10 +3280,6 @@ __umtx_op_lock_umtx_compat32(struct thread *td, st error = copyin_timeout32(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) { - return (EINVAL); - } ts = &timeout; } return (do_lock_umtx32(td, uap->obj, uap->val, ts)); @@ -3320,9 +3303,6 @@ __umtx_op_wait_compat32(struct thread *td, struct error = copyin_timeout32(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) - return (EINVAL); ts = &timeout; } return do_wait(td, uap->obj, uap->val, ts, 1, 0); @@ -3341,9 +3321,6 @@ __umtx_op_lock_umutex_compat32(struct thread *td, error = copyin_timeout32(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) - return (EINVAL); ts = &timeout; } return do_lock_umutex(td, uap->obj, ts, 0); @@ -3362,9 +3339,6 @@ __umtx_op_wait_umutex_compat32(struct thread *td, error = copyin_timeout32(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) - return (EINVAL); ts = &timeout; } return do_lock_umutex(td, uap->obj, ts, _UMUTEX_WAIT); @@ -3383,9 +3357,6 @@ __umtx_op_cv_wait_compat32(struct thread *td, stru error = copyin_timeout32(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) - return (EINVAL); ts = &timeout; } return (do_cv_wait(td, uap->obj, uap->uaddr1, ts, uap->val)); @@ -3404,10 +3375,6 @@ __umtx_op_rw_rdlock_compat32(struct thread *td, st error = copyin_timeout32(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) { - return (EINVAL); - } error = do_rw_rdlock2(td, uap->obj, uap->val, &timeout); } return (error); @@ -3426,10 +3393,6 @@ __umtx_op_rw_wrlock_compat32(struct thread *td, st error = copyin_timeout32(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) { - return (EINVAL); - } error = do_rw_wrlock2(td, uap->obj, &timeout); } @@ -3448,9 +3411,6 @@ __umtx_op_wait_uint_private_compat32(struct thread error = copyin_timeout32(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) - return (EINVAL); ts = &timeout; } return do_wait(td, uap->obj, uap->val, ts, 1, 1); @@ -3469,9 +3429,6 @@ __umtx_op_sem_wait_compat32(struct thread *td, str error = copyin_timeout32(uap->uaddr2, &timeout); if (error != 0) return (error); - if (timeout.tv_nsec >= 1000000000 || - timeout.tv_nsec < 0) - return (EINVAL); ts = &timeout; } return (do_sem_wait(td, uap->obj, ts)); Index: /usr/src/sys/kern/kern_thr.c =================================================================== --- /usr/src/sys/kern/kern_thr.c (revision 228020) +++ /usr/src/sys/kern/kern_thr.c (working copy) @@ -450,8 +450,7 @@ sys_thr_suspend(struct thread *td, struct thr_susp tsp = NULL; if (uap->timeout != NULL) { - error = copyin((const void *)uap->timeout, (void *)&ts, - sizeof(struct timespec)); + error = umtx_copyin_timeout(uap->timeout, &ts); if (error != 0) return (error); tsp = &ts; @@ -474,9 +473,6 @@ kern_thr_suspend(struct thread *td, struct timespe } if (tsp != NULL) { - if (tsp->tv_sec < 0 || tsp->tv_nsec < 0 || - tsp->tv_nsec > 1000000000) - return (EINVAL); if (tsp->tv_sec == 0 && tsp->tv_nsec == 0) error = EWOULDBLOCK; else { Index: /usr/src/sys/sys/umtx.h =================================================================== --- /usr/src/sys/sys/umtx.h (revision 228020) +++ /usr/src/sys/sys/umtx.h (working copy) @@ -223,6 +223,7 @@ umtx_key_match(const struct umtx_key *k1, const st k1->info.both.b == k2->info.both.b); } +int umtx_copyin_timeout(const void *, struct timespec *); int umtx_key_get(void *, int, int, struct umtx_key *); void umtx_key_release(struct umtx_key *); struct umtx_q *umtxq_alloc(void); -- Test scenario: syscall4.sh