GENERIC HEAD from 2015-10-27 14:21:24 UTC, r290048M, vmcore.441 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2015 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-CURRENT #2 r290048M: Wed Oct 28 14:54:25 CET 2015 pho@t1.osted.lan:/usr/src/sys/amd64/compile/MAXMEMDOM amd64 FreeBSD clang version 3.7.0 (tags/RELEASE_370/final 246257) 20150906 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.24-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206d7 Family=0x6 Model=0x2d Stepping=7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 66602323968 (63516 MB) : Trying to mount root from ufs:/dev/da0p2 [rw]... Setting hostuuid: 3141f787-07e3-e111-b968-001e6756c168. Setting hostid: 0x564ac5b6. Starting ddb. Starting file system checks: /dev/da0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p2: clean, 52661320 free (600712 frags, 6507576 blocks, 0.6% fragmentation) /dev/da0p3: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p3: clean, 21728112 free (4632 frags, 2715435 blocks, 0.0% fragmentation) Mounting local file systems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat /usr/local/lib/gcc48 /usr/local/lib/gcc49 /usr/local/lib/nss /usr/local/lib/qt4 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: t1.osted.lan. Setting up harvesting:[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy:. Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo igb0: flags=8843 metric 0 mtu 1500 options=403bb ether 00:1e:67:56:c1:68 inet 192.168.1.108 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::21e:67ff:fe56:c168%igb0 prefixlen 64 scopeid 0x1 nd6 options=23 media: Ethernet autoselect (1000baseT ) status: active igb1: flags=8c02 metric 0 mtu 1500 options=403bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: igb1. igb1: flags=8c02 metric 0 mtu 1500 options=403bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Configuring vt: keymap. ums0: on usbus2 ums0: 3 buttons and [Z] coordinates ID=0 Starting ums0 moused. add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Starting rtsold. Creating and/or trimming log files. Starting syslogd. Starting watchdogd. No core dumps found. Starting rpcbind. NFS access cache time=60 Starting casperd. lock order reversal: 1st 0xfffffe0f8fa5e3e0 bufwait (bufwait) @ kern/vfs_bio.c:3477 2nd 0xfffff80019ff7400 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:281 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe104876d350 witness_checkorder() at witness_checkorder+0xe79/frame 0xfffffe104876d3d0 _sx_xlock() at _sx_xlock+0x72/frame 0xfffffe104876d410 ufsdirhash_add() at ufsdirhash_add+0x4d/frame 0xfffffe104876d470 ufs_direnter() at ufs_direnter+0x62f/frame 0xfffffe104876d540 ufs_mkdir() at ufs_mkdir+0x8ba/frame 0xfffffe104876d740 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x115/frame 0xfffffe104876d770 kern_mkdirat() at kern_mkdirat+0x1fd/frame 0xfffffe104876d9a0 amd64_syscall() at amd64_syscall+0x2f9/frame 0xfffffe104876dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104876dab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80095fd3a, rsp = 0x7fffffffe788, rbp = 0x7fffffffec60 --- Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Starting saslauthd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backup. Starting inetd. Wed Oct 28 15:00:36 CET 2015 FreeBSD/amd64 (t1.osted.lan) (ttyu1) login: root Password: Oct 28 15:02:49 t1 login: ROOT LOGIN (root) ON ttyu1 Last login: Wed Oct 28 13:11:46 on ttyu1 FreeBSD 11.0-CURRENT (MAXMEMDOM) #2 r290048M: Wed Oct 28 14:54:25 CET 2015 You have new mail. root@t1:~ # init 1 Stopping inetd. Waiting for PIDS: 932. Shutting down local packages:. Stopping cron. Waiting for PIDS: 824. Stopping sshd. Waiting for PIDS: 814. Stopping saslauthd. Waiting for PIDS: 759. Stopping powerd. Waiting for PIDS: 743. Stopping ntpd. Waiting for PIDS: 740, 740. Stopping nfsd. Waiting for PIDS: 700 704. Stopping mountd. Waiting for PIDS: 694, 694. Stopping nfsuserd. Waiting for PIDS: 683 684 685 686 687. Stopping casperd. Waiting for PIDS: 666. Stopping rpcbind. Waiting for PIDS: 651. Stopping watchdogd. Waiting for PIDS: 636. Stopping rtsold. Waiting for PIDS: 524. Stopping devd. Waiting for PIDS: 484. Writing entropy file:. Writing early boot entropy file:. . Terminated Oct 28 15:02:55 t1 syslogd: exiting on signal 15 Enter full pathname of shell or RETURN for /bin/sh: # cd ~pho/stress2/misc # sh -x ./maxmemdom.sh + . ../default.cfg + export 'RUNDIR=/var/tmp/stressX' + export 'RUNTIME=2m' + export 'VERBOSE=1' + export 'LOAD=20' + export 'INCARNATIONS=20' + export 'BLASTHOST=192.168.1.3' + export 'runRUNTIME=3d' + export 'runINCARNATIONS=1' + export 'runLOAD=100' + export 'swapINCARNATIONS=40' + export 'swapLOAD=80' + export 'syscallKILL=1' + export 'swapKILL=1' + export 'rwLOAD=70' + export 'mkdirLOAD=80' + export 'creatLOAD=80' + export 'symlinkLOAD=20' + export 'tcpKILL=1' + export 'shmINCARNATIONS=5' + export 'TESTPROGS= testcases/rw/rw testcases/swap/swap testcases/creat/creat testcases/mkdir/mkdir testcases/thr1/thr1 testcases/udp/udp testcases/tcp/tcp ' + diskimage=/var/tmp/diskimage + mntpoint=/mnt + testuser=pho + mdstart=5 + part=a + newfs_flags=-U + CC=cc + pwd + dirname /home/pho/stress2/misc + top=/home/pho/stress2 + STRESS2BIN=/home/pho/stress2/bin + hostname + [ -f ./t1.osted.lan ] + hostname + [ -f ../t1.osted.lan ] + hostname + . ../t1.osted.lan + export 'BLASTHOST=192.168.1.109' + export 'nfs_export=t2:/tmp' + testuser=stress + ps auxH + grep -v grep + grep -q dom1 + swapinfo + wc -l + [ 1 -eq 1 ] + exit 0 # swapon -a swapon: adding /dev/da0p4 as swap device # swapon -ah -x ./maxmemdom.sh + . ../default.cfg + export 'RUNDIR=/var/tmp/stressX' + export 'RUNTIME=2m' + export 'VERBOSE=1' + export 'LOAD=20' + export 'INCARNATIONS=20' + export 'BLASTHOST=192.168.1.3' + export 'runRUNTIME=3d' + export 'runINCARNATIONS=1' + export 'runLOAD=100' + export 'swapINCARNATIONS=40' + export 'swapLOAD=80' + export 'syscallKILL=1' + export 'swapKILL=1' + export 'rwLOAD=70' + export 'mkdirLOAD=80' + export 'creatLOAD=80' + export 'symlinkLOAD=20' + export 'tcpKILL=1' + export 'shmINCARNATIONS=5' + export 'TESTPROGS= testcases/rw/rw testcases/swap/swap testcases/creat/creat testcases/mkdir/mkdir testcases/thr1/thr1 testcases/udp/udp testcases/tcp/tcp ' + diskimage=/var/tmp/diskimage + mntpoint=/mnt + testuser=pho + mdstart=5 + part=a + newfs_flags=-U + CC=cc + pwd + dirname /home/pho/stress2/misc + top=/home/pho/stress2 + STRESS2BIN=/home/pho/stress2/bin + hostname + [ -f ./t1.osted.lan ] + hostname + [ -f ../t1.osted.lan ] + hostname + . ../t1.osted.lan + export 'BLASTHOST=192.168.1.109' + export 'nfs_export=t2:/tmp' + testuser=stress + ps auxH + grep -v grep + grep -q dom1 + swapinfo + wc -l + [ 2 -eq 1 ] + sysctl -n hw.physmem + size=65428 + need=130856 + d1=/var/tmp/diskimage.1 + d2=/var/tmp/diskimage.2 + rm -f /var/tmp/diskimage.1 /var/tmp/diskimage.2 + dirname /var/tmp/diskimage + tail -1 + awk '{print int($4 / 1024)}' + df -k /var/tmp + [ 195112 -lt 130856 ] + dd 'if=/dev/zero' 'of=/var/tmp/diskimage.1' 'bs=1m' 'count=65428' + egrep -v 'records|transferred' panic: adrian cpuid = 5 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe1048776f70 vpanic() at vpanic+0x182/frame 0xfffffe1048776ff0 panic() at panic+0x43/frame 0xfffffe1048777050 vm_phys_alloc_pages() at vm_phys_alloc_pages+0x154/frame 0xfffffe10487770c0 vm_page_alloc() at vm_page_alloc+0x386/frame 0xfffffe1048777140 vm_page_grab() at vm_page_grab+0x335/frame 0xfffffe10487771c0 allocbuf() at allocbuf+0x3ab/frame 0xfffffe1048777230 getblk() at getblk+0x7bc/frame 0xfffffe10487772d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x18c0/frame 0xfffffe1048777490 ffs_write() at ffs_write+0x25b/frame 0xfffffe1048777540 VOP_WRITE_APV() at VOP_WRITE_APV+0x195/frame 0xfffffe1048777650 vn_write() at vn_write+0x289/frame 0xfffffe10487776d0 vn_io_fault1() at vn_io_fault1+0x1d2/frame 0xfffffe1048777830 vn_io_fault() at vn_io_fault+0x192/frame 0xfffffe10487778b0 dofilewrite() at dofilewrite+0x8a/frame 0xfffffe1048777900 kern_writev() at kern_writev+0x68/frame 0xfffffe1048777950 sys_write() at sys_write+0x60/frame 0xfffffe10487779a0 amd64_syscall() at amd64_syscall+0x2f9/frame 0xfffffe1048777ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048777ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8009740aa, rsp = 0x7fffffffe9b8, rbp = 0x7fffffffe9e0 --- KDB: enter: panic [ thread pid 1305 tid 100196 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> set $lines 0 db> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 DOMAIN: 1 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 001918 | 000000 11 (008192K) | 000007 | 000000 10 (004096K) | 000014 | 000000 09 (002048K) | 000006 | 000000 08 (001024K) | 000005 | 000001 07 (000512K) | 000002 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000000 | 000001 04 (000064K) | 000000 | 000001 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000003 01 (000008K) | 000001 | 000000 00 (000004K) | 000000 | 000000 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db> run pho db:0:pho> bt Tracing pid 1305 tid 100196 td 0xfffff8084047f000 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe1048776f70 vpanic() at vpanic+0x19f/frame 0xfffffe1048776ff0 panic() at panic+0x43/frame 0xfffffe1048777050 vm_phys_alloc_pages() at vm_phys_alloc_pages+0x154/frame 0xfffffe10487770c0 vm_page_alloc() at vm_page_alloc+0x386/frame 0xfffffe1048777140 vm_page_grab() at vm_page_grab+0x335/frame 0xfffffe10487771c0 allocbuf() at allocbuf+0x3ab/frame 0xfffffe1048777230 getblk() at getblk+0x7bc/frame 0xfffffe10487772d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x18c0/frame 0xfffffe1048777490 ffs_write() at ffs_write+0x25b/frame 0xfffffe1048777540 VOP_WRITE_APV() at VOP_WRITE_APV+0x195/frame 0xfffffe1048777650 vn_write() at vn_write+0x289/frame 0xfffffe10487776d0 vn_io_fault1() at vn_io_fault1+0x1d2/frame 0xfffffe1048777830 vn_io_fault() at vn_io_fault+0x192/frame 0xfffffe10487778b0 dofilewrite() at dofilewrite+0x8a/frame 0xfffffe1048777900 kern_writev() at kern_writev+0x68/frame 0xfffffe1048777950 sys_write() at sys_write+0x60/frame 0xfffffe10487779a0 amd64_syscall() at amd64_syscall+0x2f9/frame 0xfffffe1048777ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048777ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8009740aa, rsp = 0x7fffffffe9b8, rbp = 0x7fffffffe9e0 --- db:0:bt> show allpcpu Current CPU: 5 cpuid = 0 dynamic pcpu = 0x7b9480 curthread = 0xfffff8000b6e19a0: pid 11 "idle: cpu0" curpcb = 0xfffffe0f9421fb80 fpcurthread = none idlethread = 0xfffff8000b6e19a0: tid 100004 "idle: cpu0" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1a790 commontssp = 0xffffffff81d1a790 rsp0 = 0xfffffe0f9421fb80 gs32p = 0xffffffff81d20fe8 ldt = 0xffffffff81d21028 tss = 0xffffffff81d21018 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe108425b480 curthread = 0xfffff8000b6e14d0: pid 11 "idle: cpu1" curpcb = 0xfffffe0f94224b80 fpcurthread = none idlethread = 0xfffff8000b6e14d0: tid 100005 "idle: cpu1" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1a7f8 commontssp = 0xffffffff81d1a7f8 rsp0 = 0xfffffe0f94224b80 gs32p = 0xffffffff81d21050 ldt = 0xffffffff81d21090 tss = 0xffffffff81d21080 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe1084262480 curthread = 0xfffff8000b6e1000: pid 11 "idle: cpu2" curpcb = 0xfffffe0f94229b80 fpcurthread = none idlethread = 0xfffff8000b6e1000: tid 100006 "idle: cpu2" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1a860 commontssp = 0xffffffff81d1a860 rsp0 = 0xfffffe0f94229b80 gs32p = 0xffffffff81d210b8 ldt = 0xffffffff81d210f8 tss = 0xffffffff81d210e8 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe1084269480 curthread = 0xfffff8000b6e09a0: pid 11 "idle: cpu3" curpcb = 0xfffffe0f9422eb80 fpcurthread = none idlethread = 0xfffff8000b6e09a0: tid 100007 "idle: cpu3" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1a8c8 commontssp = 0xffffffff81d1a8c8 rsp0 = 0xfffffe0f9422eb80 gs32p = 0xffffffff81d21120 ldt = 0xffffffff81d21160 tss = 0xffffffff81d21150 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe1084270480 curthread = 0xfffff8000b6e04d0: pid 11 "idle: cpu4" curpcb = 0xfffffe0f94233b80 fpcurthread = none idlethread = 0xfffff8000b6e04d0: tid 100008 "idle: cpu4" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1a930 commontssp = 0xffffffff81d1a930 rsp0 = 0xfffffe0f94233b80 gs32p = 0xffffffff81d21188 ldt = 0xffffffff81d211c8 tss = 0xffffffff81d211b8 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe1084277480 curthread = 0xfffff8084047f000: pid 1305 "dd" curpcb = 0xfffffe1048777b80 fpcurthread = 0xfffff8084047f000: pid 1305 "dd" idlethread = 0xfffff8000b6e0000: tid 100009 "idle: cpu5" curpmap = 0xfffff80019f67138 tssp = 0xffffffff81d1a998 commontssp = 0xffffffff81d1a998 rsp0 = 0xfffffe1048777b80 gs32p = 0xffffffff81d211f0 ldt = 0xffffffff81d21230 tss = 0xffffffff81d21220 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe108427e480 curthread = 0xfffff8000b6f79a0: pid 11 "idle: cpu6" curpcb = 0xfffffe0f9423db80 fpcurthread = none idlethread = 0xfffff8000b6f79a0: tid 100010 "idle: cpu6" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1aa00 commontssp = 0xffffffff81d1aa00 rsp0 = 0xfffffe0f9423db80 gs32p = 0xffffffff81d21258 ldt = 0xffffffff81d21298 tss = 0xffffffff81d21288 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe1084285480 curthread = 0xfffff8000b6f74d0: pid 11 "idle: cpu7" curpcb = 0xfffffe0f94242b80 fpcurthread = none idlethread = 0xfffff8000b6f74d0: tid 100011 "idle: cpu7" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1aa68 commontssp = 0xffffffff81d1aa68 rsp0 = 0xfffffe0f94242b80 gs32p = 0xffffffff81d212c0 ldt = 0xffffffff81d21300 tss = 0xffffffff81d212f0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe108428c480 curthread = 0xfffff8000b6f7000: pid 11 "idle: cpu8" curpcb = 0xfffffe0f94247b80 fpcurthread = none idlethread = 0xfffff8000b6f7000: tid 100012 "idle: cpu8" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1aad0 commontssp = 0xffffffff81d1aad0 rsp0 = 0xfffffe0f94247b80 gs32p = 0xffffffff81d21328 ldt = 0xffffffff81d21368 tss = 0xffffffff81d21358 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe1084293480 curthread = 0xfffff8000b6f69a0: pid 11 "idle: cpu9" curpcb = 0xfffffe0f9424cb80 fpcurthread = none idlethread = 0xfffff8000b6f69a0: tid 100013 "idle: cpu9" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1ab38 commontssp = 0xffffffff81d1ab38 rsp0 = 0xfffffe0f9424cb80 gs32p = 0xffffffff81d21390 ldt = 0xffffffff81d213d0 tss = 0xffffffff81d213c0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe108429a480 curthread = 0xfffff8000b6f64d0: pid 11 "idle: cpu10" curpcb = 0xfffffe0f94251b80 fpcurthread = none idlethread = 0xfffff8000b6f64d0: tid 100014 "idle: cpu10" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1aba0 commontssp = 0xffffffff81d1aba0 rsp0 = 0xfffffe0f94251b80 gs32p = 0xffffffff81d213f8 ldt = 0xffffffff81d21438 tss = 0xffffffff81d21428 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe10842a1480 curthread = 0xfffff8000b6f6000: pid 11 "idle: cpu11" curpcb = 0xfffffe0f94256b80 fpcurthread = none idlethread = 0xfffff8000b6f6000: tid 100015 "idle: cpu11" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1ac08 commontssp = 0xffffffff81d1ac08 rsp0 = 0xfffffe0f94256b80 gs32p = 0xffffffff81d21460 ldt = 0xffffffff81d214a0 tss = 0xffffffff81d21490 spin locks held: cpuid = 12 dynamic pcpu = 0xfffffe10842a8480 curthread = 0xfffff8000b6f59a0: pid 11 "idle: cpu12" curpcb = 0xfffffe0f9425bb80 fpcurthread = none idlethread = 0xfffff8000b6f59a0: tid 100016 "idle: cpu12" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1ac70 commontssp = 0xffffffff81d1ac70 rsp0 = 0xfffffe0f9425bb80 gs32p = 0xffffffff81d214c8 ldt = 0xffffffff81d21508 tss = 0xffffffff81d214f8 spin locks held: cpuid = 13 dynamic pcpu = 0xfffffe10842af480 curthread = 0xfffff8000b6f54d0: pid 11 "idle: cpu13" curpcb = 0xfffffe0f94260b80 fpcurthread = none idlethread = 0xfffff8000b6f54d0: tid 100017 "idle: cpu13" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1acd8 commontssp = 0xffffffff81d1acd8 rsp0 = 0xfffffe0f94260b80 gs32p = 0xffffffff81d21530 ldt = 0xffffffff81d21570 tss = 0xffffffff81d21560 spin locks held: cpuid = 14 dynamic pcpu = 0xfffffe10842b6480 curthread = 0xfffff8000b6f5000: pid 11 "idle: cpu14" curpcb = 0xfffffe0f94265b80 fpcurthread = none idlethread = 0xfffff8000b6f5000: tid 100018 "idle: cpu14" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1ad40 commontssp = 0xffffffff81d1ad40 rsp0 = 0xfffffe0f94265b80 gs32p = 0xffffffff81d21598 ldt = 0xffffffff81d215d8 tss = 0xffffffff81d215c8 spin locks held: cpuid = 15 dynamic pcpu = 0xfffffe10842bd480 curthread = 0xfffff8000b6fa9a0: pid 11 "idle: cpu15" curpcb = 0xfffffe0f9426ab80 fpcurthread = none idlethread = 0xfffff8000b6fa9a0: tid 100019 "idle: cpu15" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1ada8 commontssp = 0xffffffff81d1ada8 rsp0 = 0xfffffe0f9426ab80 gs32p = 0xffffffff81d21600 ldt = 0xffffffff81d21640 tss = 0xffffffff81d21630 spin locks held: cpuid = 16 dynamic pcpu = 0xfffffe10842c4480 curthread = 0xfffff8000b6fa4d0: pid 11 "idle: cpu16" curpcb = 0xfffffe0f9426fb80 fpcurthread = none idlethread = 0xfffff8000b6fa4d0: tid 100020 "idle: cpu16" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1ae10 commontssp = 0xffffffff81d1ae10 rsp0 = 0xfffffe0f9426fb80 gs32p = 0xffffffff81d21668 ldt = 0xffffffff81d216a8 tss = 0xffffffff81d21698 spin locks held: cpuid = 17 dynamic pcpu = 0xfffffe10842cb480 curthread = 0xfffff8000b6fa000: pid 11 "idle: cpu17" curpcb = 0xfffffe0f94274b80 fpcurthread = none idlethread = 0xfffff8000b6fa000: tid 100021 "idle: cpu17" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1ae78 commontssp = 0xffffffff81d1ae78 rsp0 = 0xfffffe0f94274b80 gs32p = 0xffffffff81d216d0 ldt = 0xffffffff81d21710 tss = 0xffffffff81d21700 spin locks held: cpuid = 18 dynamic pcpu = 0xfffffe10842d2480 curthread = 0xfffff8000b6f99a0: pid 11 "idle: cpu18" curpcb = 0xfffffe0f94279b80 fpcurthread = none idlethread = 0xfffff8000b6f99a0: tid 100022 "idle: cpu18" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1aee0 commontssp = 0xffffffff81d1aee0 rsp0 = 0xfffffe0f94279b80 gs32p = 0xffffffff81d21738 ldt = 0xffffffff81d21778 tss = 0xffffffff81d21768 spin locks held: cpuid = 19 dynamic pcpu = 0xfffffe10842d9480 curthread = 0xfffff8000b6f94d0: pid 11 "idle: cpu19" curpcb = 0xfffffe0f9427eb80 fpcurthread = none idlethread = 0xfffff8000b6f94d0: tid 100023 "idle: cpu19" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1af48 commontssp = 0xffffffff81d1af48 rsp0 = 0xfffffe0f9427eb80 gs32p = 0xffffffff81d217a0 ldt = 0xffffffff81d217e0 tss = 0xffffffff81d217d0 spin locks held: cpuid = 20 dynamic pcpu = 0xfffffe10842e0480 curthread = 0xfffff8000b6f9000: pid 11 "idle: cpu20" curpcb = 0xfffffe0f94283b80 fpcurthread = none idlethread = 0xfffff8000b6f9000: tid 100024 "idle: cpu20" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1afb0 commontssp = 0xffffffff81d1afb0 rsp0 = 0xfffffe0f94283b80 gs32p = 0xffffffff81d21808 ldt = 0xffffffff81d21848 tss = 0xffffffff81d21838 spin locks held: cpuid = 21 dynamic pcpu = 0xfffffe10842e7480 curthread = 0xfffff8000b6f89a0: pid 11 "idle: cpu21" curpcb = 0xfffffe0f94288b80 fpcurthread = none idlethread = 0xfffff8000b6f89a0: tid 100025 "idle: cpu21" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1b018 commontssp = 0xffffffff81d1b018 rsp0 = 0xfffffe0f94288b80 gs32p = 0xffffffff81d21870 ldt = 0xffffffff81d218b0 tss = 0xffffffff81d218a0 spin locks held: cpuid = 22 dynamic pcpu = 0xfffffe10842ee480 curthread = 0xfffff8000b6f84d0: pid 11 "idle: cpu22" curpcb = 0xfffffe0f9428db80 fpcurthread = none idlethread = 0xfffff8000b6f84d0: tid 100026 "idle: cpu22" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1b080 commontssp = 0xffffffff81d1b080 rsp0 = 0xfffffe0f9428db80 gs32p = 0xffffffff81d218d8 ldt = 0xffffffff81d21918 tss = 0xffffffff81d21908 spin locks held: cpuid = 23 dynamic pcpu = 0xfffffe10842f5480 curthread = 0xfffff8000b6f8000: pid 11 "idle: cpu23" curpcb = 0xfffffe0f94292b80 fpcurthread = none idlethread = 0xfffff8000b6f8000: tid 100027 "idle: cpu23" curpmap = 0xffffffff81ce4890 tssp = 0xffffffff81d1b0e8 commontssp = 0xffffffff81d1b0e8 rsp0 = 0xfffffe0f94292b80 gs32p = 0xffffffff81d21940 ldt = 0xffffffff81d21980 tss = 0xffffffff81d21970 spin locks held: db:0:allpcpu> show alllocks Process 1305 (dd) thread 0xfffff8084047f000 (100196) exclusive sleep mutex vm page free queue (vm page free queue) r = 0 (0xffffffff81d19a80) locked @ vm/vm_page.c:1629 exclusive rw vm object (vm object) r = 0 (0xfffff80090b66600) locked @ kern/vfs_bio.c:2673 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0f91994c60) locked @ kern/vfs_bio.c:1454 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0f907ea498) locked @ kern/vfs_bio.c:3477 exclusive lockmgr ufs (ufs) r = 0 (0xfffff808986d72d8) locked @ kern/vfs_vnops.c:873 db:0:alllocks> show lockedvnods Locked vnodes 0xfffff808986d7270: tag ufs, type VREG usecount 1, writecount 1, refcount 50478 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80090b66600 ref 0 pages 8067686 cleanbuf 50411 dirtybuf 65 lock type ufs: EXCL by thread 0xfffff8084047f000 (pid 1305, dd, tid 100196) #0 0xffffffff80a041b2 at __lockmgr_args+0x1042 #1 0xffffffff80cc3870 at ffs_lock+0xb0 #2 0xffffffff80fd4bc0 at VOP_LOCK1_APV+0x100 #3 0xffffffff80aebd72 at _vn_lock+0xc2 #4 0xffffffff80aee927 at vn_write+0x177 #5 0xffffffff80aec3d2 at vn_io_fault1+0x1d2 #6 0xffffffff80aea612 at vn_io_fault+0x192 #7 0xffffffff80a870fa at dofilewrite+0x8a #8 0xffffffff80a86e08 at kern_writev+0x68 #9 0xffffffff80a86d90 at sys_write+0x60 #10 0xffffffff80e88499 at amd64_syscall+0x2f9 #11 0xffffffff80e6802b at Xfast_syscall+0xfb ino 33069176, on dev da0p2 db:0:lockedvnods> show mount 0xfffff80840185b58 /dev/da0p2 on / (ufs) 0xfffff80840186000 devfs on /dev (devfs) 0xfffff808405473c8 /dev/da0p3 on /tmp (ufs) 0xfffff800198de790 procfs on /proc (procfs) More info: show mount db:0:mount> show page vm_cnt.v_free_count: 7898402 vm_cnt.v_cache_count: 0 vm_cnt.v_inactive_count: 7699635 vm_cnt.v_active_count: 3072 vm_cnt.v_wire_count: 714344 vm_cnt.v_free_reserved: 21294 vm_cnt.v_free_min: 102870 vm_cnt.v_free_target: 347598 vm_cnt.v_inactive_target: 521397 db:0:page> ps pid ppid pgrp uid state wmesg wchan cmd 1306 1287 1287 0 S+ piperd 0xfffff80019b5d5d0 egrep 1305 1287 1287 0 R+ CPU 5 dd 1287 1274 1287 0 S+ wait 0xfffff8084062c548 sh 1274 1 1274 0 Ss+ wait 0xfffff80019608000 sh 19 0 0 0 DL syncer 0xffffffff81c64638 [syncer] 18 0 0 0 DL vlruwt 0xfffff80011d31000 [vnlru] 17 0 0 0 DL (threaded) [bufdaemon] 100142 D psleep 0xffffffff81c62e84 [bufdaemon] 100161 D sdflush 0xfffff8001989a8e8 [/ worker] 100169 D sdflush 0xfffff800198008e8 [/tmp worker] 16 0 0 0 DL - 0xffffffff81c63b84 [bufspacedaemon] 15 0 0 0 DL pgzero 0xffffffff81c6e004 [pagezero] 9 0 0 0 DL psleep 0xffffffff81c6d094 [vmdaemon] 8 0 0 0 DL (threaded) [pagedaemon] 100138 D psleep 0xffffffff81d19b04 [pagedaemon] 100145 D psleep 0xffffffff81d19b04 [dom1] 100146 D umarcl 0xffffffff81c6c9c0 [uma] 7 0 0 0 DL idle 0xfffff80011d33000 [enc_daemon0] 6 0 0 0 DL waiting_ 0xffffffff81d0b8e0 [sctp_iterator] 14 0 0 0 DL (threaded) [usb] 100077 D - 0xfffffe00013f0d10 [usbus0] 100078 D - 0xfffffe00013f0d68 [usbus0] 100079 D - 0xfffffe00013f0dc0 [usbus0] 100080 D - 0xfffffe00013f0e18 [usbus0] 100081 D - 0xfffffe00013f0e70 [usbus0] 100118 D - 0xfffffe00017e5560 [usbus1] 100119 D - 0xfffffe00017e55b8 [usbus1] 100120 D - 0xfffffe00017e5610 [usbus1] 100121 D - 0xfffffe00017e5668 [usbus1] 100122 D - 0xfffffe00017e56c0 [usbus1] 100124 D - 0xfffffe000165bd10 [usbus2] 100125 D - 0xfffffe000165bd68 [usbus2] 100126 D - 0xfffffe000165bdc0 [usbus2] 100127 D - 0xfffffe000165be18 [usbus2] 100128 D - 0xfffffe000165be70 [usbus2] 5 0 0 0 DL (threaded) [cam] 100066 D - 0xffffffff818f8d00 [doneq0] 100067 D - 0xffffffff818f8e00 [doneq1] 100068 D - 0xffffffff818f8f00 [doneq2] 100069 D - 0xffffffff818f9000 [doneq3] 100070 D - 0xffffffff818f9100 [doneq4] 100136 D - 0xffffffff818f8b48 [scanner] 4 0 0 0 DL crypto_r 0xffffffff81c6b4d8 [crypto returns] 3 0 0 0 DL crypto_w 0xffffffff81c6b390 [crypto] 13 0 0 0 DL (threaded) [geom] 100054 D - 0xffffffff81ce3d20 [g_event] 100055 D - 0xffffffff81ce3d28 [g_up] 100056 D - 0xffffffff81ce3d30 [g_down] 12 0 0 0 WL (threaded) [intr] 100028 I [swi3: vm] 100029 I [swi1: netisr 0] 100030 I [swi4: clock (0)] 100031 I [swi4: clock (1)] 100032 I [swi4: clock (2)] 100033 I [swi4: clock (3)] 100034 I [swi4: clock (4)] 100035 I [swi4: clock (5)] 100036 I [swi4: clock (6)] 100037 I [swi4: clock (7)] 100038 I [swi4: clock (8)] 100039 I [swi4: clock (9)] 100040 I [swi4: clock (10)] 100041 I [swi4: clock (11)] 100042 I [swi4: clock (12)] 100043 I [swi4: clock (13)] 100044 I [swi4: clock (14)] 100045 I [swi4: clock (15)] 100046 I [swi4: clock (16)] 100047 I [swi4: clock (17)] 100048 I [swi4: clock (18)] 100049 I [swi4: clock (19)] 100050 I [swi4: clock (20)] 100051 I [swi4: clock (21)] 100052 I [swi4: clock (22)] 100053 I [swi4: clock (23)] 100060 I [swi5: fast taskq] 100071 I [swi6: task queue] 100072 I [swi6: Giant taskq] 100074 I [irq264: isci0] 100075 I [irq265: isci0] 100076 I [irq22: ehci0] 100082 I [irq266: hdac0] 100083 I [irq267: igb0:que 0] 100085 I [irq268: igb0:que 1] 100087 I [irq269: igb0:que 2] 100089 I [irq270: igb0:que 3] 100091 I [irq271: igb0:que 4] 100093 I [irq272: igb0:que 5] 100095 I [irq273: igb0:que 6] 100097 I [irq274: igb0:que 7] 100099 I [irq275: igb0:link] 100100 I [irq276: igb1:que 0] 100102 I [irq277: igb1:que 1] 100104 I [irq278: igb1:que 2] 100106 I [irq279: igb1:que 3] 100108 I [irq280: igb1:que 4] 100110 I [irq281: igb1:que 5] 100112 I [irq282: igb1:que 6] 100114 I [irq283: igb1:que 7] 100116 I [irq284: igb1:link] 100117 I [irq285: xhci0] 100123 I [irq20: ehci1] 100129 I [irq286: ahci0] 100130 I [irq287: hdac1] 100131 I [swi0: uart] 11 0 0 0 RL (threaded) [idle] 100004 Run CPU 0 [idle: cpu0] 100005 Run CPU 1 [idle: cpu1] 100006 Run CPU 2 [idle: cpu2] 100007 Run CPU 3 [idle: cpu3] 100008 Run CPU 4 [idle: cpu4] 100009 CanRun [idle: cpu5] 100010 Run CPU 6 [idle: cpu6] 100011 Run CPU 7 [idle: cpu7] 100012 Run CPU 8 [idle: cpu8] 100013 Run CPU 9 [idle: cpu9] 100014 Run CPU 10 [idle: cpu10] 100015 Run CPU 11 [idle: cpu11] 100016 Run CPU 12 [idle: cpu12] 100017 Run CPU 13 [idle: cpu13] 100018 Run CPU 14 [idle: cpu14] 100019 Run CPU 15 [idle: cpu15] 100020 Run CPU 16 [idle: cpu16] 100021 Run CPU 17 [idle: cpu17] 100022 Run CPU 18 [idle: cpu18] 100023 Run CPU 19 [idle: cpu19] 100024 Run CPU 20 [idle: cpu20] 100025 Run CPU 21 [idle: cpu21] 100026 Run CPU 22 [idle: cpu22] 100027 Run CPU 23 [idle: cpu23] 2 0 0 0 DL - 0xffffffff81a25bb0 [rand_harvestq] 1 0 1 0 SLs wait 0xfffff8000b6df548 [init] 10 0 0 0 DL audit_wo 0xffffffff81d10eb0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81ce3d58 [swapper] 100057 D - 0xfffff8000b71aa00 [firmware taskq] 100061 D - 0xfffff8000b71a700 [kqueue taskq] 100062 D - 0xfffff8000b71a600 [acpi_task_0] 100063 D - 0xfffff8000b71a600 [acpi_task_1] 100064 D - 0xfffff8000b71a600 [acpi_task_2] 100065 D - 0xfffff8000b71a500 [ffs_trim taskq] 100073 D - 0xfffff8000b719d00 [thread taskq] 100084 D - 0xfffff80011d4c800 [igb0 que (qid 0)] 100086 D - 0xfffff80011d4c700 [igb0 que (qid 1)] 100088 D - 0xfffff80011d4c600 [igb0 que (qid 2)] 100090 D - 0xfffff80011d4c500 [igb0 que (qid 3)] 100092 D - 0xfffff80011d4c400 [igb0 que (qid 4)] 100094 D - 0xfffff80011d4c300 [igb0 que (qid 5)] 100096 D - 0xfffff80011d4c200 [igb0 que (qid 6)] 100098 D - 0xfffff80011d4c100 [igb0 que (qid 7)] 100101 D - 0xfffff80011d4b600 [igb1 que (qid 8)] 100103 D - 0xfffff80011d4b500 [igb1 que (qid 9)] 100105 D - 0xfffff80011d4b400 [igb1 que (qid 10)] 100107 D - 0xfffff80011d4b300 [igb1 que (qid 11)] 100109 D - 0xfffff80011d4b200 [igb1 que (qid 12)] 100111 D - 0xfffff80011d4b100 [igb1 que (qid 13)] 100113 D - 0xfffff80011d4b000 [igb1 que (qid 14)] 100115 D - 0xfffff80011d4ae00 [igb1 que (qid 15)] 100132 D - 0xfffff80011d4a200 [mca taskq] 100133 D - 0xffffffff81ad3277 [deadlkres] 100135 D - 0xfffff8000b71a400 [CAM taskq] db:0:ps> allt Tracing command egrep pid 1306 tid 100201 td 0xfffff800195339a0 sched_switch() at sched_switch+0x495/frame 0xfffffe10487906a0 mi_switch() at mi_switch+0x169/frame 0xfffffe10487906d0 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe1048790710 sleepq_catch_signals() at sleepq_catch_signals+0x2dc/frame 0xfffffe1048790780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10487907b0 _sleep() at _sleep+0x324/frame 0xfffffe1048790850 pipe_read() at pipe_read+0x288/frame 0xfffffe10487908b0 dofileread() at dofileread+0x98/frame 0xfffffe1048790900 kern_readv() at kern_readv+0x68/frame 0xfffffe1048790950 sys_read() at sys_read+0x60/frame 0xfffffe10487909a0 amd64_syscall() at amd64_syscall+0x2f9/frame 0xfffffe1048790ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048790ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800fc40ea, rsp = 0x7fffffffe858, rbp = 0x7fffffffe8b0 --- Tracing command dd pid 1305 tid 100196 td 0xfffff8084047f000 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe1048776f70 vpanic() at vpanic+0x19f/frame 0xfffffe1048776ff0 panic() at panic+0x43/frame 0xfffffe1048777050 vm_phys_alloc_pages() at vm_phys_alloc_pages+0x154/frame 0xfffffe10487770c0 vm_page_alloc() at vm_page_alloc+0x386/frame 0xfffffe1048777140 vm_page_grab() at vm_page_grab+0x335/frame 0xfffffe10487771c0 allocbuf() at allocbuf+0x3ab/frame 0xfffffe1048777230 getblk() at getblk+0x7bc/frame 0xfffffe10487772d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x18c0/frame 0xfffffe1048777490 ffs_write() at ffs_write+0x25b/frame 0xfffffe1048777540 VOP_WRITE_APV() at VOP_WRITE_APV+0x195/frame 0xfffffe1048777650 vn_write() at vn_write+0x289/frame 0xfffffe10487776d0 vn_io_fault1() at vn_io_fault1+0x1d2/frame 0xfffffe1048777830 vn_io_fault() at vn_io_fault+0x192/frame 0xfffffe10487778b0 dofilewrite() at dofilewrite+0x8a/frame 0xfffffe1048777900 kern_writev() at kern_writev+0x68/frame 0xfffffe1048777950 sys_write() at sys_write+0x60/frame 0xfffffe10487779a0 amd64_syscall() at amd64_syscall+0x2f9/frame 0xfffffe1048777ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048777ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8009740aa, rsp = 0x7fffffffe9b8, rbp = 0x7fffffffe9e0 --- Tracing command sh pid 1287 tid 100209 td 0xfffff808405fe4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe10487b8550 mi_switch() at mi_switch+0x169/frame 0xfffffe10487b8580 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10487b85c0 sleepq_catch_signals() at sleepq_catch_signals+0x2dc/frame 0xfffffe10487b8630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10487b8660 _sleep() at _sleep+0x324/frame 0xfffffe10487b8700 kern_wait6() at kern_wait6+0x410/frame 0xfffffe10487b87b0 sys_wait4() at sys_wait4+0x73/frame 0xfffffe10487b89a0 amd64_syscall() at amd64_syscall+0x2f9/frame 0xfffffe10487b8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10487b8ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b5c9aa, rsp = 0x7fffffffea68, rbp = 0x7fffffffeb20 --- Tracing command sh pid 1274 tid 100218 td 0xfffff800196949a0 sched_switch() at sched_switch+0x495/frame 0xfffffe10487f1550 mi_switch() at mi_switch+0x169/frame 0xfffffe10487f1580 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10487f15c0 sleepq_catch_signals() at sleepq_catch_signals+0x2dc/frame 0xfffffe10487f1630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10487f1660 _sleep() at _sleep+0x324/frame 0xfffffe10487f1700 kern_wait6() at kern_wait6+0x410/frame 0xfffffe10487f17b0 sys_wait4() at sys_wait4+0x73/frame 0xfffffe10487f19a0 amd64_syscall() at amd64_syscall+0x2f9/frame 0xfffffe10487f1ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10487f1ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b5c9aa, rsp = 0x7fffffffe9c8, rbp = 0x7fffffffea80 --- Tracing command syncer pid 19 tid 100144 td 0xfffff80015f8b000 sched_switch() at sched_switch+0x495/frame 0xfffffe10484ce8c0 mi_switch() at mi_switch+0x169/frame 0xfffffe10484ce8f0 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10484ce930 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10484ce960 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x21c/frame 0xfffffe10484ce9e0 sched_sync() at sched_sync+0x5c5/frame 0xfffffe10484cea70 fork_exit() at fork_exit+0x84/frame 0xfffffe10484ceab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10484ceab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 18 tid 100143 td 0xfffff80015f8b4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe10484c98b0 mi_switch() at mi_switch+0x169/frame 0xfffffe10484c98e0 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10484c9920 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10484c9950 _sleep() at _sleep+0x311/frame 0xfffffe10484c99f0 vnlru_proc() at vnlru_proc+0x48/frame 0xfffffe10484c9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10484c9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10484c9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100142 td 0xfffff80015f8b9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe10484c4900 mi_switch() at mi_switch+0x169/frame 0xfffffe10484c4930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10484c4970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10484c49a0 _sleep() at _sleep+0x311/frame 0xfffffe10484c4a40 buf_daemon() at buf_daemon+0x68/frame 0xfffffe10484c4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10484c4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10484c4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100161 td 0xfffff800196954d0 sched_switch() at sched_switch+0x495/frame 0xfffffe10486c8900 mi_switch() at mi_switch+0x169/frame 0xfffffe10486c8930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10486c8970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10486c89a0 _sleep() at _sleep+0x311/frame 0xfffffe10486c8a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe10486c8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10486c8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10486c8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100169 td 0xfffff8001973c000 sched_switch() at sched_switch+0x495/frame 0xfffffe10486f0900 mi_switch() at mi_switch+0x169/frame 0xfffffe10486f0930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10486f0970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10486f09a0 _sleep() at _sleep+0x311/frame 0xfffffe10486f0a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe10486f0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10486f0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10486f0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufspacedaemon pid 16 tid 100141 td 0xfffff80015f8c000 sched_switch() at sched_switch+0x495/frame 0xfffffe10483fb910 mi_switch() at mi_switch+0x169/frame 0xfffffe10483fb940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10483fb980 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10483fb9b0 _sleep() at _sleep+0x311/frame 0xfffffe10483fba50 bufspace_daemon() at bufspace_daemon+0x1b7/frame 0xfffffe10483fba70 fork_exit() at fork_exit+0x84/frame 0xfffffe10483fbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10483fbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagezero pid 15 tid 100140 td 0xfffff80015f8c4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe10483f6900 mi_switch() at mi_switch+0x169/frame 0xfffffe10483f6930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10483f6970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10483f69a0 _sleep() at _sleep+0x311/frame 0xfffffe10483f6a40 vm_pagezero() at vm_pagezero+0xa2/frame 0xfffffe10483f6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10483f6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10483f6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 9 tid 100139 td 0xfffff80015f8c9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe10483f1830 mi_switch() at mi_switch+0x169/frame 0xfffffe10483f1860 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10483f18a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10483f18d0 _sleep() at _sleep+0x357/frame 0xfffffe10483f1970 vm_daemon() at vm_daemon+0x9f/frame 0xfffffe10483f1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10483f1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10483f1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 8 tid 100138 td 0xfffff80015f8d000 sched_switch() at sched_switch+0x495/frame 0xfffffe10483ec890 mi_switch() at mi_switch+0x169/frame 0xfffffe10483ec8c0 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10483ec900 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10483ec930 _sleep() at _sleep+0x311/frame 0xfffffe10483ec9d0 vm_pageout_worker() at vm_pageout_worker+0x1b9/frame 0xfffffe10483eca20 vm_pageout() at vm_pageout+0x11b/frame 0xfffffe10483eca70 fork_exit() at fork_exit+0x84/frame 0xfffffe10483ecab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10483ecab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 8 tid 100145 td 0xfffff8084005b9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe10484d38e0 mi_switch() at mi_switch+0x169/frame 0xfffffe10484d3910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10484d3950 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10484d3980 _sleep() at _sleep+0x311/frame 0xfffffe10484d3a20 vm_pageout_worker() at vm_pageout_worker+0x1b9/frame 0xfffffe10484d3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10484d3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10484d3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 8 tid 100146 td 0xfffff8084005b4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe10484d8910 mi_switch() at mi_switch+0x169/frame 0xfffffe10484d8940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10484d8980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484d89b0 _sleep() at _sleep+0x357/frame 0xfffffe10484d8a50 uma_reclaim_worker() at uma_reclaim_worker+0x71/frame 0xfffffe10484d8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10484d8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10484d8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 7 tid 100137 td 0xfffff80015f8d4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe10483e78c0 mi_switch() at mi_switch+0x169/frame 0xfffffe10483e78f0 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10483e7930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10483e7960 _sleep() at _sleep+0x357/frame 0xfffffe10483e7a00 enc_daemon() at enc_daemon+0x269/frame 0xfffffe10483e7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10483e7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10483e7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 6 tid 100134 td 0xfffff80011dac4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe10482d8910 mi_switch() at mi_switch+0x169/frame 0xfffffe10482d8940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10482d8980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10482d89b0 _sleep() at _sleep+0x357/frame 0xfffffe10482d8a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe10482d8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10482d8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10482d8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100077 td 0xfffff8000b8f54d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0000307930 mi_switch() at mi_switch+0x169/frame 0xfffffe0000307960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe00003079a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003079d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe0000307a40 usb_process() at usb_process+0x13b/frame 0xfffffe0000307a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000307ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000307ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100078 td 0xfffff8000b8f5000 sched_switch() at sched_switch+0x495/frame 0xfffffe000030c930 mi_switch() at mi_switch+0x169/frame 0xfffffe000030c960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe000030c9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000030c9d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe000030ca40 usb_process() at usb_process+0x13b/frame 0xfffffe000030ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000030cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000030cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100079 td 0xfffff8000b8f49a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0000311930 mi_switch() at mi_switch+0x169/frame 0xfffffe0000311960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe00003119a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003119d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe0000311a40 usb_process() at usb_process+0x13b/frame 0xfffffe0000311a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000311ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000311ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100080 td 0xfffff8000b8f44d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0000316930 mi_switch() at mi_switch+0x169/frame 0xfffffe0000316960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe00003169a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003169d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe0000316a40 usb_process() at usb_process+0x13b/frame 0xfffffe0000316a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000316ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000316ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100081 td 0xfffff8000b8f4000 sched_switch() at sched_switch+0x495/frame 0xfffffe000031b930 mi_switch() at mi_switch+0x169/frame 0xfffffe000031b960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe000031b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000031b9d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe000031ba40 usb_process() at usb_process+0x13b/frame 0xfffffe000031ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000031bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000031bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100118 td 0xfffff80011d979a0 sched_switch() at sched_switch+0x495/frame 0xfffffe1046080930 mi_switch() at mi_switch+0x169/frame 0xfffffe1046080960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10460809a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10460809d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe1046080a40 usb_process() at usb_process+0x13b/frame 0xfffffe1046080a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1046080ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1046080ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100119 td 0xfffff80011d974d0 sched_switch() at sched_switch+0x495/frame 0xfffffe1046085930 mi_switch() at mi_switch+0x169/frame 0xfffffe1046085960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10460859a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10460859d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe1046085a40 usb_process() at usb_process+0x13b/frame 0xfffffe1046085a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1046085ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1046085ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100120 td 0xfffff80011d97000 sched_switch() at sched_switch+0x495/frame 0xfffffe104608a930 mi_switch() at mi_switch+0x169/frame 0xfffffe104608a960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe104608a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104608a9d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe104608aa40 usb_process() at usb_process+0x13b/frame 0xfffffe104608aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe104608aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104608aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100121 td 0xfffff80011d8f9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe104608f930 mi_switch() at mi_switch+0x169/frame 0xfffffe104608f960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe104608f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104608f9d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe104608fa40 usb_process() at usb_process+0x13b/frame 0xfffffe104608fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe104608fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104608fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100122 td 0xfffff80011d8f4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe1046094930 mi_switch() at mi_switch+0x169/frame 0xfffffe1046094960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10460949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10460949d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe1046094a40 usb_process() at usb_process+0x13b/frame 0xfffffe1046094a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1046094ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1046094ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100124 td 0xfffff80011d8e9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe1046221930 mi_switch() at mi_switch+0x169/frame 0xfffffe1046221960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10462219a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10462219d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe1046221a40 usb_process() at usb_process+0x13b/frame 0xfffffe1046221a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1046221ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1046221ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100125 td 0xfffff80011d8e4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe1046226930 mi_switch() at mi_switch+0x169/frame 0xfffffe1046226960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10462269a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10462269d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe1046226a40 usb_process() at usb_process+0x13b/frame 0xfffffe1046226a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1046226ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1046226ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100126 td 0xfffff80011d8e000 sched_switch() at sched_switch+0x495/frame 0xfffffe104622b930 mi_switch() at mi_switch+0x169/frame 0xfffffe104622b960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe104622b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104622b9d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe104622ba40 usb_process() at usb_process+0x13b/frame 0xfffffe104622ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe104622bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104622bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100127 td 0xfffff80011dae9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe1046230930 mi_switch() at mi_switch+0x169/frame 0xfffffe1046230960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10462309a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10462309d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe1046230a40 usb_process() at usb_process+0x13b/frame 0xfffffe1046230a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1046230ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1046230ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100128 td 0xfffff80011dae4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe1046235930 mi_switch() at mi_switch+0x169/frame 0xfffffe1046235960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10462359a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10462359d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe1046235a40 usb_process() at usb_process+0x13b/frame 0xfffffe1046235a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1046235ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1046235ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 5 tid 100066 td 0xfffff8000b8ea000 sched_switch() at sched_switch+0x495/frame 0xfffffe0f943558e0 mi_switch() at mi_switch+0x169/frame 0xfffffe0f94355910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0f94355950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f94355980 _sleep() at _sleep+0x357/frame 0xfffffe0f94355a20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0f94355a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94355ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94355ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 5 tid 100067 td 0xfffff8000b8e99a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0f9435a8e0 mi_switch() at mi_switch+0x169/frame 0xfffffe0f9435a910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0f9435a950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f9435a980 _sleep() at _sleep+0x357/frame 0xfffffe0f9435aa20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0f9435aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9435aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9435aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 5 tid 100068 td 0xfffff8000b8e94d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0f9435f8e0 mi_switch() at mi_switch+0x169/frame 0xfffffe0f9435f910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0f9435f950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f9435f980 _sleep() at _sleep+0x357/frame 0xfffffe0f9435fa20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0f9435fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9435fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9435fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 5 tid 100069 td 0xfffff8000b8e9000 sched_switch() at sched_switch+0x495/frame 0xfffffe0f943648e0 mi_switch() at mi_switch+0x169/frame 0xfffffe0f94364910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0f94364950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f94364980 _sleep() at _sleep+0x357/frame 0xfffffe0f94364a20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0f94364a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94364ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94364ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 5 tid 100070 td 0xfffff8000b8e89a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0f943698e0 mi_switch() at mi_switch+0x169/frame 0xfffffe0f94369910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0f94369950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f94369980 _sleep() at _sleep+0x357/frame 0xfffffe0f94369a20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0f94369a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94369ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94369ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 5 tid 100136 td 0xfffff80015f8d9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe10482e28e0 mi_switch() at mi_switch+0x169/frame 0xfffffe10482e2910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10482e2950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10482e2980 _sleep() at _sleep+0x357/frame 0xfffffe10482e2a20 xpt_scanner_thread() at xpt_scanner_thread+0xa4/frame 0xfffffe10482e2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10482e2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10482e2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns pid 4 tid 100059 td 0xfffff8000b7544d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0f943328f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0f94332920 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0f94332960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f94332990 _sleep() at _sleep+0x357/frame 0xfffffe0f94332a30 crypto_ret_proc() at crypto_ret_proc+0x1da/frame 0xfffffe0f94332a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94332ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94332ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100058 td 0xfffff8000b7549a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0f9432d8f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0f9432d920 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0f9432d960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f9432d990 _sleep() at _sleep+0x357/frame 0xfffffe0f9432da30 crypto_proc() at crypto_proc+0x394/frame 0xfffffe0f9432da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9432dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9432dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100054 td 0xfffff8000b730000 sched_switch() at sched_switch+0x495/frame 0xfffffe0f943198f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0f94319920 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0f94319960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f94319990 _sleep() at _sleep+0x357/frame 0xfffffe0f94319a30 g_run_events() at g_run_events+0x50/frame 0xfffffe0f94319a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94319ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94319ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100055 td 0xfffff8000b7559a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0f9431e8f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0f9431e920 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0f9431e960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f9431e990 _sleep() at _sleep+0x357/frame 0xfffffe0f9431ea30 g_io_schedule_up() at g_io_schedule_up+0xf7/frame 0xfffffe0f9431ea60 g_up_procbody() at g_up_procbody+0x7d/frame 0xfffffe0f9431ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9431eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9431eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100056 td 0xfffff8000b7554d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0f943238e0 mi_switch() at mi_switch+0x169/frame 0xfffffe0f94323910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0f94323950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f94323980 _sleep() at _sleep+0x357/frame 0xfffffe0f94323a20 g_io_schedule_down() at g_io_schedule_down+0x12c/frame 0xfffffe0f94323a60 g_down_procbody() at g_down_procbody+0x7d/frame 0xfffffe0f94323a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94323ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94323ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100028 td 0xfffff8000b7259a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100029 td 0xfffff8000b7254d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0f9429c9f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0f9429ca20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0f9429ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9429cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9429cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100030 td 0xfffff8000b725000 sched_switch() at sched_switch+0x495/frame 0xfffffe0f942a19f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0f942a1a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0f942a1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f942a1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f942a1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100031 td 0xfffff8000b7249a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100032 td 0xfffff8000b7244d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100033 td 0xfffff8000b724000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100034 td 0xfffff8000b7239a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100035 td 0xfffff8000b7234d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100036 td 0xfffff8000b723000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100037 td 0xfffff8000b72f9a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100038 td 0xfffff8000b72f4d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100039 td 0xfffff8000b72f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100040 td 0xfffff8000b72e9a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xfffff8000b72e4d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xfffff8000b72e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100043 td 0xfffff8000b72d9a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100044 td 0xfffff8000b72d4d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffff8000b72d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100046 td 0xfffff8000b7329a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff8000b7324d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffff8000b732000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff8000b7319a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff8000b7314d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff8000b731000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff8000b7309a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff8000b7304d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffff8000b754000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100071 td 0xfffff8000b8e84d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0f9436e9f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0f9436ea20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0f9436ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9436eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9436eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100072 td 0xfffff8000b8e8000 sched_switch() at sched_switch+0x495/frame 0xfffffe0f943739f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0f94373a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0f94373a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94373ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94373ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100074 td 0xfffff8000b8f64d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0f943bd9f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0f943bda20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0f943bda70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f943bdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f943bdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100075 td 0xfffff8000b8f6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100076 td 0xfffff8000b8f59a0 sched_switch() at sched_switch+0x495/frame 0xfffffe00003029f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0000302a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0000302a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000302ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000302ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100082 td 0xfffff80011d399a0 sched_switch() at sched_switch+0x495/frame 0xfffffe00003209f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0000320a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0000320a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000320ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000320ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100083 td 0xfffff80011d394d0 sched_switch() at sched_switch+0x495/frame 0xfffffe000036f9f0 mi_switch() at mi_switch+0x169/frame 0xfffffe000036fa20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe000036fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000036fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000036fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100085 td 0xfffff80011d389a0 sched_switch() at sched_switch+0x495/frame 0xfffffe00003799f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0000379a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0000379a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000379ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000379ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100087 td 0xfffff80011d38000 sched_switch() at sched_switch+0x495/frame 0xfffffe00003839f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0000383a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0000383a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000383ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000383ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100089 td 0xfffff80011d374d0 sched_switch() at sched_switch+0x495/frame 0xfffffe000038d9f0 mi_switch() at mi_switch+0x169/frame 0xfffffe000038da20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe000038da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000038dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000038dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100091 td 0xfffff80011d609a0 sched_switch() at sched_switch+0x495/frame 0xfffffe00003979f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0000397a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0000397a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000397ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000397ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100093 td 0xfffff80011d60000 sched_switch() at sched_switch+0x495/frame 0xfffffe00003a19f0 mi_switch() at mi_switch+0x169/frame 0xfffffe00003a1a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe00003a1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003a1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003a1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff80011d5f4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe00003ab9f0 mi_switch() at mi_switch+0x169/frame 0xfffffe00003aba20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe00003aba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003abab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003abab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100097 td 0xfffff80011d5e9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe00003b59f0 mi_switch() at mi_switch+0x169/frame 0xfffffe00003b5a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe00003b5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003b5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003b5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100099 td 0xfffff80011d5e000 sched_switch() at sched_switch+0x495/frame 0xfffffe00003bf9f0 mi_switch() at mi_switch+0x169/frame 0xfffffe00003bfa20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe00003bfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003bfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003bfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100100 td 0xfffff80011d769a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100102 td 0xfffff80011d76000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100104 td 0xfffff80011d754d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100106 td 0xfffff80011d749a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100108 td 0xfffff80011d74000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100110 td 0xfffff80011d7a4d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100112 td 0xfffff80011d799a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100114 td 0xfffff80011d79000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100116 td 0xfffff80011d784d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100117 td 0xfffff80011d78000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100123 td 0xfffff80011d8f000 sched_switch() at sched_switch+0x495/frame 0xfffffe104621c9f0 mi_switch() at mi_switch+0x169/frame 0xfffffe104621ca20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe104621ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe104621cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104621cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100129 td 0xfffff80011dae000 sched_switch() at sched_switch+0x495/frame 0xfffffe104623a9f0 mi_switch() at mi_switch+0x169/frame 0xfffffe104623aa20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe104623aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe104623aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104623aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100130 td 0xfffff80011dad9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe10482bc9f0 mi_switch() at mi_switch+0x169/frame 0xfffffe10482bca20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe10482bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe10482bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10482bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100131 td 0xfffff80011dad4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe10482c49f0 mi_switch() at mi_switch+0x169/frame 0xfffffe10482c4a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe10482c4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10482c4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10482c4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff8000b6e19a0 cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81c72250 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xffffffff81c72270 trap() at trap+0x3a/frame 0xffffffff81c72480 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81c72480 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f9421f8e0, rbp = 0xfffffe0f9421f8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f9421f8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f9421f940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f9421f960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f9421f980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f9421fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9421fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9421fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff8000b6e14d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005b51cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005b51d10 trap() at trap+0x3a/frame 0xfffffe1005b51f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005b51f20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f942248e0, rbp = 0xfffffe0f942248f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f942248f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f94224940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94224960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f94224980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94224a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94224ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94224ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff8000b6e1000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005b58cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005b58d10 trap() at trap+0x3a/frame 0xfffffe1005b58f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005b58f20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f942298e0, rbp = 0xfffffe0f942298f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f942298f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f94229940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94229960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f94229980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94229a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94229ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94229ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff8000b6e09a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005b5fcf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005b5fd10 trap() at trap+0x3a/frame 0xfffffe1005b5ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005b5ff20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f9422e8e0, rbp = 0xfffffe0f9422e8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f9422e8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f9422e940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f9422e960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f9422e980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f9422ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9422eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9422eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff8000b6e04d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005b66cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005b66d10 trap() at trap+0x3a/frame 0xfffffe1005b66f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005b66f20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f942338e0, rbp = 0xfffffe0f942338f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f942338f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f94233940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94233960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f94233980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94233a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94233ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94233ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff8000b6e0000 sched_switch() at sched_switch+0x495/frame 0xfffffe0f94238950 mi_switch() at mi_switch+0x169/frame 0xfffffe0f94238980 sched_idletd() at sched_idletd+0xf9/frame 0xfffffe0f94238a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94238ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94238ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff8000b6f79a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005b74cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005b74d10 trap() at trap+0x3a/frame 0xfffffe1005b74f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005b74f20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f9423d8e0, rbp = 0xfffffe0f9423d8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f9423d8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f9423d940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f9423d960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f9423d980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f9423da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9423dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9423dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff8000b6f74d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005b7bcf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005b7bd10 trap() at trap+0x3a/frame 0xfffffe1005b7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005b7bf20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f942428e0, rbp = 0xfffffe0f942428f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f942428f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f94242940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94242960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f94242980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94242a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94242ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94242ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff8000b6f7000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005b82cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005b82d10 trap() at trap+0x3a/frame 0xfffffe1005b82f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005b82f20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f942478e0, rbp = 0xfffffe0f942478f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f942478f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f94247940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94247960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f94247980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94247a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94247ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94247ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000b6f69a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005b89cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005b89d10 trap() at trap+0x3a/frame 0xfffffe1005b89f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005b89f20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f9424c8e0, rbp = 0xfffffe0f9424c8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f9424c8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f9424c940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f9424c960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f9424c980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f9424ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9424cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9424cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000b6f64d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005b90cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005b90d10 trap() at trap+0x3a/frame 0xfffffe1005b90f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005b90f20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f942518e0, rbp = 0xfffffe0f942518f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f942518f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f94251940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94251960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f94251980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94251a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94251ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94251ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100015 td 0xfffff8000b6f6000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005b97cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005b97d10 trap() at trap+0x3a/frame 0xfffffe1005b97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005b97f20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f942568e0, rbp = 0xfffffe0f942568f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f942568f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f94256940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94256960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f94256980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94256a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94256ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94256ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100016 td 0xfffff8000b6f59a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005b9ecf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005b9ed10 trap() at trap+0x3a/frame 0xfffffe1005b9ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005b9ef20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f9425b8e0, rbp = 0xfffffe0f9425b8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f9425b8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f9425b940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f9425b960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f9425b980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f9425ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9425bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9425bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100017 td 0xfffff8000b6f54d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005ba5cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005ba5d10 trap() at trap+0x3a/frame 0xfffffe1005ba5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005ba5f20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f942608e0, rbp = 0xfffffe0f942608f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f942608f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f94260940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94260960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f94260980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94260a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94260ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94260ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100018 td 0xfffff8000b6f5000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005baccf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005bacd10 trap() at trap+0x3a/frame 0xfffffe1005bacf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005bacf20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f942658e0, rbp = 0xfffffe0f942658f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f942658f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f94265940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94265960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f94265980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94265a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94265ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94265ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100019 td 0xfffff8000b6fa9a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005bb3cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005bb3d10 trap() at trap+0x3a/frame 0xfffffe1005bb3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005bb3f20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f9426a8e0, rbp = 0xfffffe0f9426a8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f9426a8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f9426a940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f9426a960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f9426a980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f9426aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9426aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9426aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100020 td 0xfffff8000b6fa4d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005bbacf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005bbad10 trap() at trap+0x3a/frame 0xfffffe1005bbaf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005bbaf20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f9426f8e0, rbp = 0xfffffe0f9426f8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f9426f8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f9426f940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f9426f960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f9426f980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f9426fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9426fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9426fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100021 td 0xfffff8000b6fa000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005bc1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005bc1d10 trap() at trap+0x3a/frame 0xfffffe1005bc1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005bc1f20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f942748e0, rbp = 0xfffffe0f942748f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f942748f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f94274940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94274960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f94274980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94274a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94274ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94274ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100022 td 0xfffff8000b6f99a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005bc8cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005bc8d10 trap() at trap+0x3a/frame 0xfffffe1005bc8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005bc8f20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f942798e0, rbp = 0xfffffe0f942798f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f942798f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f94279940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94279960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f94279980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94279a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94279ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94279ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100023 td 0xfffff8000b6f94d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005bcfcf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005bcfd10 trap() at trap+0x3a/frame 0xfffffe1005bcff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005bcff20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f9427e8e0, rbp = 0xfffffe0f9427e8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f9427e8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f9427e940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f9427e960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f9427e980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f9427ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9427eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9427eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100024 td 0xfffff8000b6f9000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005bd6cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005bd6d10 trap() at trap+0x3a/frame 0xfffffe1005bd6f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005bd6f20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f942838e0, rbp = 0xfffffe0f942838f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f942838f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f94283940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94283960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f94283980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94283a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94283ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94283ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100025 td 0xfffff8000b6f89a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005bddcf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005bddd10 trap() at trap+0x3a/frame 0xfffffe1005bddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005bddf20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f942888e0, rbp = 0xfffffe0f942888f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f942888f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f94288940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94288960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f94288980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94288a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94288ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94288ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100026 td 0xfffff8000b6f84d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005be4cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005be4d10 trap() at trap+0x3a/frame 0xfffffe1005be4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005be4f20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f9428d8e0, rbp = 0xfffffe0f9428d8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f9428d8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f9428d940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f9428d960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f9428d980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f9428da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9428dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9428dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100027 td 0xfffff8000b6f8000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005bebcf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005bebd10 trap() at trap+0x3a/frame 0xfffffe1005bebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005bebf20 --- trap 0x13, rip = 0xffffffff80fbe59f, rsp = 0xfffffe0f942928e0, rbp = 0xfffffe0f942928f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f942928f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0f94292940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94292960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0f94292980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94292a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94292ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94292ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 2 tid 100003 td 0xfffff8000b6e2000 sched_switch() at sched_switch+0x495/frame 0xfffffe1005bfc8d0 mi_switch() at mi_switch+0x169/frame 0xfffffe1005bfc900 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe1005bfc940 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe1005bfc970 _sleep() at _sleep+0x311/frame 0xfffffe1005bfca10 random_kthread() at random_kthread+0x230/frame 0xfffffe1005bfca70 fork_exit() at fork_exit+0x84/frame 0xfffffe1005bfcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1005bfcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff8000b6e24d0 sched_switch() at sched_switch+0x495/frame 0xfffffe1005bf7550 mi_switch() at mi_switch+0x169/frame 0xfffffe1005bf7580 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe1005bf75c0 sleepq_catch_signals() at sleepq_catch_signals+0x2dc/frame 0xfffffe1005bf7630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1005bf7660 _sleep() at _sleep+0x324/frame 0xfffffe1005bf7700 kern_wait6() at kern_wait6+0x410/frame 0xfffffe1005bf77b0 sys_wait4() at sys_wait4+0x73/frame 0xfffffe1005bf79a0 amd64_syscall() at amd64_syscall+0x2f9/frame 0xfffffe1005bf7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1005bf7ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x41b19a, rsp = 0x7fffffffe728, rbp = 0x7fffffffe810 --- Tracing command audit pid 10 tid 100001 td 0xfffff8000b6e29a0 sched_switch() at sched_switch+0x495/frame 0xfffffe1005bf2900 mi_switch() at mi_switch+0x169/frame 0xfffffe1005bf2930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe1005bf2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1005bf29a0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe1005bf2a10 audit_worker() at audit_worker+0xa3/frame 0xfffffe1005bf2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1005bf2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1005bf2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81ce42b0 sched_switch() at sched_switch+0x495/frame 0xffffffff820af990 mi_switch() at mi_switch+0x169/frame 0xffffffff820af9c0 sleepq_switch() at sleepq_switch+0xf6/frame 0xffffffff820afa00 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffffff820afa30 _sleep() at _sleep+0x311/frame 0xffffffff820afad0 swapper() at swapper+0x2e4/frame 0xffffffff820afb70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100057 td 0xfffff8000b755000 sched_switch() at sched_switch+0x495/frame 0xfffffe0f94328900 mi_switch() at mi_switch+0x169/frame 0xfffffe0f94328930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0f94328970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f943289a0 _sleep() at _sleep+0x357/frame 0xfffffe0f94328a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0f94328a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94328ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94328ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff8000b7539a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0f9433c900 mi_switch() at mi_switch+0x169/frame 0xfffffe0f9433c930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0f9433c970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f9433c9a0 _sleep() at _sleep+0x357/frame 0xfffffe0f9433ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0f9433ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9433cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9433cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffff8000b7534d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0f94341910 mi_switch() at mi_switch+0x169/frame 0xfffffe0f94341940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0f94341980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f943419b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ef/frame 0xfffffe0f94341a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0f94341a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94341ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94341ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffff8000b753000 sched_switch() at sched_switch+0x495/frame 0xfffffe0f94346910 mi_switch() at mi_switch+0x169/frame 0xfffffe0f94346940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0f94346980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f943469b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ef/frame 0xfffffe0f94346a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0f94346a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94346ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94346ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff8000b8ea9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0f9434b910 mi_switch() at mi_switch+0x169/frame 0xfffffe0f9434b940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0f9434b980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f9434b9b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ef/frame 0xfffffe0f9434ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0f9434ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9434bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9434bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff8000b8ea4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0f94350900 mi_switch() at mi_switch+0x169/frame 0xfffffe0f94350930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0f94350970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f943509a0 _sleep() at _sleep+0x357/frame 0xfffffe0f94350a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0f94350a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94350ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94350ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff8000b8f69a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0f94378900 mi_switch() at mi_switch+0x169/frame 0xfffffe0f94378930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0f94378970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f943789a0 _sleep() at _sleep+0x357/frame 0xfffffe0f94378a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0f94378a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94378ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94378ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100084 td 0xfffff80011d39000 sched_switch() at sched_switch+0x495/frame 0xfffffe0000374900 mi_switch() at mi_switch+0x169/frame 0xfffffe0000374930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0000374970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003749a0 _sleep() at _sleep+0x357/frame 0xfffffe0000374a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000374a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000374ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000374ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100086 td 0xfffff80011d384d0 sched_switch() at sched_switch+0x495/frame 0xfffffe000037e900 mi_switch() at mi_switch+0x169/frame 0xfffffe000037e930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe000037e970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000037e9a0 _sleep() at _sleep+0x357/frame 0xfffffe000037ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000037ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000037eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000037eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100088 td 0xfffff80011d379a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0000388900 mi_switch() at mi_switch+0x169/frame 0xfffffe0000388930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0000388970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003889a0 _sleep() at _sleep+0x357/frame 0xfffffe0000388a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000388a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000388ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000388ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100090 td 0xfffff80011d37000 sched_switch() at sched_switch+0x495/frame 0xfffffe0000392900 mi_switch() at mi_switch+0x169/frame 0xfffffe0000392930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0000392970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003929a0 _sleep() at _sleep+0x357/frame 0xfffffe0000392a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000392a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000392ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000392ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100092 td 0xfffff80011d604d0 sched_switch() at sched_switch+0x495/frame 0xfffffe000039c900 mi_switch() at mi_switch+0x169/frame 0xfffffe000039c930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe000039c970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000039c9a0 _sleep() at _sleep+0x357/frame 0xfffffe000039ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000039ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000039cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000039cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100094 td 0xfffff80011d5f9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe00003a6900 mi_switch() at mi_switch+0x169/frame 0xfffffe00003a6930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe00003a6970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003a69a0 _sleep() at _sleep+0x357/frame 0xfffffe00003a6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00003a6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003a6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003a6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffff80011d5f000 sched_switch() at sched_switch+0x495/frame 0xfffffe00003b0900 mi_switch() at mi_switch+0x169/frame 0xfffffe00003b0930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe00003b0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003b09a0 _sleep() at _sleep+0x357/frame 0xfffffe00003b0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00003b0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003b0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003b0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffff80011d5e4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe00003ba900 mi_switch() at mi_switch+0x169/frame 0xfffffe00003ba930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe00003ba970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003ba9a0 _sleep() at _sleep+0x357/frame 0xfffffe00003baa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00003baa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003baab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003baab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100101 td 0xfffff80011d764d0 sched_switch() at sched_switch+0x495/frame 0xfffffe1046009900 mi_switch() at mi_switch+0x169/frame 0xfffffe1046009930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe1046009970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10460099a0 _sleep() at _sleep+0x357/frame 0xfffffe1046009a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1046009a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1046009ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1046009ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100103 td 0xfffff80011d759a0 sched_switch() at sched_switch+0x495/frame 0xfffffe1046013900 mi_switch() at mi_switch+0x169/frame 0xfffffe1046013930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe1046013970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10460139a0 _sleep() at _sleep+0x357/frame 0xfffffe1046013a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1046013a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1046013ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1046013ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100105 td 0xfffff80011d75000 sched_switch() at sched_switch+0x495/frame 0xfffffe104601d900 mi_switch() at mi_switch+0x169/frame 0xfffffe104601d930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe104601d970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104601d9a0 _sleep() at _sleep+0x357/frame 0xfffffe104601da40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe104601da70 fork_exit() at fork_exit+0x84/frame 0xfffffe104601dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104601dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100107 td 0xfffff80011d744d0 sched_switch() at sched_switch+0x495/frame 0xfffffe1046027900 mi_switch() at mi_switch+0x169/frame 0xfffffe1046027930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe1046027970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10460279a0 _sleep() at _sleep+0x357/frame 0xfffffe1046027a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1046027a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1046027ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1046027ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100109 td 0xfffff80011d7a9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe1046031900 mi_switch() at mi_switch+0x169/frame 0xfffffe1046031930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe1046031970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10460319a0 _sleep() at _sleep+0x357/frame 0xfffffe1046031a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1046031a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1046031ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1046031ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100111 td 0xfffff80011d7a000 sched_switch() at sched_switch+0x495/frame 0xfffffe104603b900 mi_switch() at mi_switch+0x169/frame 0xfffffe104603b930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe104603b970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104603b9a0 _sleep() at _sleep+0x357/frame 0xfffffe104603ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe104603ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe104603bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104603bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100113 td 0xfffff80011d794d0 sched_switch() at sched_switch+0x495/frame 0xfffffe1046045900 mi_switch() at mi_switch+0x169/frame 0xfffffe1046045930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe1046045970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10460459a0 _sleep() at _sleep+0x357/frame 0xfffffe1046045a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1046045a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1046045ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1046045ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100115 td 0xfffff80011d789a0 sched_switch() at sched_switch+0x495/frame 0xfffffe104604f900 mi_switch() at mi_switch+0x169/frame 0xfffffe104604f930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe104604f970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104604f9a0 _sleep() at _sleep+0x357/frame 0xfffffe104604fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe104604fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe104604fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104604fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100132 td 0xfffff80011dad000 sched_switch() at sched_switch+0x495/frame 0xfffffe10482cd910 mi_switch() at mi_switch+0x169/frame 0xfffffe10482cd940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10482cd980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10482cd9b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ef/frame 0xfffffe10482cda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe10482cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe10482cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10482cdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100133 td 0xfffff80011dac9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe10482d2890 mi_switch() at mi_switch+0x169/frame 0xfffffe10482d28c0 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10482d2900 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10482d2930 _sleep() at _sleep+0x311/frame 0xfffffe10482d29d0 pause_sbt() at pause_sbt+0xd8/frame 0xfffffe10482d2a20 deadlkres() at deadlkres+0x2c/frame 0xfffffe10482d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10482d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10482d2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100135 td 0xfffff80011dac000 sched_switch() at sched_switch+0x495/frame 0xfffffe10482dd900 mi_switch() at mi_switch+0x169/frame 0xfffffe10482dd930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe10482dd970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10482dd9a0 _sleep() at _sleep+0x357/frame 0xfffffe10482dda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe10482dda70 fork_exit() at fork_exit+0x84/frame 0xfffffe10482ddab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10482ddab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:allt> call doadump Dumping 2953 out of 65428 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 5 (kgdb) bt #0 doadump (textdump=0x0) at pcpu.h:221 #1 0xffffffff8037d6b6 in db_fncall (dummy1=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:568 #2 0xffffffff8037d14e in db_command (cmd_table=0x0) at ../../../ddb/db_command.c:440 #3 0xffffffff80381478 in db_script_exec (scriptname=0xffffffff81cd5c80 "doadump", warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xffffffff8037d14e in db_command (cmd_table=0x0) at ../../../ddb/db_command.c:440 #5 0xffffffff8037cee4 in db_command_loop () at ../../../ddb/db_command.c:493 #6 0xffffffff8037f97b in db_trap (type=, code=0x0) at ../../../ddb/db_main.c:251 #7 0xffffffff80a653f3 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:654 #8 0xffffffff80e875e8 in trap (frame=0xfffffe1048776ea0) at ../../../amd64/amd64/trap.c:549 #9 0xffffffff80e67d47 in calltrap () at ../../../amd64/amd64/exception.S:234 #10 0xffffffff80a64adb in kdb_enter (why=0xffffffff813977ad "panic", msg=0x80
) at cpufunc.h:63 #11 0xffffffff80a2833f in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:750 #12 0xffffffff80a283a3 in panic (fmt=0xffffffff81ad09c0 "\004") at ../../../kern/kern_shutdown.c:688 #13 0xffffffff80d10c64 in vm_phys_alloc_pages (pool=0x0, order=0x0) at ../../../vm/vm_phys.c:819 #14 0xffffffff80d04406 in vm_page_alloc (object=0xfffff80090b66600, pindex=0x7b12a6, req=0x21222) at ../../../vm/vm_page.c:1664 #15 0xffffffff80d07805 in vm_page_grab (object=0xfffff80090b66600, pindex=0x7b12a6, allocflags=0x21222) at ../../../vm/vm_page.c:2856 #16 0xffffffff80ac126b in allocbuf (bp=0xfffffe0f91994bf0, size=) at ../../../kern/vfs_bio.c:2685 #17 0xffffffff80abf35c in getblk (vp=, blkno=, size=0x8000, slpflag=0x0, slptimeo=0x0, flags=) at ../../../kern/vfs_bio.c:3679 #18 0xffffffff80c9a540 in ffs_balloc_ufs2 (vp=0xfffff808986d7270, startoffset=, size=, cred=0xfffff8000b6cdd00, flags=0x7f040000, bpp=0xfffffe1048777510) at ../../../ufs/ffs/ffs_balloc.c:971 #19 0xffffffff80cc32ab in ffs_write (ap=0xfffffe1048777680) at ../../../ufs/ffs/ffs_vnops.c:741 #20 0xffffffff80fd3055 in VOP_WRITE_APV (vop=, a=) at vnode_if.c:997 #21 0xffffffff80aeea39 in vn_write (fp=0xfffff80840451f00, uio=0xfffffe1048777970, active_cred=, flags=, td=0x1) at vnode_if.h:413 #22 0xffffffff80aec3d2 in vn_io_fault1 () at ../../../kern/vfs_vnops.c:1067 #23 0xffffffff80aea612 in vn_io_fault (fp=0xfffff80840451f00, uio=0xfffffe1048777970, active_cred=, flags=0x0, td=0xfffff8084047f000) at ../../../kern/vfs_vnops.c:1172 #24 0xffffffff80a870fa in dofilewrite (td=0xfffff8084047f000, fd=0x4, fp=0xfffff80840451f00, auio=0xfffffe1048777970, offset=, flags=0x0) at file.h:308 #25 0xffffffff80a86e08 in kern_writev (td=0xfffff8084047f000, fd=0x4, auio=0xfffffe1048777970) at ../../../kern/sys_generic.c:486 #26 0xffffffff80a86d90 in sys_write (td=0xffffffff81ad09c0, uap=) at ../../../kern/sys_generic.c:399 #27 0xffffffff80e88499 in amd64_syscall (td=0xfffff8084047f000, traced=0x0) at subr_syscall.c:140 #28 0xffffffff80e6802b in Xfast_syscall () at ../../../amd64/amd64/exception.S:394 #29 0x00000008009740aa in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xffffffff80d10c64 in vm_phys_alloc_pages (pool=0x0, order=0x0) at ../../../vm/vm_phys.c:819 819 if (vm_cnt.v_free_count > 0) panic("adrian"); (kgdb) info loc m = 0x0 domain = 0x0 flind = 0x2 c1 = 0x2 c2 = 0x2 vi = {policy = VM_POLICY_FIRST_TOUCH_ROUND_ROBIN, domain = 0x0, n = 0x0} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/vm/vm_phys.c =================================================================== --- /usr/src/sys/vm/vm_phys.c (revision 290048) +++ /usr/src/sys/vm/vm_phys.c (working copy) @@ -394,6 +394,38 @@ sysctl_vm_phys_free(SYSCTL_HANDLER_ARGS) return (error); } +static void +pho_vm_phys_free(void) +{ + struct vm_freelist *fl; + int dom, flind, oind, pind; + + for (dom = 0; dom < vm_ndomains; dom++) { + printf("\nDOMAIN %d:\n", dom); + for (flind = 0; flind < vm_nfreelists; flind++) { + printf("\nFREE LIST %d:\n" + "\n ORDER (SIZE) | NUMBER" + "\n ", flind); + for (pind = 0; pind < VM_NFREEPOOL; pind++) + printf(" | POOL %d", pind); + printf("\n-- "); + for (pind = 0; pind < VM_NFREEPOOL; pind++) + printf("-- -- "); + printf("--\n"); + for (oind = VM_NFREEORDER - 1; oind >= 0; oind--) { + printf(" %2d (%6dK)", oind, + 1 << (PAGE_SHIFT - 10 + oind)); + for (pind = 0; pind < VM_NFREEPOOL; pind++) { + fl = vm_phys_free_queues[dom][flind][pind]; + printf(" | %6d", + fl[oind].lcnt); + } + printf("\n"); + } + } + } +} + /* * Outputs the set of physical memory segments. */ @@ -762,6 +794,7 @@ vm_phys_alloc_pages(int pool, int order) { vm_page_t m; int domain, flind; + int c1, c2; struct vm_domain_iterator vi; KASSERT(pool < VM_NFREEPOOL, @@ -771,8 +804,12 @@ vm_phys_alloc_pages(int pool, int order) vm_policy_iterator_init(&vi); + c1 = 0; while ((vm_domain_iterator_run(&vi, &domain)) == 0) { + c1++; + c2 = 0; for (flind = 0; flind < vm_nfreelists; flind++) { + c2++; m = vm_phys_alloc_domain_pages(domain, flind, pool, order); if (m != NULL) @@ -779,8 +816,11 @@ vm_phys_alloc_pages(int pool, int order) return (m); } } +if (vm_cnt.v_free_count > 0) panic("adrian"); vm_policy_iterator_finish(&vi); + printf("%s: c1 = %d, c2 = %d\n", __func__, c1, c2); + pho_vm_phys_free(); return (NULL); } -- Test scenario: dd if=/dev/zero of=/var/tmp/diskimage.1 bs=1m count=65428