GENERIC HEAD from 2015-11-12 03:37:28 UTC, r290704M, vmcore.317 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2015 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-CURRENT #1 r290704M: Thu Nov 12 09:59:26 CET 2015 pho@t2.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 3.7.0 (tags/RELEASE_370/final 246257) 20150906 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.23-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206d7 Family=0x6 Model=0x2d Stepping=7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 32140910592 (30651 MB) : Trying to mount root from ufs:/dev/da0p2 [rw]... uhub1: 4 ports with 4 removable, self powered uhub0: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered Setting hostuuid: 2bde2bde-f4e2-e111-aab2-001e6756b69b. Setting hostid: 0x0035ff86. Starting ddb. ugen2.2: at usbus2 uhub3: on usbus2 ugen0.2: at usbus0 Starting file syuhub4: on usbus0 stem checks: /dev/da0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p2: clean, 54937381 free (586445 frags, 6793867 blocks, 0.6% fragmentation) /dev/da0p3: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p3: clean, 13503777 free (3945 frags, 1687479 blocks, 0.0% fragmentation) Mounting local file systems:. lock order reversal: 1st 0xfffff80012716548 ufs (ufs) @ kern/vfs_subr.c:2231 2nd 0xfffffe0785639640 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:263 3rd 0xfffff80012ba37b8 ufs (ufs) @ kern/vfs_subr.c:2231 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081d1bac40 witness_checkorder() at witness_checkorder+0xe79/frame 0xfffffe081d1bacc0 __lockmgr_args() at __lockmgr_args+0xd47/frame 0xfffffe081d1bad70 ffs_lock() at ffs_lock+0xb0/frame 0xfffffe081d1badc0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x100/frame 0xfffffe081d1badf0 _vn_lock() at _vn_lock+0xc2/frame 0xfffffe081d1bae60 vget() at vget+0x146/frame 0xfffffe081d1baeb0 vfs_hash_get() at vfs_hash_get+0xcc/frame 0xfffffe081d1baf00 ffs_vgetf() at ffs_vgetf+0x40/frame 0xfffffe081d1baf90 softdep_sync_buf() at softdep_sync_buf+0xad1/frame 0xfffffe081d1bb070 ffs_syncvnode() at ffs_syncvnode+0x256/frame 0xfffffe081d1bb0f0 ffs_truncate() at ffs_truncate+0x650/frame 0xfffffe081d1bb2e0 ufs_direnter() at ufs_direnter+0x7bb/frame 0xfffffe081d1bb3b0 ufs_makeinode() at ufs_makeinode+0x5f3/frame 0xfffffe081d1bb570 ufs_create() at ufs_create+0x2d/frame 0xfffffe081d1bb590 VOP_CREATE_APV() at VOP_CREATE_APV+0x10f/frame 0xfffffe081d1bb5c0 vn_open_cred() at vn_open_cred+0x2e2/frame 0xfffffe081d1bb730 kern_openat() at kern_openat+0x25c/frame 0xfffffe081d1bb8a0 syscallenter() at syscallenter+0x56b/frame 0xfffffe081d1bb980 amd64_syscall() at amd64_syscall+0x5c/frame 0xfffffe081d1bbab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081d1bbab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800b5cb5a, rsp = 0x7fffffffd538, rbp = 0x7fffffffd620 --- uhub4: 6 ports with 6 removable, self powered ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/gcc48 /usr/local/lib/nss 32-bit compatibility ldconfig path: /usr/lib32 uhub3: 8 ports with 8 removable, self powered Setting hostname: t2.osted.lan. Setting up harvesting:[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy:ugen0.3: at usbus0 ukbd0: on usbus0 kbd2 at ukbd0 . ugen2.3: at usbus2 uhub5: on usbus2 uhub5: MTT enabled uhub5: 4 ports with 4 removable, self powered ugen2.4: at usbus2 ukbd1: on usbus2 kbd3 at ukbd1 Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo igb0: flags=8843 metric 0 mtu 1500 options=403bb ether 00:1e:67:56:b6:9b inet 192.168.1.109 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::21e:67ff:fe56:b69b%igb0 prefixlen 64 scopeid 0x1 nd6 options=23 media: Ethernet autoselect status: no carrier igb1: flags=8c02 metric 0 mtu 1500 options=403bb ether 00:1e:67:56:b6:9c nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: igb1. igb1: flags=8c02 metric 0 mtu 1500 options=403bb ether 00:1e:67:56:b6:9c nd6 options=29 media: Ethernet autoselect status: no carrier Configuring vt: keymap. ums0: on usbus0 igb0: link state changed to UP ums1: on usbus2 ums0: 18 buttons and [XYZT] coordinates ID=2 ums1: 3 buttons and [Z] coordinates ID=0 Starting ums0 moused. Starting ums1 moused. add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Starting rtsold. Creating and/or trimming log files. Starting syslogd. Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Starting casperd. lock order reversal: 1st 0xfffffe0785675038 bufwait (bufwait) @ kern/vfs_bio.c:3476 2nd 0xfffff8001f096400 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:281 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081d418250 witness_checkorder() at witness_checkorder+0xe79/frame 0xfffffe081d4182d0 _sx_xlock() at _sx_xlock+0x72/frame 0xfffffe081d418310 ufsdirhash_add() at ufsdirhash_add+0x4d/frame 0xfffffe081d418370 ufs_direnter() at ufs_direnter+0x62f/frame 0xfffffe081d418440 ufs_mkdir() at ufs_mkdir+0x8ba/frame 0xfffffe081d418640 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x115/frame 0xfffffe081d418670 kern_mkdirat() at kern_mkdirat+0x1fd/frame 0xfffffe081d4188a0 syscallenter() at syscallenter+0x56b/frame 0xfffffe081d418980 amd64_syscall() at amd64_syscall+0x5c/frame 0xfffffe081d418ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081d418ab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80095fd6a, rsp = 0x7fffffffe788, rbp = 0x7fffffffec60 --- Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backup. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Thu Nov 12 10:06:01 CET 2015 FreeBSD/amd64 (t2.osted.lan) (ttyu1) login: root Password: Nov 12 10:06:07 t2 login: ROOT LOGIN (root) ON ttyu1 Last login: Wed Nov 11 20:21:04 on ttyu1 FreeBSD 11.0-CURRENT (PHO) #1 r290704M: Thu Nov 12 09:59:26 CET 2015 Welcome to FreeBSD! Release Notes, Errata: https://www.FreeBSD.org/releases/ Security Advisories: https://www.FreeBSD.org/security/ FreeBSD Handbook: https://www.FreeBSD.org/handbook/ FreeBSD FAQ: https://www.FreeBSD.org/faq/ Questions List: https://lists.FreeBSD.org/mailman/listinfo/freebsd-questions/ FreeBSD Forums: https://forums.FreeBSD.org/ Documents installed with the system are in the /usr/local/share/doc/freebsd/ directory, or can be installed later with: pkg install en-freebsd-doc For other languages, replace "en" with a language code like de or fr. Show the version of FreeBSD installed: freebsd-version ; uname -a Please include that output and any error messages when posting questions. Introduction to manual pages: man man FreeBSD directory layout: man hier Edit /etc/motd to change this login announcement. You have new mail. root@t2:~ # init 1 root@t2:~ # Shutting down local packages:. Stopping cron. Waiting for PIDS: 781. Stopping sshd. Waiting for PIDS: 771. Stopping powerd. Waiting for PIDS: 726. Stopping ntpd. Waiting for PIDS: 723, 723. Stopping nfsd. Waiting for PIDS: 683 687, 687. Stopping mountd. Waiting for PIDS: 677. Stopping nfsuserd. Waiting for PIDS: 666 667 668 670 671. Stopping casperd. Waiting for PIDS: 649. Stopping watchdogd. Waiting for PIDS: 630. Stopping rpcbind. Waiting for PIDS: 552. Stopping rtsold. Waiting for PIDS: 510. Stopping devd. Waiting for PIDS: 470. Writing entropy file:. Writing early boot entropy file:. Terminated . Nov 12 10:06:13 t2 syslogd: exiting on signal 15 Enter full pathname of shell or RETURN for /bin/sh: # exit Setting hostuuid: 2bde2bde-f4e2-e111-aab2-001e6756b69b. Setting hostid: 0x0035ff86. Starting ddb. Fast boot: skipping disk checks. lock order reversal: 1st 0xfffff80012611548 ufs (ufs) @ kern/vfs_mount.c:1224 2nd 0xfffff80012e51068 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1587 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081d95d440 witness_checkorder() at witness_checkorder+0xe79/frame 0xfffffe081d95d4c0 __lockmgr_args() at __lockmgr_args+0xd47/frame 0xfffffe081d95d570 vop_stdlock() at vop_stdlock+0x3c/frame 0xfffffe081d95d590 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x100/frame 0xfffffe081d95d5c0 _vn_lock() at _vn_lock+0xc2/frame 0xfffffe081d95d630 ffs_sync() at ffs_sync+0x302/frame 0xfffffe081d95d6f0 dounmount() at dounmount+0x4e9/frame 0xfffffe081d95d770 sys_unmount() at sys_unmount+0x35d/frame 0xfffffe081d95d8a0 syscallenter() at syscallenter+0x56b/frame 0xfffffe081d95d980 amd64_syscall() at amd64_syscall+0x5c/frame 0xfffffe081d95dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081d95dab0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x80086e85a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe570 --- Mounting local file systems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/gcc48 /usr/local/lib/nss 32-bit compatibility ldconfig path: /usr/lib32 Setting up harvesting:[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy:. ifa_maintain_loopback_route: deletion failed for interface igb0: 3 panic: bogus refcnt 0 on lle 0xfffff80012d3b200 cpuid = 9 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081d9cb000 vpanic() at vpanic+0x249/frame 0xfffffe081d9cb0d0 kassert_panic() at kassert_panic+0xc4/frame 0xfffffe081d9cb140 llentry_free() at llentry_free+0x129/frame 0xfffffe081d9cb170 in_lltable_free_entry() at in_lltable_free_entry+0x1bd/frame 0xfffffe081d9cb1d0 lltable_free_entry() at lltable_free_entry+0x2d/frame 0xfffffe081d9cb200 htable_prefix_free() at htable_prefix_free+0x11c/frame 0xfffffe081d9cb270 lltable_prefix_free() at lltable_prefix_free+0x73/frame 0xfffffe081d9cb2b0 in_scrubprefixlle() at in_scrubprefixlle+0xd7/frame 0xfffffe081d9cb340 in_scrubprefix() at in_scrubprefix+0x4cc/frame 0xfffffe081d9cb420 in_difaddr_ioctl() at in_difaddr_ioctl+0x507/frame 0xfffffe081d9cb4f0 in_control() at in_control+0x1a2/frame 0xfffffe081d9cb5c0 ifioctl() at ifioctl+0x3aa/frame 0xfffffe081d9cb6b0 fo_ioctl() at fo_ioctl+0x4c/frame 0xfffffe081d9cb6f0 kern_ioctl() at kern_ioctl+0x361/frame 0xfffffe081d9cb7c0 sys_ioctl() at sys_ioctl+0x2b8/frame 0xfffffe081d9cb8a0 syscallenter() at syscallenter+0x56b/frame 0xfffffe081d9cb980 amd64_syscall() at amd64_syscall+0x5c/frame 0xfffffe081d9cbab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081d9cbab0 --- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x8011f319a, rsp = 0x7fffffffe468, rbp = 0x7fffffffe4b0 --- KDB: enter: panic [ thread pid 1400 tid 100461 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> bt Tracing pid 1400 tid 100461 td 0xfffff800725b3000 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe081d9cb000 vpanic() at vpanic+0x26b/frame 0xfffffe081d9cb0d0 kassert_panic() at kassert_panic+0xc4/frame 0xfffffe081d9cb140 llentry_free() at llentry_free+0x129/frame 0xfffffe081d9cb170 in_lltable_free_entry() at in_lltable_free_entry+0x1bd/frame 0xfffffe081d9cb1d0 lltable_free_entry() at lltable_free_entry+0x2d/frame 0xfffffe081d9cb200 htable_prefix_free() at htable_prefix_free+0x11c/frame 0xfffffe081d9cb270 lltable_prefix_free() at lltable_prefix_free+0x73/frame 0xfffffe081d9cb2b0 in_scrubprefixlle() at in_scrubprefixlle+0xd7/frame 0xfffffe081d9cb340 in_scrubprefix() at in_scrubprefix+0x4cc/frame 0xfffffe081d9cb420 in_difaddr_ioctl() at in_difaddr_ioctl+0x507/frame 0xfffffe081d9cb4f0 in_control() at in_control+0x1a2/frame 0xfffffe081d9cb5c0 ifioctl() at ifioctl+0x3aa/frame 0xfffffe081d9cb6b0 fo_ioctl() at fo_ioctl+0x4c/frame 0xfffffe081d9cb6f0 kern_ioctl() at kern_ioctl+0x361/frame 0xfffffe081d9cb7c0 sys_ioctl() at sys_ioctl+0x2b8/frame 0xfffffe081d9cb8a0 syscallenter() at syscallenter+0x56b/frame 0xfffffe081d9cb980 amd64_syscall() at amd64_syscall+0x5c/frame 0xfffffe081d9cbab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081d9cbab0 --- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x8011f319a, rsp = 0x7fffffffe468, rbp = 0x7fffffffe4b0 --- db:0:bt> show allpcpu Current CPU: 9 cpuid = 0 dynamic pcpu = 0x7b6300 curthread = 0xfffff800075699a0: pid 11 "idle: cpu0" curpcb = 0xfffffe0785579b80 fpcurthread = none idlethread = 0xfffff800075699a0: tid 100004 "idle: cpu0" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d10110 commontssp = 0xffffffff81d10110 rsp0 = 0xfffffe0785579b80 gs32p = 0xffffffff81d16968 ldt = 0xffffffff81d169a8 tss = 0xffffffff81d16998 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe0879e65300 curthread = 0xfffff800075694d0: pid 11 "idle: cpu1" curpcb = 0xfffffe078557eb80 fpcurthread = none idlethread = 0xfffff800075694d0: tid 100005 "idle: cpu1" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d10178 commontssp = 0xffffffff81d10178 rsp0 = 0xfffffe078557eb80 gs32p = 0xffffffff81d169d0 ldt = 0xffffffff81d16a10 tss = 0xffffffff81d16a00 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe0879e6d300 curthread = 0xfffff80007569000: pid 11 "idle: cpu2" curpcb = 0xfffffe0785583b80 fpcurthread = none idlethread = 0xfffff80007569000: tid 100006 "idle: cpu2" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d101e0 commontssp = 0xffffffff81d101e0 rsp0 = 0xfffffe0785583b80 gs32p = 0xffffffff81d16a38 ldt = 0xffffffff81d16a78 tss = 0xffffffff81d16a68 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe0879e75300 curthread = 0xfffff800075689a0: pid 11 "idle: cpu3" curpcb = 0xfffffe0785588b80 fpcurthread = none idlethread = 0xfffff800075689a0: tid 100007 "idle: cpu3" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d10248 commontssp = 0xffffffff81d10248 rsp0 = 0xfffffe0785588b80 gs32p = 0xffffffff81d16aa0 ldt = 0xffffffff81d16ae0 tss = 0xffffffff81d16ad0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe0879e7d300 curthread = 0xfffff800075684d0: pid 11 "idle: cpu4" curpcb = 0xfffffe078558db80 fpcurthread = none idlethread = 0xfffff800075684d0: tid 100008 "idle: cpu4" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d102b0 commontssp = 0xffffffff81d102b0 rsp0 = 0xfffffe078558db80 gs32p = 0xffffffff81d16b08 ldt = 0xffffffff81d16b48 tss = 0xffffffff81d16b38 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe0879e85300 curthread = 0xfffff80007568000: pid 11 "idle: cpu5" curpcb = 0xfffffe0785592b80 fpcurthread = none idlethread = 0xfffff80007568000: tid 100009 "idle: cpu5" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d10318 commontssp = 0xffffffff81d10318 rsp0 = 0xfffffe0785592b80 gs32p = 0xffffffff81d16b70 ldt = 0xffffffff81d16bb0 tss = 0xffffffff81d16ba0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe0879e8d300 curthread = 0xfffff8000757f9a0: pid 11 "idle: cpu6" curpcb = 0xfffffe0785597b80 fpcurthread = none idlethread = 0xfffff8000757f9a0: tid 100010 "idle: cpu6" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d10380 commontssp = 0xffffffff81d10380 rsp0 = 0xfffffe0785597b80 gs32p = 0xffffffff81d16bd8 ldt = 0xffffffff81d16c18 tss = 0xffffffff81d16c08 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe0879e95300 curthread = 0xfffff8000757f4d0: pid 11 "idle: cpu7" curpcb = 0xfffffe078559cb80 fpcurthread = none idlethread = 0xfffff8000757f4d0: tid 100011 "idle: cpu7" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d103e8 commontssp = 0xffffffff81d103e8 rsp0 = 0xfffffe078559cb80 gs32p = 0xffffffff81d16c40 ldt = 0xffffffff81d16c80 tss = 0xffffffff81d16c70 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe0879e9d300 curthread = 0xfffff8000757f000: pid 11 "idle: cpu8" curpcb = 0xfffffe07855a1b80 fpcurthread = none idlethread = 0xfffff8000757f000: tid 100012 "idle: cpu8" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d10450 commontssp = 0xffffffff81d10450 rsp0 = 0xfffffe07855a1b80 gs32p = 0xffffffff81d16ca8 ldt = 0xffffffff81d16ce8 tss = 0xffffffff81d16cd8 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe0879ea5300 curthread = 0xfffff800725b3000: pid 1400 "ifconfig" curpcb = 0xfffffe081d9cbb80 fpcurthread = 0xfffff800725b3000: pid 1400 "ifconfig" idlethread = 0xfffff8000757e9a0: tid 100013 "idle: cpu9" curpmap = 0xfffff8001f1f3138 tssp = 0xffffffff81d104b8 commontssp = 0xffffffff81d104b8 rsp0 = 0xfffffe081d9cbb80 gs32p = 0xffffffff81d16d10 ldt = 0xffffffff81d16d50 tss = 0xffffffff81d16d40 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe0879ead300 curthread = 0xfffff8000757e4d0: pid 11 "idle: cpu10" curpcb = 0xfffffe07855abb80 fpcurthread = none idlethread = 0xfffff8000757e4d0: tid 100014 "idle: cpu10" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d10520 commontssp = 0xffffffff81d10520 rsp0 = 0xfffffe07855abb80 gs32p = 0xffffffff81d16d78 ldt = 0xffffffff81d16db8 tss = 0xffffffff81d16da8 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe0879eb5300 curthread = 0xfffff8000757e000: pid 11 "idle: cpu11" curpcb = 0xfffffe07855b0b80 fpcurthread = none idlethread = 0xfffff8000757e000: tid 100015 "idle: cpu11" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d10588 commontssp = 0xffffffff81d10588 rsp0 = 0xfffffe07855b0b80 gs32p = 0xffffffff81d16de0 ldt = 0xffffffff81d16e20 tss = 0xffffffff81d16e10 spin locks held: cpuid = 12 dynamic pcpu = 0xfffffe0879ebd300 curthread = 0xfffff8000757d9a0: pid 11 "idle: cpu12" curpcb = 0xfffffe07855b5b80 fpcurthread = none idlethread = 0xfffff8000757d9a0: tid 100016 "idle: cpu12" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d105f0 commontssp = 0xffffffff81d105f0 rsp0 = 0xfffffe07855b5b80 gs32p = 0xffffffff81d16e48 ldt = 0xffffffff81d16e88 tss = 0xffffffff81d16e78 spin locks held: cpuid = 13 dynamic pcpu = 0xfffffe0879ec5300 curthread = 0xfffff8000757d4d0: pid 11 "idle: cpu13" curpcb = 0xfffffe07855bab80 fpcurthread = none idlethread = 0xfffff8000757d4d0: tid 100017 "idle: cpu13" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d10658 commontssp = 0xffffffff81d10658 rsp0 = 0xfffffe07855bab80 gs32p = 0xffffffff81d16eb0 ldt = 0xffffffff81d16ef0 tss = 0xffffffff81d16ee0 spin locks held: cpuid = 14 dynamic pcpu = 0xfffffe0879ecd300 curthread = 0xfffff8000757d000: pid 11 "idle: cpu14" curpcb = 0xfffffe07855bfb80 fpcurthread = none idlethread = 0xfffff8000757d000: tid 100018 "idle: cpu14" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d106c0 commontssp = 0xffffffff81d106c0 rsp0 = 0xfffffe07855bfb80 gs32p = 0xffffffff81d16f18 ldt = 0xffffffff81d16f58 tss = 0xffffffff81d16f48 spin locks held: cpuid = 15 dynamic pcpu = 0xfffffe0879ed5300 curthread = 0xfffff800075829a0: pid 11 "idle: cpu15" curpcb = 0xfffffe07855c4b80 fpcurthread = none idlethread = 0xfffff800075829a0: tid 100019 "idle: cpu15" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d10728 commontssp = 0xffffffff81d10728 rsp0 = 0xfffffe07855c4b80 gs32p = 0xffffffff81d16f80 ldt = 0xffffffff81d16fc0 tss = 0xffffffff81d16fb0 spin locks held: cpuid = 16 dynamic pcpu = 0xfffffe0879edd300 curthread = 0xfffff800075824d0: pid 11 "idle: cpu16" curpcb = 0xfffffe07855c9b80 fpcurthread = none idlethread = 0xfffff800075824d0: tid 100020 "idle: cpu16" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d10790 commontssp = 0xffffffff81d10790 rsp0 = 0xfffffe07855c9b80 gs32p = 0xffffffff81d16fe8 ldt = 0xffffffff81d17028 tss = 0xffffffff81d17018 spin locks held: cpuid = 17 dynamic pcpu = 0xfffffe0879ee5300 curthread = 0xfffff80007582000: pid 11 "idle: cpu17" curpcb = 0xfffffe07855ceb80 fpcurthread = none idlethread = 0xfffff80007582000: tid 100021 "idle: cpu17" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d107f8 commontssp = 0xffffffff81d107f8 rsp0 = 0xfffffe07855ceb80 gs32p = 0xffffffff81d17050 ldt = 0xffffffff81d17090 tss = 0xffffffff81d17080 spin locks held: cpuid = 18 dynamic pcpu = 0xfffffe0879eed300 curthread = 0xfffff800075819a0: pid 11 "idle: cpu18" curpcb = 0xfffffe07855d3b80 fpcurthread = none idlethread = 0xfffff800075819a0: tid 100022 "idle: cpu18" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d10860 commontssp = 0xffffffff81d10860 rsp0 = 0xfffffe07855d3b80 gs32p = 0xffffffff81d170b8 ldt = 0xffffffff81d170f8 tss = 0xffffffff81d170e8 spin locks held: cpuid = 19 dynamic pcpu = 0xfffffe0879ef5300 curthread = 0xfffff800075814d0: pid 11 "idle: cpu19" curpcb = 0xfffffe07855d8b80 fpcurthread = none idlethread = 0xfffff800075814d0: tid 100023 "idle: cpu19" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d108c8 commontssp = 0xffffffff81d108c8 rsp0 = 0xfffffe07855d8b80 gs32p = 0xffffffff81d17120 ldt = 0xffffffff81d17160 tss = 0xffffffff81d17150 spin locks held: cpuid = 20 dynamic pcpu = 0xfffffe0879efd300 curthread = 0xfffff80007581000: pid 11 "idle: cpu20" curpcb = 0xfffffe07855ddb80 fpcurthread = none idlethread = 0xfffff80007581000: tid 100024 "idle: cpu20" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d10930 commontssp = 0xffffffff81d10930 rsp0 = 0xfffffe07855ddb80 gs32p = 0xffffffff81d17188 ldt = 0xffffffff81d171c8 tss = 0xffffffff81d171b8 spin locks held: cpuid = 21 dynamic pcpu = 0xfffffe0879f05300 curthread = 0xfffff800075809a0: pid 11 "idle: cpu21" curpcb = 0xfffffe07855e2b80 fpcurthread = none idlethread = 0xfffff800075809a0: tid 100025 "idle: cpu21" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d10998 commontssp = 0xffffffff81d10998 rsp0 = 0xfffffe07855e2b80 gs32p = 0xffffffff81d171f0 ldt = 0xffffffff81d17230 tss = 0xffffffff81d17220 spin locks held: cpuid = 22 dynamic pcpu = 0xfffffe0879f0d300 curthread = 0xfffff800075804d0: pid 11 "idle: cpu22" curpcb = 0xfffffe07855e7b80 fpcurthread = none idlethread = 0xfffff800075804d0: tid 100026 "idle: cpu22" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d10a00 commontssp = 0xffffffff81d10a00 rsp0 = 0xfffffe07855e7b80 gs32p = 0xffffffff81d17258 ldt = 0xffffffff81d17298 tss = 0xffffffff81d17288 spin locks held: cpuid = 23 dynamic pcpu = 0xfffffe0803c76300 curthread = 0xfffff80007580000: pid 11 "idle: cpu23" curpcb = 0xfffffe07855ecb80 fpcurthread = none idlethread = 0xfffff80007580000: tid 100027 "idle: cpu23" curpmap = 0xffffffff81cda3e0 tssp = 0xffffffff81d10a68 commontssp = 0xffffffff81d10a68 rsp0 = 0xfffffe07855ecb80 gs32p = 0xffffffff81d172c0 ldt = 0xffffffff81d17300 tss = 0xffffffff81d172f0 spin locks held: db:0:allpcpu> show alllocks Process 1400 (ifconfig) thread 0xfffff800725b3000 (100461) exclusive rw lle (lle) r = 0 (0xfffff80012d3b2e8) locked @ net/if_llatbl.c:203 shared rw lltable_rwlock (lltable_rwlock) r = 0 (0xffffffff81d00a98) locked @ net/if_llatbl.c:473 exclusive sx in_control (in_control) r = 0 (0xffffffff81c5f400) locked @ netinet/in.c:247 db:0:alllocks> show lockedvnods Locked vnodes db:0:lockedvnods> show mount 0xfffff800125d33c8 /dev/da0p2 on / (ufs) 0xfffff80012474000 devfs on /dev (devfs) 0xfffff8002c9c93c8 /dev/da0p3 on /tmp (ufs) 0xfffff8002c9c9000 procfs on /proc (procfs) More info: show mount db:0:mount> show page vm_cnt.v_free_count: 7767994 vm_cnt.v_cache_count: 0 vm_cnt.v_inactive_count: 2186 vm_cnt.v_active_count: 2349 vm_cnt.v_wire_count: 112623 vm_cnt.v_free_reserved: 10317 vm_cnt.v_free_min: 49741 vm_cnt.v_free_target: 168013 vm_cnt.v_inactive_target: 252019 db:0:page> ps pid ppid pgrp uid state wmesg wchan cmd 1400 1337 1204 0 R+ CPU 9 ifconfig 1337 1204 1204 0 S+ wait 0xfffff80012153000 sh 1204 1 1204 0 Ss+ wait 0xfffff80012f20a90 sh 800 0 0 0 SL - 0xffffffff81ccf7c0 [newnfs 0] 19 0 0 0 DL syncer 0xffffffff81c5a9b8 [syncer] 18 0 0 0 DL vlruwt 0xfffff8000db9c000 [vnlru] 17 0 0 0 DL (threaded) [bufdaemon] 100142 D psleep 0xffffffff81c59204 [bufdaemon] 100159 D sdflush 0xfffff80012ed22e8 [/ worker] 100483 D sdflush 0xfffff8002c9b66e8 [/tmp worker] 16 0 0 0 DL - 0xffffffff81c59f04 [bufspacedaemon] 15 0 0 0 DL pgzero 0xffffffff81c63c34 [pagezero] 9 0 0 0 DL psleep 0xffffffff81c63414 [vmdaemon] 8 0 0 0 DL (threaded) [pagedaemon] 100138 D psleep 0xffffffff81d0f484 [pagedaemon] 100145 D umarcl 0xffffffff81c62d40 [uma] 7 0 0 0 DL idle 0xfffff8000db9e000 [enc_daemon0] 6 0 0 0 DL waiting_ 0xffffffff81d01460 [sctp_iterator] 14 0 0 0 DL (threaded) [usb] 100077 D - 0xfffffe00013a2d10 [usbus0] 100078 D - 0xfffffe00013a2d68 [usbus0] 100079 D - 0xfffffe00013a2dc0 [usbus0] 100080 D - 0xfffffe00013a2e18 [usbus0] 100081 D - 0xfffffe00013a2e70 [usbus0] 100118 D - 0xfffffe0001797560 [usbus1] 100119 D - 0xfffffe00017975b8 [usbus1] 100120 D - 0xfffffe0001797610 [usbus1] 100121 D - 0xfffffe0001797668 [usbus1] 100122 D - 0xfffffe00017976c0 [usbus1] 100124 D - 0xfffffe000160dd10 [usbus2] 100125 D - 0xfffffe000160dd68 [usbus2] 100126 D - 0xfffffe000160ddc0 [usbus2] 100127 D - 0xfffffe000160de18 [usbus2] 100128 D - 0xfffffe000160de70 [usbus2] 5 0 0 0 DL (threaded) [cam] 100068 D - 0xffffffff818ef080 [doneq0] 100069 D - 0xffffffff818ef180 [doneq1] 100070 D - 0xffffffff818ef280 [doneq2] 100071 D - 0xffffffff818ef380 [doneq3] 100072 D - 0xffffffff818ef480 [doneq4] 100136 D - 0xffffffff818eeec8 [scanner] 4 0 0 0 DL crypto_r 0xffffffff81c61868 [crypto returns] 3 0 0 0 DL crypto_w 0xffffffff81c61720 [crypto] 13 0 0 0 DL (threaded) [geom] 100054 D - 0xffffffff81cd9870 [g_event] 100055 D - 0xffffffff81cd9878 [g_up] 100056 D - 0xffffffff81cd9880 [g_down] 12 0 0 0 WL (threaded) [intr] 100028 I [swi1: netisr 0] 100029 I [swi4: clock (0)] 100030 I [swi4: clock (1)] 100031 I [swi4: clock (2)] 100032 I [swi4: clock (3)] 100033 I [swi4: clock (4)] 100034 I [swi4: clock (5)] 100035 I [swi4: clock (6)] 100036 I [swi4: clock (7)] 100037 I [swi4: clock (8)] 100038 I [swi4: clock (9)] 100039 I [swi4: clock (10)] 100040 I [swi4: clock (11)] 100041 I [swi4: clock (12)] 100042 I [swi4: clock (13)] 100043 I [swi4: clock (14)] 100044 I [swi4: clock (15)] 100045 I [swi4: clock (16)] 100046 I [swi4: clock (17)] 100047 I [swi4: clock (18)] 100048 I [swi4: clock (19)] 100049 I [swi4: clock (20)] 100050 I [swi4: clock (21)] 100051 I [swi4: clock (22)] 100052 I [swi4: clock (23)] 100053 I [swi3: vm] 100060 I [swi6: Giant taskq] 100062 I [swi5: fast taskq] 100073 I [swi6: task queue] 100074 I [irq264: isci0] 100075 I [irq265: isci0] 100076 I [irq22: ehci0] 100082 I [irq266: hdac0] 100083 I [irq267: igb0:que 0] 100085 I [irq268: igb0:que 1] 100087 I [irq269: igb0:que 2] 100089 I [irq270: igb0:que 3] 100091 I [irq271: igb0:que 4] 100093 I [irq272: igb0:que 5] 100095 I [irq273: igb0:que 6] 100097 I [irq274: igb0:que 7] 100099 I [irq275: igb0:link] 100100 I [irq276: igb1:que 0] 100102 I [irq277: igb1:que 1] 100104 I [irq278: igb1:que 2] 100106 I [irq279: igb1:que 3] 100108 I [irq280: igb1:que 4] 100110 I [irq281: igb1:que 5] 100112 I [irq282: igb1:que 6] 100114 I [irq283: igb1:que 7] 100116 I [irq284: igb1:link] 100117 I [irq285: xhci0] 100123 I [irq20: ehci1] 100129 I [irq286: ahci0] 100130 I [irq287: hdac1] 100131 I [swi0: uart] 11 0 0 0 RL (threaded) [idle] 100004 Run CPU 0 [idle: cpu0] 100005 Run CPU 1 [idle: cpu1] 100006 Run CPU 2 [idle: cpu2] 100007 Run CPU 3 [idle: cpu3] 100008 Run CPU 4 [idle: cpu4] 100009 Run CPU 5 [idle: cpu5] 100010 Run CPU 6 [idle: cpu6] 100011 Run CPU 7 [idle: cpu7] 100012 Run CPU 8 [idle: cpu8] 100013 CanRun [idle: cpu9] 100014 Run CPU 10 [idle: cpu10] 100015 Run CPU 11 [idle: cpu11] 100016 Run CPU 12 [idle: cpu12] 100017 Run CPU 13 [idle: cpu13] 100018 Run CPU 14 [idle: cpu14] 100019 Run CPU 15 [idle: cpu15] 100020 Run CPU 16 [idle: cpu16] 100021 Run CPU 17 [idle: cpu17] 100022 Run CPU 18 [idle: cpu18] 100023 Run CPU 19 [idle: cpu19] 100024 Run CPU 20 [idle: cpu20] 100025 Run CPU 21 [idle: cpu21] 100026 Run CPU 22 [idle: cpu22] 100027 Run CPU 23 [idle: cpu23] 2 0 0 0 DL - 0xffffffff81a1bf30 [rand_harvestq] 1 0 1 0 SLs wait 0xfffff80007567548 [init] 10 0 0 0 DL audit_wo 0xffffffff81d06a30 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81cd98a8 [swapper] 100057 D - 0xfffff8000755a300 [firmware taskq] 100061 D - 0xfffff8000774fe00 [thread taskq] 100063 D - 0xfffff8000774fa00 [kqueue taskq] 100064 D - 0xfffff8000774f800 [ffs_trim taskq] 100065 D - 0xfffff8000774f600 [acpi_task_0] 100066 D - 0xfffff8000774f600 [acpi_task_1] 100067 D - 0xfffff8000774f600 [acpi_task_2] 100084 D - 0xfffff8000774de00 [igb0 que (qid 0)] 100086 D - 0xfffff8000774db00 [igb0 que (qid 1)] 100088 D - 0xfffff8000774d800 [igb0 que (qid 2)] 100090 D - 0xfffff8000774d500 [igb0 que (qid 3)] 100092 D - 0xfffff8000774d200 [igb0 que (qid 4)] 100094 D - 0xfffff8000755ee00 [igb0 que (qid 5)] 100096 D - 0xfffff8000755eb00 [igb0 que (qid 6)] 100098 D - 0xfffff8000755e800 [igb0 que (qid 7)] 100101 D - 0xfffff8000755e400 [igb1 que (qid 8)] 100103 D - 0xfffff8000755e100 [igb1 que (qid 9)] 100105 D - 0xfffff8000dbf2000 [igb1 que (qid 10)] 100107 D - 0xfffff8000dbf1c00 [igb1 que (qid 11)] 100109 D - 0xfffff8000dbf1900 [igb1 que (qid 12)] 100111 D - 0xfffff8000dbf1600 [igb1 que (qid 13)] 100113 D - 0xfffff8000dbf1300 [igb1 que (qid 14)] 100115 D - 0xfffff8000dbf1000 [igb1 que (qid 15)] 100132 D - 0xfffff8000dbefc00 [mca taskq] 100133 D - 0xffffffff81ac95e6 [deadlkres] 100135 D - 0xfffff8000774f200 [CAM taskq] db:0:ps> allt Tracing command ifconfig pid 1400 tid 100461 td 0xfffff800725b3000 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe081d9cb000 vpanic() at vpanic+0x26b/frame 0xfffffe081d9cb0d0 kassert_panic() at kassert_panic+0xc4/frame 0xfffffe081d9cb140 llentry_free() at llentry_free+0x129/frame 0xfffffe081d9cb170 in_lltable_free_entry() at in_lltable_free_entry+0x1bd/frame 0xfffffe081d9cb1d0 lltable_free_entry() at lltable_free_entry+0x2d/frame 0xfffffe081d9cb200 htable_prefix_free() at htable_prefix_free+0x11c/frame 0xfffffe081d9cb270 lltable_prefix_free() at lltable_prefix_free+0x73/frame 0xfffffe081d9cb2b0 in_scrubprefixlle() at in_scrubprefixlle+0xd7/frame 0xfffffe081d9cb340 in_scrubprefix() at in_scrubprefix+0x4cc/frame 0xfffffe081d9cb420 in_difaddr_ioctl() at in_difaddr_ioctl+0x507/frame 0xfffffe081d9cb4f0 in_control() at in_control+0x1a2/frame 0xfffffe081d9cb5c0 ifioctl() at ifioctl+0x3aa/frame 0xfffffe081d9cb6b0 fo_ioctl() at fo_ioctl+0x4c/frame 0xfffffe081d9cb6f0 kern_ioctl() at kern_ioctl+0x361/frame 0xfffffe081d9cb7c0 sys_ioctl() at sys_ioctl+0x2b8/frame 0xfffffe081d9cb8a0 syscallenter() at syscallenter+0x56b/frame 0xfffffe081d9cb980 amd64_syscall() at amd64_syscall+0x5c/frame 0xfffffe081d9cbab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081d9cbab0 --- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x8011f319a, rsp = 0x7fffffffe468, rbp = 0x7fffffffe4b0 --- Tracing command sh pid 1337 tid 100180 td 0xfffff80012f6b4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081d35a450 mi_switch() at mi_switch+0x169/frame 0xfffffe081d35a480 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d35a4c0 sleepq_catch_signals() at sleepq_catch_signals+0x2dc/frame 0xfffffe081d35a530 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081d35a560 _sleep() at _sleep+0x324/frame 0xfffffe081d35a600 kern_wait6() at kern_wait6+0x410/frame 0xfffffe081d35a6b0 sys_wait4() at sys_wait4+0x73/frame 0xfffffe081d35a8a0 syscallenter() at syscallenter+0x56b/frame 0xfffffe081d35a980 amd64_syscall() at amd64_syscall+0x5c/frame 0xfffffe081d35aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081d35aab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b5c9fa, rsp = 0x7fffffffca08, rbp = 0x7fffffffcac0 --- Tracing command sh pid 1204 tid 100189 td 0xfffff800121e34d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081d3f0450 mi_switch() at mi_switch+0x169/frame 0xfffffe081d3f0480 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d3f04c0 sleepq_catch_signals() at sleepq_catch_signals+0x2dc/frame 0xfffffe081d3f0530 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081d3f0560 _sleep() at _sleep+0x324/frame 0xfffffe081d3f0600 kern_wait6() at kern_wait6+0x410/frame 0xfffffe081d3f06b0 sys_wait4() at sys_wait4+0x73/frame 0xfffffe081d3f08a0 syscallenter() at syscallenter+0x56b/frame 0xfffffe081d3f0980 amd64_syscall() at amd64_syscall+0x5c/frame 0xfffffe081d3f0ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081d3f0ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b5c9fa, rsp = 0x7fffffffe858, rbp = 0x7fffffffe910 --- Tracing command newnfs 0 pid 800 tid 100173 td 0xfffff800121e4000 sched_switch() at sched_switch+0x495/frame 0xfffffe081d2e0880 mi_switch() at mi_switch+0x169/frame 0xfffffe081d2e08b0 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d2e08f0 sleepq_catch_signals() at sleepq_catch_signals+0x2dc/frame 0xfffffe081d2e0960 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081d2e0990 _sleep() at _sleep+0x2ff/frame 0xfffffe081d2e0a30 nfssvc_iod() at nfssvc_iod+0x10b/frame 0xfffffe081d2e0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d2e0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d2e0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 19 tid 100144 td 0xfffff80012012000 sched_switch() at sched_switch+0x495/frame 0xfffffe081cffd8c0 mi_switch() at mi_switch+0x169/frame 0xfffffe081cffd8f0 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cffd930 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081cffd960 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x21c/frame 0xfffffe081cffd9e0 sched_sync() at sched_sync+0x5c5/frame 0xfffffe081cffda70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cffdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cffdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 18 tid 100143 td 0xfffff800120124d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081cff88b0 mi_switch() at mi_switch+0x169/frame 0xfffffe081cff88e0 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cff8920 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081cff8950 _sleep() at _sleep+0x311/frame 0xfffffe081cff89f0 vnlru_proc() at vnlru_proc+0x48/frame 0xfffffe081cff8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cff8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cff8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100142 td 0xfffff800120129a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081cff3900 mi_switch() at mi_switch+0x169/frame 0xfffffe081cff3930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cff3970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081cff39a0 _sleep() at _sleep+0x311/frame 0xfffffe081cff3a40 buf_daemon() at buf_daemon+0x68/frame 0xfffffe081cff3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cff3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cff3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100159 td 0xfffff8001288c4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081d29a900 mi_switch() at mi_switch+0x169/frame 0xfffffe081d29a930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d29a970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d29a9a0 _sleep() at _sleep+0x311/frame 0xfffffe081d29aa40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe081d29aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d29aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d29aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100483 td 0xfffff80072524000 sched_switch() at sched_switch+0x495/frame 0xfffffe081d2bd900 mi_switch() at mi_switch+0x169/frame 0xfffffe081d2bd930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d2bd970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d2bd9a0 _sleep() at _sleep+0x311/frame 0xfffffe081d2bda40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe081d2bda70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d2bdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d2bdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufspacedaemon pid 16 tid 100141 td 0xfffff80012013000 sched_switch() at sched_switch+0x495/frame 0xfffffe081cfee910 mi_switch() at mi_switch+0x169/frame 0xfffffe081cfee940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cfee980 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081cfee9b0 _sleep() at _sleep+0x311/frame 0xfffffe081cfeea50 bufspace_daemon() at bufspace_daemon+0x1b7/frame 0xfffffe081cfeea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cfeeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cfeeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagezero pid 15 tid 100140 td 0xfffff800120134d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081cfe9900 mi_switch() at mi_switch+0x169/frame 0xfffffe081cfe9930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cfe9970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081cfe99a0 _sleep() at _sleep+0x311/frame 0xfffffe081cfe9a40 vm_pagezero() at vm_pagezero+0x85/frame 0xfffffe081cfe9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cfe9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cfe9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 9 tid 100139 td 0xfffff800120139a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081cfe48c0 mi_switch() at mi_switch+0x169/frame 0xfffffe081cfe48f0 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cfe4930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081cfe4960 _sleep() at _sleep+0x357/frame 0xfffffe081cfe4a00 vm_daemon() at vm_daemon+0x96/frame 0xfffffe081cfe4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cfe4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cfe4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 8 tid 100138 td 0xfffff80012014000 sched_switch() at sched_switch+0x495/frame 0xfffffe081cfdf890 mi_switch() at mi_switch+0x169/frame 0xfffffe081cfdf8c0 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cfdf900 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081cfdf930 _sleep() at _sleep+0x311/frame 0xfffffe081cfdf9d0 vm_pageout() at vm_pageout+0x22a/frame 0xfffffe081cfdfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cfdfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cfdfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 8 tid 100145 td 0xfffff800121e49a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081d184910 mi_switch() at mi_switch+0x169/frame 0xfffffe081d184940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d184980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d1849b0 _sleep() at _sleep+0x357/frame 0xfffffe081d184a50 uma_reclaim_worker() at uma_reclaim_worker+0x71/frame 0xfffffe081d184a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d184ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d184ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 7 tid 100137 td 0xfffff800120144d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081cfda8c0 mi_switch() at mi_switch+0x169/frame 0xfffffe081cfda8f0 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cfda930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081cfda960 _sleep() at _sleep+0x357/frame 0xfffffe081cfdaa00 enc_daemon() at enc_daemon+0x269/frame 0xfffffe081cfdaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cfdaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cfdaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 6 tid 100134 td 0xfffff8000dc434d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081cf8b910 mi_switch() at mi_switch+0x169/frame 0xfffffe081cf8b940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cf8b980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081cf8b9b0 _sleep() at _sleep+0x357/frame 0xfffffe081cf8ba50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe081cf8ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cf8bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cf8bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100077 td 0xfffff800077654d0 sched_switch() at sched_switch+0x495/frame 0xfffffe00003e0930 mi_switch() at mi_switch+0x169/frame 0xfffffe00003e0960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe00003e09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003e09d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe00003e0a40 usb_process() at usb_process+0x13b/frame 0xfffffe00003e0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003e0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003e0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100078 td 0xfffff80007765000 sched_switch() at sched_switch+0x495/frame 0xfffffe00003e5930 mi_switch() at mi_switch+0x169/frame 0xfffffe00003e5960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe00003e59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003e59d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe00003e5a40 usb_process() at usb_process+0x13b/frame 0xfffffe00003e5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003e5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003e5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100079 td 0xfffff800077649a0 sched_switch() at sched_switch+0x495/frame 0xfffffe00003ea930 mi_switch() at mi_switch+0x169/frame 0xfffffe00003ea960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe00003ea9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003ea9d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe00003eaa40 usb_process() at usb_process+0x13b/frame 0xfffffe00003eaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003eaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003eaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100080 td 0xfffff800077644d0 sched_switch() at sched_switch+0x495/frame 0xfffffe00003ef930 mi_switch() at mi_switch+0x169/frame 0xfffffe00003ef960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe00003ef9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003ef9d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe00003efa40 usb_process() at usb_process+0x13b/frame 0xfffffe00003efa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003efab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003efab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100081 td 0xfffff80007764000 sched_switch() at sched_switch+0x495/frame 0xfffffe00003f4930 mi_switch() at mi_switch+0x169/frame 0xfffffe00003f4960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe00003f49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003f49d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe00003f4a40 usb_process() at usb_process+0x13b/frame 0xfffffe00003f4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003f4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003f4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100118 td 0xfffff8000dc2e9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ad39930 mi_switch() at mi_switch+0x169/frame 0xfffffe081ad39960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ad399a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ad399d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe081ad39a40 usb_process() at usb_process+0x13b/frame 0xfffffe081ad39a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ad39ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ad39ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100119 td 0xfffff8000dc2e4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ad3e930 mi_switch() at mi_switch+0x169/frame 0xfffffe081ad3e960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ad3e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ad3e9d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe081ad3ea40 usb_process() at usb_process+0x13b/frame 0xfffffe081ad3ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ad3eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ad3eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100120 td 0xfffff8000dc2e000 sched_switch() at sched_switch+0x495/frame 0xfffffe081ad43930 mi_switch() at mi_switch+0x169/frame 0xfffffe081ad43960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ad439a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ad439d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe081ad43a40 usb_process() at usb_process+0x13b/frame 0xfffffe081ad43a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ad43ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ad43ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100121 td 0xfffff8000dc2a9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ad48930 mi_switch() at mi_switch+0x169/frame 0xfffffe081ad48960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ad489a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ad489d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe081ad48a40 usb_process() at usb_process+0x13b/frame 0xfffffe081ad48a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ad48ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ad48ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100122 td 0xfffff8000dc2a4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ad4d930 mi_switch() at mi_switch+0x169/frame 0xfffffe081ad4d960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ad4d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ad4d9d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe081ad4da40 usb_process() at usb_process+0x13b/frame 0xfffffe081ad4da70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ad4dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ad4dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100124 td 0xfffff8000dc259a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081aeda930 mi_switch() at mi_switch+0x169/frame 0xfffffe081aeda960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081aeda9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081aeda9d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe081aedaa40 usb_process() at usb_process+0x13b/frame 0xfffffe081aedaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081aedaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081aedaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100125 td 0xfffff8000dc254d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081aedf930 mi_switch() at mi_switch+0x169/frame 0xfffffe081aedf960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081aedf9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081aedf9d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe081aedfa40 usb_process() at usb_process+0x13b/frame 0xfffffe081aedfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081aedfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081aedfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100126 td 0xfffff8000dc25000 sched_switch() at sched_switch+0x495/frame 0xfffffe081aee4930 mi_switch() at mi_switch+0x169/frame 0xfffffe081aee4960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081aee49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081aee49d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe081aee4a40 usb_process() at usb_process+0x13b/frame 0xfffffe081aee4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081aee4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081aee4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100127 td 0xfffff8000dc459a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081aee9930 mi_switch() at mi_switch+0x169/frame 0xfffffe081aee9960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081aee99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081aee99d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe081aee9a40 usb_process() at usb_process+0x13b/frame 0xfffffe081aee9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081aee9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081aee9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100128 td 0xfffff8000dc454d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081aeee930 mi_switch() at mi_switch+0x169/frame 0xfffffe081aeee960 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081aeee9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081aeee9d0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe081aeeea40 usb_process() at usb_process+0x13b/frame 0xfffffe081aeeea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081aeeeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081aeeeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 5 tid 100068 td 0xfffff800077564d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789ed88e0 mi_switch() at mi_switch+0x169/frame 0xfffffe0789ed8910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789ed8950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789ed8980 _sleep() at _sleep+0x357/frame 0xfffffe0789ed8a20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0789ed8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789ed8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789ed8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 5 tid 100069 td 0xfffff80007756000 sched_switch() at sched_switch+0x495/frame 0xfffffe0789edd8e0 mi_switch() at mi_switch+0x169/frame 0xfffffe0789edd910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789edd950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789edd980 _sleep() at _sleep+0x357/frame 0xfffffe0789edda20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0789edda70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789eddab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789eddab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 5 tid 100070 td 0xfffff800077559a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789ee28e0 mi_switch() at mi_switch+0x169/frame 0xfffffe0789ee2910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789ee2950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789ee2980 _sleep() at _sleep+0x357/frame 0xfffffe0789ee2a20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0789ee2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789ee2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789ee2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 5 tid 100071 td 0xfffff800077554d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789ee78e0 mi_switch() at mi_switch+0x169/frame 0xfffffe0789ee7910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789ee7950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789ee7980 _sleep() at _sleep+0x357/frame 0xfffffe0789ee7a20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0789ee7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789ee7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789ee7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 5 tid 100072 td 0xfffff80007755000 sched_switch() at sched_switch+0x495/frame 0xfffffe0789eec8e0 mi_switch() at mi_switch+0x169/frame 0xfffffe0789eec910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789eec950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789eec980 _sleep() at _sleep+0x357/frame 0xfffffe0789eeca20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0789eeca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789eecab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789eecab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 5 tid 100136 td 0xfffff800120149a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081cf958e0 mi_switch() at mi_switch+0x169/frame 0xfffffe081cf95910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cf95950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081cf95980 _sleep() at _sleep+0x357/frame 0xfffffe081cf95a20 xpt_scanner_thread() at xpt_scanner_thread+0xa4/frame 0xfffffe081cf95a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cf95ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cf95ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns pid 4 tid 100059 td 0xfffff800075ca4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789eab8f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0789eab920 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789eab960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789eab990 _sleep() at _sleep+0x357/frame 0xfffffe0789eaba30 crypto_ret_proc() at crypto_ret_proc+0x1da/frame 0xfffffe0789eaba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789eabab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789eabab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100058 td 0xfffff800075ca9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789ea68f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0789ea6920 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789ea6960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789ea6990 _sleep() at _sleep+0x357/frame 0xfffffe0789ea6a30 crypto_proc() at crypto_proc+0x394/frame 0xfffffe0789ea6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789ea6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789ea6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100054 td 0xfffff800075b5000 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e928f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0789e92920 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e92960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e92990 _sleep() at _sleep+0x357/frame 0xfffffe0789e92a30 g_run_events() at g_run_events+0x50/frame 0xfffffe0789e92a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e92ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e92ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100055 td 0xfffff800075cb9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e978f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0789e97920 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e97960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e97990 _sleep() at _sleep+0x357/frame 0xfffffe0789e97a30 g_io_schedule_up() at g_io_schedule_up+0xf7/frame 0xfffffe0789e97a60 g_up_procbody() at g_up_procbody+0x7d/frame 0xfffffe0789e97a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e97ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e97ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100056 td 0xfffff800075cb4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e9c8e0 mi_switch() at mi_switch+0x169/frame 0xfffffe0789e9c910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e9c950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e9c980 _sleep() at _sleep+0x357/frame 0xfffffe0789e9ca20 g_io_schedule_down() at g_io_schedule_down+0x12c/frame 0xfffffe0789e9ca60 g_down_procbody() at g_down_procbody+0x7d/frame 0xfffffe0789e9ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e9cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e9cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100028 td 0xfffff800075ab9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe07855f19f0 mi_switch() at mi_switch+0x169/frame 0xfffffe07855f1a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe07855f1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855f1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855f1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100029 td 0xfffff800075ab4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe07855f69f0 mi_switch() at mi_switch+0x169/frame 0xfffffe07855f6a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe07855f6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855f6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855f6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100030 td 0xfffff800075ab000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100031 td 0xfffff800075aa9a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100032 td 0xfffff800075aa4d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100033 td 0xfffff800075aa000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100034 td 0xfffff800075a99a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100035 td 0xfffff800075a94d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100036 td 0xfffff800075a9000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100037 td 0xfffff800075b29a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100038 td 0xfffff800075b24d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100039 td 0xfffff800075b2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100040 td 0xfffff800075b19a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xfffff800075b14d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xfffff800075b1000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100043 td 0xfffff800075b09a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100044 td 0xfffff800075b04d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffff800075b0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100046 td 0xfffff800075b79a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff800075b74d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffff800075b7000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff800075b69a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff800075b64d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff800075b6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff800075b59a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff800075b54d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffff800075ca000 sched_switch() at sched_switch+0x495/frame 0xfffffe0789eb09f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0789eb0a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0789eb0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789eb0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789eb0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100062 td 0xfffff800075c94d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100073 td 0xfffff800077669a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789ef19f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0789ef1a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0789ef1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789ef1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789ef1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100074 td 0xfffff800077664d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789ff19f0 mi_switch() at mi_switch+0x169/frame 0xfffffe0789ff1a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0789ff1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789ff1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789ff1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100075 td 0xfffff80007766000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100076 td 0xfffff800077659a0 sched_switch() at sched_switch+0x495/frame 0xfffffe00003db9f0 mi_switch() at mi_switch+0x169/frame 0xfffffe00003dba20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe00003dba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003dbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003dbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100082 td 0xfffff8000dba39a0 sched_switch() at sched_switch+0x495/frame 0xfffffe00003f99f0 mi_switch() at mi_switch+0x169/frame 0xfffffe00003f9a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe00003f9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003f9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003f9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100083 td 0xfffff8000dba34d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac489f0 mi_switch() at mi_switch+0x169/frame 0xfffffe081ac48a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ac48a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac48ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac48ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100085 td 0xfffff8000dba29a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac529f0 mi_switch() at mi_switch+0x169/frame 0xfffffe081ac52a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ac52a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac52ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac52ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100087 td 0xfffff8000dba2000 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac5c9f0 mi_switch() at mi_switch+0x169/frame 0xfffffe081ac5ca20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ac5ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac5cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac5cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100089 td 0xfffff8000dba14d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac669f0 mi_switch() at mi_switch+0x169/frame 0xfffffe081ac66a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ac66a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac66ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac66ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100091 td 0xfffff8000dbd59a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac709f0 mi_switch() at mi_switch+0x169/frame 0xfffffe081ac70a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ac70a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac70ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac70ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100093 td 0xfffff8000dbd5000 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac7a9f0 mi_switch() at mi_switch+0x169/frame 0xfffffe081ac7aa20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ac7aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac7aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac7aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff8000dbd44d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac849f0 mi_switch() at mi_switch+0x169/frame 0xfffffe081ac84a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ac84a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac84ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac84ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100097 td 0xfffff8000dbd39a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac8e9f0 mi_switch() at mi_switch+0x169/frame 0xfffffe081ac8ea20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ac8ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac8eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac8eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100099 td 0xfffff8000dbd3000 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac989f0 mi_switch() at mi_switch+0x169/frame 0xfffffe081ac98a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ac98a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac98ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac98ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100100 td 0xfffff8000dbee9a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100102 td 0xfffff8000dbee000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100104 td 0xfffff8000dbed4d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100106 td 0xfffff8000dbec9a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100108 td 0xfffff8000dbec000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100110 td 0xfffff8000dbf54d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100112 td 0xfffff8000dbf49a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100114 td 0xfffff8000dbf4000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100116 td 0xfffff8000dbf34d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100117 td 0xfffff8000dbf3000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100123 td 0xfffff8000dc2a000 sched_switch() at sched_switch+0x495/frame 0xfffffe081aed59f0 mi_switch() at mi_switch+0x169/frame 0xfffffe081aed5a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081aed5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081aed5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081aed5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100129 td 0xfffff8000dc45000 sched_switch() at sched_switch+0x495/frame 0xfffffe081aef39f0 mi_switch() at mi_switch+0x169/frame 0xfffffe081aef3a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081aef3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081aef3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081aef3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100130 td 0xfffff8000dc449a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081cf6f9f0 mi_switch() at mi_switch+0x169/frame 0xfffffe081cf6fa20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081cf6fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cf6fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cf6fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100131 td 0xfffff8000dc444d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081cf779f0 mi_switch() at mi_switch+0x169/frame 0xfffffe081cf77a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081cf77a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cf77ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cf77ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800075699a0 cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81c67d60 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xffffffff81c67d80 trap() at trap+0x7c/frame 0xffffffff81c680c0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81c680c0 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855798e0, rbp = 0xfffffe07855798f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855798f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785579940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785579960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785579980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785579a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785579ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785579ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800075694d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb751bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb751be0 trap() at trap+0x7c/frame 0xfffffe07fb751f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb751f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe078557e8e0, rbp = 0xfffffe078557e8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe078557e8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe078557e940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078557e960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe078557e980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe078557ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe078557eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078557eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff80007569000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb759bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb759be0 trap() at trap+0x7c/frame 0xfffffe07fb759f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb759f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855838e0, rbp = 0xfffffe07855838f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855838f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785583940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785583960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785583980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785583a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785583ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785583ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800075689a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb761bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb761be0 trap() at trap+0x7c/frame 0xfffffe07fb761f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb761f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855888e0, rbp = 0xfffffe07855888f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855888f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785588940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785588960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785588980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785588a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785588ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785588ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800075684d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb769bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb769be0 trap() at trap+0x7c/frame 0xfffffe07fb769f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb769f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe078558d8e0, rbp = 0xfffffe078558d8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe078558d8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe078558d940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078558d960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe078558d980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe078558da70 fork_exit() at fork_exit+0x84/frame 0xfffffe078558dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078558dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80007568000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb771bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb771be0 trap() at trap+0x7c/frame 0xfffffe07fb771f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb771f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855928e0, rbp = 0xfffffe07855928f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855928f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785592940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785592960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785592980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785592a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785592ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785592ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff8000757f9a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb779bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb779be0 trap() at trap+0x7c/frame 0xfffffe07fb779f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb779f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855978e0, rbp = 0xfffffe07855978f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855978f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785597940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785597960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785597980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785597a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785597ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785597ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff8000757f4d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb781bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb781be0 trap() at trap+0x7c/frame 0xfffffe07fb781f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb781f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe078559c8e0, rbp = 0xfffffe078559c8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe078559c8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe078559c940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078559c960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe078559c980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe078559ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe078559cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078559cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff8000757f000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb789bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb789be0 trap() at trap+0x7c/frame 0xfffffe07fb789f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb789f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855a18e0, rbp = 0xfffffe07855a18f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855a18f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe07855a1940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07855a1960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe07855a1980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe07855a1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855a1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855a1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000757e9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe07855a6950 mi_switch() at mi_switch+0x169/frame 0xfffffe07855a6980 sched_idletd() at sched_idletd+0xf9/frame 0xfffffe07855a6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855a6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855a6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000757e4d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb799bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb799be0 trap() at trap+0x7c/frame 0xfffffe07fb799f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb799f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855ab8e0, rbp = 0xfffffe07855ab8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855ab8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe07855ab940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07855ab960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe07855ab980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe07855aba70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855abab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855abab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100015 td 0xfffff8000757e000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7a1bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7a1be0 trap() at trap+0x7c/frame 0xfffffe07fb7a1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7a1f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855b08e0, rbp = 0xfffffe07855b08f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855b08f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe07855b0940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07855b0960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe07855b0980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe07855b0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855b0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855b0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100016 td 0xfffff8000757d9a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7a9bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7a9be0 trap() at trap+0x7c/frame 0xfffffe07fb7a9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7a9f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855b58e0, rbp = 0xfffffe07855b58f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855b58f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe07855b5940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07855b5960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe07855b5980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe07855b5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855b5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855b5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100017 td 0xfffff8000757d4d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7b1bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7b1be0 trap() at trap+0x7c/frame 0xfffffe07fb7b1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7b1f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855ba8e0, rbp = 0xfffffe07855ba8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855ba8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe07855ba940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07855ba960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe07855ba980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe07855baa70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855baab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855baab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100018 td 0xfffff8000757d000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7b9bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7b9be0 trap() at trap+0x7c/frame 0xfffffe07fb7b9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7b9f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855bf8e0, rbp = 0xfffffe07855bf8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855bf8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe07855bf940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07855bf960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe07855bf980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe07855bfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855bfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855bfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100019 td 0xfffff800075829a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7c1bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7c1be0 trap() at trap+0x7c/frame 0xfffffe07fb7c1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7c1f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855c48e0, rbp = 0xfffffe07855c48f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855c48f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe07855c4940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07855c4960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe07855c4980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe07855c4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855c4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855c4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100020 td 0xfffff800075824d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7c9bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7c9be0 trap() at trap+0x7c/frame 0xfffffe07fb7c9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7c9f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855c98e0, rbp = 0xfffffe07855c98f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855c98f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe07855c9940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07855c9960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe07855c9980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe07855c9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855c9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855c9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100021 td 0xfffff80007582000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7d1bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7d1be0 trap() at trap+0x7c/frame 0xfffffe07fb7d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7d1f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855ce8e0, rbp = 0xfffffe07855ce8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855ce8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe07855ce940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07855ce960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe07855ce980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe07855cea70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855ceab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855ceab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100022 td 0xfffff800075819a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7d9bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7d9be0 trap() at trap+0x7c/frame 0xfffffe07fb7d9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7d9f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855d38e0, rbp = 0xfffffe07855d38f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855d38f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe07855d3940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07855d3960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe07855d3980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe07855d3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855d3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855d3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100023 td 0xfffff800075814d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7e1bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7e1be0 trap() at trap+0x7c/frame 0xfffffe07fb7e1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7e1f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855d88e0, rbp = 0xfffffe07855d88f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855d88f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe07855d8940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07855d8960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe07855d8980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe07855d8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855d8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855d8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100024 td 0xfffff80007581000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7e9bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7e9be0 trap() at trap+0x7c/frame 0xfffffe07fb7e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7e9f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855dd8e0, rbp = 0xfffffe07855dd8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855dd8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe07855dd940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07855dd960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe07855dd980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe07855dda70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855ddab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855ddab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100025 td 0xfffff800075809a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7f1bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7f1be0 trap() at trap+0x7c/frame 0xfffffe07fb7f1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7f1f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855e28e0, rbp = 0xfffffe07855e28f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855e28f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe07855e2940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07855e2960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe07855e2980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe07855e2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855e2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855e2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100026 td 0xfffff800075804d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7f9bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7f9be0 trap() at trap+0x7c/frame 0xfffffe07fb7f9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7f9f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855e78e0, rbp = 0xfffffe07855e78f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855e78f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe07855e7940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07855e7960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe07855e7980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe07855e7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855e7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855e7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100027 td 0xfffff80007580000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0785562bc0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe0785562be0 trap() at trap+0x7c/frame 0xfffffe0785562f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0785562f20 --- trap 0x13, rip = 0xffffffff80fb505f, rsp = 0xfffffe07855ec8e0, rbp = 0xfffffe07855ec8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855ec8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe07855ec940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07855ec960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe07855ec980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe07855eca70 fork_exit() at fork_exit+0x84/frame 0xfffffe07855ecab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07855ecab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 2 tid 100003 td 0xfffff8000756a000 sched_switch() at sched_switch+0x495/frame 0xfffffe07855748d0 mi_switch() at mi_switch+0x169/frame 0xfffffe0785574900 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0785574940 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe0785574970 _sleep() at _sleep+0x311/frame 0xfffffe0785574a10 random_kthread() at random_kthread+0x230/frame 0xfffffe0785574a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785574ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785574ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff8000756a4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe078556f450 mi_switch() at mi_switch+0x169/frame 0xfffffe078556f480 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe078556f4c0 sleepq_catch_signals() at sleepq_catch_signals+0x2dc/frame 0xfffffe078556f530 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe078556f560 _sleep() at _sleep+0x324/frame 0xfffffe078556f600 kern_wait6() at kern_wait6+0x410/frame 0xfffffe078556f6b0 sys_wait4() at sys_wait4+0x73/frame 0xfffffe078556f8a0 syscallenter() at syscallenter+0x56b/frame 0xfffffe078556f980 amd64_syscall() at amd64_syscall+0x5c/frame 0xfffffe078556fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe078556fab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x41b19a, rsp = 0x7fffffffe768, rbp = 0x7fffffffe800 --- Tracing command audit pid 10 tid 100001 td 0xfffff8000756a9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe078556a900 mi_switch() at mi_switch+0x169/frame 0xfffffe078556a930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe078556a970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078556a9a0 _cv_wait() at _cv_wait+0x1ea/frame 0xfffffe078556aa10 audit_worker() at audit_worker+0xa3/frame 0xfffffe078556aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078556aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078556aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81cd9e00 sched_switch() at sched_switch+0x495/frame 0xffffffff820a29e0 mi_switch() at mi_switch+0x169/frame 0xffffffff820a2a10 sleepq_switch() at sleepq_switch+0xf6/frame 0xffffffff820a2a50 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffffff820a2a80 _sleep() at _sleep+0x311/frame 0xffffffff820a2b20 swapper() at swapper+0x248/frame 0xffffffff820a2b70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100057 td 0xfffff800075cb000 sched_switch() at sched_switch+0x495/frame 0xfffffe0789ea1900 mi_switch() at mi_switch+0x169/frame 0xfffffe0789ea1930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789ea1970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789ea19a0 _sleep() at _sleep+0x357/frame 0xfffffe0789ea1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0789ea1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789ea1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789ea1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff800075c99a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789eb5900 mi_switch() at mi_switch+0x169/frame 0xfffffe0789eb5930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789eb5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789eb59a0 _sleep() at _sleep+0x357/frame 0xfffffe0789eb5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0789eb5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789eb5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789eb5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffff800075c9000 sched_switch() at sched_switch+0x495/frame 0xfffffe0789ebf900 mi_switch() at mi_switch+0x169/frame 0xfffffe0789ebf930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789ebf970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789ebf9a0 _sleep() at _sleep+0x357/frame 0xfffffe0789ebfa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0789ebfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789ebfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789ebfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff800077579a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789ec4900 mi_switch() at mi_switch+0x169/frame 0xfffffe0789ec4930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789ec4970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789ec49a0 _sleep() at _sleep+0x357/frame 0xfffffe0789ec4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0789ec4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789ec4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789ec4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff800077574d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789ec9910 mi_switch() at mi_switch+0x169/frame 0xfffffe0789ec9940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789ec9980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789ec99b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ef/frame 0xfffffe0789ec9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0789ec9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789ec9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789ec9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80007757000 sched_switch() at sched_switch+0x495/frame 0xfffffe0789ece910 mi_switch() at mi_switch+0x169/frame 0xfffffe0789ece940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789ece980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789ece9b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ef/frame 0xfffffe0789ecea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0789ecea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789eceab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789eceab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff800077569a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789ed3910 mi_switch() at mi_switch+0x169/frame 0xfffffe0789ed3940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789ed3980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789ed39b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ef/frame 0xfffffe0789ed3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0789ed3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789ed3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789ed3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100084 td 0xfffff8000dba3000 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac4d900 mi_switch() at mi_switch+0x169/frame 0xfffffe081ac4d930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ac4d970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ac4d9a0 _sleep() at _sleep+0x357/frame 0xfffffe081ac4da40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ac4da70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac4dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac4dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100086 td 0xfffff8000dba24d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac57900 mi_switch() at mi_switch+0x169/frame 0xfffffe081ac57930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ac57970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ac579a0 _sleep() at _sleep+0x357/frame 0xfffffe081ac57a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ac57a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac57ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac57ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100088 td 0xfffff8000dba19a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac61900 mi_switch() at mi_switch+0x169/frame 0xfffffe081ac61930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ac61970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ac619a0 _sleep() at _sleep+0x357/frame 0xfffffe081ac61a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ac61a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac61ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac61ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100090 td 0xfffff8000dba1000 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac6b900 mi_switch() at mi_switch+0x169/frame 0xfffffe081ac6b930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ac6b970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ac6b9a0 _sleep() at _sleep+0x357/frame 0xfffffe081ac6ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ac6ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac6bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac6bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100092 td 0xfffff8000dbd54d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac75900 mi_switch() at mi_switch+0x169/frame 0xfffffe081ac75930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ac75970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ac759a0 _sleep() at _sleep+0x357/frame 0xfffffe081ac75a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ac75a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac75ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac75ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100094 td 0xfffff8000dbd49a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac7f900 mi_switch() at mi_switch+0x169/frame 0xfffffe081ac7f930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ac7f970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ac7f9a0 _sleep() at _sleep+0x357/frame 0xfffffe081ac7fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ac7fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac7fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac7fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffff8000dbd4000 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac89900 mi_switch() at mi_switch+0x169/frame 0xfffffe081ac89930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ac89970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ac899a0 _sleep() at _sleep+0x357/frame 0xfffffe081ac89a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ac89a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac89ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac89ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffff8000dbd34d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac93900 mi_switch() at mi_switch+0x169/frame 0xfffffe081ac93930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ac93970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ac939a0 _sleep() at _sleep+0x357/frame 0xfffffe081ac93a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ac93a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac93ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac93ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100101 td 0xfffff8000dbee4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ace2900 mi_switch() at mi_switch+0x169/frame 0xfffffe081ace2930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ace2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ace29a0 _sleep() at _sleep+0x357/frame 0xfffffe081ace2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ace2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ace2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ace2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100103 td 0xfffff8000dbed9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081acec900 mi_switch() at mi_switch+0x169/frame 0xfffffe081acec930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081acec970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081acec9a0 _sleep() at _sleep+0x357/frame 0xfffffe081aceca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081aceca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081acecab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081acecab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100105 td 0xfffff8000dbed000 sched_switch() at sched_switch+0x495/frame 0xfffffe081acf6900 mi_switch() at mi_switch+0x169/frame 0xfffffe081acf6930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081acf6970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081acf69a0 _sleep() at _sleep+0x357/frame 0xfffffe081acf6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081acf6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081acf6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081acf6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100107 td 0xfffff8000dbec4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ad00900 mi_switch() at mi_switch+0x169/frame 0xfffffe081ad00930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ad00970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ad009a0 _sleep() at _sleep+0x357/frame 0xfffffe081ad00a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ad00a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ad00ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ad00ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100109 td 0xfffff8000dbf59a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ad0a900 mi_switch() at mi_switch+0x169/frame 0xfffffe081ad0a930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ad0a970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ad0a9a0 _sleep() at _sleep+0x357/frame 0xfffffe081ad0aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ad0aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ad0aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ad0aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100111 td 0xfffff8000dbf5000 sched_switch() at sched_switch+0x495/frame 0xfffffe081ad14900 mi_switch() at mi_switch+0x169/frame 0xfffffe081ad14930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ad14970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ad149a0 _sleep() at _sleep+0x357/frame 0xfffffe081ad14a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ad14a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ad14ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ad14ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100113 td 0xfffff8000dbf44d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ad1e900 mi_switch() at mi_switch+0x169/frame 0xfffffe081ad1e930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ad1e970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ad1e9a0 _sleep() at _sleep+0x357/frame 0xfffffe081ad1ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ad1ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ad1eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ad1eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100115 td 0xfffff8000dbf39a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ad28900 mi_switch() at mi_switch+0x169/frame 0xfffffe081ad28930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ad28970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ad289a0 _sleep() at _sleep+0x357/frame 0xfffffe081ad28a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ad28a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ad28ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ad28ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100132 td 0xfffff8000dc44000 sched_switch() at sched_switch+0x495/frame 0xfffffe081cf80910 mi_switch() at mi_switch+0x169/frame 0xfffffe081cf80940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cf80980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081cf809b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ef/frame 0xfffffe081cf80a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe081cf80a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cf80ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cf80ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100133 td 0xfffff8000dc439a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081cf85890 mi_switch() at mi_switch+0x169/frame 0xfffffe081cf858c0 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cf85900 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081cf85930 _sleep() at _sleep+0x311/frame 0xfffffe081cf859d0 pause_sbt() at pause_sbt+0xd8/frame 0xfffffe081cf85a20 deadlkres() at deadlkres+0x2c/frame 0xfffffe081cf85a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cf85ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cf85ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100135 td 0xfffff8000dc43000 sched_switch() at sched_switch+0x495/frame 0xfffffe081cf90900 mi_switch() at mi_switch+0x169/frame 0xfffffe081cf90930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cf90970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081cf909a0 _sleep() at _sleep+0x357/frame 0xfffffe081cf90a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081cf90a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cf90ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cf90ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:allt> dump Dumping 1312 out of 31636 MB:..2%..11%..21%..31%..41%..52%..61%..71%..81%..91% Dump complete db:0:dump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 9 (kgdb) bt #0 doadump (textdump=0x0) at ../../../kern/kern_shutdown.c:296 #1 0xffffffff8037d35b in db_dump (dummy=, dummy2=0x0, dummy3=0x0, dummy4=0x0) at ../../../ddb/db_command.c:533 #2 0xffffffff8037d14e in db_command (cmd_table=0x0) at ../../../ddb/db_command.c:440 #3 0xffffffff80381478 in db_script_exec (scriptname=0xffffffff81ccb7d0 "dump", warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xffffffff8037d14e in db_command (cmd_table=0x0) at ../../../ddb/db_command.c:440 #5 0xffffffff8037cee4 in db_command_loop () at ../../../ddb/db_command.c:493 #6 0xffffffff8037f97b in db_trap (type=, code=0x0) at ../../../ddb/db_main.c:251 #7 0xffffffff80a64763 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:654 #8 0xffffffff80e7dd01 in trap (frame=0xfffffe081d9caf30) at ../../../amd64/amd64/trap.c:549 #9 0xffffffff80e7ee6a in trap_check (frame=0xfffffe081d9caf30) at ../../../amd64/amd64/trap.c:628 #10 0xffffffff80e5ce57 in calltrap () at ../../../amd64/amd64/exception.S:234 #11 0xffffffff80a63e4b in kdb_enter (why=0xffffffff8138e315 "panic", msg=0x80
) at cpufunc.h:63 #12 0xffffffff80a26f3b in vpanic (fmt=0xffffffff813a6e7e "bogus refcnt %d on lle %p", ap=0xfffffe081d9cb120) at ../../../kern/kern_shutdown.c:750 #13 0xffffffff80a26aa4 in kassert_panic (fmt=0xffffffff813a6e7e "bogus refcnt %d on lle %p") at ../../../kern/kern_shutdown.c:647 #14 0xffffffff80b13ee9 in llentry_free (lle=0xfffff80012d3b200) at ../../../net/if_llatbl.c:311 #15 0xffffffff80b71aad in in_lltable_free_entry (llt=0xfffff80007541b00, lle=0xfffff80012d3b200) at ../../../netinet/in.c:1100 #16 0xffffffff80b1435d in lltable_free_entry (llt=0xfffff80007541b00, lle=0xfffff80012d3b200) at ../../../net/if_llatbl.c:552 #17 0xffffffff80b14edc in htable_prefix_free (llt=0xfffff80007541b00, addr=0xfffffe081d9cb328, mask=0xfffffe081d9cb318, flags=0x2) at ../../../net/if_llatbl.c:231 #18 0xffffffff80b14a13 in lltable_prefix_free (af=0x2, addr=0xfffffe081d9cb328, mask=0xfffffe081d9cb318, flags=0x2) at ../../../net/if_llatbl.c:478 #19 0xffffffff80b70977 in in_scrubprefixlle (ia=0xfffff8001f2ea200, all=0x1, flags=0x2) at ../../../netinet/in.c:757 #20 0xffffffff80b706ec in in_scrubprefix (target=0xfffff8001f2ea200, flags=0x2) at ../../../netinet/in.c:883 #21 0xffffffff80b6ea27 in in_difaddr_ioctl (data=0xfffffe081d9cb818 "igb0", ifp=0xfffff80007758800, td=0xfffff800725b3000) at ../../../netinet/in.c:608 #22 0xffffffff80b6e182 in in_control (so=0xfffff8001f3332e8, cmd=0x80206919, data=0xfffffe081d9cb818 "igb0", ifp=0xfffff80007758800, td=0xfffff800725b3000) at ../../../netinet/in.c:248 #23 0xffffffff80b0836a in ifioctl (so=0xfffff8001f3332e8, cmd=0x80206919, data=0xfffffe081d9cb818 "igb0", td=0xfffff800725b3000) at ../../../net/if.c:2679 #24 0xffffffff80a8788c in fo_ioctl (fp=0xfffff800126a3730, com=0x80206919, data=0xfffffe081d9cb818, active_cred=0xfffff80012e68800, td=0xfffff800725b3000) at file.h:324 #25 0xffffffff80a875e1 in kern_ioctl (td=0xfffff800725b3000, fd=0x3, com=0x80206919, data=0xfffffe081d9cb818 "igb0") at ../../../kern/sys_generic.c:814 #26 0xffffffff80a871c8 in sys_ioctl (td=0xfffff800725b3000, uap=0xfffffe081d9cba58) at ../../../kern/sys_generic.c:723 #27 0xffffffff80e7f9bb in syscallenter (td=0xfffff800725b3000, sa=0xfffffe081d9cba48) at subr_syscall.c:140 #28 0xffffffff80e7f24c in amd64_syscall (td=0xfffff800725b3000, traced=0x0) at ../../../amd64/amd64/trap.c:935 #29 0xffffffff80e5d13b in Xfast_syscall () at ../../../amd64/amd64/exception.S:394 #30 0x00000008011f319a in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 14 #14 0xffffffff80b13ee9 in llentry_free (lle=0xfffff80012d3b200) at ../../../net/if_llatbl.c:311 311 LLE_FREE_LOCKED(lle); (kgdb) l 306 307 KASSERT((lle->la_flags & LLE_LINKED) == 0, ("freeing linked lle")); 308 309 pkts_dropped = lltable_drop_entry_queue(lle); 310 311 LLE_FREE_LOCKED(lle); 312 313 return (pkts_dropped); 314 } 315 (kgdb) info loc pkts_dropped = 0x0 (kgdb) p *lle $1 = {lle_next = {le_next = 0x0, le_prev = 0xfffff80007541a20}, r_l3addr = {addr4 = {s_addr = 0x6d01a8c0}, addr6 = {__u6_addr = {__u6_addr8 = 0xfffff80012d3b210 "ĀĻ\001m", __u6_addr16 = 0xfffff80012d3b210, __u6_addr32 = 0xfffff80012d3b210}}}, ll_addr = {mac_aligned = 0x9bb656671e00, mac16 = 0xfffff80012d3b220, mac8 = 0xfffff80012d3b220 ""}, spare0 = 0x0, spare1 = 0x0, lle_tbl = 0xfffff80007541b00, lle_head = 0xfffff80007541a20, lle_free = 0xffffffff80b723d0 , la_hold = 0x0, la_numheld = 0x0, la_expire = 0x5, la_flags = 0x6, la_asked = 0x0, la_preempt = 0x0, ln_state = 0x0, ln_router = 0x0, ln_ntick = 0x0, lle_refcnt = 0x0, lle_chain = {le_next = 0x0, le_prev = 0xfffff80012a24898}, lle_timer = {c_links = {le = {le_next = 0x0, le_prev = 0x0}, sle = {sle_next = 0x0}, tqe = {tqe_next = 0x0, tqe_prev = 0x0}}, c_time = 0x0, c_precision = 0x0, c_arg = 0x0, c_func = 0, c_lock = 0x0, c_flags = 0x0, c_iflags = 0x10, c_cpu = 0x0}, lle_lock = {lock_object = {lo_name = 0xffffffff813a6e7a "lle", lo_flags = 0x5630000, lo_data = 0x0, lo_witness = 0xfffffe0000baa880}, rw_lock = 0xfffff800725b3000}} (kgdb) f 15 #15 0xffffffff80b71aad in in_lltable_free_entry (llt=0xfffff80007541b00, lle=0xfffff80012d3b200) at ../../../netinet/in.c:1100 1100 pkts_dropped = llentry_free(lle); (kgdb) l 1095 /* cancel timer */ 1096 if (callout_stop(&lle->lle_timer)) 1097 LLE_REMREF(lle); 1098 1099 /* Drop hold queue */ 1100 pkts_dropped = llentry_free(lle); 1101 ARPSTAT_ADD(dropped, pkts_dropped); 1102 } 1103 1104 static int (kgdb) info loc ifp = (struct ifnet *) 0xe4 pkts_dropped = 0x0 (kgdb) p *llt $2 = {llt_link = {sle_next = 0xfffff80007541d00}, llt_af = 0x2, llt_hsize = 0x20, lle_head = 0xfffff80007541a00, llt_ifp = 0xfffff80007758800, llt_lookup = 0xffffffff80b70f80 , llt_alloc_entry = 0xffffffff80b710c0 , llt_delete_entry = 0xffffffff80b71230 , llt_prefix_free = 0xffffffff80b14dc0 , llt_dump_entry = 0xffffffff80b714d0 , llt_hash = 0xffffffff80b71850 , llt_match_prefix = 0xffffffff80b71ad0 , llt_free_entry = 0xffffffff80b718f0 , llt_foreach_entry = 0xffffffff80b14ef0 , llt_link_entry = 0xffffffff80b14b40 , llt_unlink_entry = 0xffffffff80b14c90 , llt_fill_sa_entry = 0xffffffff80b71880 , llt_free_tbl = 0xffffffff80b14fc0 } (kgdb) $ svnlite diff -x -p /usr/src/sys Index: /usr/src/sys/vm/vm_page.h =================================================================== --- /usr/src/sys/vm/vm_page.h (revision 290704) +++ /usr/src/sys/vm/vm_page.h (working copy) @@ -227,6 +227,7 @@ struct vm_domain { long vmd_segs; /* bitmask of the segments */ boolean_t vmd_oom; int vmd_pass; /* local pagedaemon pass */ + int vmd_oom_seq; int vmd_last_active_scan; struct vm_page vmd_marker; /* marker for pagedaemon private use */ struct vm_page vmd_inacthead; /* marker for LRU-defeating insertions */ Index: /usr/src/sys/vm/vm_pageout.c =================================================================== --- /usr/src/sys/vm/vm_pageout.c (revision 290704) +++ /usr/src/sys/vm/vm_pageout.c (working copy) @@ -122,7 +122,8 @@ static void vm_pageout_init(void); static int vm_pageout_clean(vm_page_t m); static int vm_pageout_cluster(vm_page_t m); static void vm_pageout_scan(struct vm_domain *vmd, int pass); -static void vm_pageout_mightbe_oom(struct vm_domain *vmd, int pass); +static void vm_pageout_mightbe_oom(struct vm_domain *vmd, int page_shortage, + int starting_page_shortage); SYSINIT(pagedaemon_init, SI_SUB_KTHREAD_PAGE, SI_ORDER_FIRST, vm_pageout_init, NULL); @@ -158,6 +159,7 @@ SYSINIT(vmdaemon, SI_SUB_KTHREAD_VM, SI_ORDER_FIRS int vm_pages_needed; /* Event on which pageout daemon sleeps */ int vm_pageout_deficit; /* Estimated number of pages deficit */ int vm_pageout_wakeup_thresh; +static int vm_pageout_oom_seq = 24; #if !defined(NO_SWAPPING) static int vm_pageout_req_swapout; /* XXX */ @@ -223,6 +225,10 @@ static int pageout_lock_miss; SYSCTL_INT(_vm, OID_AUTO, pageout_lock_miss, CTLFLAG_RD, &pageout_lock_miss, 0, "vget() lock misses during pageout"); +SYSCTL_INT(_vm, OID_AUTO, pageout_oom_seq, + CTLFLAG_RW, &vm_pageout_oom_seq, 0, + "back-to-back calls to oom detector to start OOM"); + #define VM_PAGEOUT_PAGE_COUNT 16 int vm_pageout_page_count = VM_PAGEOUT_PAGE_COUNT; @@ -1041,7 +1047,8 @@ vm_pageout_scan(struct vm_domain *vmd, int pass) vm_object_t object; long min_scan; int act_delta, addl_page_shortage, deficit, error, maxlaunder, maxscan; - int page_shortage, scan_tick, scanned, vnodes_skipped; + int page_shortage, scan_tick, scanned, starting_page_shortage; + int vnodes_skipped; boolean_t pageout_ok, queues_locked; /* @@ -1080,6 +1087,7 @@ vm_pageout_scan(struct vm_domain *vmd, int pass) page_shortage = vm_paging_target() + deficit; } else page_shortage = deficit = 0; + starting_page_shortage = page_shortage; /* * maxlaunder limits the number of dirty pages we flush per scan. @@ -1343,6 +1351,12 @@ relock_queues: (void)speedup_syncer(); /* + * If the inactive queue scan fails repeatedly to meet its + * target, kill the largest process. + */ + vm_pageout_mightbe_oom(vmd, page_shortage, starting_page_shortage); + + /* * Compute the number of pages we want to try to move from the * active queue to the inactive queue. */ @@ -1453,15 +1467,6 @@ relock_queues: } } #endif - - /* - * If we are critically low on one of RAM or swap and low on - * the other, kill the largest process. However, we avoid - * doing this on the first pass in order to give ourselves a - * chance to flush out dirty vnode-backed pages and to allow - * active pages to be moved to the inactive queue and reclaimed. - */ - vm_pageout_mightbe_oom(vmd, pass); } static int vm_pageout_oom_vote; @@ -1472,12 +1477,17 @@ static int vm_pageout_oom_vote; * failed to reach free target is premature. */ static void -vm_pageout_mightbe_oom(struct vm_domain *vmd, int pass) +vm_pageout_mightbe_oom(struct vm_domain *vmd, int page_shortage, + int starting_page_shortage) { int old_vote; - if (pass <= 1 || !((swap_pager_avail < 64 && vm_page_count_min()) || - (swap_pager_full && vm_paging_target() > 0))) { + if (starting_page_shortage <= 0 || starting_page_shortage != + page_shortage) + vmd->vmd_oom_seq = 0; + else + vmd->vmd_oom_seq++; + if (vmd->vmd_oom_seq < vm_pageout_oom_seq) { if (vmd->vmd_oom) { vmd->vmd_oom = FALSE; atomic_subtract_int(&vm_pageout_oom_vote, 1); @@ -1485,6 +1495,12 @@ static void return; } + /* + * Do not follow the call sequence until OOM condition is + * cleared. + */ + vmd->vmd_oom_seq = 0; + if (vmd->vmd_oom) return; @@ -1510,6 +1526,37 @@ static void atomic_subtract_int(&vm_pageout_oom_vote, 1); } +static long +vm_pageout_resident_count(struct vmspace *vmspace) +{ + vm_map_t map; + vm_map_entry_t entry; + vm_object_t obj; + long res; + + map = &vmspace->vm_map; + KASSERT(!map->system_map, ("system map")); + sx_assert(&map->lock, SA_LOCKED); + res = 0; + for (entry = map->header.next; entry != &map->header; + entry = entry->next) { + if ((entry->eflags & MAP_ENTRY_IS_SUB_MAP) != 0) + continue; + obj = entry->object.vm_object; + if (obj == NULL) + continue; + switch (obj->type) { + case OBJT_DEFAULT: + case OBJT_SWAP: + case OBJT_VNODE: + case OBJT_PHYS: + res += obj->resident_page_count; + break; + } + } + return (res); +} + void vm_pageout_oom(int shortage) { @@ -1554,7 +1601,8 @@ vm_pageout_oom(int shortage) if (!TD_ON_RUNQ(td) && !TD_IS_RUNNING(td) && !TD_IS_SLEEPING(td) && - !TD_IS_SUSPENDED(td)) { + !TD_IS_SUSPENDED(td) && + !TD_IS_SWAPPED(td)) { thread_unlock(td); breakout = 1; break; @@ -1582,9 +1630,9 @@ vm_pageout_oom(int shortage) } PROC_UNLOCK(p); size = vmspace_swap_count(vm); + if (shortage == VM_OOM_MEM) + size += vm_pageout_resident_count(vm); vm_map_unlock_read(&vm->vm_map); - if (shortage == VM_OOM_MEM) - size += vmspace_resident_count(vm); vmspace_free(vm); /* * if the this process is bigger than the biggest one