GENERIC HEAD from 2013-08-19 08:28:35 UTC, r254514M, vmcore.26 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #2 r254514M: Mon Aug 19 18:55:12 CEST 2013 pho@t1.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.24-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x206d7 Family = 0x6 Model = 0x2d Stepping = 7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 32154800128 (30665 MB) : Trying to mount root from ufs:/dev/da0p2 [rw]... Setting hostuuid: 3141f787-07e3-e111-b968-001e6756c168. Setting hostid: 0x564ac5b6. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/da0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p2: clean, 74718726 free (102070 frags, 9327082 blocks, 0.1% fragmentation) /dev/da0p3: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p3: clean, 22846936 free (1504 frags, 2855679 blocks, 0.0% fragmentation) Mounting local file systems:. Writing entropy file:. Setting hostname: t1.osted.lan. Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 igb0: flags=8843 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:c1:68 inet 192.168.1.108 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::21e:67ff:fe56:c168%igb0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active igb1: flags=8c02 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: igb1. igb1: flags=8c02 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Configuring keyboard: keymap. ums0: on usbus2 ums0: 3 buttons and [Z] coordinates ID=0 Starting ums0 moused. Expensive timeout(9) function: 0xffffffff807131e0(0xffffffff8159eed0) 0.003702698 s add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib 32-bit compatibility ldconfig path: /usr/lib32 Creating and/or trimming log files. Starting syslogd. No core dumps found. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xffffff87860d81f8 bufwait (bufwait) @ kern/vfs_bio.c:3053 2nd 0xfffffe0087687600 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff881e0d7300 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff881e0d73b0 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff881e0d7440 _sx_xlock() at _sx_xlock+0x75/frame 0xffffff881e0d7480 ufsdirhash_add() at ufsdirhash_add+0x4c/frame 0xffffff881e0d74c0 ufs_direnter() at ufs_direnter+0x688/frame 0xffffff881e0d7580 ufs_mkdir() at ufs_mkdir+0x863/frame 0xffffff881e0d7780 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x10e/frame 0xffffff881e0d77b0 kern_mkdirat() at kern_mkdirat+0x20e/frame 0xffffff881e0d79a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0d7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0d7ab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80093978a, rsp = 0x7fffffffd798, rbp = 0x7fffffffdc70 --- Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Configuring syscons: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Local package initialization: backup. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Mon Aug 19 19:00:06 CEST 2013 FreeBSD/amd64 (t1.osted.lan) (console) login: Aug 19 19:00:53 t1 su: pho to root on /dev/pts/1 20130819 19:00:58 all (1/1): holdcnt0.sh 20130819 19:10:17 all (1/1): holdcnt0.sh 20130819 19:19:31 all (1/1): holdcnt0.sh 20130819 19:27:02 all (1/1): holdcnt0.sh 20130819 19:38:22 all (1/1): holdcnt0.sh 20130819 19:42:48 all (1/1): holdcnt0.sh 20130819 19:57:51 all (1/1): holdcnt0.sh 20130819 20:10:41 all (1/1): holdcnt0.sh 20130819 20:40:24 all (1/1): holdcnt0a.sh 20130819 21:11:10 all (1/1): holdcnt0a.sh 20130819 21:25:09 all (1/1): holdcnt0b.sh 20130819 21:28:17 all (1/1): holdcnt0b.sh Aug 19 21:30:27 t1 su: pho to root on /dev/pts/2 20130819 21:30:52 all (1/1): holdcnt0b.sh 20130819 21:33:05 all (1/1): holdcnt0b.sh 20130819 21:46:39 all (1/1): holdcnt0c.sh 20130819 22:02:26 all (1/1): holdcnt0c.sh 20130819 22:18:19 all (1/1): holdcnt0c.sh 20130819 22:33:32 all (1/1): holdcnt0c.sh 20130819 22:49:26 all (1/1): holdcnt0c.sh 20130819 23:04:47 all (1/1): holdcnt0c.sh VNASSERT failed 0xfffffe0255395c30: tag ufs, type VREG usecount 0, writecount 0, refcount 0 mountedhere 0 flags (VI_DOOMED|VI_ACTIVE|VI_DOINGINACT) VI_LOCKed v_object 0xfffffe0015a9e200 ref 0 pages 0 lock type ufs: EXCL by thread 0xfffffe0015a73920 (pid 4880, holdcnt0, tid 100336) #0 0xffffffff8089e539 at __lockmgr_args+0x9a9 #1 0xffffffff80b17722 at ffs_lock+0x92 #2 0xffffffff80d6e955 at VOP_LOCK1_APV+0xf5 #3 0xffffffff8097bbd6 at _vn_lock+0xc6 #4 0xffffffff80b484ac at vm_object_deallocate+0x56c #5 0xffffffff80b454e5 at vm_map_entry_deallocate+0x35 #6 0xffffffff80b3c8dd at vm_map_process_deferred+0x10d #7 0xffffffff80b3c7c8 at _vm_map_unlock+0x68 #8 0xffffffff80b4267e at vm_map_remove+0xbe #9 0xffffffff80b3c302 at vmspace_dofree+0x22 #10 0xffffffff80b3c52e at vmspace_exit+0x15e #11 0xffffffff8088626e at exit1+0x52e #12 0xffffffff80885d3e at sys_sys_exit+0xe #13 0xffffffff80cc3b82 at amd64_syscall+0x282 #14 0xffffffff80ca704b at Xfast_syscall+0xfb ino 1284106, on dev da0p3 panic: cleaned vnode isn't cpuid = 14 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff881e42c350 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff881e42c400 vpanic() at vpanic+0x126/frame 0xffffff881e42c440 kassert_panic() at kassert_panic+0x136/frame 0xffffff881e42c4b0 vdropl() at vdropl+0x631/frame 0xffffff881e42c4f0 vdrop() at vdrop+0x3a/frame 0xffffff881e42c510 vm_page_cache_free() at vm_page_cache_free+0x14a/frame 0xffffff881e42c550 bufobj_invalbuf() at bufobj_invalbuf+0x385/frame 0xffffff881e42c590 vinvalbuf() at vinvalbuf+0x45/frame 0xffffff881e42c5c0 vgonel() at vgonel+0x158/frame 0xffffff881e42c600 vrecycle() at vrecycle+0x71/frame 0xffffff881e42c620 ufs_inactive() at ufs_inactive+0x32a/frame 0xffffff881e42c660 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x10e/frame 0xffffff881e42c690 VOP_INACTIVE() at VOP_INACTIVE+0x39/frame 0xffffff881e42c6d0 vinactive() at vinactive+0x174/frame 0xffffff881e42c710 vputx() at vputx+0x3b5/frame 0xffffff881e42c770 vput() at vput+0x1a/frame 0xffffff881e42c790 vm_object_deallocate() at vm_object_deallocate+0x61f/frame 0xffffff881e42c7f0 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x35/frame 0xffffff881e42c820 vm_map_process_deferred() at vm_map_process_deferred+0x10d/frame 0xffffff881e42c850 _vm_map_unlock() at _vm_map_unlock+0x68/frame 0xffffff881e42c880 vm_map_remove() at vm_map_remove+0xbe/frame 0xffffff881e42c8c0 vmspace_dofree() at vmspace_dofree+0x22/frame 0xffffff881e42c8e0 vmspace_exit() at vmspace_exit+0x15e/frame 0xffffff881e42c920 exit1() at exit1+0x52e/frame 0xffffff881e42c990 sys_sys_exit() at sys_sys_exit+0xe/frame 0xffffff881e42c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e42cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e42cab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8008e6e6a, rsp = 0x7fffffffd868, rbp = 0x7fffffffd960 --- KDB: enter: panic [ thread pid 4880 tid 100336 ] Stopped at kdb_enter+0x3e: movq $0,kdb_why db> run pho db:0:pho> bt Tracing pid 4880 tid 100336 td 0xfffffe0015a73920 kdb_enter() at kdb_enter+0x3e/frame 0xffffff881e42c400 vpanic() at vpanic+0x146/frame 0xffffff881e42c440 kassert_panic() at kassert_panic+0x136/frame 0xffffff881e42c4b0 vdropl() at vdropl+0x631/frame 0xffffff881e42c4f0 vdrop() at vdrop+0x3a/frame 0xffffff881e42c510 vm_page_cache_free() at vm_page_cache_free+0x14a/frame 0xffffff881e42c550 bufobj_invalbuf() at bufobj_invalbuf+0x385/frame 0xffffff881e42c590 vinvalbuf() at vinvalbuf+0x45/frame 0xffffff881e42c5c0 vgonel() at vgonel+0x158/frame 0xffffff881e42c600 vrecycle() at vrecycle+0x71/frame 0xffffff881e42c620 ufs_inactive() at ufs_inactive+0x32a/frame 0xffffff881e42c660 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x10e/frame 0xffffff881e42c690 VOP_INACTIVE() at VOP_INACTIVE+0x39/frame 0xffffff881e42c6d0 vinactive() at vinactive+0x174/frame 0xffffff881e42c710 vputx() at vputx+0x3b5/frame 0xffffff881e42c770 vput() at vput+0x1a/frame 0xffffff881e42c790 vm_object_deallocate() at vm_object_deallocate+0x61f/frame 0xffffff881e42c7f0 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x35/frame 0xffffff881e42c820 vm_map_process_deferred() at vm_map_process_deferred+0x10d/frame 0xffffff881e42c850 _vm_map_unlock() at _vm_map_unlock+0x68/frame 0xffffff881e42c880 vm_map_remove() at vm_map_remove+0xbe/frame 0xffffff881e42c8c0 vmspace_dofree() at vmspace_dofree+0x22/frame 0xffffff881e42c8e0 vmspace_exit() at vmspace_exit+0x15e/frame 0xffffff881e42c920 exit1() at exit1+0x52e/frame 0xffffff881e42c990 sys_sys_exit() at sys_sys_exit+0xe/frame 0xffffff881e42c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e42cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e42cab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8008e6e6a, rsp = 0x7fffffffd868, rbp = 0x7fffffffd960 --- db:0:bt> show allpcpu Current CPU: 14 cpuid = 0 dynamic pcpu = 0x559c80 curthread = 0xfffffe000b223920: pid 11 "idle: cpu0" curpcb = 0xffffff87fc5fcb80 fpcurthread = none idlethread = 0xfffffe000b223920: tid 100003 "idle: cpu0" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9610 commontssp = 0xffffffff815f9610 rsp0 = 0xffffff87fc5fcb80 gs32p = 0xffffffff815fb068 ldt = 0xffffffff815fb0a8 tss = 0xffffffff815fb098 spin locks held: cpuid = 1 dynamic pcpu = 0xffffff887b1fbc80 curthread = 0xfffffe000b223490: pid 11 "idle: cpu1" curpcb = 0xffffff878ac2cb80 fpcurthread = none idlethread = 0xfffffe000b223490: tid 100004 "idle: cpu1" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9678 commontssp = 0xffffffff815f9678 rsp0 = 0xffffff878ac2cb80 gs32p = 0xffffffff815fb0d0 ldt = 0xffffffff815fb110 tss = 0xffffffff815fb100 spin locks held: cpuid = 2 dynamic pcpu = 0xffffff887b202c80 curthread = 0xfffffe000b26b000: pid 13 "g_up" curpcb = 0xffffff878ad26b80 fpcurthread = none idlethread = 0xfffffe000b223000: tid 100005 "idle: cpu2" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f96e0 commontssp = 0xffffffff815f96e0 rsp0 = 0xffffff878ad26b80 gs32p = 0xffffffff815fb138 ldt = 0xffffffff815fb178 tss = 0xffffffff815fb168 spin locks held: cpuid = 3 dynamic pcpu = 0xffffff887b209c80 curthread = 0xfffffe000b233000: pid 11 "idle: cpu3" curpcb = 0xffffff878ac36b80 fpcurthread = none idlethread = 0xfffffe000b233000: tid 100006 "idle: cpu3" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9748 commontssp = 0xffffffff815f9748 rsp0 = 0xffffff878ac36b80 gs32p = 0xffffffff815fb1a0 ldt = 0xffffffff815fb1e0 tss = 0xffffffff815fb1d0 spin locks held: cpuid = 4 dynamic pcpu = 0xffffff887b210c80 curthread = 0xfffffe000b232920: pid 11 "idle: cpu4" curpcb = 0xffffff878ac3bb80 fpcurthread = none idlethread = 0xfffffe000b232920: tid 100007 "idle: cpu4" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f97b0 commontssp = 0xffffffff815f97b0 rsp0 = 0xffffff878ac3bb80 gs32p = 0xffffffff815fb208 ldt = 0xffffffff815fb248 tss = 0xffffffff815fb238 spin locks held: cpuid = 5 dynamic pcpu = 0xffffff887b217c80 curthread = 0xfffffe000b232490: pid 11 "idle: cpu5" curpcb = 0xffffff878ac40b80 fpcurthread = none idlethread = 0xfffffe000b232490: tid 100008 "idle: cpu5" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9818 commontssp = 0xffffffff815f9818 rsp0 = 0xffffff878ac40b80 gs32p = 0xffffffff815fb270 ldt = 0xffffffff815fb2b0 tss = 0xffffffff815fb2a0 spin locks held: cpuid = 6 dynamic pcpu = 0xffffff887b21ec80 curthread = 0xfffffe000b232000: pid 11 "idle: cpu6" curpcb = 0xffffff878ac45b80 fpcurthread = none idlethread = 0xfffffe000b232000: tid 100009 "idle: cpu6" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9880 commontssp = 0xffffffff815f9880 rsp0 = 0xffffff878ac45b80 gs32p = 0xffffffff815fb2d8 ldt = 0xffffffff815fb318 tss = 0xffffffff815fb308 spin locks held: cpuid = 7 dynamic pcpu = 0xffffff887b225c80 curthread = 0xfffffe000b224920: pid 11 "idle: cpu7" curpcb = 0xffffff878ac4ab80 fpcurthread = none idlethread = 0xfffffe000b224920: tid 100010 "idle: cpu7" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f98e8 commontssp = 0xffffffff815f98e8 rsp0 = 0xffffff878ac4ab80 gs32p = 0xffffffff815fb340 ldt = 0xffffffff815fb380 tss = 0xffffffff815fb370 spin locks held: cpuid = 8 dynamic pcpu = 0xffffff887b22cc80 curthread = 0xfffffe000b234920: pid 11 "idle: cpu8" curpcb = 0xffffff878ac4fb80 fpcurthread = none idlethread = 0xfffffe000b234920: tid 100011 "idle: cpu8" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9950 commontssp = 0xffffffff815f9950 rsp0 = 0xffffff878ac4fb80 gs32p = 0xffffffff815fb3a8 ldt = 0xffffffff815fb3e8 tss = 0xffffffff815fb3d8 spin locks held: cpuid = 9 dynamic pcpu = 0xffffff887b233c80 curthread = 0xfffffe000b234490: pid 11 "idle: cpu9" curpcb = 0xffffff878ac54b80 fpcurthread = none idlethread = 0xfffffe000b234490: tid 100012 "idle: cpu9" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f99b8 commontssp = 0xffffffff815f99b8 rsp0 = 0xffffff878ac54b80 gs32p = 0xffffffff815fb410 ldt = 0xffffffff815fb450 tss = 0xffffffff815fb440 spin locks held: cpuid = 10 dynamic pcpu = 0xffffff887b23ac80 curthread = 0xfffffe000b234000: pid 11 "idle: cpu10" curpcb = 0xffffff878ac59b80 fpcurthread = none idlethread = 0xfffffe000b234000: tid 100013 "idle: cpu10" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9a20 commontssp = 0xffffffff815f9a20 rsp0 = 0xffffff878ac59b80 gs32p = 0xffffffff815fb478 ldt = 0xffffffff815fb4b8 tss = 0xffffffff815fb4a8 spin locks held: cpuid = 11 dynamic pcpu = 0xffffff887b241c80 curthread = 0xfffffe000b233920: pid 11 "idle: cpu11" curpcb = 0xffffff878ac5eb80 fpcurthread = none idlethread = 0xfffffe000b233920: tid 100014 "idle: cpu11" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9a88 commontssp = 0xffffffff815f9a88 rsp0 = 0xffffff878ac5eb80 gs32p = 0xffffffff815fb4e0 ldt = 0xffffffff815fb520 tss = 0xffffffff815fb510 spin locks held: cpuid = 12 dynamic pcpu = 0xffffff887b248c80 curthread = 0xfffffe000b233490: pid 11 "idle: cpu12" curpcb = 0xffffff878ac63b80 fpcurthread = none idlethread = 0xfffffe000b233490: tid 100015 "idle: cpu12" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9af0 commontssp = 0xffffffff815f9af0 rsp0 = 0xffffff878ac63b80 gs32p = 0xffffffff815fb548 ldt = 0xffffffff815fb588 tss = 0xffffffff815fb578 spin locks held: cpuid = 13 dynamic pcpu = 0xffffff887b24fc80 curthread = 0xfffffe000b236490: pid 11 "idle: cpu13" curpcb = 0xffffff878ac68b80 fpcurthread = none idlethread = 0xfffffe000b236490: tid 100016 "idle: cpu13" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9b58 commontssp = 0xffffffff815f9b58 rsp0 = 0xffffff878ac68b80 gs32p = 0xffffffff815fb5b0 ldt = 0xffffffff815fb5f0 tss = 0xffffffff815fb5e0 spin locks held: cpuid = 14 dynamic pcpu = 0xffffff887b256c80 curthread = 0xfffffe0015a73920: pid 4880 "holdcnt0" curpcb = 0xffffff881e42cb80 fpcurthread = none idlethread = 0xfffffe000b236000: tid 100017 "idle: cpu14" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9bc0 commontssp = 0xffffffff815f9bc0 rsp0 = 0xffffff881e42cb80 gs32p = 0xffffffff815fb618 ldt = 0xffffffff815fb658 tss = 0xffffffff815fb648 spin locks held: cpuid = 15 dynamic pcpu = 0xffffff887b25dc80 curthread = 0xfffffe000b235920: pid 11 "idle: cpu15" curpcb = 0xffffff878ac72b80 fpcurthread = none idlethread = 0xfffffe000b235920: tid 100018 "idle: cpu15" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9c28 commontssp = 0xffffffff815f9c28 rsp0 = 0xffffff878ac72b80 gs32p = 0xffffffff815fb680 ldt = 0xffffffff815fb6c0 tss = 0xffffffff815fb6b0 spin locks held: cpuid = 16 dynamic pcpu = 0xffffff887b264c80 curthread = 0xfffffe000b235490: pid 11 "idle: cpu16" curpcb = 0xffffff878ac77b80 fpcurthread = none idlethread = 0xfffffe000b235490: tid 100019 "idle: cpu16" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9c90 commontssp = 0xffffffff815f9c90 rsp0 = 0xffffff878ac77b80 gs32p = 0xffffffff815fb6e8 ldt = 0xffffffff815fb728 tss = 0xffffffff815fb718 spin locks held: cpuid = 17 dynamic pcpu = 0xffffff887b26bc80 curthread = 0xfffffe000b235000: pid 11 "idle: cpu17" curpcb = 0xffffff878ac7cb80 fpcurthread = none idlethread = 0xfffffe000b235000: tid 100020 "idle: cpu17" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9cf8 commontssp = 0xffffffff815f9cf8 rsp0 = 0xffffff878ac7cb80 gs32p = 0xffffffff815fb750 ldt = 0xffffffff815fb790 tss = 0xffffffff815fb780 spin locks held: cpuid = 18 dynamic pcpu = 0xffffff887b272c80 curthread = 0xfffffe0315516920: pid 4874 "swap" curpcb = 0xffffff881e2a9b80 fpcurthread = none idlethread = 0xfffffe000b238000: tid 100021 "idle: cpu18" curpmap = 0xfffffe0015a7a798 tssp = 0xffffffff815f9d60 commontssp = 0xffffffff815f9d60 rsp0 = 0xffffff881e2a9b80 gs32p = 0xffffffff815fb7b8 ldt = 0xffffffff815fb7f8 tss = 0xffffffff815fb7e8 spin locks held: cpuid = 19 dynamic pcpu = 0xffffff887b279c80 curthread = 0xfffffe000b237920: pid 11 "idle: cpu19" curpcb = 0xffffff878ac86b80 fpcurthread = none idlethread = 0xfffffe000b237920: tid 100022 "idle: cpu19" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9dc8 commontssp = 0xffffffff815f9dc8 rsp0 = 0xffffff878ac86b80 gs32p = 0xffffffff815fb820 ldt = 0xffffffff815fb860 tss = 0xffffffff815fb850 spin locks held: cpuid = 20 dynamic pcpu = 0xffffff887b280c80 curthread = 0xfffffe000b237490: pid 11 "idle: cpu20" curpcb = 0xffffff878ac8bb80 fpcurthread = none idlethread = 0xfffffe000b237490: tid 100023 "idle: cpu20" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9e30 commontssp = 0xffffffff815f9e30 rsp0 = 0xffffff878ac8bb80 gs32p = 0xffffffff815fb888 ldt = 0xffffffff815fb8c8 tss = 0xffffffff815fb8b8 spin locks held: cpuid = 21 dynamic pcpu = 0xffffff887b287c80 curthread = 0xfffffe000b237000: pid 11 "idle: cpu21" curpcb = 0xffffff878ac90b80 fpcurthread = none idlethread = 0xfffffe000b237000: tid 100024 "idle: cpu21" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9e98 commontssp = 0xffffffff815f9e98 rsp0 = 0xffffff878ac90b80 gs32p = 0xffffffff815fb8f0 ldt = 0xffffffff815fb930 tss = 0xffffffff815fb920 spin locks held: cpuid = 22 dynamic pcpu = 0xffffff887b28ec80 curthread = 0xfffffe000b236920: pid 11 "idle: cpu22" curpcb = 0xffffff878ac95b80 fpcurthread = none idlethread = 0xfffffe000b236920: tid 100025 "idle: cpu22" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9f00 commontssp = 0xffffffff815f9f00 rsp0 = 0xffffff878ac95b80 gs32p = 0xffffffff815fb958 ldt = 0xffffffff815fb998 tss = 0xffffffff815fb988 spin locks held: cpuid = 23 dynamic pcpu = 0xffffff887b295c80 curthread = 0xfffffe000b239920: pid 11 "idle: cpu23" curpcb = 0xffffff878ac9ab80 fpcurthread = none idlethread = 0xfffffe000b239920: tid 100026 "idle: cpu23" curpmap = 0xffffffff815e2108 tssp = 0xffffffff815f9f68 commontssp = 0xffffffff815f9f68 rsp0 = 0xffffff878ac9ab80 gs32p = 0xffffffff815fb9c0 ldt = 0xffffffff815fba00 tss = 0xffffffff815fb9f0 spin locks held: db:0:allpcpu> show alllocks Process 4880 (holdcnt0) thread 0xfffffe0015a73920 (100336) exclusive sleep mutex vnode interlock (vnode interlock) r = 0 (0xfffffe0255395d60) locked @ kern/vfs_subr.c:2321 exclusive rw vm object (vm object) r = 0 (0xfffffe0015a9e200) locked @ kern/vfs_subr.c:1292 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe0255395c98) locked @ vm/vm_object.c:479 Process 13 (geom) thread 0xfffffe000b26b000 (100054) shared rw pmap pv list (pmap pv list) r = 0 (0xffffffff8158cb40) locked @ amd64/amd64/pmap.c:4426 shared rw pmap pv global (pmap pv global) r = 0 (0xffffffff8158c500) locked @ amd64/amd64/pmap.c:4424 exclusive rw vm object (vm object) r = 0 (0xfffffe0015852600) locked @ vm/swap_pager.c:1497 db:0:alllocks> show lockedvnods Locked vnodes 0xfffffe0255395c30: tag ufs, type VREG usecount 0, writecount 0, refcount 0 mountedhere 0 flags (VI_DOOMED|VI_ACTIVE|VI_DOINGINACT) VI_LOCKed v_object 0xfffffe0015a9e200 ref 0 pages 0 lock type ufs: EXCL by thread 0xfffffe0015a73920 (pid 4880, holdcnt0, tid 100336) #0 0xffffffff8089e539 at __lockmgr_args+0x9a9 #1 0xffffffff80b17722 at ffs_lock+0x92 #2 0xffffffff80d6e955 at VOP_LOCK1_APV+0xf5 #3 0xffffffff8097bbd6 at _vn_lock+0xc6 #4 0xffffffff80b484ac at vm_object_deallocate+0x56c #5 0xffffffff80b454e5 at vm_map_entry_deallocate+0x35 #6 0xffffffff80b3c8dd at vm_map_process_deferred+0x10d #7 0xffffffff80b3c7c8 at _vm_map_unlock+0x68 #8 0xffffffff80b4267e at vm_map_remove+0xbe #9 0xffffffff80b3c302 at vmspace_dofree+0x22 #10 0xffffffff80b3c52e at vmspace_exit+0x15e #11 0xffffffff8088626e at exit1+0x52e #12 0xffffffff80885d3e at sys_sys_exit+0xe #13 0xffffffff80cc3b82 at amd64_syscall+0x282 #14 0xffffffff80ca704b at Xfast_syscall+0xfb ino 1284106, on dev da0p3 db:0:lockedvnods> show mount 0xfffffe00156c7b58 /dev/da0p2 on / (ufs) 0xfffffe00156c8000 devfs on /dev (devfs) 0xfffffe0015e1a3c8 /dev/da0p3 on /tmp (ufs) 0xfffffe0015e35790 procfs on /proc (procfs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 4880 4871 3915 0 RE+ CPU 14 holdcnt0 4874 4873 3915 0 RL+ CPU 18 swap 4873 4872 3915 0 SW+ wait 0xfffffe0581ddb4b8 swap 4872 4860 3915 0 SW+ wait 0xfffffe0015140000 swap 4871 4869 3915 0 S+ wait 0xfffffe018b1254b8 holdcnt0 4869 4860 3915 0 SW+ wait 0xfffffe0015e55970 sh 4860 3915 3915 0 SW+ wait 0xfffffe00875c34b8 sh 3915 1063 3915 0 SW+ wait 0xfffffe031558f970 sh 3582 3581 3582 0 S+ ttyin 0xfffffe04d99d10a8 csh 3581 3577 3581 1001 SW+ wait 0xfffffe03156014b8 su 3577 3576 3577 1001 SWs+ wait 0xfffffe00158ef4b8 bash 3576 3574 3574 1001 S select 0xfffffe0015e04240 sshd 3574 946 3574 0 Ss select 0xfffffe001552aac0 sshd 1063 1061 1063 0 SW+ wait 0xfffffe0015c40970 bash 1061 1060 1061 0 SW+ pause 0xfffffe0015caaa18 csh 1060 1050 1060 1001 SW+ wait 0xfffffe0087a6e000 su 1050 1049 1050 1001 SWs+ wait 0xfffffe0087e51000 bash 1049 1047 1047 1001 S select 0xfffffe0015d676c0 sshd 1047 946 1047 0 Ss select 0xfffffe0015443840 sshd 1046 1042 1046 1001 S+ select 0xfffffe0015832f40 top 1042 1041 1042 1001 SWs+ wait 0xfffffe0087794970 bash 1041 1039 1039 1001 S select 0xfffffe0015d67740 sshd 1039 946 1039 0 Ss select 0xfffffe00155b6740 sshd 1037 1 1037 0 Ss+ ttyin 0xfffffe000b3388a8 getty 1036 1 1036 0 Ss+ ttyin 0xfffffe000b338ca8 getty 1035 1 1035 0 Ss+ ttyin 0xfffffe000b3390a8 getty 1034 1 1034 0 Ss+ ttyin 0xfffffe000b3394a8 getty 1033 1 1033 0 Ss+ ttyin 0xfffffe000b3398a8 getty 1032 1 1032 0 Ss+ ttyin 0xfffffe000b339ca8 getty 1031 1 1031 0 Ss+ ttyin 0xfffffe000b33a0a8 getty 1030 1 1030 0 Ss+ ttyin 0xfffffe000b33a4a8 getty 1029 1 1029 0 Ss+ ttyin 0xfffffe000b33a8a8 getty 956 1 956 0 Ss nanslp 0xffffffff8138ef64 cron 952 1 952 25 SWs pause 0xfffffe0087a6e560 sendmail 949 1 949 0 Ss select 0xfffffe0015d677c0 sendmail 946 1 946 0 Ss select 0xfffffe0015620b40 sshd 918 1 918 0 Ss select 0xfffffe001561f440 powerd 915 1 915 0 Ss select 0xfffffe0015badec0 ntpd 877 875 875 0 S (threaded) nfsd 100198 S rpcsvc 0xfffffe00154940a0 nfsd: service 100197 S rpcsvc 0xfffffe0015494120 nfsd: service 100196 S rpcsvc 0xfffffe008778d520 nfsd: service 100195 S rpcsvc 0xfffffe00410463a0 nfsd: master 875 1 875 0 Ss select 0xfffffe001552b1c0 nfsd 869 1 869 0 Ss select 0xfffffe0015620bc0 mountd 862 858 858 0 S select 0xfffffe001556a2c0 nfsuserd 861 858 858 0 S select 0xfffffe0015778140 nfsuserd 860 858 858 0 S select 0xfffffe00155b67c0 nfsuserd 859 858 858 0 S select 0xfffffe0015f97340 nfsuserd 858 1 858 0 SWs pause 0xfffffe00876d50a8 nfsuserd 828 1 828 0 Ss select 0xfffffe0015e1e4c0 rpcbind 815 1 815 0 Ss select 0xfffffe00154e8340 syslogd 686 1 686 0 Ss select 0xfffffe0015a721c0 devd 669 1 669 0 Ss select 0xfffffe001556a6c0 moused 17 0 0 0 DL sdflush 0xffffffff81585004 [softdepflush] 16 0 0 0 DL vlruwt 0xfffffe00151414b8 [vnlru] 9 0 0 0 DL syncer 0xffffffff8157e330 [syncer] 8 0 0 0 DL psleep 0xffffffff8157dd04 [bufdaemon] 7 0 0 0 DL pgzero 0xffffffff815865fc [pagezero] 6 0 0 0 DL psleep 0xffffffff81585d40 [vmdaemon] 5 0 0 0 DL psleep 0xffffffff815f8e84 [pagedaemon] 4 0 0 0 DL idle 0xfffffe000b222970 [enc_daemon0] 3 0 0 0 DL ccb_scan 0xffffffff813581b0 [xpt_thrd] 2 0 0 0 DL waiting_ 0xffffffff815ecc88 [sctp_iterator] 15 0 0 0 DL (threaded) [usb] 100119 D - 0xffffff8001163e18 [usbus2] 100118 D - 0xffffff8001163dc0 [usbus2] 100117 D - 0xffffff8001163d68 [usbus2] 100116 D - 0xffffff8001163d10 [usbus2] 100114 D - 0xffffff800115c1b0 [usbus1] 100113 D - 0xffffff800115c158 [usbus1] 100112 D - 0xffffff800115c100 [usbus1] 100111 D - 0xffffff800115c0a8 [usbus1] 100074 D - 0xffffff8000ea9e18 [usbus0] 100073 D - 0xffffff8000ea9dc0 [usbus0] 100072 D - 0xffffff8000ea9d68 [usbus0] 100071 D - 0xffffff8000ea9d10 [usbus0] 14 0 0 0 DL - 0xffffffff81371408 [yarrow] 13 0 0 0 RL (threaded) [geom] 100055 D - 0xffffffff815e1598 [g_down] 100054 Run CPU 2 [g_up] 100053 D - 0xffffffff815e1588 [g_event] 12 0 0 0 WL (threaded) [intr] 100122 I [swi0: uart] 100121 I [irq287: hdac1] 100120 I [irq286: ahci0] 100115 I [irq20: ehci1] 100110 I [irq285: xhci0] 100109 I [irq284: igb1:link] 100107 I [irq283: igb1:que 7] 100105 I [irq282: igb1:que 6] 100103 I [irq281: igb1:que 5] 100101 I [irq280: igb1:que 4] 100099 I [irq279: igb1:que 3] 100097 I [irq278: igb1:que 2] 100095 I [irq277: igb1:que 1] 100093 I [irq276: igb1:que 0] 100092 I [irq275: igb0:link] 100090 I [irq274: igb0:que 7] 100088 I [irq273: igb0:que 6] 100086 I [irq272: igb0:que 5] 100084 I [irq271: igb0:que 4] 100082 I [irq270: igb0:que 3] 100080 I [irq269: igb0:que 2] 100078 I [irq268: igb0:que 1] 100076 I [irq267: igb0:que 0] 100075 I [irq266: hdac0] 100070 I [irq22: ehci0] 100069 I [irq265: isci0] 100068 I [irq264: isci0] 100067 I [swi6: task queue] 100062 I [swi2: cambio] 100061 I [swi5: fast taskq] 100058 I [swi6: Giant taskq] 100052 I [swi4: clock] 100051 I [swi4: clock] 100050 I [swi4: clock] 100049 I [swi4: clock] 100048 I [swi4: clock] 100047 I [swi4: clock] 100046 I [swi4: clock] 100045 I [swi4: clock] 100044 I [swi4: clock] 100043 I [swi4: clock] 100042 I [swi4: clock] 100041 I [swi4: clock] 100040 I [swi4: clock] 100039 I [swi4: clock] 100038 I [swi4: clock] 100037 I [swi4: clock] 100036 I [swi4: clock] 100035 I [swi4: clock] 100034 I [swi4: clock] 100033 I [swi4: clock] 100032 I [swi4: clock] 100031 I [swi4: clock] 100030 I [swi4: clock] 100029 I [swi4: clock] 100028 I [swi3: vm] 100027 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100026 Run CPU 23 [idle: cpu23] 100025 Run CPU 22 [idle: cpu22] 100024 Run CPU 21 [idle: cpu21] 100023 Run CPU 20 [idle: cpu20] 100022 Run CPU 19 [idle: cpu19] 100021 CanRun [idle: cpu18] 100020 Run CPU 17 [idle: cpu17] 100019 Run CPU 16 [idle: cpu16] 100018 Run CPU 15 [idle: cpu15] 100017 CanRun [idle: cpu14] 100016 Run CPU 13 [idle: cpu13] 100015 Run CPU 12 [idle: cpu12] 100014 Run CPU 11 [idle: cpu11] 100013 Run CPU 10 [idle: cpu10] 100012 Run CPU 9 [idle: cpu9] 100011 Run CPU 8 [idle: cpu8] 100010 Run CPU 7 [idle: cpu7] 100009 Run CPU 6 [idle: cpu6] 100008 Run CPU 5 [idle: cpu5] 100007 Run CPU 4 [idle: cpu4] 100006 Run CPU 3 [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 Run CPU 0 [idle: cpu0] 1 0 1 0 SLs wait 0xfffffe000b222000 [init] 10 0 0 0 DL audit_wo 0xffffffff815f03f8 [audit] 0 0 0 0 DLs (threaded) [kernel] 100124 D - 0xffffffff8138ddbb [deadlkres] 100123 D - 0xfffffe000c86c700 [mca taskq] 100108 D - 0xfffffe000c86d800 [igb1 que] 100106 D - 0xfffffe000c86db00 [igb1 que] 100104 D - 0xfffffe000c86de00 [igb1 que] 100102 D - 0xfffffe000c86e200 [igb1 que] 100100 D - 0xfffffe000b21c300 [igb1 que] 100098 D - 0xfffffe000b21c600 [igb1 que] 100096 D - 0xfffffe000b21c900 [igb1 que] 100094 D - 0xfffffe000b21cc00 [igb1 que] 100091 D - 0xfffffe000b3e9100 [igb0 que] 100089 D - 0xfffffe000b3e9400 [igb0 que] 100087 D - 0xfffffe000b3e9700 [igb0 que] 100085 D - 0xfffffe000b3e9a00 [igb0 que] 100083 D - 0xfffffe000b3e9d00 [igb0 que] 100081 D - 0xfffffe000b3ea100 [igb0 que] 100079 D - 0xfffffe000b3ea400 [igb0 que] 100077 D - 0xfffffe000b3ea700 [igb0 que] 100066 D - 0xfffffe000b3eb700 [acpi_task_2] 100065 D - 0xfffffe000b3eb700 [acpi_task_1] 100064 D - 0xfffffe000b3eb700 [acpi_task_0] 100063 D - 0xfffffe000b3eb900 [kqueue taskq] 100060 D - 0xfffffe000b3ebe00 [ffs_trim taskq] 100059 D - 0xfffffe000b3ec100 [thread taskq] 100056 D - 0xfffffe000b218400 [firmware taskq] 100000 D swapin 0xffffffff815e1698 [swapper] db:0:ps> allt Tracing command holdcnt0 pid 4880 tid 100336 td 0xfffffe0015a73920 kdb_enter() at kdb_enter+0x3e/frame 0xffffff881e42c400 vpanic() at vpanic+0x146/frame 0xffffff881e42c440 kassert_panic() at kassert_panic+0x136/frame 0xffffff881e42c4b0 vdropl() at vdropl+0x631/frame 0xffffff881e42c4f0 vdrop() at vdrop+0x3a/frame 0xffffff881e42c510 vm_page_cache_free() at vm_page_cache_free+0x14a/frame 0xffffff881e42c550 bufobj_invalbuf() at bufobj_invalbuf+0x385/frame 0xffffff881e42c590 vinvalbuf() at vinvalbuf+0x45/frame 0xffffff881e42c5c0 vgonel() at vgonel+0x158/frame 0xffffff881e42c600 vrecycle() at vrecycle+0x71/frame 0xffffff881e42c620 ufs_inactive() at ufs_inactive+0x32a/frame 0xffffff881e42c660 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x10e/frame 0xffffff881e42c690 VOP_INACTIVE() at VOP_INACTIVE+0x39/frame 0xffffff881e42c6d0 vinactive() at vinactive+0x174/frame 0xffffff881e42c710 vputx() at vputx+0x3b5/frame 0xffffff881e42c770 vput() at vput+0x1a/frame 0xffffff881e42c790 vm_object_deallocate() at vm_object_deallocate+0x61f/frame 0xffffff881e42c7f0 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x35/frame 0xffffff881e42c820 vm_map_process_deferred() at vm_map_process_deferred+0x10d/frame 0xffffff881e42c850 _vm_map_unlock() at _vm_map_unlock+0x68/frame 0xffffff881e42c880 vm_map_remove() at vm_map_remove+0xbe/frame 0xffffff881e42c8c0 vmspace_dofree() at vmspace_dofree+0x22/frame 0xffffff881e42c8e0 vmspace_exit() at vmspace_exit+0x15e/frame 0xffffff881e42c920 exit1() at exit1+0x52e/frame 0xffffff881e42c990 sys_sys_exit() at sys_sys_exit+0xe/frame 0xffffff881e42c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e42cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e42cab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8008e6e6a, rsp = 0x7fffffffd868, rbp = 0x7fffffffd960 --- Tracing command swap pid 4874 tid 100259 td 0xfffffe0315516920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5c8ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5c8d00 trap() at trap+0x42/frame 0xffffff87fc5c8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5c8f20 --- trap 0x13, rip = 0xffffffff808b87b5, rsp = 0xffffff87fc5c8fe0, rbp = 0xffffff881e2a9320 --- __rw_wlock_hard() at __rw_wlock_hard+0x275/frame 0xffffff881e2a9320 _rw_wlock_cookie() at _rw_wlock_cookie+0xb4/frame 0xffffff881e2a9360 _sleep() at _sleep+0x3de/frame 0xffffff881e2a93f0 swap_pager_getpages() at swap_pager_getpages+0x427/frame 0xffffff881e2a9480 vm_pager_get_pages() at vm_pager_get_pages+0x71/frame 0xffffff881e2a94c0 vm_fault_hold() at vm_fault_hold+0xef6/frame 0xffffff881e2a97a0 vm_fault() at vm_fault+0xc7/frame 0xffffff881e2a97e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881e2a9890 trap() at trap+0x52b/frame 0xffffff881e2a9ab0 calltrap() at calltrap+0x8/frame 0xffffff881e2a9ab0 --- trap 0xc, rip = 0x800b5f354, rsp = 0x7fffffffd798, rbp = 0x7fffffffd800 --- Tracing command swap pid 4873 tid 100307 td 0xfffffe034a893920 Tracing command swap pid 4872 tid 100187 td 0xfffffe0087417920 Tracing command holdcnt0 pid 4871 tid 100338 td 0xfffffe018b127490 sched_switch() at sched_switch+0x482/frame 0xffffff881e436560 mi_switch() at mi_switch+0x179/frame 0xffffff881e4365a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e4365e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e436650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e436680 _sleep() at _sleep+0x320/frame 0xffffff881e436710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff881e4367b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff881e4369a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e436ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e436ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8008a2eda, rsp = 0x7fffffffd968, rbp = 0x7fffffffd980 --- Tracing command sh pid 4869 tid 100168 td 0xfffffe0015f4b000 Tracing command sh pid 4860 tid 100185 td 0xfffffe00410bf490 Tracing command sh pid 3915 tid 100273 td 0xfffffe0315591920 Tracing command csh pid 3582 tid 100265 td 0xfffffe0315591000 sched_switch() at sched_switch+0x482/frame 0xffffff881e2c7620 mi_switch() at mi_switch+0x179/frame 0xffffff881e2c7660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e2c76a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e2c7710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e2c7740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e2c77b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e2c77e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e2c7840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e2c7870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e2c78d0 dofileread() at dofileread+0x7b/frame 0xffffff881e2c7910 kern_readv() at kern_readv+0x48/frame 0xffffff881e2c7950 sys_read() at sys_read+0x63/frame 0xffffff881e2c79a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e2c7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e2c7ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800e0bcaa, rsp = 0x7fffffffd0b8, rbp = 0x7fffffffd0e0 --- Tracing command su pid 3581 tid 100271 td 0xfffffe0315603490 Tracing command bash pid 3577 tid 100310 td 0xfffffe00158fa920 Tracing command sshd pid 3576 tid 100313 td 0xfffffe058e737920 sched_switch() at sched_switch+0x482/frame 0xffffff881e3b7590 mi_switch() at mi_switch+0x179/frame 0xffffff881e3b75d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e3b7610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e3b7680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e3b76b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e3b7720 seltdwait() at seltdwait+0x78/frame 0xffffff881e3b7760 kern_select() at kern_select+0x892/frame 0xffffff881e3b7960 sys_select() at sys_select+0x54/frame 0xffffff881e3b79a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e3b7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e3b7ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80257cc2a, rsp = 0x7fffffffd168, rbp = 0x7fffffffd1d0 --- Tracing command sshd pid 3574 tid 100170 td 0xfffffe0015a00920 sched_switch() at sched_switch+0x482/frame 0xffffff881e0dc630 mi_switch() at mi_switch+0x179/frame 0xffffff881e0dc670 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0dc6b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e0dc720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e0dc750 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e0dc7c0 seltdwait() at seltdwait+0x78/frame 0xffffff881e0dc800 sys_poll() at sys_poll+0x37c/frame 0xffffff881e0dc9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0dcab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0dcab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80251508a, rsp = 0x7fffffffd1f8, rbp = 0x7fffffffd250 --- Tracing command bash pid 1063 tid 100193 td 0xfffffe0015a00000 Tracing command csh pid 1061 tid 100151 td 0xfffffe0015cdc000 Tracing command su pid 1060 tid 100227 td 0xfffffe0087a70000 Tracing command bash pid 1050 tid 100226 td 0xfffffe0087e53000 Tracing command sshd pid 1049 tid 100225 td 0xfffffe00877a4490 sched_switch() at sched_switch+0x482/frame 0xffffff881e1fc590 mi_switch() at mi_switch+0x179/frame 0xffffff881e1fc5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1fc610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1fc680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1fc6b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1fc720 seltdwait() at seltdwait+0x78/frame 0xffffff881e1fc760 kern_select() at kern_select+0x892/frame 0xffffff881e1fc960 sys_select() at sys_select+0x54/frame 0xffffff881e1fc9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1fcab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1fcab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80257cc2a, rsp = 0x7fffffffd168, rbp = 0x7fffffffd1d0 --- Tracing command sshd pid 1047 tid 100224 td 0xfffffe0087e53490 sched_switch() at sched_switch+0x482/frame 0xffffff881e1f7630 mi_switch() at mi_switch+0x179/frame 0xffffff881e1f7670 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1f76b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1f7720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1f7750 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1f77c0 seltdwait() at seltdwait+0x78/frame 0xffffff881e1f7800 sys_poll() at sys_poll+0x37c/frame 0xffffff881e1f79a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1f7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1f7ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80251508a, rsp = 0x7fffffffd1f8, rbp = 0x7fffffffd250 --- Tracing command top pid 1046 tid 100169 td 0xfffffe00158fa000 sched_switch() at sched_switch+0x482/frame 0xffffff881e0d7580 mi_switch() at mi_switch+0x179/frame 0xffffff881e0d75c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0d7600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e0d7670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e0d76a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e0d7720 seltdwait() at seltdwait+0x8b/frame 0xffffff881e0d7760 kern_select() at kern_select+0x892/frame 0xffffff881e0d7960 sys_select() at sys_select+0x54/frame 0xffffff881e0d79a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0d7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0d7ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800fcfc2a, rsp = 0x7fffffffd828, rbp = 0x7fffffffda10 --- Tracing command bash pid 1042 tid 100204 td 0xfffffe0087417490 Tracing command sshd pid 1041 tid 100222 td 0xfffffe0015cdc490 sched_switch() at sched_switch+0x482/frame 0xffffff881e1ed590 mi_switch() at mi_switch+0x179/frame 0xffffff881e1ed5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1ed610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1ed680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1ed6b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1ed720 seltdwait() at seltdwait+0x78/frame 0xffffff881e1ed760 kern_select() at kern_select+0x892/frame 0xffffff881e1ed960 sys_select() at sys_select+0x54/frame 0xffffff881e1ed9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1edab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1edab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80257cc2a, rsp = 0x7fffffffd168, rbp = 0x7fffffffd1d0 --- Tracing command sshd pid 1039 tid 100202 td 0xfffffe00877a4920 sched_switch() at sched_switch+0x482/frame 0xffffff881e189630 mi_switch() at mi_switch+0x179/frame 0xffffff881e189670 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1896b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e189720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e189750 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1897c0 seltdwait() at seltdwait+0x78/frame 0xffffff881e189800 sys_poll() at sys_poll+0x37c/frame 0xffffff881e1899a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e189ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e189ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80251508a, rsp = 0x7fffffffd1f8, rbp = 0x7fffffffd250 --- Tracing command getty pid 1037 tid 100221 td 0xfffffe0087a9e920 sched_switch() at sched_switch+0x482/frame 0xffffff881e1e8620 mi_switch() at mi_switch+0x179/frame 0xffffff881e1e8660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1e86a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1e8710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1e8740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1e87b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e1e87e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e1e8840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e1e8870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e1e88d0 dofileread() at dofileread+0x7b/frame 0xffffff881e1e8910 kern_readv() at kern_readv+0x48/frame 0xffffff881e1e8950 sys_read() at sys_read+0x63/frame 0xffffff881e1e89a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1e8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1e8ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1036 tid 100220 td 0xfffffe0087c5b000 sched_switch() at sched_switch+0x482/frame 0xffffff881e1e3620 mi_switch() at mi_switch+0x179/frame 0xffffff881e1e3660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1e36a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1e3710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1e3740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1e37b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e1e37e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e1e3840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e1e3870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e1e38d0 dofileread() at dofileread+0x7b/frame 0xffffff881e1e3910 kern_readv() at kern_readv+0x48/frame 0xffffff881e1e3950 sys_read() at sys_read+0x63/frame 0xffffff881e1e39a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1e3ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1e3ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1035 tid 100219 td 0xfffffe0087c5b490 sched_switch() at sched_switch+0x482/frame 0xffffff881e1de620 mi_switch() at mi_switch+0x179/frame 0xffffff881e1de660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1de6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1de710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1de740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1de7b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e1de7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e1de840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e1de870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e1de8d0 dofileread() at dofileread+0x7b/frame 0xffffff881e1de910 kern_readv() at kern_readv+0x48/frame 0xffffff881e1de950 sys_read() at sys_read+0x63/frame 0xffffff881e1de9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1deab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1deab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1034 tid 100218 td 0xfffffe0087c5b920 sched_switch() at sched_switch+0x482/frame 0xffffff881e1d9620 mi_switch() at mi_switch+0x179/frame 0xffffff881e1d9660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1d96a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1d9710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1d9740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1d97b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e1d97e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e1d9840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e1d9870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e1d98d0 dofileread() at dofileread+0x7b/frame 0xffffff881e1d9910 kern_readv() at kern_readv+0x48/frame 0xffffff881e1d9950 sys_read() at sys_read+0x63/frame 0xffffff881e1d99a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1d9ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1d9ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1033 tid 100217 td 0xfffffe00875c5000 sched_switch() at sched_switch+0x482/frame 0xffffff881e1d4620 mi_switch() at mi_switch+0x179/frame 0xffffff881e1d4660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1d46a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1d4710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1d4740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1d47b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e1d47e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e1d4840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e1d4870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e1d48d0 dofileread() at dofileread+0x7b/frame 0xffffff881e1d4910 kern_readv() at kern_readv+0x48/frame 0xffffff881e1d4950 sys_read() at sys_read+0x63/frame 0xffffff881e1d49a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1d4ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1d4ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1032 tid 100216 td 0xfffffe00875c5490 sched_switch() at sched_switch+0x482/frame 0xffffff881e1cf620 mi_switch() at mi_switch+0x179/frame 0xffffff881e1cf660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1cf6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1cf710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1cf740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1cf7b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e1cf7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e1cf840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e1cf870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e1cf8d0 dofileread() at dofileread+0x7b/frame 0xffffff881e1cf910 kern_readv() at kern_readv+0x48/frame 0xffffff881e1cf950 sys_read() at sys_read+0x63/frame 0xffffff881e1cf9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1cfab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1cfab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1031 tid 100215 td 0xfffffe00875c5920 sched_switch() at sched_switch+0x482/frame 0xffffff881e1ca620 mi_switch() at mi_switch+0x179/frame 0xffffff881e1ca660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1ca6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1ca710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1ca740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1ca7b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e1ca7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e1ca840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e1ca870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e1ca8d0 dofileread() at dofileread+0x7b/frame 0xffffff881e1ca910 kern_readv() at kern_readv+0x48/frame 0xffffff881e1ca950 sys_read() at sys_read+0x63/frame 0xffffff881e1ca9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1caab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1caab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1030 tid 100214 td 0xfffffe00410bf000 sched_switch() at sched_switch+0x482/frame 0xffffff881e1c5620 mi_switch() at mi_switch+0x179/frame 0xffffff881e1c5660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1c56a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1c5710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1c5740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1c57b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e1c57e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e1c5840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e1c5870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e1c58d0 dofileread() at dofileread+0x7b/frame 0xffffff881e1c5910 kern_readv() at kern_readv+0x48/frame 0xffffff881e1c5950 sys_read() at sys_read+0x63/frame 0xffffff881e1c59a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1c5ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1c5ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1029 tid 100135 td 0xfffffe0015779490 sched_switch() at sched_switch+0x482/frame 0xffffff881e02d620 mi_switch() at mi_switch+0x179/frame 0xffffff881e02d660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e02d6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e02d710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e02d740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e02d7b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e02d7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e02d840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e02d870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e02d8d0 dofileread() at dofileread+0x7b/frame 0xffffff881e02d910 kern_readv() at kern_readv+0x48/frame 0xffffff881e02d950 sys_read() at sys_read+0x63/frame 0xffffff881e02d9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e02dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e02dab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command cron pid 956 tid 100139 td 0xfffffe0015880490 sched_switch() at sched_switch+0x482/frame 0xffffff881e041750 mi_switch() at mi_switch+0x179/frame 0xffffff881e041790 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0417d0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e041840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e041870 _sleep() at _sleep+0x300/frame 0xffffff881e041900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xffffff881e041960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xffffff881e0419a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e041ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e041ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800d4ed5a, rsp = 0x7fffffffdb28, rbp = 0x7fffffffdd00 --- Tracing command sendmail pid 952 tid 100208 td 0xfffffe0087a70490 Tracing command sendmail pid 949 tid 100207 td 0xfffffe00876d6920 sched_switch() at sched_switch+0x482/frame 0xffffff881e1a2580 mi_switch() at mi_switch+0x179/frame 0xffffff881e1a25c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1a2600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1a2670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e1a26a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e1a2720 seltdwait() at seltdwait+0x8b/frame 0xffffff881e1a2760 kern_select() at kern_select+0x892/frame 0xffffff881e1a2960 sys_select() at sys_select+0x54/frame 0xffffff881e1a29a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1a2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1a2ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x801459c2a, rsp = 0x7fffffffbd18, rbp = 0x7fffffffc810 --- Tracing command sshd pid 946 tid 100179 td 0xfffffe0015f6f920 sched_switch() at sched_switch+0x482/frame 0xffffff881e109590 mi_switch() at mi_switch+0x179/frame 0xffffff881e1095d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e109610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e109680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1096b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e109720 seltdwait() at seltdwait+0x78/frame 0xffffff881e109760 kern_select() at kern_select+0x892/frame 0xffffff881e109960 sys_select() at sys_select+0x54/frame 0xffffff881e1099a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e109ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e109ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80257cc2a, rsp = 0x7fffffffd288, rbp = 0x7fffffffdd10 --- Tracing command powerd pid 918 tid 100166 td 0xfffffe0015df2920 sched_switch() at sched_switch+0x482/frame 0xffffff881e0c8580 mi_switch() at mi_switch+0x179/frame 0xffffff881e0c85c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0c8600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e0c8670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e0c86a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e0c8720 seltdwait() at seltdwait+0x8b/frame 0xffffff881e0c8760 kern_select() at kern_select+0x892/frame 0xffffff881e0c8960 sys_select() at sys_select+0x54/frame 0xffffff881e0c89a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0c8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0c8ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b5dc2a, rsp = 0x7fffffffdb88, rbp = 0x7fffffffdd00 --- Tracing command ntpd pid 915 tid 100180 td 0xfffffe0015a00490 sched_switch() at sched_switch+0x482/frame 0xffffff881e11b590 mi_switch() at mi_switch+0x179/frame 0xffffff881e11b5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e11b610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e11b680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e11b6b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e11b720 seltdwait() at seltdwait+0x78/frame 0xffffff881e11b760 kern_select() at kern_select+0x892/frame 0xffffff881e11b960 sys_select() at sys_select+0x54/frame 0xffffff881e11b9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e11bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e11bab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8013c8c2a, rsp = 0x7fffffffdbc8, rbp = 0x7fffffffdc90 --- Tracing command nfsd pid 877 tid 100198 td 0xfffffe00158f2000 sched_switch() at sched_switch+0x482/frame 0xffffff881e175730 mi_switch() at mi_switch+0x179/frame 0xffffff881e175770 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1757b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e175820 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e175850 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e1758d0 svc_run_internal() at svc_run_internal+0x9c7/frame 0xffffff881e175a60 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff881e175a70 fork_exit() at fork_exit+0x84/frame 0xffffff881e175ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881e175ab0 --- trap 0xc, rip = 0x80088be8a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 877 tid 100197 td 0xfffffe00158f2490 sched_switch() at sched_switch+0x482/frame 0xffffff881e170730 mi_switch() at mi_switch+0x179/frame 0xffffff881e170770 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1707b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e170820 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e170850 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e1708d0 svc_run_internal() at svc_run_internal+0x9c7/frame 0xffffff881e170a60 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff881e170a70 fork_exit() at fork_exit+0x84/frame 0xffffff881e170ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881e170ab0 --- trap 0xc, rip = 0x80088be8a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 877 tid 100196 td 0xfffffe00158f2920 sched_switch() at sched_switch+0x482/frame 0xffffff881e16b730 mi_switch() at mi_switch+0x179/frame 0xffffff881e16b770 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e16b7b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e16b820 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e16b850 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e16b8d0 svc_run_internal() at svc_run_internal+0x9c7/frame 0xffffff881e16ba60 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff881e16ba70 fork_exit() at fork_exit+0x84/frame 0xffffff881e16bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881e16bab0 --- trap 0xc, rip = 0x80088be8a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 877 tid 100195 td 0xfffffe0015c41000 sched_switch() at sched_switch+0x482/frame 0xffffff881e165ea0 mi_switch() at mi_switch+0x179/frame 0xffffff881e165ee0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e165f20 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e165f90 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e165fc0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e166040 svc_run_internal() at svc_run_internal+0x9c7/frame 0xffffff881e1661d0 svc_run() at svc_run+0xd4/frame 0xffffff881e166210 nfsrvd_nfsd() at nfsrvd_nfsd+0x194/frame 0xffffff881e166370 nfssvc_nfsd() at nfssvc_nfsd+0x103/frame 0xffffff881e166970 sys_nfssvc() at sys_nfssvc+0xd2/frame 0xffffff881e1669a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e166ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e166ab0 --- syscall (155, FreeBSD ELF64, sys_nfssvc), rip = 0x80088be8a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 875 tid 100194 td 0xfffffe0015ba3000 sched_switch() at sched_switch+0x482/frame 0xffffff881e161590 mi_switch() at mi_switch+0x179/frame 0xffffff881e1615d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e161610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e161680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1616b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e161720 seltdwait() at seltdwait+0x78/frame 0xffffff881e161760 kern_select() at kern_select+0x892/frame 0xffffff881e161960 sys_select() at sys_select+0x54/frame 0xffffff881e1619a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e161ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e161ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094cc2a, rsp = 0x7fffffffd888, rbp = 0x7fffffffdce0 --- Tracing command mountd pid 869 tid 100192 td 0xfffffe0015ba3490 sched_switch() at sched_switch+0x482/frame 0xffffff881e157590 mi_switch() at mi_switch+0x179/frame 0xffffff881e1575d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e157610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e157680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1576b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e157720 seltdwait() at seltdwait+0x78/frame 0xffffff881e157760 kern_select() at kern_select+0x892/frame 0xffffff881e157960 sys_select() at sys_select+0x54/frame 0xffffff881e1579a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e157ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e157ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b64c2a, rsp = 0x7fffffffdb88, rbp = 0x7fffffffdd00 --- Tracing command nfsuserd pid 862 tid 100191 td 0xfffffe0087434490 sched_switch() at sched_switch+0x482/frame 0xffffff881e152580 mi_switch() at mi_switch+0x179/frame 0xffffff881e1525c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e152600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e152670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e1526a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e152720 seltdwait() at seltdwait+0x8b/frame 0xffffff881e152760 kern_select() at kern_select+0x892/frame 0xffffff881e152960 sys_select() at sys_select+0x54/frame 0xffffff881e1529a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e152ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e152ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094bc2a, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 861 tid 100190 td 0xfffffe0087434920 sched_switch() at sched_switch+0x482/frame 0xffffff881e14d580 mi_switch() at mi_switch+0x179/frame 0xffffff881e14d5c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e14d600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e14d670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e14d6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e14d720 seltdwait() at seltdwait+0x8b/frame 0xffffff881e14d760 kern_select() at kern_select+0x892/frame 0xffffff881e14d960 sys_select() at sys_select+0x54/frame 0xffffff881e14d9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e14dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e14dab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094bc2a, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 860 tid 100189 td 0xfffffe008745f000 sched_switch() at sched_switch+0x482/frame 0xffffff881e148580 mi_switch() at mi_switch+0x179/frame 0xffffff881e1485c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e148600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e148670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e1486a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e148720 seltdwait() at seltdwait+0x8b/frame 0xffffff881e148760 kern_select() at kern_select+0x892/frame 0xffffff881e148960 sys_select() at sys_select+0x54/frame 0xffffff881e1489a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e148ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e148ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094bc2a, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 859 tid 100181 td 0xfffffe008745f490 sched_switch() at sched_switch+0x482/frame 0xffffff881e120580 mi_switch() at mi_switch+0x179/frame 0xffffff881e1205c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e120600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e120670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e1206a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e120720 seltdwait() at seltdwait+0x8b/frame 0xffffff881e120760 kern_select() at kern_select+0x892/frame 0xffffff881e120960 sys_select() at sys_select+0x54/frame 0xffffff881e1209a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e120ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e120ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094bc2a, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 858 tid 100188 td 0xfffffe00876d7000 Tracing command rpcbind pid 828 tid 100171 td 0xfffffe001507f490 sched_switch() at sched_switch+0x482/frame 0xffffff881e0e1620 mi_switch() at mi_switch+0x179/frame 0xffffff881e0e1660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0e16a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e0e1710 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e0e1740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e0e17c0 seltdwait() at seltdwait+0x8b/frame 0xffffff881e0e1800 sys_poll() at sys_poll+0x37c/frame 0xffffff881e0e19a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0e1ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0e1ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800d0508a, rsp = 0x7fffffffba68, rbp = 0x7fffffffdc80 --- Tracing command syslogd pid 815 tid 100177 td 0xfffffe0015828490 sched_switch() at sched_switch+0x482/frame 0xffffff881e0ff590 mi_switch() at mi_switch+0x179/frame 0xffffff881e0ff5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0ff610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e0ff680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e0ff6b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e0ff720 seltdwait() at seltdwait+0x78/frame 0xffffff881e0ff760 kern_select() at kern_select+0x892/frame 0xffffff881e0ff960 sys_select() at sys_select+0x54/frame 0xffffff881e0ff9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0ffab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0ffab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b62c2a, rsp = 0x7fffffffcce8, rbp = 0x7fffffffdd00 --- Tracing command devd pid 686 tid 100173 td 0xfffffe0015cd4920 sched_switch() at sched_switch+0x482/frame 0xffffff881e0eb580 mi_switch() at mi_switch+0x179/frame 0xffffff881e0eb5c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0eb600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e0eb670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e0eb6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e0eb720 seltdwait() at seltdwait+0x8b/frame 0xffffff881e0eb760 kern_select() at kern_select+0x892/frame 0xffffff881e0eb960 sys_select() at sys_select+0x54/frame 0xffffff881e0eb9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0ebab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0ebab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x44cb6a, rsp = 0x7fffffffbbb8, rbp = 0x7fffffffdd20 --- Tracing command moused pid 669 tid 100176 td 0xfffffe008745f920 sched_switch() at sched_switch+0x482/frame 0xffffff881e0fa590 mi_switch() at mi_switch+0x179/frame 0xffffff881e0fa5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0fa610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e0fa680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e0fa6b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e0fa720 seltdwait() at seltdwait+0x78/frame 0xffffff881e0fa760 kern_select() at kern_select+0x892/frame 0xffffff881e0fa960 sys_select() at sys_select+0x54/frame 0xffffff881e0fa9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0faab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0faab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800d88c2a, rsp = 0x7fffffffd6f8, rbp = 0x7fffffffdca0 --- Tracing command softdepflush pid 17 tid 100134 td 0xfffffe001507f920 sched_switch() at sched_switch+0x482/frame 0xffffff881de8e8f0 mi_switch() at mi_switch+0x179/frame 0xffffff881de8e930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881de8e970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881de8e9a0 _sleep() at _sleep+0x312/frame 0xffffff881de8ea30 softdep_flush() at softdep_flush+0x20c/frame 0xffffff881de8ea70 fork_exit() at fork_exit+0x84/frame 0xffffff881de8eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881de8eab0 --- trap 0, rip = 0, rsp = 0xffffff881de8eb70, rbp = 0 --- Tracing command vnlru pid 16 tid 100133 td 0xfffffe001513d000 sched_switch() at sched_switch+0x482/frame 0xffffff881de898c0 mi_switch() at mi_switch+0x179/frame 0xffffff881de89900 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881de89940 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881de89970 _sleep() at _sleep+0x312/frame 0xffffff881de89a00 vnlru_proc() at vnlru_proc+0x11c/frame 0xffffff881de89a70 fork_exit() at fork_exit+0x84/frame 0xffffff881de89ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881de89ab0 --- trap 0, rip = 0, rsp = 0xffffff881de89b70, rbp = 0 --- Tracing command syncer pid 9 tid 100132 td 0xfffffe001513d490 sched_switch() at sched_switch+0x482/frame 0xffffff881de848b0 mi_switch() at mi_switch+0x179/frame 0xffffff881de848f0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881de84930 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881de84960 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x1fe/frame 0xffffff881de849e0 sched_sync() at sched_sync+0x5e6/frame 0xffffff881de84a70 fork_exit() at fork_exit+0x84/frame 0xffffff881de84ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881de84ab0 --- trap 0, rip = 0, rsp = 0xffffff881de84b70, rbp = 0 --- Tracing command bufdaemon pid 8 tid 100131 td 0xfffffe001513d920 sched_switch() at sched_switch+0x482/frame 0xffffff881ddfd8f0 mi_switch() at mi_switch+0x179/frame 0xffffff881ddfd930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ddfd970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881ddfd9a0 _sleep() at _sleep+0x312/frame 0xffffff881ddfda30 buf_daemon() at buf_daemon+0x1bc/frame 0xffffff881ddfda70 fork_exit() at fork_exit+0x84/frame 0xffffff881ddfdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ddfdab0 --- trap 0, rip = 0, rsp = 0xffffff881ddfdb70, rbp = 0 --- Tracing command pagezero pid 7 tid 100130 td 0xfffffe000c9de920 sched_switch() at sched_switch+0x482/frame 0xffffff881ddf8900 mi_switch() at mi_switch+0x179/frame 0xffffff881ddf8940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ddf8980 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881ddf89b0 _sleep() at _sleep+0x312/frame 0xffffff881ddf8a40 vm_pagezero() at vm_pagezero+0x88/frame 0xffffff881ddf8a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ddf8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ddf8ab0 --- trap 0, rip = 0, rsp = 0xffffff881ddf8b70, rbp = 0 --- Tracing command vmdaemon pid 6 tid 100129 td 0xfffffe001507e000 sched_switch() at sched_switch+0x482/frame 0xffffff881ddf38c0 mi_switch() at mi_switch+0x179/frame 0xffffff881ddf3900 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ddf3940 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ddf3970 _sleep() at _sleep+0x33d/frame 0xffffff881ddf3a00 vm_daemon() at vm_daemon+0x7e/frame 0xffffff881ddf3a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ddf3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ddf3ab0 --- trap 0, rip = 0, rsp = 0xffffff881ddf3b70, rbp = 0 --- Tracing command pagedaemon pid 5 tid 100128 td 0xfffffe001507e490 sched_switch() at sched_switch+0x482/frame 0xffffff881ddee8a0 mi_switch() at mi_switch+0x179/frame 0xffffff881ddee8e0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ddee920 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881ddee950 _sleep() at _sleep+0x312/frame 0xffffff881ddee9e0 vm_pageout() at vm_pageout+0x237/frame 0xffffff881ddeea70 fork_exit() at fork_exit+0x84/frame 0xffffff881ddeeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ddeeab0 --- trap 0, rip = 0, rsp = 0xffffff881ddeeb70, rbp = 0 --- Tracing command enc_daemon0 pid 4 tid 100127 td 0xfffffe001507e920 sched_switch() at sched_switch+0x482/frame 0xffffff881dde98c0 mi_switch() at mi_switch+0x179/frame 0xffffff881dde9900 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dde9940 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881dde9970 _sleep() at _sleep+0x33d/frame 0xffffff881dde9a00 enc_daemon() at enc_daemon+0x109/frame 0xffffff881dde9a70 fork_exit() at fork_exit+0x84/frame 0xffffff881dde9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dde9ab0 --- trap 0, rip = 0, rsp = 0xffffff881dde9b70, rbp = 0 --- Tracing command xpt_thrd pid 3 tid 100126 td 0xfffffe001507f000 sched_switch() at sched_switch+0x482/frame 0xffffff881dca4900 mi_switch() at mi_switch+0x179/frame 0xffffff881dca4940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dca4980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881dca49b0 _sleep() at _sleep+0x33d/frame 0xffffff881dca4a40 xpt_scanner_thread() at xpt_scanner_thread+0xdc/frame 0xffffff881dca4a70 fork_exit() at fork_exit+0x84/frame 0xffffff881dca4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dca4ab0 --- trap 0, rip = 0, rsp = 0xffffff881dca4b70, rbp = 0 --- Tracing command sctp_iterator pid 2 tid 100125 td 0xfffffe000c9da000 sched_switch() at sched_switch+0x482/frame 0xffffff881dc9f910 mi_switch() at mi_switch+0x179/frame 0xffffff881dc9f950 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dc9f990 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881dc9f9c0 _sleep() at _sleep+0x33d/frame 0xffffff881dc9fa50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xffffff881dc9fa70 fork_exit() at fork_exit+0x84/frame 0xffffff881dc9fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dc9fab0 --- trap 0, rip = 0, rsp = 0xffffff881dc9fb70, rbp = 0 --- Tracing command usb pid 15 tid 100119 td 0xfffffe000c883920 sched_switch() at sched_switch+0x482/frame 0xffffff881bbfc920 mi_switch() at mi_switch+0x179/frame 0xffffff881bbfc960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881bbfc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881bbfc9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881bbfca40 usb_process() at usb_process+0xd4/frame 0xffffff881bbfca70 fork_exit() at fork_exit+0x84/frame 0xffffff881bbfcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881bbfcab0 --- trap 0, rip = 0, rsp = 0xffffff881bbfcb70, rbp = 0 --- Tracing command usb pid 15 tid 100118 td 0xfffffe000c890000 sched_switch() at sched_switch+0x482/frame 0xffffff881bbf7920 mi_switch() at mi_switch+0x179/frame 0xffffff881bbf7960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881bbf79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881bbf79d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881bbf7a40 usb_process() at usb_process+0xd4/frame 0xffffff881bbf7a70 fork_exit() at fork_exit+0x84/frame 0xffffff881bbf7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881bbf7ab0 --- trap 0, rip = 0, rsp = 0xffffff881bbf7b70, rbp = 0 --- Tracing command usb pid 15 tid 100117 td 0xfffffe000c890490 sched_switch() at sched_switch+0x482/frame 0xffffff881bbf2920 mi_switch() at mi_switch+0x179/frame 0xffffff881bbf2960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881bbf29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881bbf29d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881bbf2a40 usb_process() at usb_process+0xd4/frame 0xffffff881bbf2a70 fork_exit() at fork_exit+0x84/frame 0xffffff881bbf2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881bbf2ab0 --- trap 0, rip = 0, rsp = 0xffffff881bbf2b70, rbp = 0 --- Tracing command usb pid 15 tid 100116 td 0xfffffe000c890920 sched_switch() at sched_switch+0x482/frame 0xffffff881bbed920 mi_switch() at mi_switch+0x179/frame 0xffffff881bbed960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881bbed9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881bbed9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881bbeda40 usb_process() at usb_process+0xd4/frame 0xffffff881bbeda70 fork_exit() at fork_exit+0x84/frame 0xffffff881bbedab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881bbedab0 --- trap 0, rip = 0, rsp = 0xffffff881bbedb70, rbp = 0 --- Tracing command usb pid 15 tid 100114 td 0xfffffe000c882000 sched_switch() at sched_switch+0x482/frame 0xffffff881ba60920 mi_switch() at mi_switch+0x179/frame 0xffffff881ba60960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba609a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba609d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881ba60a40 usb_process() at usb_process+0xd4/frame 0xffffff881ba60a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba60ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba60ab0 --- trap 0, rip = 0, rsp = 0xffffff881ba60b70, rbp = 0 --- Tracing command usb pid 15 tid 100113 td 0xfffffe000c882490 sched_switch() at sched_switch+0x482/frame 0xffffff881ba5b920 mi_switch() at mi_switch+0x179/frame 0xffffff881ba5b960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba5b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba5b9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881ba5ba40 usb_process() at usb_process+0xd4/frame 0xffffff881ba5ba70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba5bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba5bab0 --- trap 0, rip = 0, rsp = 0xffffff881ba5bb70, rbp = 0 --- Tracing command usb pid 15 tid 100112 td 0xfffffe000c882920 sched_switch() at sched_switch+0x482/frame 0xffffff881ba56920 mi_switch() at mi_switch+0x179/frame 0xffffff881ba56960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba569a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba569d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881ba56a40 usb_process() at usb_process+0xd4/frame 0xffffff881ba56a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba56ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba56ab0 --- trap 0, rip = 0, rsp = 0xffffff881ba56b70, rbp = 0 --- Tracing command usb pid 15 tid 100111 td 0xfffffe000c883000 sched_switch() at sched_switch+0x482/frame 0xffffff881ba51920 mi_switch() at mi_switch+0x179/frame 0xffffff881ba51960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba519a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba519d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881ba51a40 usb_process() at usb_process+0xd4/frame 0xffffff881ba51a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba51ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba51ab0 --- trap 0, rip = 0, rsp = 0xffffff881ba51b70, rbp = 0 --- Tracing command usb pid 15 tid 100074 td 0xfffffe000b3ff920 sched_switch() at sched_switch+0x482/frame 0xffffff80002ec920 mi_switch() at mi_switch+0x179/frame 0xffffff80002ec960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff80002ec9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80002ec9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff80002eca40 usb_process() at usb_process+0xd4/frame 0xffffff80002eca70 fork_exit() at fork_exit+0x84/frame 0xffffff80002ecab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002ecab0 --- trap 0, rip = 0, rsp = 0xffffff80002ecb70, rbp = 0 --- Tracing command usb pid 15 tid 100073 td 0xfffffe000c827000 sched_switch() at sched_switch+0x482/frame 0xffffff80002e7920 mi_switch() at mi_switch+0x179/frame 0xffffff80002e7960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff80002e79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80002e79d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff80002e7a40 usb_process() at usb_process+0xd4/frame 0xffffff80002e7a70 fork_exit() at fork_exit+0x84/frame 0xffffff80002e7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002e7ab0 --- trap 0, rip = 0, rsp = 0xffffff80002e7b70, rbp = 0 --- Tracing command usb pid 15 tid 100072 td 0xfffffe000c827490 sched_switch() at sched_switch+0x482/frame 0xffffff80002e2920 mi_switch() at mi_switch+0x179/frame 0xffffff80002e2960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff80002e29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80002e29d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff80002e2a40 usb_process() at usb_process+0xd4/frame 0xffffff80002e2a70 fork_exit() at fork_exit+0x84/frame 0xffffff80002e2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002e2ab0 --- trap 0, rip = 0, rsp = 0xffffff80002e2b70, rbp = 0 --- Tracing command usb pid 15 tid 100071 td 0xfffffe000c827920 sched_switch() at sched_switch+0x482/frame 0xffffff80002dd920 mi_switch() at mi_switch+0x179/frame 0xffffff80002dd960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff80002dd9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80002dd9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff80002dda40 usb_process() at usb_process+0xd4/frame 0xffffff80002dda70 fork_exit() at fork_exit+0x84/frame 0xffffff80002ddab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002ddab0 --- trap 0, rip = 0, rsp = 0xffffff80002ddb70, rbp = 0 --- Tracing command yarrow pid 14 tid 100057 td 0xfffffe000b276490 sched_switch() at sched_switch+0x482/frame 0xffffff878ad358f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ad35930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad35970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff878ad359a0 msleep_spin_sbt() at msleep_spin_sbt+0x1f0/frame 0xffffff878ad35a30 random_kthread() at random_kthread+0x68/frame 0xffffff878ad35a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad35ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad35ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad35b70, rbp = 0 --- Tracing command geom pid 13 tid 100055 td 0xfffffe000b266920 sched_switch() at sched_switch+0x482/frame 0xffffff878ad2b8d0 mi_switch() at mi_switch+0x179/frame 0xffffff878ad2b910 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad2b950 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad2b980 _sleep() at _sleep+0x33d/frame 0xffffff878ad2ba10 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xffffff878ad2ba60 g_down_procbody() at g_down_procbody+0x7d/frame 0xffffff878ad2ba70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad2bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad2bab0 --- trap 0, rip = 0, rsp = 0xffffff878ad2bb70, rbp = 0 --- Tracing command geom pid 13 tid 100054 td 0xfffffe000b26b000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc558ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc558d00 trap() at trap+0x42/frame 0xffffff87fc558f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc558f20 --- trap 0x13, rip = 0xffffffff80cba0fa, rsp = 0xffffff87fc558fe0, rbp = 0xffffff878ad26950 --- pmap_page_is_mapped() at pmap_page_is_mapped+0xfa/frame 0xffffff878ad26950 swp_pager_async_iodone() at swp_pager_async_iodone+0x1d3/frame 0xffffff878ad269a0 bufdone() at bufdone+0xb7/frame 0xffffff878ad269d0 swapgeom_done() at swapgeom_done+0x38/frame 0xffffff878ad269f0 biodone() at biodone+0x129/frame 0xffffff878ad26a30 g_io_schedule_up() at g_io_schedule_up+0xf1/frame 0xffffff878ad26a60 g_up_procbody() at g_up_procbody+0x7d/frame 0xffffff878ad26a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad26ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad26ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad26b70, rbp = 0 --- Tracing command geom pid 13 tid 100053 td 0xfffffe000b26b490 sched_switch() at sched_switch+0x482/frame 0xffffff878ad218f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ad21930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad21970 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad219a0 _sleep() at _sleep+0x33d/frame 0xffffff878ad21a30 g_run_events() at g_run_events+0x4f4/frame 0xffffff878ad21a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad21ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad21ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad21b70, rbp = 0 --- Tracing command intr pid 12 tid 100122 td 0xfffffe000c9de000 sched_switch() at sched_switch+0x482/frame 0xffffff881dc8b9f0 mi_switch() at mi_switch+0x179/frame 0xffffff881dc8ba30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881dc8ba70 fork_exit() at fork_exit+0x84/frame 0xffffff881dc8bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dc8bab0 --- trap 0, rip = 0, rsp = 0xffffff881dc8bb70, rbp = 0 --- Tracing command intr pid 12 tid 100121 td 0xfffffe000c9de490 sched_switch() at sched_switch+0x482/frame 0xffffff881dc839f0 mi_switch() at mi_switch+0x179/frame 0xffffff881dc83a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881dc83a70 fork_exit() at fork_exit+0x84/frame 0xffffff881dc83ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dc83ab0 --- trap 0, rip = 0, rsp = 0xffffff881dc83b70, rbp = 0 --- Tracing command intr pid 12 tid 100120 td 0xfffffe000c883490 sched_switch() at sched_switch+0x482/frame 0xffffff881bc049f0 mi_switch() at mi_switch+0x179/frame 0xffffff881bc04a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881bc04a70 fork_exit() at fork_exit+0x84/frame 0xffffff881bc04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881bc04ab0 --- trap 0, rip = 0, rsp = 0xffffff881bc04b70, rbp = 0 --- Tracing command intr pid 12 tid 100115 td 0xfffffe000c871920 sched_switch() at sched_switch+0x482/frame 0xffffff881bbe89f0 mi_switch() at mi_switch+0x179/frame 0xffffff881bbe8a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881bbe8a70 fork_exit() at fork_exit+0x84/frame 0xffffff881bbe8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881bbe8ab0 --- trap 0, rip = 0, rsp = 0xffffff881bbe8b70, rbp = 0 --- Tracing command intr pid 12 tid 100110 td 0xfffffe000c870000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100109 td 0xfffffe000c870490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100107 td 0xfffffe000c871000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100105 td 0xfffffe000c865490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100103 td 0xfffffe000c86a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100101 td 0xfffffe000c86a920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100099 td 0xfffffe000c864000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100097 td 0xfffffe000c864920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100095 td 0xfffffe000c84d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100093 td 0xfffffe000c84d920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100092 td 0xfffffe000c84e000 sched_switch() at sched_switch+0x482/frame 0xffffff80003909f0 mi_switch() at mi_switch+0x179/frame 0xffffff8000390a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff8000390a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000390ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000390ab0 --- trap 0, rip = 0, rsp = 0xffffff8000390b70, rbp = 0 --- Tracing command intr pid 12 tid 100090 td 0xfffffe000c84b490 sched_switch() at sched_switch+0x482/frame 0xffffff80003869f0 mi_switch() at mi_switch+0x179/frame 0xffffff8000386a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff8000386a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000386ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000386ab0 --- trap 0, rip = 0, rsp = 0xffffff8000386b70, rbp = 0 --- Tracing command intr pid 12 tid 100088 td 0xfffffe000c84c000 sched_switch() at sched_switch+0x482/frame 0xffffff800037c9f0 mi_switch() at mi_switch+0x179/frame 0xffffff800037ca30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff800037ca70 fork_exit() at fork_exit+0x84/frame 0xffffff800037cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800037cab0 --- trap 0, rip = 0, rsp = 0xffffff800037cb70, rbp = 0 --- Tracing command intr pid 12 tid 100086 td 0xfffffe000c84c920 sched_switch() at sched_switch+0x482/frame 0xffffff80003729f0 mi_switch() at mi_switch+0x179/frame 0xffffff8000372a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff8000372a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000372ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000372ab0 --- trap 0, rip = 0, rsp = 0xffffff8000372b70, rbp = 0 --- Tracing command intr pid 12 tid 100084 td 0xfffffe000c84a000 sched_switch() at sched_switch+0x482/frame 0xffffff80003689f0 mi_switch() at mi_switch+0x179/frame 0xffffff8000368a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff8000368a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000368ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000368ab0 --- trap 0, rip = 0, rsp = 0xffffff8000368b70, rbp = 0 --- Tracing command intr pid 12 tid 100082 td 0xfffffe000c84a920 sched_switch() at sched_switch+0x482/frame 0xffffff800035e9f0 mi_switch() at mi_switch+0x179/frame 0xffffff800035ea30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff800035ea70 fork_exit() at fork_exit+0x84/frame 0xffffff800035eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800035eab0 --- trap 0, rip = 0, rsp = 0xffffff800035eb70, rbp = 0 --- Tracing command intr pid 12 tid 100080 td 0xfffffe000c848000 sched_switch() at sched_switch+0x482/frame 0xffffff80003549f0 mi_switch() at mi_switch+0x179/frame 0xffffff8000354a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff8000354a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000354ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000354ab0 --- trap 0, rip = 0, rsp = 0xffffff8000354b70, rbp = 0 --- Tracing command intr pid 12 tid 100078 td 0xfffffe000c848920 sched_switch() at sched_switch+0x482/frame 0xffffff800034a9f0 mi_switch() at mi_switch+0x179/frame 0xffffff800034aa30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff800034aa70 fork_exit() at fork_exit+0x84/frame 0xffffff800034aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800034aab0 --- trap 0, rip = 0, rsp = 0xffffff800034ab70, rbp = 0 --- Tracing command intr pid 12 tid 100076 td 0xfffffe000c849490 sched_switch() at sched_switch+0x482/frame 0xffffff80003409f0 mi_switch() at mi_switch+0x179/frame 0xffffff8000340a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff8000340a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000340ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000340ab0 --- trap 0, rip = 0, rsp = 0xffffff8000340b70, rbp = 0 --- Tracing command intr pid 12 tid 100075 td 0xfffffe000b3ff490 sched_switch() at sched_switch+0x482/frame 0xffffff80002f19f0 mi_switch() at mi_switch+0x179/frame 0xffffff80002f1a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff80002f1a70 fork_exit() at fork_exit+0x84/frame 0xffffff80002f1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002f1ab0 --- trap 0, rip = 0, rsp = 0xffffff80002f1b70, rbp = 0 --- Tracing command intr pid 12 tid 100070 td 0xfffffe000b3f1920 sched_switch() at sched_switch+0x482/frame 0xffffff80002d89f0 mi_switch() at mi_switch+0x179/frame 0xffffff80002d8a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff80002d8a70 fork_exit() at fork_exit+0x84/frame 0xffffff80002d8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002d8ab0 --- trap 0, rip = 0, rsp = 0xffffff80002d8b70, rbp = 0 --- Tracing command intr pid 12 tid 100069 td 0xfffffe000b3fe000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100068 td 0xfffffe000b3fe490 sched_switch() at sched_switch+0x482/frame 0xffffff878adad9f0 mi_switch() at mi_switch+0x179/frame 0xffffff878adada30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878adada70 fork_exit() at fork_exit+0x84/frame 0xffffff878adadab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878adadab0 --- trap 0, rip = 0, rsp = 0xffffff878adadb70, rbp = 0 --- Tracing command intr pid 12 tid 100067 td 0xfffffe000b3fe920 sched_switch() at sched_switch+0x482/frame 0xffffff878ad679f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ad67a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878ad67a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad67ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad67ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad67b70, rbp = 0 --- Tracing command intr pid 12 tid 100062 td 0xfffffe000b3f1000 sched_switch() at sched_switch+0x482/frame 0xffffff878ad4e9f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ad4ea30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878ad4ea70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad4eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad4eab0 --- trap 0, rip = 0, rsp = 0xffffff878ad4eb70, rbp = 0 --- Tracing command intr pid 12 tid 100061 td 0xfffffe000b3f1490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffffe000b276000 sched_switch() at sched_switch+0x482/frame 0xffffff878ad3a9f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ad3aa30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878ad3aa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad3aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad3aab0 --- trap 0, rip = 0, rsp = 0xffffff878ad3ab70, rbp = 0 --- Tracing command intr pid 12 tid 100052 td 0xfffffe000b26b920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffffe000b26c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffffe000b265000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffffe000b265490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffffe000b265920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffffe000b266000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100046 td 0xfffffe000b266490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffffe000b261490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100044 td 0xfffffe000b261920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100043 td 0xfffffe000b262000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xfffffe000b262490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xfffffe000b262920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100040 td 0xfffffe000b25c920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100039 td 0xfffffe000b260000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100038 td 0xfffffe000b260490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100037 td 0xfffffe000b260920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100036 td 0xfffffe000b261000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100035 td 0xfffffe000b25b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100034 td 0xfffffe000b25b490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100033 td 0xfffffe000b25b920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100032 td 0xfffffe000b25c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100031 td 0xfffffe000b25c490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100030 td 0xfffffe000b238490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100029 td 0xfffffe000b238920 sched_switch() at sched_switch+0x482/frame 0xffffff878aca99f0 mi_switch() at mi_switch+0x179/frame 0xffffff878aca9a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878aca9a70 fork_exit() at fork_exit+0x84/frame 0xffffff878aca9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878aca9ab0 --- trap 0, rip = 0, rsp = 0xffffff878aca9b70, rbp = 0 --- Tracing command intr pid 12 tid 100028 td 0xfffffe000b239000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100027 td 0xfffffe000b239490 sched_switch() at sched_switch+0x482/frame 0xffffff878ac9f9f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ac9fa30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878ac9fa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac9fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac9fab0 --- trap 0, rip = 0, rsp = 0xffffff878ac9fb70, rbp = 0 --- Tracing command idle pid 11 tid 100026 td 0xfffffe000b239920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5ebce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5ebd00 trap() at trap+0x42/frame 0xffffff87fc5ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5ebf20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc5ebfe0, rbp = 0xffffff878ac9a930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac9a930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac9a980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac9a9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac9a9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac9aa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac9aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac9aab0 --- trap 0, rip = 0, rsp = 0xffffff878ac9ab70, rbp = 0 --- Tracing command idle pid 11 tid 100025 td 0xfffffe000b236920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5e4ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5e4d00 trap() at trap+0x42/frame 0xffffff87fc5e4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5e4f20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc5e4fe0, rbp = 0xffffff878ac95930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac95930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac95980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac959a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac959c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac95a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac95ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac95ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac95b70, rbp = 0 --- Tracing command idle pid 11 tid 100024 td 0xfffffe000b237000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5ddce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5ddd00 trap() at trap+0x42/frame 0xffffff87fc5ddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5ddf20 --- trap 0x13, rip = 0xffffffff80cab04e, rsp = 0xffffff87fc5ddfe0, rbp = 0xffffff878ac909c0 --- cpu_idle() at cpu_idle+0xbe/frame 0xffffff878ac909c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac90a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac90ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac90ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac90b70, rbp = 0 --- Tracing command idle pid 11 tid 100023 td 0xfffffe000b237490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5d6ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5d6d00 trap() at trap+0x42/frame 0xffffff87fc5d6f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5d6f20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc5d6fe0, rbp = 0xffffff878ac8b930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac8b930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac8b980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac8b9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac8b9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac8ba70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac8bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac8bab0 --- trap 0, rip = 0, rsp = 0xffffff878ac8bb70, rbp = 0 --- Tracing command idle pid 11 tid 100022 td 0xfffffe000b237920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5cfce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5cfd00 trap() at trap+0x42/frame 0xffffff87fc5cff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5cff20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc5cffe0, rbp = 0xffffff878ac86930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac86930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac86980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac869a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac869c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac86a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac86ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac86ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac86b70, rbp = 0 --- Tracing command idle pid 11 tid 100021 td 0xfffffe000b238000 sched_switch() at sched_switch+0x482/frame 0xffffff878ac81980 mi_switch() at mi_switch+0x179/frame 0xffffff878ac819c0 sched_idletd() at sched_idletd+0x102/frame 0xffffff878ac81a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac81ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac81ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac81b70, rbp = 0 --- Tracing command idle pid 11 tid 100020 td 0xfffffe000b235000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5c1ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5c1d00 trap() at trap+0x42/frame 0xffffff87fc5c1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5c1f20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc5c1fe0, rbp = 0xffffff878ac7c930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac7c930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac7c980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac7c9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac7c9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac7ca70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac7cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac7cab0 --- trap 0, rip = 0, rsp = 0xffffff878ac7cb70, rbp = 0 --- Tracing command idle pid 11 tid 100019 td 0xfffffe000b235490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5bace0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5bad00 trap() at trap+0x42/frame 0xffffff87fc5baf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5baf20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc5bafe0, rbp = 0xffffff878ac77930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac77930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac77980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac779a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac779c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac77a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac77ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac77ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac77b70, rbp = 0 --- Tracing command idle pid 11 tid 100018 td 0xfffffe000b235920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5b3ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5b3d00 trap() at trap+0x42/frame 0xffffff87fc5b3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5b3f20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc5b3fe0, rbp = 0xffffff878ac72930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac72930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac72980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac729a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac729c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac72a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac72ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac72ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac72b70, rbp = 0 --- Tracing command idle pid 11 tid 100017 td 0xfffffe000b236000 sched_switch() at sched_switch+0x482/frame 0xffffff878ac6d960 mi_switch() at mi_switch+0x179/frame 0xffffff878ac6d9a0 critical_exit() at critical_exit+0x8b/frame 0xffffff878ac6d9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac6da70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac6dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac6dab0 --- trap 0, rip = 0, rsp = 0xffffff878ac6db70, rbp = 0 --- Tracing command idle pid 11 tid 100016 td 0xfffffe000b236490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5a5ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5a5d00 trap() at trap+0x42/frame 0xffffff87fc5a5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5a5f20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc5a5fe0, rbp = 0xffffff878ac68930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac68930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac68980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac689a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac689c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac68a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac68ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac68ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac68b70, rbp = 0 --- Tracing command idle pid 11 tid 100015 td 0xfffffe000b233490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc59ece0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc59ed00 trap() at trap+0x42/frame 0xffffff87fc59ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc59ef20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc59efe0, rbp = 0xffffff878ac63930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac63930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac63980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac639a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac639c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac63a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac63ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac63ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac63b70, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe000b233920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc597ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc597d00 trap() at trap+0x42/frame 0xffffff87fc597f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc597f20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc597fe0, rbp = 0xffffff878ac5e930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac5e930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac5e980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac5e9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac5e9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac5ea70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac5eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac5eab0 --- trap 0, rip = 0, rsp = 0xffffff878ac5eb70, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe000b234000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc590ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc590d00 trap() at trap+0x42/frame 0xffffff87fc590f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc590f20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc590fe0, rbp = 0xffffff878ac59930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac59930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac59980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac599a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac599c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac59a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac59ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac59ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac59b70, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe000b234490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc589ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc589d00 trap() at trap+0x42/frame 0xffffff87fc589f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc589f20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc589fe0, rbp = 0xffffff878ac54930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac54930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac54980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac549a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac549c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac54a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac54ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac54ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac54b70, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe000b234920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc582ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc582d00 trap() at trap+0x42/frame 0xffffff87fc582f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc582f20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc582fe0, rbp = 0xffffff878ac4f930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac4f930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac4f980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac4f9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac4f9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac4fa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac4fab0 --- trap 0, rip = 0, rsp = 0xffffff878ac4fb70, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe000b224920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc57bce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc57bd00 trap() at trap+0x42/frame 0xffffff87fc57bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc57bf20 --- trap 0x13, rip = 0xffffffff80cab04e, rsp = 0xffffff87fc57bfe0, rbp = 0xffffff878ac4a9c0 --- cpu_idle() at cpu_idle+0xbe/frame 0xffffff878ac4a9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac4aa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac4aab0 --- trap 0, rip = 0, rsp = 0xffffff878ac4ab70, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe000b232000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc574ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc574d00 trap() at trap+0x42/frame 0xffffff87fc574f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc574f20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc574fe0, rbp = 0xffffff878ac45930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac45930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac45980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac459a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac459c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac45a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac45ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac45ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac45b70, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe000b232490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc56dce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc56dd00 trap() at trap+0x42/frame 0xffffff87fc56df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc56df20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc56dfe0, rbp = 0xffffff878ac40930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac40930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac40980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac409a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac409c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac40a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac40ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac40ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac40b70, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe000b232920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc566ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc566d00 trap() at trap+0x42/frame 0xffffff87fc566f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc566f20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc566fe0, rbp = 0xffffff878ac3b930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac3b930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac3b980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac3b9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac3b9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac3ba70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac3bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac3bab0 --- trap 0, rip = 0, rsp = 0xffffff878ac3bb70, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe000b233000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc55fce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc55fd00 trap() at trap+0x42/frame 0xffffff87fc55ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc55ff20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc55ffe0, rbp = 0xffffff878ac36930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac36930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac36980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac369a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac369c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac36a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac36ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac36b70, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe000b223000 sched_switch() at sched_switch+0x482/frame 0xffffff878ac31980 mi_switch() at mi_switch+0x179/frame 0xffffff878ac319c0 sched_idletd() at sched_idletd+0x102/frame 0xffffff878ac31a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac31ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac31b70, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe000b223490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc551ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc551d00 trap() at trap+0x42/frame 0xffffff87fc551f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc551f20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffff87fc551fe0, rbp = 0xffffff878ac2c930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac2c930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac2c980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac2c9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac2c9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac2ca70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac2cab0 --- trap 0, rip = 0, rsp = 0xffffff878ac2cb70, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe000b223920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff8158a8e0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffffff8158a900 trap() at trap+0x42/frame 0xffffffff8158ab20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff8158ab20 --- trap 0x13, rip = 0xffffffff80ca1ed6, rsp = 0xffffffff8158abe0, rbp = 0xffffff87fc5fc930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff87fc5fc930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff87fc5fc980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff87fc5fc9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff87fc5fc9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff87fc5fca70 fork_exit() at fork_exit+0x84/frame 0xffffff87fc5fcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff87fc5fcab0 --- trap 0, rip = 0, rsp = 0xffffff87fc5fcb70, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe000b224000 sched_switch() at sched_switch+0x482/frame 0xffffff87fc5f7560 mi_switch() at mi_switch+0x179/frame 0xffffff87fc5f75a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff87fc5f75e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff87fc5f7650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff87fc5f7680 _sleep() at _sleep+0x320/frame 0xffffff87fc5f7710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff87fc5f77b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff87fc5f79a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff87fc5f7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff87fc5f7ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x41323a, rsp = 0x7fffffffd758, rbp = 0x7fffffffd7c0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe000b224490 sched_switch() at sched_switch+0x482/frame 0xffffff87fc5f28f0 mi_switch() at mi_switch+0x179/frame 0xffffff87fc5f2930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff87fc5f2970 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff87fc5f29a0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff87fc5f2a10 audit_worker() at audit_worker+0xa3/frame 0xffffff87fc5f2a70 fork_exit() at fork_exit+0x84/frame 0xffffff87fc5f2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff87fc5f2ab0 --- trap 0, rip = 0, rsp = 0xffffff87fc5f2b70, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffffe000c9da490 sched_switch() at sched_switch+0x482/frame 0xffffff881dc99890 mi_switch() at mi_switch+0x179/frame 0xffffff881dc998d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dc99910 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881dc99940 _sleep() at _sleep+0x312/frame 0xffffff881dc999d0 pause_sbt() at pause_sbt+0x70/frame 0xffffff881dc99a20 deadlkres() at deadlkres+0x66/frame 0xffffff881dc99a70 fork_exit() at fork_exit+0x84/frame 0xffffff881dc99ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dc99ab0 --- trap 0, rip = 0, rsp = 0xffffff881dc99b70, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffffe000c9da920 sched_switch() at sched_switch+0x482/frame 0xffffff881dc94900 mi_switch() at mi_switch+0x179/frame 0xffffff881dc94940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dc94980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881dc949b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff881dc94a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff881dc94a70 fork_exit() at fork_exit+0x84/frame 0xffffff881dc94ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dc94ab0 --- trap 0, rip = 0, rsp = 0xffffff881dc94b70, rbp = 0 --- Tracing command kernel pid 0 tid 100108 td 0xfffffe000c870920 sched_switch() at sched_switch+0x482/frame 0xffffff881ba22900 mi_switch() at mi_switch+0x179/frame 0xffffff881ba22940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba22980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba229b0 _sleep() at _sleep+0x33d/frame 0xffffff881ba22a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ba22a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba22ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba22ab0 --- trap 0, rip = 0, rsp = 0xffffff881ba22b70, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffffe000c871490 sched_switch() at sched_switch+0x482/frame 0xffffff881ba18900 mi_switch() at mi_switch+0x179/frame 0xffffff881ba18940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba18980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba189b0 _sleep() at _sleep+0x33d/frame 0xffffff881ba18a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ba18a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba18ab0 --- trap 0, rip = 0, rsp = 0xffffff881ba18b70, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffffe000c865920 sched_switch() at sched_switch+0x482/frame 0xffffff881ba0e900 mi_switch() at mi_switch+0x179/frame 0xffffff881ba0e940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba0e980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba0e9b0 _sleep() at _sleep+0x33d/frame 0xffffff881ba0ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ba0ea70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba0eab0 --- trap 0, rip = 0, rsp = 0xffffff881ba0eb70, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffffe000c86a490 sched_switch() at sched_switch+0x482/frame 0xffffff881ba04900 mi_switch() at mi_switch+0x179/frame 0xffffff881ba04940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba04980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba049b0 _sleep() at _sleep+0x33d/frame 0xffffff881ba04a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ba04a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba04ab0 --- trap 0, rip = 0, rsp = 0xffffff881ba04b70, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffffe000c84e920 sched_switch() at sched_switch+0x482/frame 0xffffff80003f8900 mi_switch() at mi_switch+0x179/frame 0xffffff80003f8940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff80003f8980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003f89b0 _sleep() at _sleep+0x33d/frame 0xffffff80003f8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff80003f8a70 fork_exit() at fork_exit+0x84/frame 0xffffff80003f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80003f8ab0 --- trap 0, rip = 0, rsp = 0xffffff80003f8b70, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffffe000c864490 sched_switch() at sched_switch+0x482/frame 0xffffff80003ee900 mi_switch() at mi_switch+0x179/frame 0xffffff80003ee940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff80003ee980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003ee9b0 _sleep() at _sleep+0x33d/frame 0xffffff80003eea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff80003eea70 fork_exit() at fork_exit+0x84/frame 0xffffff80003eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80003eeab0 --- trap 0, rip = 0, rsp = 0xffffff80003eeb70, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffffe000c865000 sched_switch() at sched_switch+0x482/frame 0xffffff80003e4900 mi_switch() at mi_switch+0x179/frame 0xffffff80003e4940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff80003e4980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003e49b0 _sleep() at _sleep+0x33d/frame 0xffffff80003e4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff80003e4a70 fork_exit() at fork_exit+0x84/frame 0xffffff80003e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80003e4ab0 --- trap 0, rip = 0, rsp = 0xffffff80003e4b70, rbp = 0 --- Tracing command kernel pid 0 tid 100094 td 0xfffffe000c84d490 sched_switch() at sched_switch+0x482/frame 0xffffff80003da900 mi_switch() at mi_switch+0x179/frame 0xffffff80003da940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff80003da980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003da9b0 _sleep() at _sleep+0x33d/frame 0xffffff80003daa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff80003daa70 fork_exit() at fork_exit+0x84/frame 0xffffff80003daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80003daab0 --- trap 0, rip = 0, rsp = 0xffffff80003dab70, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffffe000c84e490 sched_switch() at sched_switch+0x482/frame 0xffffff800038b900 mi_switch() at mi_switch+0x179/frame 0xffffff800038b940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff800038b980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff800038b9b0 _sleep() at _sleep+0x33d/frame 0xffffff800038ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff800038ba70 fork_exit() at fork_exit+0x84/frame 0xffffff800038bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800038bab0 --- trap 0, rip = 0, rsp = 0xffffff800038bb70, rbp = 0 --- Tracing command kernel pid 0 tid 100089 td 0xfffffe000c84b920 sched_switch() at sched_switch+0x482/frame 0xffffff8000381900 mi_switch() at mi_switch+0x179/frame 0xffffff8000381940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8000381980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003819b0 _sleep() at _sleep+0x33d/frame 0xffffff8000381a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff8000381a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000381ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000381ab0 --- trap 0, rip = 0, rsp = 0xffffff8000381b70, rbp = 0 --- Tracing command kernel pid 0 tid 100087 td 0xfffffe000c84c490 sched_switch() at sched_switch+0x482/frame 0xffffff8000377900 mi_switch() at mi_switch+0x179/frame 0xffffff8000377940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8000377980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003779b0 _sleep() at _sleep+0x33d/frame 0xffffff8000377a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff8000377a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000377ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000377ab0 --- trap 0, rip = 0, rsp = 0xffffff8000377b70, rbp = 0 --- Tracing command kernel pid 0 tid 100085 td 0xfffffe000c849920 sched_switch() at sched_switch+0x482/frame 0xffffff800036d900 mi_switch() at mi_switch+0x179/frame 0xffffff800036d940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff800036d980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff800036d9b0 _sleep() at _sleep+0x33d/frame 0xffffff800036da40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff800036da70 fork_exit() at fork_exit+0x84/frame 0xffffff800036dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800036dab0 --- trap 0, rip = 0, rsp = 0xffffff800036db70, rbp = 0 --- Tracing command kernel pid 0 tid 100083 td 0xfffffe000c84a490 sched_switch() at sched_switch+0x482/frame 0xffffff8000363900 mi_switch() at mi_switch+0x179/frame 0xffffff8000363940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8000363980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003639b0 _sleep() at _sleep+0x33d/frame 0xffffff8000363a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff8000363a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000363ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000363ab0 --- trap 0, rip = 0, rsp = 0xffffff8000363b70, rbp = 0 --- Tracing command kernel pid 0 tid 100081 td 0xfffffe000c84b000 sched_switch() at sched_switch+0x482/frame 0xffffff8000359900 mi_switch() at mi_switch+0x179/frame 0xffffff8000359940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8000359980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003599b0 _sleep() at _sleep+0x33d/frame 0xffffff8000359a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff8000359a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000359ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000359ab0 --- trap 0, rip = 0, rsp = 0xffffff8000359b70, rbp = 0 --- Tracing command kernel pid 0 tid 100079 td 0xfffffe000c848490 sched_switch() at sched_switch+0x482/frame 0xffffff800034f900 mi_switch() at mi_switch+0x179/frame 0xffffff800034f940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff800034f980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff800034f9b0 _sleep() at _sleep+0x33d/frame 0xffffff800034fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff800034fa70 fork_exit() at fork_exit+0x84/frame 0xffffff800034fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800034fab0 --- trap 0, rip = 0, rsp = 0xffffff800034fb70, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffffe000c849000 sched_switch() at sched_switch+0x482/frame 0xffffff8000345900 mi_switch() at mi_switch+0x179/frame 0xffffff8000345940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8000345980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003459b0 _sleep() at _sleep+0x33d/frame 0xffffff8000345a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff8000345a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000345ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000345ab0 --- trap 0, rip = 0, rsp = 0xffffff8000345b70, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe000b3ff000 sched_switch() at sched_switch+0x482/frame 0xffffff878ad62900 mi_switch() at mi_switch+0x179/frame 0xffffff878ad62940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad62980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad629b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff878ad62a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff878ad62a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad62ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad62ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad62b70, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffffe000b3ed000 sched_switch() at sched_switch+0x482/frame 0xffffff878ad5d900 mi_switch() at mi_switch+0x179/frame 0xffffff878ad5d940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad5d980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad5d9b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff878ad5da40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff878ad5da70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad5dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad5dab0 --- trap 0, rip = 0, rsp = 0xffffff878ad5db70, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffffe000b3ed490 sched_switch() at sched_switch+0x482/frame 0xffffff878ad58900 mi_switch() at mi_switch+0x179/frame 0xffffff878ad58940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad58980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad589b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff878ad58a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff878ad58a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad58ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad58ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad58b70, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffffe000b3ed920 sched_switch() at sched_switch+0x482/frame 0xffffff878ad53900 mi_switch() at mi_switch+0x179/frame 0xffffff878ad53940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad53980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad539b0 _sleep() at _sleep+0x33d/frame 0xffffff878ad53a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff878ad53a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad53ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad53ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad53b70, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffffe000b26c490 sched_switch() at sched_switch+0x482/frame 0xffffff878ad44900 mi_switch() at mi_switch+0x179/frame 0xffffff878ad44940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad44980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad449b0 _sleep() at _sleep+0x33d/frame 0xffffff878ad44a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff878ad44a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad44ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad44ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad44b70, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffffe000b26c920 sched_switch() at sched_switch+0x482/frame 0xffffff878ad3f900 mi_switch() at mi_switch+0x179/frame 0xffffff878ad3f940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad3f980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad3f9b0 _sleep() at _sleep+0x33d/frame 0xffffff878ad3fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff878ad3fa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad3fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad3fab0 --- trap 0, rip = 0, rsp = 0xffffff878ad3fb70, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffffe000b276920 sched_switch() at sched_switch+0x482/frame 0xffffff878ad30900 mi_switch() at mi_switch+0x179/frame 0xffffff878ad30940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad30980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad309b0 _sleep() at _sleep+0x33d/frame 0xffffff878ad30a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff878ad30a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad30ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad30ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad30b70, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff815e1b60 sched_switch() at sched_switch+0x482/frame 0xffffffff818af9e0 mi_switch() at mi_switch+0x179/frame 0xffffffff818afa20 sleepq_switch() at sleepq_switch+0x185/frame 0xffffffff818afa60 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffffff818afa90 _sleep() at _sleep+0x312/frame 0xffffffff818afb20 swapper() at swapper+0x211/frame 0xffffffff818afb70 btext() at btext+0x2c db:0:allt> call doadump Dumping 1461 out of 31644 MB:..2%..11%..21%..31%..41%..51%..61%..71%..82%..91% Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 14 (kgdb) bt #0 doadump (textdump=0xd) at pcpu.h:236 #1 0xffffffff8033c505 in db_fncall (dummy1=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:578 #2 0xffffffff8033c1ed in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #3 0xffffffff8034044f in db_script_exec (scriptname=0xffffffff815d6280 "doadump", warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xffffffff8033c1ed in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #5 0xffffffff8033bf64 in db_command_loop () at ../../../ddb/db_command.c:502 #6 0xffffffff8033e910 in db_trap (type=, code=0x0) at ../../../ddb/db_main.c:231 #7 0xffffffff808f1c53 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:654 #8 0xffffffff80cc2f1b in trap (frame=0xffffff881e42c330) at ../../../amd64/amd64/trap.c:579 #9 0xffffffff80ca6d62 in calltrap () at ../../../amd64/amd64/exception.S:232 #10 0xffffffff808f142e in kdb_enter (why=0xffffffff80f8a33d "panic", msg=) at cpufunc.h:63 #11 0xffffffff808bb016 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:747 #12 0xffffffff808baec6 in kassert_panic (fmt=) at ../../../kern/kern_shutdown.c:642 #13 0xffffffff80967e31 in vdropl (vp=0xfffffe0255395c30) at ../../../kern/vfs_subr.c:2388 #14 0xffffffff809661aa in vdrop (vp=0xfffffe0255395c30) at ../../../kern/vfs_subr.c:2322 #15 0xffffffff80b4e53a in vm_page_cache_free (object=0xfffffe0015a9e200, start=0x0, end=0x0) at ../../../vm/vm_page.c:1310 #16 0xffffffff80964b25 in bufobj_invalbuf (bo=0xfffffe0255395d98, flags=0x1, slpflag=0x0, slptimeo=0x0) at ../../../kern/vfs_subr.c:1293 #17 0xffffffff80965065 in vinvalbuf (vp=0xfffffe0255395c30, flags=0x1, slpflag=0x0, slptimeo=0x0) at ../../../kern/vfs_subr.c:1318 #18 0xffffffff809692b8 in vgonel (vp=0xfffffe0255395c30) at ../../../kern/vfs_subr.c:2739 #19 0xffffffff80969971 in vrecycle (vp=0xfffffe0255395c30) at ../../../kern/vfs_subr.c:2617 #20 0xffffffff80b1f68a in ufs_inactive (ap=) at ../../../ufs/ufs/ufs_inode.c:174 #21 0xffffffff80d6e64e in VOP_INACTIVE_APV (vop=, a=) at vnode_if.c:1953 #22 0xffffffff80968389 in VOP_INACTIVE (vp=0xfffffe0255395c30, td=0xfffffe0015a73920) at vnode_if.h:807 #23 0xffffffff80967194 in vinactive (vp=0xfffffe0255395c30, td=0xfffffe0015a73920) at ../../../kern/vfs_subr.c:2452 #24 0xffffffff80967715 in vputx (vp=0xfffffe0255395c30, func=0x2) at ../../../kern/vfs_subr.c:2229 #25 0xffffffff8096776a in vput (vp=0xfffffe0255395c30) at ../../../kern/vfs_subr.c:2256 #26 0xffffffff80b4855f in vm_object_deallocate (object=) at ../../../vm/vm_object.c:490 #27 0xffffffff80b454e5 in vm_map_entry_deallocate (entry=0xfffffe0015b6be80, system_map=0x0) at ../../../vm/vm_map.c:2737 #28 0xffffffff80b3c8dd in vm_map_process_deferred () at ../../../vm/vm_map.c:489 #29 0xffffffff80b3c7c8 in _vm_map_unlock (map=0xfffffe0015ce5198, file=0xffffffff80fcb01a "../../../vm/vm_map.c", line=0xb64) at ../../../vm/vm_map.c:502 #30 0xffffffff80b4267e in vm_map_remove (map=0xfffffe0015ce5198, start=0x1000, end=0x800000000000) at ../../../vm/vm_map.c:2916 #31 0xffffffff80b3c302 in vmspace_dofree (vm=0xfffffe0015ce5198) at ../../../vm/vm_map.c:341 #32 0xffffffff80b3c52e in vmspace_exit (td=0xfffffe0015a73920) at ../../../vm/vm_map.c:419 #33 0xffffffff8088626e in exit1 (td=0xfffffe0015a73920, rv=) at ../../../kern/kern_exit.c:321 #34 0xffffffff80885d3e in sys_sys_exit (td=, uap=) at ../../../kern/kern_exit.c:121 #35 0xffffffff80cc3b82 in amd64_syscall (td=0xfffffe0015a73920, traced=0x0) at subr_syscall.c:134 #36 0xffffffff80ca704b in Xfast_syscall () at ../../../amd64/amd64/exception.S:391 #37 0x00000008008e6e6a in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xffffffff80967e31 in vdropl (vp=0xfffffe0255395c30) at ../../../kern/vfs_subr.c:2388 2388 VNASSERT(vp->v_data == NULL, vp, ("cleaned vnode isn't")); (kgdb) l 2383 numvnodes--; 2384 mtx_unlock(&vnode_free_list_mtx); 2385 bo = &vp->v_bufobj; 2386 VNASSERT((vp->v_iflag & VI_FREE) == 0, vp, 2387 ("cleaned vnode still on the free list.")); 2388 VNASSERT(vp->v_data == NULL, vp, ("cleaned vnode isn't")); 2389 VNASSERT(vp->v_holdcnt == 0, vp, ("Non-zero hold count")); 2390 VNASSERT(vp->v_usecount == 0, vp, ("Non-zero use count")); 2391 VNASSERT(vp->v_writecount == 0, vp, ("Non-zero write count")); 2392 VNASSERT(bo->bo_numoutput == 0, vp, ("Clean vnode has pending I/O's")); (kgdb) info loc bo = (struct bufobj *) 0xfffffe0255395d98 mp = (struct mount *) 0xfffffe0005cc7500 active = 0x0 (kgdb) p *vp $1 = {v_tag = 0xffffffff80f78e36 "ufs", v_op = 0xffffffff81333f50, v_data = 0xfffffe0015e5c690, v_mount = 0xfffffe0015e1a3c8, v_nmntvnodes = { tqe_next = 0xfffffe0015894750, tqe_prev = 0xfffffe008781c500}, v_un = {vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = { le_next = 0x0, le_prev = 0xffffff80011a7d60}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xfffffe0255395c80}, v_cache_dd = 0x0, v_lock = {lock_object = {lo_name = 0xffffffff80f78e36 "ufs", lo_flags = 0x6fb0000, lo_data = 0x0, lo_witness = 0xffffff80006d8080}, lk_lock = 0xfffffe0015a73920, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0xf, pcs = {0xffffffff8089e539, 0xffffffff80b17722, 0xffffffff80d6e955, 0xffffffff8097bbd6, 0xffffffff80b484ac, 0xffffffff80b454e5, 0xffffffff80b3c8dd, 0xffffffff80b3c7c8, 0xffffffff80b4267e, 0xffffffff80b3c302, 0xffffffff80b3c52e, 0xffffffff8088626e, 0xffffffff80885d3e, 0xffffffff80cc3b82, 0xffffffff80ca704b, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = {lo_name = 0xffffffff80f93849 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xffffff80006bd600}, mtx_lock = 0xfffffe0015a73920}, v_vnlock = 0xfffffe0255395c98, v_actfreelist = {tqe_next = 0xfffffe008781c4e0, tqe_prev = 0xfffffe0015e1a440}, v_bufobj = {bo_lock = {lock_object = {lo_name = 0xffffffff80f9bda3 "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xffffff80006c6480}, rw_lock = 0x1}, bo_ops = 0xffffffff813049c0, bo_object = 0xfffffe0015a9e200, bo_synclist = { le_next = 0xfffffe054bc37648, le_prev = 0xfffffe0015d29198}, bo_private = 0xfffffe0255395c30, __bo_vnode = 0xfffffe0255395c30, bo_clean = {bv_hd = { tqh_first = 0x0, tqh_last = 0xfffffe0255395de8}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffffe0255395e08}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_bsize = 0x8000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffffe0255395e50}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x0, v_usecount = 0x0, v_iflag = 0xa80, v_vflag = 0x0, v_writecount = 0x0, v_hash = 0x13980a, v_type = VREG} (kgdb) p *bo $2 = {bo_lock = {lock_object = {lo_name = 0xffffffff80f9bda3 "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xffffff80006c6480}, rw_lock = 0x1}, bo_ops = 0xffffffff813049c0, bo_object = 0xfffffe0015a9e200, bo_synclist = {le_next = 0xfffffe054bc37648, le_prev = 0xfffffe0015d29198}, bo_private = 0xfffffe0255395c30, __bo_vnode = 0xfffffe0255395c30, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffffe0255395de8}, bv_root = { pt_root = 0x0}, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffffe0255395e08}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_bsize = 0x8000} (kgdb) p *mp $3 = {mnt_mtx = {lock_object = {lo_name = 0xfffffe0005cc7550 "process_exit", lo_flags = 0x1, lo_data = 0x0, lo_witness = 0xffffffff80f756ac}, mtx_lock = 0x1030000}, mnt_gen = 0x6c1200, mnt_list = {tqe_next = 0x4, tqe_prev = 0xfffffe0005cc7580}, mnt_op = 0xfffffe0005cc74b0, mnt_vfc = 0xfffffe0005cac400, mnt_vnodecovered = 0xfffffe0005cac140, mnt_syncer = 0x5f737365636f7270, mnt_ref = 0x74697865, mnt_nvnodelist = { tqh_first = 0xdeadc0dedeadc0de, tqh_last = 0xdeadc0dedeadc0de}, mnt_nvnodelistsize = 0xdeadc0de, mnt_activevnodelist = {tqh_first = 0x0, tqh_last = 0xfffffe0005cc75d0}, mnt_activevnodelistsize = 0x1, mnt_writeopcount = 0x0, mnt_kern_flag = 0x80d90ebf, mnt_flag = 0x1030000, mnt_opt = 0xffffff80006c1200, mnt_optnew = 0x4, mnt_maxsymlinklen = 0x5cc7600, mnt_stat = {f_version = 0x5cc7530, f_type = 0xfffffe00, f_flags = 0xfffffe0005cac440, f_bsize = 0xfffffe0005cac440, f_iosize = 0x676f646863746177, f_blocks = 0xdead007473696c5f, f_bfree = 0xdeadc0dedeadc0de, f_bavail = 0xdeadc0dedeadc0de, f_files = 0xdeadc0dedeadc0de, f_ffree = 0x0, f_syncwrites = 0xfffffe0005cc7650, f_asyncwrites = 0x1, f_syncreads = 0xffffffff80f8e984, f_asyncreads = 0x1030000, f_spare = {0xffffff80006c1200, 0x4, 0xfffffe0005cc7680, 0xfffffe0005cc75b0, 0xfffffe0005cac540, 0xfffffe0005cac540, 0x6f6f72746e756f6d, 0xdeadc0dedead0074, 0xdeadc0dedeadc0de, 0xdeadc0dedeadc0de}, f_namemax = 0xdeadc0de, f_owner = 0xdeadc0de, f_fsid = {val = {0x0, 0x0}}, f_charspare = "ÐvÌ\005\000þÿÿ\001\000\000\000\000\000\000\000\002Uó\200ÿÿÿÿ\000\000\003\001\000\000\000\000\000\022l\000\200ÿÿÿ\004\000\000\000\000\000\000\000\000wÌ\005\000þÿÿ0vÌ\005\000þÿÿÀÅÊ\005\000þÿÿ\000»Ê\005\000þÿÿ", f_fstypename = "power_resume\000À­Þ", f_mntfromname = "ÞÀ­ÞÞÀ­ÞÞÀ­ÞÞÀ­ÞÞÀ­ÞÞÀ­Þ\000\000\000\000\000\000\000\000PwÌ\005\000þÿÿ\001\000\000\000\000\000\000\000s?ð\200ÿÿÿÿ\000\000\003\001\000\000\000\000\000\022l\000\200ÿÿÿ\004\000\000\000\000\000\000\000\200wÌ\005\000þÿÿ", f_mntonname = "°vÌ\005\000þÿÿ\000ÇÊ\005\000þÿÿ\200ÆÊ\005\000þÿÿvlan_unconfig\000­ÞÞÀ­ÞÞÀ­ÞÞÀ­ÞÞÀ­ÞÞÀ­ÞÞÀ­Þ\000\000\000\000\000\000\000\000ÐwÌ\005\000þÿÿ\001\000\000\000\000\000\000"}, mnt_cred = 0xffffffff80f03f67, mnt_data = 0x1030000, mnt_time = 0xffffff80006c1200, mnt_iosize_max = 0x4, mnt_export = 0xfffffe0005cc7800, mnt_label = 0xfffffe0005cc7730, mnt_hashseed = 0x5cac740, mnt_lockref = 0xfffffe00, mnt_secondary_writes = 0x5cac6c0, mnt_secondary_accwrites = 0xfffffe00, mnt_susp_owner = 0x6e6f635f6e616c76, mnt_gjprovider = 0xdeadc0de00676966
, mnt_explock = {lock_object = {lo_name = 0xdeadc0dedeadc0de
, lo_flags = 0xdeadc0de, lo_data = 0xdeadc0de, lo_witness = 0xdeadc0dedeadc0de}, lk_lock = 0x0, lk_exslpfail = 0x5cc7850, lk_timo = 0xfffffe00, lk_pri = 0x1, lk_stack = {depth = 0x80f354c6, pcs = { 0x1030000, 0xffffff80006c1200, 0x4, 0xfffffe0005cc7880, 0xfffffe0005cc77b0, 0xfffffe0005cac600, 0xfffffe0005cabb40, 0x75735f7265776f70, 0xdead00646e657073, 0xdeadc0dedeadc0de, 0xdeadc0dedeadc0de, 0xdeadc0dedeadc0de, 0x0, 0xfffffe0005cc78d0, 0x1, 0xffffffff80d95056, 0x1030000, 0xffffff80006c1200}}}, mnt_upper_link = {tqe_next = 0x4, tqe_prev = 0xfffffe0005cc7900}, mnt_uppers = {tqh_first = 0xfffffe0005cc7830, tqh_last = 0xfffffe0005cac7c0}} (kgdb) f 15 #15 0xffffffff80b4e53a in vm_page_cache_free (object=0xfffffe0015a9e200, start=0x0, end=0x0) at ../../../vm/vm_page.c:1310 1310 vdrop(object->handle); (kgdb) p *object $4 = {lock = {lock_object = {lo_name = 0xffffffff80fcbf66 "vm object", lo_flags = 0x5630000, lo_data = 0x0, lo_witness = 0xffffff80006bd780}, rw_lock = 0xfffffe0015a73920}, object_list = {tqe_next = 0xfffffe001595d100, tqe_prev = 0xfffffe0087e9e220}, shadow_head = {lh_first = 0x0}, shadow_list = {le_next = 0x0, le_prev = 0xfffffe037b95f338}, memq = {tqh_first = 0x0, tqh_last = 0xfffffe0015a9e248}, rtree = {rt_root = 0x0, rt_flags = 0x0}, size = 0x0, generation = 0x1, ref_count = 0x0, shadow_count = 0x0, memattr = 0x6, type = 0x2, flags = 0x1000, pg_color = 0x1dcf, paging_in_progress = 0x0, resident_page_count = 0x0, backing_object = 0x0, backing_object_offset = 0x0, pager_object_list = {tqe_next = 0x0, tqe_prev = 0xffffffff81585178}, rvq = {lh_first = 0x0}, cache = {rt_root = 0x0, rt_flags = 0x0}, handle = 0xfffffe0255395c30, un_pager = {vnp = { vnp_size = 0x0, writemappings = 0x0}, devp = {devp_pglist = {tqh_first = 0x0, tqh_last = 0x0}, ops = 0xffffffff81334fe8, dev = 0xfffffe0015113400}, sgp = {sgp_pglist = {tqh_first = 0x0, tqh_last = 0x0}}, swp = {swp_tmpfs = 0x0, swp_bcount = 0x0}}, cred = 0x0, charge = 0x0} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/amd64/amd64/pmap.c =================================================================== --- /usr/src/sys/amd64/amd64/pmap.c (revision 254514) +++ /usr/src/sys/amd64/amd64/pmap.c (working copy) @@ -232,7 +232,6 @@ u_int64_t KPML4phys; /* phys addr of kernel level static u_int64_t DMPDphys; /* phys addr of direct mapped level 2 */ static u_int64_t DMPDPphys; /* phys addr of direct mapped level 3 */ -static int ndmpdpphys; /* number of DMPDPphys pages */ static struct rwlock_padalign pvh_global_lock; @@ -540,18 +539,7 @@ create_pagetables(vm_paddr_t *firstaddr) ndmpdp = (ptoa(Maxmem) + NBPDP - 1) >> PDPSHIFT; if (ndmpdp < 4) /* Minimum 4GB of dirmap */ ndmpdp = 4; - ndmpdpphys = howmany(ndmpdp, NPDPEPG); - if (ndmpdpphys > NDMPML4E) { - /* - * Each NDMPML4E allows 512 GB, so limit to that, - * and then readjust ndmpdp and ndmpdpphys. - */ - printf("NDMPML4E limits system to %d GB\n", NDMPML4E * 512); - Maxmem = atop(NDMPML4E * NBPML4); - ndmpdpphys = NDMPML4E; - ndmpdp = NDMPML4E * NPDEPG; - } - DMPDPphys = allocpages(firstaddr, ndmpdpphys); + DMPDPphys = allocpages(firstaddr, NDMPML4E); ndm1g = 0; if ((amd_feature & AMDID_PAGE1GB) != 0) ndm1g = ptoa(Maxmem) >> PDPSHIFT; @@ -568,10 +556,6 @@ create_pagetables(vm_paddr_t *firstaddr) * bootstrap. We defer this until after all memory-size dependent * allocations are done (e.g. direct map), so that we don't have to * build in too much slop in our estimate. - * - * Note that when NKPML4E > 1, we have an empty page underneath - * all but the KPML4I'th one, so we need NKPML4E-1 extra (zeroed) - * pages. (pmap_enter requires a PD page to exist for each KPML4E.) */ nkpt_init(*firstaddr); nkpdpe = NKPDPE(nkpt); @@ -596,8 +580,8 @@ create_pagetables(vm_paddr_t *firstaddr) for (i = 0; (i << PDRSHIFT) < *firstaddr; i++) pd_p[i] = (i << PDRSHIFT) | PG_RW | PG_V | PG_PS | PG_G; - /* And connect up the PD to the PDP (leaving room for L4 pages) */ - pdp_p = (pdp_entry_t *)(KPDPphys + ptoa(KPML4I - KPML4BASE)); + /* And connect up the PD to the PDP */ + pdp_p = (pdp_entry_t *)KPDPphys; for (i = 0; i < nkpdpe; i++) pdp_p[i + KPDPI] = (KPDphys + ptoa(i)) | PG_RW | PG_V | PG_U; @@ -634,16 +618,14 @@ create_pagetables(vm_paddr_t *firstaddr) p4_p[PML4PML4I] |= PG_RW | PG_V | PG_U; /* Connect the Direct Map slot(s) up to the PML4. */ - for (i = 0; i < ndmpdpphys; i++) { + for (i = 0; i < NDMPML4E; i++) { p4_p[DMPML4I + i] = DMPDPphys + ptoa(i); p4_p[DMPML4I + i] |= PG_RW | PG_V | PG_U; } - /* Connect the KVA slots up to the PML4 */ - for (i = 0; i < NKPML4E; i++) { - p4_p[KPML4BASE + i] = KPDPphys + ptoa(i); - p4_p[KPML4BASE + i] |= PG_RW | PG_V | PG_U; - } + /* Connect the KVA slot up to the PML4 */ + p4_p[KPML4I] = KPDPphys; + p4_p[KPML4I] |= PG_RW | PG_V | PG_U; } /* @@ -1687,8 +1669,6 @@ pmap_pinit(pmap_t pmap) vm_page_t pml4pg; int i; - PMAP_LOCK_INIT(pmap); - /* * allocate the page directory page */ @@ -1702,11 +1682,8 @@ pmap_pinit(pmap_t pmap) pagezero(pmap->pm_pml4); /* Wire in kernel global address entries. */ - for (i = 0; i < NKPML4E; i++) { - pmap->pm_pml4[KPML4BASE + i] = (KPDPphys + (i << PAGE_SHIFT)) | - PG_RW | PG_V | PG_U; - } - for (i = 0; i < ndmpdpphys; i++) { + pmap->pm_pml4[KPML4I] = KPDPphys | PG_RW | PG_V | PG_U; + for (i = 0; i < NDMPML4E; i++) { pmap->pm_pml4[DMPML4I + i] = (DMPDPphys + (i << PAGE_SHIFT)) | PG_RW | PG_V | PG_U; } @@ -1959,14 +1936,10 @@ pmap_release(pmap_t pmap) KASSERT(vm_radix_is_empty(&pmap->pm_root), ("pmap_release: pmap has reserved page table page(s)")); - rw_wlock(&pvh_global_lock); - rw_wunlock(&pvh_global_lock); - m = PHYS_TO_VM_PAGE(pmap->pm_pml4[PML4PML4I] & PG_FRAME); - for (i = 0; i < NKPML4E; i++) /* KVA */ - pmap->pm_pml4[KPML4BASE + i] = 0; - for (i = 0; i < ndmpdpphys; i++)/* Direct Map */ + pmap->pm_pml4[KPML4I] = 0; /* KVA */ + for (i = 0; i < NDMPML4E; i++) /* Direct Map */ pmap->pm_pml4[DMPML4I + i] = 0; pmap->pm_pml4[PML4PML4I] = 0; /* Recursive Mapping */ @@ -1973,7 +1946,6 @@ pmap_release(pmap_t pmap) m->wire_count--; atomic_subtract_int(&cnt.v_wire_count, 1); vm_page_free_zero(m); - PMAP_LOCK_DESTROY(pmap); } static int @@ -4765,10 +4737,12 @@ pmap_remove_write(vm_page_t m) { struct md_page *pvh; pmap_t pmap; + struct rwlock *lock; pv_entry_t next_pv, pv; pd_entry_t *pde; pt_entry_t oldpte, *pte; vm_offset_t va; + int pvh_gen, md_gen; KASSERT((m->oflags & VPO_UNMANAGED) == 0, ("pmap_remove_write: page %p is not managed", m)); @@ -4781,13 +4755,26 @@ pmap_remove_write(vm_page_t m) VM_OBJECT_ASSERT_WLOCKED(m->object); if (!vm_page_xbusied(m) && (m->aflags & PGA_WRITEABLE) == 0) return; - rw_wlock(&pvh_global_lock); + rw_rlock(&pvh_global_lock); + lock = VM_PAGE_TO_PV_LIST_LOCK(m); + pvh = pa_to_pvh(VM_PAGE_TO_PHYS(m)); +retry_pv_loop: + rw_wlock(lock); if ((m->flags & PG_FICTITIOUS) != 0) goto small_mappings; - pvh = pa_to_pvh(VM_PAGE_TO_PHYS(m)); TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_next, next_pv) { pmap = PV_PMAP(pv); - PMAP_LOCK(pmap); + if (!PMAP_TRYLOCK(pmap)) { + pvh_gen = pvh->pv_gen; + rw_wunlock(lock); + PMAP_LOCK(pmap); + rw_wlock(lock); + if (pvh_gen != pvh->pv_gen) { + PMAP_UNLOCK(pmap); + rw_wunlock(lock); + goto retry_pv_loop; + } + } va = pv->pv_va; pde = pmap_pde(pmap, va); if ((*pde & PG_RW) != 0) @@ -4797,7 +4784,19 @@ pmap_remove_write(vm_page_t m) small_mappings: TAILQ_FOREACH(pv, &m->md.pv_list, pv_next) { pmap = PV_PMAP(pv); - PMAP_LOCK(pmap); + if (!PMAP_TRYLOCK(pmap)) { + pvh_gen = pvh->pv_gen; + md_gen = m->md.pv_gen; + rw_wunlock(lock); + PMAP_LOCK(pmap); + rw_wlock(lock); + if (pvh_gen != pvh->pv_gen || + md_gen != m->md.pv_gen) { + PMAP_UNLOCK(pmap); + rw_wunlock(lock); + goto retry_pv_loop; + } + } pde = pmap_pde(pmap, pv->pv_va); KASSERT((*pde & PG_PS) == 0, ("pmap_remove_write: found a 2mpage in page %p's pv list", @@ -4815,8 +4814,9 @@ retry: } PMAP_UNLOCK(pmap); } + rw_wunlock(lock); vm_page_aflag_clear(m, PGA_WRITEABLE); - rw_wunlock(&pvh_global_lock); + rw_runlock(&pvh_global_lock); } /* Index: /usr/src/sys/amd64/include/pmap.h =================================================================== --- /usr/src/sys/amd64/include/pmap.h (revision 254514) +++ /usr/src/sys/amd64/include/pmap.h (working copy) @@ -113,13 +113,7 @@ ((unsigned long)(l2) << PDRSHIFT) | \ ((unsigned long)(l1) << PAGE_SHIFT)) -/* - * Number of kernel PML4 slots. Can be anywhere from 1 to 64 or so, - * but setting it larger than NDMPML4E makes no sense. - * - * Each slot provides .5 TB of kernel virtual space. - */ -#define NKPML4E 4 +#define NKPML4E 1 /* number of kernel PML4 slots */ #define NUPML4E (NPML4EPG/2) /* number of userland PML4 pages */ #define NUPDPE (NUPML4E*NPDPEPG)/* number of userland PDP pages */ @@ -126,36 +120,21 @@ #define NUPDE (NUPDPE*NPDEPG) /* number of userland PD entries */ /* - * NDMPML4E is the maximum number of PML4 entries that will be - * used to implement the direct map. It must be a power of two, - * and should generally exceed NKPML4E. The maximum possible - * value is 64; using 128 will make the direct map intrude into - * the recursive page table map. + * NDMPML4E is the number of PML4 entries that are used to implement the + * direct map. It must be a power of two. */ -#define NDMPML4E 8 +#define NDMPML4E 2 /* - * These values control the layout of virtual memory. The starting address + * The *PDI values control the layout of virtual memory. The starting address * of the direct map, which is controlled by DMPML4I, must be a multiple of * its size. (See the PHYS_TO_DMAP() and DMAP_TO_PHYS() macros.) - * - * Note: KPML4I is the index of the (single) level 4 page that maps - * the KVA that holds KERNBASE, while KPML4BASE is the index of the - * first level 4 page that maps VM_MIN_KERNEL_ADDRESS. If NKPML4E - * is 1, these are the same, otherwise KPML4BASE < KPML4I and extra - * level 4 PDEs are needed to map from VM_MIN_KERNEL_ADDRESS up to - * KERNBASE. - * - * (KPML4I combines with KPDPI to choose where KERNBASE starts. - * Or, in other words, KPML4I provides bits 39..47 of KERNBASE, - * and KPDPI provides bits 30..38.) */ #define PML4PML4I (NPML4EPG/2) /* Index of recursive pml4 mapping */ -#define KPML4BASE (NPML4EPG-NKPML4E) /* KVM at highest addresses */ -#define DMPML4I rounddown(KPML4BASE-NDMPML4E, NDMPML4E) /* Below KVM */ +#define KPML4I (NPML4EPG-1) /* Top 512GB for KVM */ +#define DMPML4I rounddown(KPML4I - NDMPML4E, NDMPML4E) /* Below KVM */ -#define KPML4I (NPML4EPG-1) #define KPDPI (NPDPEPG-2) /* kernbase at -2GB */ /* Index: /usr/src/sys/amd64/include/vmparam.h =================================================================== --- /usr/src/sys/amd64/include/vmparam.h (revision 254514) +++ /usr/src/sys/amd64/include/vmparam.h (working copy) @@ -145,10 +145,10 @@ * 0x0000000000000000 - 0x00007fffffffffff user map * 0x0000800000000000 - 0xffff7fffffffffff does not exist (hole) * 0xffff800000000000 - 0xffff804020100fff recursive page table (512GB slot) - * 0xffff804020101000 - 0xfffff7ffffffffff unused - * 0xfffff80000000000 - 0xfffffbffffffffff 4TB direct map - * 0xfffffc0000000000 - 0xfffffdffffffffff unused - * 0xfffffe0000000000 - 0xffffffffffffffff 2TB kernel map + * 0xffff804020101000 - 0xfffffdffffffffff unused + * 0xfffffe0000000000 - 0xfffffeffffffffff 1TB direct map + * 0xffffff0000000000 - 0xffffff7fffffffff unused + * 0xffffff8000000000 - 0xffffffffffffffff 512GB kernel map * * Within the kernel map: * @@ -155,9 +155,8 @@ * 0xffffffff80000000 KERNBASE */ -#define VM_MIN_KERNEL_ADDRESS KVADDR(KPML4BASE, 0, 0, 0) -#define VM_MAX_KERNEL_ADDRESS KVADDR(KPML4BASE + NKPML4E - 1, \ - NPDPEPG-1, NPDEPG-1, NPTEPG-1) +#define VM_MAX_KERNEL_ADDRESS KVADDR(KPML4I, NPDPEPG-1, NPDEPG-1, NPTEPG-1) +#define VM_MIN_KERNEL_ADDRESS KVADDR(KPML4I, NPDPEPG-512, 0, 0) #define DMAP_MIN_ADDRESS KVADDR(DMPML4I, 0, 0, 0) #define DMAP_MAX_ADDRESS KVADDR(DMPML4I + NDMPML4E, 0, 0, 0) Index: /usr/src/sys/arm/arm/pmap-v6.c =================================================================== --- /usr/src/sys/arm/arm/pmap-v6.c (revision 254514) +++ /usr/src/sys/arm/arm/pmap-v6.c (working copy) @@ -1844,7 +1844,6 @@ pmap_release(pmap_t pmap) } pmap_free_l1(pmap); - PMAP_LOCK_DESTROY(pmap); dprintf("pmap_release()\n"); } @@ -3249,7 +3248,6 @@ pmap_pinit(pmap_t pmap) { PDEBUG(1, printf("pmap_pinit: pmap = %08x\n", (uint32_t) pmap)); - PMAP_LOCK_INIT(pmap); pmap_alloc_l1(pmap); bzero(pmap->pm_l2, sizeof(pmap->pm_l2)); Index: /usr/src/sys/arm/arm/pmap.c =================================================================== --- /usr/src/sys/arm/arm/pmap.c (revision 254514) +++ /usr/src/sys/arm/arm/pmap.c (working copy) @@ -2479,7 +2479,6 @@ pmap_release(pmap_t pmap) } pmap_free_l1(pmap); - PMAP_LOCK_DESTROY(pmap); dprintf("pmap_release()\n"); } @@ -3819,7 +3818,6 @@ pmap_pinit(pmap_t pmap) { PDEBUG(1, printf("pmap_pinit: pmap = %08x\n", (uint32_t) pmap)); - PMAP_LOCK_INIT(pmap); pmap_alloc_l1(pmap); bzero(pmap->pm_l2, sizeof(pmap->pm_l2)); Index: /usr/src/sys/i386/i386/pmap.c =================================================================== --- /usr/src/sys/i386/i386/pmap.c (revision 254514) +++ /usr/src/sys/i386/i386/pmap.c (working copy) @@ -1738,8 +1738,6 @@ pmap_pinit(pmap_t pmap) vm_paddr_t pa; int i; - PMAP_LOCK_INIT(pmap); - /* * No need to allocate page table space yet but we do need a valid * page directory table. @@ -2051,7 +2049,6 @@ pmap_release(pmap_t pmap) atomic_subtract_int(&cnt.v_wire_count, 1); vm_page_free_zero(m); } - PMAP_LOCK_DESTROY(pmap); } static int Index: /usr/src/sys/i386/xen/pmap.c =================================================================== --- /usr/src/sys/i386/xen/pmap.c (revision 254514) +++ /usr/src/sys/i386/xen/pmap.c (working copy) @@ -1452,8 +1452,6 @@ pmap_pinit(pmap_t pmap) mtx_lock(&createdelete_lock); #endif - PMAP_LOCK_INIT(pmap); - /* * No need to allocate page table space yet but we do need a valid * page directory table. @@ -1821,7 +1819,6 @@ pmap_release(pmap_t pmap) #ifdef PAE pmap_qremove((vm_offset_t)pmap->pm_pdpt, 1); #endif - PMAP_LOCK_DESTROY(pmap); #ifdef HAMFISTED_LOCKING mtx_unlock(&createdelete_lock); Index: /usr/src/sys/ia64/ia64/pmap.c =================================================================== --- /usr/src/sys/ia64/ia64/pmap.c (revision 254514) +++ /usr/src/sys/ia64/ia64/pmap.c (working copy) @@ -622,6 +622,8 @@ pmap_free_rid(uint32_t rid) void pmap_pinit0(struct pmap *pmap) { + + PMAP_LOCK_INIT(pmap); /* kernel_pmap is the same as any other pmap. */ pmap_pinit(pmap); } @@ -635,7 +637,6 @@ pmap_pinit(struct pmap *pmap) { int i; - PMAP_LOCK_INIT(pmap); for (i = 0; i < IA64_VM_MINKERN_REGION; i++) pmap->pm_rid[i] = pmap_allocate_rid(); TAILQ_INIT(&pmap->pm_pvchunk); @@ -660,7 +661,6 @@ pmap_release(pmap_t pmap) for (i = 0; i < IA64_VM_MINKERN_REGION; i++) if (pmap->pm_rid[i]) pmap_free_rid(pmap->pm_rid[i]); - PMAP_LOCK_DESTROY(pmap); } /* Index: /usr/src/sys/kern/subr_vmem.c =================================================================== --- /usr/src/sys/kern/subr_vmem.c (revision 254514) +++ /usr/src/sys/kern/subr_vmem.c (working copy) @@ -54,6 +54,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include @@ -167,6 +168,9 @@ struct vmem_btag { #define BT_END(bt) ((bt)->bt_start + (bt)->bt_size - 1) #if defined(DIAGNOSTIC) +static int do_vmem_check = 1; +SYSCTL_INT(_debug, OID_AUTO, do_vmem_check, CTLFLAG_RW, + &do_vmem_check, 0, "Enable vmem check"); static void vmem_check(vmem_t *); #endif @@ -720,9 +724,11 @@ vmem_periodic(void *unused, int pending) LIST_FOREACH(vm, &vmem_list, vm_alllist) { #ifdef DIAGNOSTIC /* Convenient time to verify vmem state. */ - VMEM_LOCK(vm); - vmem_check(vm); - VMEM_UNLOCK(vm); + if (do_vmem_check == 1) { + VMEM_LOCK(vm); + vmem_check(vm); + VMEM_UNLOCK(vm); + } #endif desired = 1 << flsl(vm->vm_nbusytag); desired = MIN(MAX(desired, VMEM_HASHSIZE_MIN), Index: /usr/src/sys/kern/vfs_bio.c =================================================================== --- /usr/src/sys/kern/vfs_bio.c (revision 254514) +++ /usr/src/sys/kern/vfs_bio.c (working copy) @@ -108,7 +108,6 @@ static void vm_hold_load_pages(struct buf *bp, vm_ static void vfs_page_set_valid(struct buf *bp, vm_ooffset_t off, vm_page_t m); static void vfs_page_set_validclean(struct buf *bp, vm_ooffset_t off, vm_page_t m); -static void vfs_drain_busy_pages(struct buf *bp); static void vfs_clean_pages_dirty_buf(struct buf *bp); static void vfs_setdirty_locked_object(struct buf *bp); static void vfs_vmio_release(struct buf *bp); @@ -3983,7 +3982,7 @@ vfs_page_set_validclean(struct buf *bp, vm_ooffset * Ensure that all buffer pages are not exclusive busied. If any page is * exclusive busy, drain it. */ -static void +void vfs_drain_busy_pages(struct buf *bp) { vm_page_t m; Index: /usr/src/sys/kern/vfs_cluster.c =================================================================== --- /usr/src/sys/kern/vfs_cluster.c (revision 254514) +++ /usr/src/sys/kern/vfs_cluster.c (working copy) @@ -315,7 +315,7 @@ cluster_rbuild(struct vnode *vp, u_quad_t filesize daddr_t bn; off_t off; long tinc, tsize; - int i, inc, j, toff; + int i, inc, j, k, toff; KASSERT(size == vp->v_mount->mnt_stat.f_iosize, ("cluster_rbuild: size %ld != f_iosize %jd\n", @@ -378,7 +378,15 @@ cluster_rbuild(struct vnode *vp, u_quad_t filesize inc = btodb(size); bo = &vp->v_bufobj; for (bn = blkno, i = 0; i < run; ++i, bn += inc) { - if (i != 0) { + if (i == 0) { + VM_OBJECT_WLOCK(tbp->b_bufobj->bo_object); + vfs_drain_busy_pages(tbp); + vm_object_pip_add(tbp->b_bufobj->bo_object, + tbp->b_npages); + for (k = 0; k < tbp->b_npages; k++) + vm_page_sbusy(tbp->b_pages[k]); + VM_OBJECT_WUNLOCK(tbp->b_bufobj->bo_object); + } else { if ((bp->b_npages * PAGE_SIZE) + round_page(size) > vp->v_mount->mnt_iosize_max) { break; @@ -424,14 +432,23 @@ cluster_rbuild(struct vnode *vp, u_quad_t filesize if ((tbp->b_pages[j]->valid & vm_page_bits(toff, tinc)) != 0) break; + if (vm_page_xbusied(tbp->b_pages[j])) + break; + vm_object_pip_add(tbp->b_bufobj->bo_object, 1); + vm_page_sbusy(tbp->b_pages[j]); off += tinc; tsize -= tinc; } - VM_OBJECT_WUNLOCK(tbp->b_bufobj->bo_object); if (tsize > 0) { +clean_sbusy: + vm_object_pip_add(tbp->b_bufobj->bo_object, -j); + for (k = 0; k < j; k++) + vm_page_sunbusy(tbp->b_pages[k]); + VM_OBJECT_WUNLOCK(tbp->b_bufobj->bo_object); bqrelse(tbp); break; } + VM_OBJECT_WUNLOCK(tbp->b_bufobj->bo_object); /* * Set a read-ahead mark as appropriate @@ -451,8 +468,8 @@ cluster_rbuild(struct vnode *vp, u_quad_t filesize if (tbp->b_blkno == tbp->b_lblkno) { tbp->b_blkno = bn; } else if (tbp->b_blkno != bn) { - brelse(tbp); - break; + VM_OBJECT_WLOCK(tbp->b_bufobj->bo_object); + goto clean_sbusy; } } /* @@ -466,10 +483,8 @@ cluster_rbuild(struct vnode *vp, u_quad_t filesize for (j = 0; j < tbp->b_npages; j += 1) { vm_page_t m; m = tbp->b_pages[j]; - vm_page_sbusy(m); - vm_object_pip_add(m->object, 1); if ((bp->b_npages == 0) || - (bp->b_pages[bp->b_npages-1] != m)) { + (bp->b_pages[bp->b_npages-1] != m)) { bp->b_pages[bp->b_npages] = m; bp->b_npages++; } @@ -944,7 +959,9 @@ cluster_wbuild(struct vnode *vp, long size, daddr_ vm_page_t m; VM_OBJECT_WLOCK(tbp->b_bufobj->bo_object); - if (i != 0) { /* if not first buffer */ + if (i == 0) { + vfs_drain_busy_pages(tbp); + } else { /* if not first buffer */ for (j = 0; j < tbp->b_npages; j += 1) { m = tbp->b_pages[j]; if (vm_page_xbusied(m)) { Index: /usr/src/sys/mips/mips/pmap.c =================================================================== --- /usr/src/sys/mips/mips/pmap.c (revision 254514) +++ /usr/src/sys/mips/mips/pmap.c (working copy) @@ -1070,8 +1070,6 @@ pmap_pinit(pmap_t pmap) vm_page_t ptdpg; int i; - PMAP_LOCK_INIT(pmap); - /* * allocate the page directory page */ @@ -1231,7 +1229,6 @@ pmap_release(pmap_t pmap) ptdpg->wire_count--; atomic_subtract_int(&cnt.v_wire_count, 1); vm_page_free_zero(ptdpg); - PMAP_LOCK_DESTROY(pmap); } /* Index: /usr/src/sys/powerpc/aim/mmu_oea.c =================================================================== --- /usr/src/sys/powerpc/aim/mmu_oea.c (revision 254514) +++ /usr/src/sys/powerpc/aim/mmu_oea.c (working copy) @@ -1655,7 +1655,6 @@ moea_pinit(mmu_t mmu, pmap_t pmap) u_int entropy; KASSERT((int)pmap < VM_MIN_KERNEL_ADDRESS, ("moea_pinit: virt pmap")); - PMAP_LOCK_INIT(pmap); RB_INIT(&pmap->pmap_pvo); entropy = 0; @@ -1719,6 +1718,7 @@ void moea_pinit0(mmu_t mmu, pmap_t pm) { + PMAP_LOCK_INIT(pm); moea_pinit(mmu, pm); bzero(&pm->pm_stats, sizeof(pm->pm_stats)); } @@ -1824,7 +1824,6 @@ moea_release(mmu_t mmu, pmap_t pmap) idx /= VSID_NBPW; moea_vsid_bitmap[idx] &= ~mask; mtx_unlock(&moea_vsid_mutex); - PMAP_LOCK_DESTROY(pmap); } /* Index: /usr/src/sys/powerpc/aim/mmu_oea64.c =================================================================== --- /usr/src/sys/powerpc/aim/mmu_oea64.c (revision 254514) +++ /usr/src/sys/powerpc/aim/mmu_oea64.c (working copy) @@ -1879,7 +1879,7 @@ moea64_get_unique_vsid(void) { void moea64_pinit(mmu_t mmu, pmap_t pmap) { - PMAP_LOCK_INIT(pmap); + RB_INIT(&pmap->pmap_pvo); pmap->pm_slb_tree_root = slb_alloc_tree(); @@ -1893,7 +1893,6 @@ moea64_pinit(mmu_t mmu, pmap_t pmap) int i; uint32_t hash; - PMAP_LOCK_INIT(pmap); RB_INIT(&pmap->pmap_pvo); if (pmap_bootstrapped) @@ -1920,6 +1919,8 @@ moea64_pinit(mmu_t mmu, pmap_t pmap) void moea64_pinit0(mmu_t mmu, pmap_t pm) { + + PMAP_LOCK_INIT(pm); moea64_pinit(mmu, pm); bzero(&pm->pm_stats, sizeof(pm->pm_stats)); } @@ -2074,8 +2075,6 @@ moea64_release(mmu_t mmu, pmap_t pmap) moea64_release_vsid(VSID_TO_HASH(pmap->pm_sr[0])); #endif - - PMAP_LOCK_DESTROY(pmap); } /* Index: /usr/src/sys/powerpc/booke/pmap.c =================================================================== --- /usr/src/sys/powerpc/booke/pmap.c (revision 254514) +++ /usr/src/sys/powerpc/booke/pmap.c (working copy) @@ -1477,6 +1477,7 @@ static void mmu_booke_pinit0(mmu_t mmu, pmap_t pmap) { + PMAP_LOCK_INIT(pmap); mmu_booke_pinit(mmu, pmap); PCPU_SET(curpmap, pmap); } @@ -1495,7 +1496,6 @@ mmu_booke_pinit(mmu_t mmu, pmap_t pmap) KASSERT((pmap != kernel_pmap), ("pmap_pinit: initializing kernel_pmap")); - PMAP_LOCK_INIT(pmap); for (i = 0; i < MAXCPU; i++) pmap->pm_tid[i] = TID_NONE; CPU_ZERO(&kernel_pmap->pm_active); @@ -1516,8 +1516,6 @@ mmu_booke_release(mmu_t mmu, pmap_t pmap) KASSERT(pmap->pm_stats.resident_count == 0, ("pmap_release: pmap resident count %ld != 0", pmap->pm_stats.resident_count)); - - PMAP_LOCK_DESTROY(pmap); } /* Index: /usr/src/sys/sparc64/sparc64/pmap.c =================================================================== --- /usr/src/sys/sparc64/sparc64/pmap.c (revision 254514) +++ /usr/src/sys/sparc64/sparc64/pmap.c (working copy) @@ -1204,8 +1204,6 @@ pmap_pinit(pmap_t pm) vm_page_t m; int i; - PMAP_LOCK_INIT(pm); - /* * Allocate KVA space for the TSB. */ @@ -1299,7 +1297,6 @@ pmap_release(pmap_t pm) vm_page_free_zero(m); } VM_OBJECT_WUNLOCK(obj); - PMAP_LOCK_DESTROY(pm); } /* Index: /usr/src/sys/sys/buf.h =================================================================== --- /usr/src/sys/sys/buf.h (revision 254514) +++ /usr/src/sys/sys/buf.h (working copy) @@ -501,6 +501,7 @@ void bufstrategy(struct bufobj *, struct buf *); void brelse(struct buf *); void bqrelse(struct buf *); int vfs_bio_awrite(struct buf *); +void vfs_drain_busy_pages(struct buf *bp); struct buf * getpbuf(int *); struct buf *incore(struct bufobj *, daddr_t); struct buf *gbincore(struct bufobj *, daddr_t); Index: /usr/src/sys/vm/vm_map.c =================================================================== --- /usr/src/sys/vm/vm_map.c (revision 254514) +++ /usr/src/sys/vm/vm_map.c (working copy) @@ -226,6 +226,7 @@ vmspace_zinit(void *mem, int size, int flags) vm->vm_map.pmap = NULL; (void)vm_map_zinit(&vm->vm_map, sizeof(vm->vm_map), flags); + PMAP_LOCK_INIT(vmspace_pmap(vm)); return (0); } -- Test scenario: wip/holdcnt0c.sh