GENERIC HEAD from 2013-06-05 01:22:59 UTC, r251406M, vmcore.16 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r251406M: Wed Jun 5 12:30:49 CEST 2013 pho@x4.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 gcc version 4.2.1 20070831 patched [FreeBSD] WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 0x10 Model = 0x2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 7831900160 (7469 MB) : Trying to mount root from ufs:/dev/ufs/root [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ufs/root: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ufs/root: clean, 433332 free (900 frags, 54054 blocks, 0.1% fragmentation) /dev/ufs/home: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ufs/home: clean, 797851 free (8347 frags, 98688 blocks, 0.8% fragmentation) /dev/ufs/usr: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ufs/usr: clean, 4515821 free (211845 frags, 537997 blocks, 2.1% fragmentation) /dev/label/tmp: clean, 47941403 free (7563 frags, 5991730 blocks, 0.0% fragmentation) /dev/ufs/var: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ufs/var: clean, 8820254 free (55390 frags, 1095608 blocks, 0.2% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet 127.0.0.1 netmask 0xff000000 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 tentative scopeid 0x1 nd6 options=29 media: Ethernet autoselect (none) status: no carrier Starting devd. add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat/pkg /usr/local/lib/qt4 32-bit compatibility ldconfig path: /usr/lib32 Creating and/or trimming log files. Starting syslogd. savecore: unable to read from bounds, using 0 savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device Jun 5 12:47:34 x4 savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device savecore: unable to read from bounds, using 0 No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xffffff81e8e7c2e8 bufwait (bufwait) @ kern/vfs_bio.c:3028 2nd 0xfffffe001a77dc00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff82328673d0 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff8232867490 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff82328674b0 witness_checkorder() at witness_checkorder+0x8a1/frame 0xffffff8232867550 _sx_xlock() at _sx_xlock+0x74/frame 0xffffff8232867580 ufsdirhash_acquire() at ufsdirhash_acquire+0x44/frame 0xffffff82328675a0 ufsdirhash_add() at ufsdirhash_add+0x19/frame 0xffffff82328675d0 ufs_direnter() at ufs_direnter+0x6c1/frame 0xffffff82328676a0 ufs_mkdir() at ufs_mkdir+0x50e/frame 0xffffff8232867890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0xc9/frame 0xffffff82328678c0 kern_mkdirat() at kern_mkdirat+0x230/frame 0xffffff8232867ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8232867bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8232867bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80092679a, rsp = 0x7fffffffd788, rbp = 0x801006050 --- Clearing /tmp (X related). Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: watchdogd. Starting default moused. Starting inetd. Wed Jun 5 12:47:38 CEST 2013 FreeBSD/amd64 (x4.osted.lan) (console) login: Jun 5 13:19:53 x4 su: pho to root on /dev/pts/0 lock order reversal: 1st 0xfffffe001ac352d8 ufs (ufs) @ kern/vfs_mount.c:1236 2nd 0xfffffe01104af068 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1411 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff82329c54b0 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff82329c5570 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff82329c5590 witness_checkorder() at witness_checkorder+0x8a1/frame 0xffffff82329c5630 __lockmgr_args() at __lockmgr_args+0x38e/frame 0xffffff82329c5720 vop_stdlock() at vop_stdlock+0x39/frame 0xffffff82329c5740 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xab/frame 0xffffff82329c5770 _vn_lock() at _vn_lock+0x8e/frame 0xffffff82329c57f0 ffs_flushfiles() at ffs_flushfiles+0x114/frame 0xffffff82329c5870 softdep_flushfiles() at softdep_flushfiles+0x54/frame 0xffffff82329c58e0 ffs_unmount() at ffs_unmount+0x1d1/frame 0xffffff82329c5950 dounmount() at dounmount+0x372/frame 0xffffff82329c59d0 sys_unmount() at sys_unmount+0x38e/frame 0xffffff82329c5ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff82329c5bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff82329c5bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x80088523a, rsp = 0x7fffffffceb8, rbp = 0x801006ce8 --- 20130605 13:58:11 all (1/4): mlockall.sh 20130605 13:58:22 all (2/4): mlockall2.sh panic: Lock 0ɽþÿÿPËþÿÿ not exclusively locked @ ../../../vm/vm_page.c:900 cpuid = 0 KDB: enter: panic [ thread pid 3000 tid 101229 ] Stopped at kdb_enter+0x3b: movq $0,0xac2c72(%rip) db> run pho db:0:pho> bt Tracing pid 3000 tid 101229 td 0xfffffe01104d1490 kdb_enter() at kdb_enter+0x3b/frame 0xffffff8232a83520 vpanic() at vpanic+0xe1/frame 0xffffff8232a83560 panic() at panic+0x67/frame 0xffffff8232a83640 __rw_assert() at __rw_assert+0xd3/frame 0xffffff8232a83650 vm_page_remove() at vm_page_remove+0x3c/frame 0xffffff8232a83670 vm_page_free_toq() at vm_page_free_toq+0x6d/frame 0xffffff8232a83690 pmap_remove_pages() at pmap_remove_pages+0x682/frame 0xffffff8232a83740 vmspace_exit() at vmspace_exit+0x9a/frame 0xffffff8232a83770 exit1() at exit1+0x3e9/frame 0xffffff8232a83800 sigexit() at sigexit+0x8f/frame 0xffffff8232a83ac0 postsig() at postsig+0x417/frame 0xffffff8232a83bb0 ast() at ast+0x247/frame 0xffffff8232a83bf0 doreti_ast() at doreti_ast+0x1f/frame 0x6666666666666667 db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x5e8200 curthread = 0xfffffe01104d1490: pid 3000 "mlockall2" curpcb = 0xffffff8232a83cc0 fpcurthread = none idlethread = 0xfffffe0015485490: tid 100003 "idle: cpu0" curpmap = 0xfffffe001548a908 tssp = 0xffffffff815c8f80 commontssp = 0xffffffff815c8f80 rsp0 = 0xffffff8232a83cc0 gs32p = 0xffffffff815c70b8 ldt = 0xffffffff815c70f8 tss = 0xffffffff815c70e8 spin locks held: cpuid = 1 dynamic pcpu = 0xffffff807eec3200 curthread = 0xfffffe011021c920: pid 3011 "mlockall2" curpcb = 0xffffff82329b1cc0 fpcurthread = none idlethread = 0xfffffe0015485000: tid 100004 "idle: cpu1" curpmap = 0xfffffe011097e2c8 tssp = 0xffffffff815c8fe8 commontssp = 0xffffffff815c8fe8 rsp0 = 0xffffff82329b1cc0 gs32p = 0xffffffff815c7120 ldt = 0xffffffff815c7160 tss = 0xffffffff815c7150 spin locks held: cpuid = 2 dynamic pcpu = 0xffffff807eeca200 curthread = 0xfffffe011053a000: pid 2987 "mlockall2" curpcb = 0xffffff8232993cc0 fpcurthread = none idlethread = 0xfffffe0015491920: tid 100005 "idle: cpu2" curpmap = 0xfffffe01106e05e8 tssp = 0xffffffff815c9050 commontssp = 0xffffffff815c9050 rsp0 = 0xffffff8232993cc0 gs32p = 0xffffffff815c7188 ldt = 0xffffffff815c71c8 tss = 0xffffffff815c71b8 spin locks held: cpuid = 3 dynamic pcpu = 0xffffff807eed1200 curthread = 0xfffffe0110515920: pid 3010 "mlockall2" curpcb = 0xffffff82329accc0 fpcurthread = none idlethread = 0xfffffe0015491490: tid 100006 "idle: cpu3" curpmap = 0xfffffe011097e458 tssp = 0xffffffff815c90b8 commontssp = 0xffffffff815c90b8 rsp0 = 0xffffff82329accc0 gs32p = 0xffffffff815c71f0 ldt = 0xffffffff815c7230 tss = 0xffffffff815c7220 spin locks held: db:0:allpcpu> show alllocks Process 53790 (rm) thread 0xfffffe0110697490 (100282) exclusive lockmgr bufwait (bufwait) r = 0 (0xffffff81e8e22c58) locked @ vm/vm_pager.c:312 shared lockmgr ufs (ufs) r = 0 (0xfffffe001aa04068) locked @ kern/vfs_subr.c:2099 Process 3022 (mlockall2) thread 0xfffffe011021c000 (101017) exclusive rw vm object (vm object) r = 0 (0xfffffe01104c5780) locked @ vm/vm_object.c:511 Process 3020 (mlockall2) thread 0xfffffe0110508920 (101015) exclusive sleep mutex vm page (vm page) r = 0 (0xffffffff815bef80) locked @ vm/vm_object.c:749 exclusive rw vm object (vm object) r = 0 (0xfffffe0110689a50) locked @ vm/vm_object.c:511 Process 3019 (mlockall2) thread 0xfffffe001aefb490 (101013) shared sx vm map (user) (vm map (user)) r = 0 (0xfffffe011097d3a0) locked @ vm/vm_fault.c:815 Process 3017 (mlockall2) thread 0xfffffe011067a490 (101011) shared sx vm map (user) (vm map (user)) r = 0 (0xfffffe011097d6c0) locked @ vm/vm_fault.c:815 Process 3014 (mlockall2) thread 0xfffffe0110535920 (101005) exclusive rw vm object (vm object) r = 0 (0xfffffe01104f75a0) locked @ vm/vm_object.c:511 Process 3011 (mlockall2) thread 0xfffffe011021c920 (101001) exclusive rw pmap pv list (pmap pv list) r = 0 (0xffffffff815e4be0) locked @ amd64/amd64/pmap.c:4474 exclusive sleep mutex pmap (pmap) r = 0 (0xfffffe011097e2c8) locked @ amd64/amd64/pmap.c:4413 shared rw pmap pv global (pmap pv global) r = 0 (0xffffffff815e4a80) locked @ amd64/amd64/pmap.c:4412 Process 3010 (mlockall2) thread 0xfffffe0110515920 (101000) exclusive sleep mutex vm page free queue (vm page free queue) r = 0 (0xffffffff815bd000) locked @ vm/vm_page.c:1947 exclusive rw pmap pv list (pmap pv list) r = 0 (0xffffffff815e4f80) locked @ amd64/amd64/pmap.c:4474 exclusive sleep mutex pmap (pmap) r = 0 (0xfffffe011097e458) locked @ amd64/amd64/pmap.c:4413 shared rw pmap pv global (pmap pv global) r = 0 (0xffffffff815e4a80) locked @ amd64/amd64/pmap.c:4412 Process 3009 (mlockall2) thread 0xfffffe011045e000 (100998) exclusive sleep mutex vm page (vm page) r = 0 (0xffffffff815bf580) locked @ vm/vm_object.c:749 exclusive rw vm object (vm object) r = 0 (0xfffffe01104dad20) locked @ vm/vm_object.c:511 Process 3006 (mlockall2) thread 0xfffffe0110529000 (101148) exclusive rw vm object (vm object) r = 0 (0xfffffe01103baa50) locked @ vm/vm_object.c:511 Process 3003 (mlockall2) thread 0xfffffe01104ec000 (101215) exclusive rw vm object (vm object) r = 0 (0xfffffe0110460a50) locked @ vm/vm_object.c:511 Process 3002 (mlockall2) thread 0xfffffe011054a490 (100431) shared sx vm map (user) (vm map (user)) r = 0 (0xfffffe001a9633a0) locked @ vm/vm_fault.c:815 Process 3000 (mlockall2) thread 0xfffffe01104d1490 (101229) exclusive rw pmap pv list (pmap pv list) r = 0 (0xffffffff815e4ee0) locked @ amd64/amd64/pmap.c:4474 exclusive sleep mutex pmap (pmap) r = 0 (0xfffffe001548a908) locked @ amd64/amd64/pmap.c:4413 shared rw pmap pv global (pmap pv global) r = 0 (0xffffffff815e4a80) locked @ amd64/amd64/pmap.c:4412 Process 2999 (mlockall2) thread 0xfffffe01104d1000 (100389) exclusive sleep mutex vm page (vm page) r = 0 (0xffffffff815bf300) locked @ vm/vm_object.c:749 exclusive rw vm object (vm object) r = 0 (0xfffffe011070d0f0) locked @ vm/vm_object.c:511 Process 2998 (mlockall2) thread 0xfffffe011068e000 (100298) exclusive sleep mutex vm page (vm page) r = 0 (0xffffffff815bf680) locked @ vm/vm_object.c:749 exclusive rw vm object (vm object) r = 0 (0xfffffe011061dd20) locked @ vm/vm_object.c:511 Process 2994 (mlockall2) thread 0xfffffe011045e490 (100386) exclusive rw vm object (vm object) r = 0 (0xfffffe011072ea50) locked @ vm/vm_object.c:511 Process 2993 (mlockall2) thread 0xfffffe01104eb000 (101147) shared sx vm map (user) (vm map (user)) r = 0 (0xfffffe001ab0c530) locked @ vm/vm_fault.c:815 Process 2991 (mlockall2) thread 0xfffffe001a9fd000 (100780) shared sx vm map (user) (vm map (user)) r = 0 (0xfffffe001ab349e0) locked @ vm/vm_fault.c:815 Process 2990 (mlockall2) thread 0xfffffe001aa3f920 (101039) exclusive rw vm object (vm object) r = 0 (0xfffffe01104c5b40) locked @ vm/vm_object.c:511 Process 2989 (mlockall2) thread 0xfffffe01104ef000 (100969) shared sx vm map (user) (vm map (user)) r = 0 (0xfffffe01106e0b70) locked @ vm/vm_fault.c:815 Process 2988 (mlockall2) thread 0xfffffe01104ef920 (100632) exclusive rw vm object (vm object) r = 0 (0xfffffe0110709000) locked @ vm/vm_object.c:511 Process 2987 (mlockall2) thread 0xfffffe011053a000 (100993) exclusive sleep mutex pmap (pmap) r = 0 (0xfffffe01106e05e8) locked @ amd64/amd64/pmap.c:4413 shared rw pmap pv global (pmap pv global) r = 0 (0xffffffff815e4a80) locked @ amd64/amd64/pmap.c:4412 Process 2985 (mlockall2) thread 0xfffffe001aefa000 (100882) shared sx vm map (user) (vm map (user)) r = 0 (0xfffffe011005c6c0) locked @ vm/vm_fault.c:815 Process 5 (pagedaemon) thread 0xfffffe001591f490 (100068) exclusive rw vm object (vm object) r = 0 (0xfffffe01104c4c30) locked @ vm/vm_pageout.c:967 exclusive sleep mutex vm page (vm page) r = 0 (0xffffffff815bdc00) locked @ vm/vm_pageout.c:311 Process 13 (geom) thread 0xfffffe00154a3490 (100014) exclusive rw vm object (vm object) r = 0 (0xfffffe01104bfe10) locked @ vm/swap_pager.c:1502 db:0:alllocks> show lockedvnods Locked vnodes 0xfffffe001aa04000: tag ufs, type VREG usecount 4, writecount 0, refcount 5 mountedhere 0 flags (VV_TEXT|VI_ACTIVE) v_object 0xfffffe001aa9d780 ref 2 pages 4 lock type ufs: SHARED (count 1) #0 0xffffffff808f266a at __lockmgr_args+0xdba #1 0xffffffff80b6d95b at ffs_lock+0x9b #2 0xffffffff80d58a3b at VOP_LOCK1_APV+0xab #3 0xffffffff809c612e at _vn_lock+0x8e #4 0xffffffff809b95e3 at vget+0x63 #5 0xffffffff80b8c43d at vm_fault_hold+0xb4d #6 0xffffffff80b8d953 at vm_fault+0x73 #7 0xffffffff80cb9e64 at trap_pfault+0x1b4 #8 0xffffffff80cba664 at trap+0x604 #9 0xffffffff80ca3033 at calltrap+0x8 ino 94249, on dev ufs/root db:0:lockedvnods> show mount 0xfffffe001a8d8b58 /dev/ufs/root on / (ufs) 0xfffffe001a8d9000 devfs on /dev (devfs) 0xfffffe001aaa1790 /dev/ufs/home on /home (ufs) 0xfffffe001aaa13c8 /dev/label/tmp on /tmp (ufs) 0xfffffe001aaa1000 /dev/ufs/usr on /usr (ufs) 0xfffffe001a8d9b58 /dev/ufs/var on /var (ufs) 0xfffffe001a8d9790 procfs on /proc (procfs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 53790 2969 2650 0 DL+ vnread 0xffffff81e8e22bd0 rm 3022 1 2650 0 LE+ *vm page 0xfffffe01104c0840 mlockall2 3021 1 2650 0 DL+ swread 0xfffffe02166709e8 mlockall2 3020 1 2650 0 LE+ *pmap pv 0xfffffe00151f36c0 mlockall2 3019 1 2650 0 LL+ *pmap pv 0xfffffe00151f36c0 mlockall2 3018 1 2650 0 DL+ swread 0xfffffe021668f988 mlockall2 3017 1 2650 0 LL+ *pmap pv 0xfffffe00151f36c0 mlockall2 3016 1 2650 0 DL+ swread 0xfffffe021622a968 mlockall2 3015 1 2650 0 DL+ swread 0xfffffe02165f3f38 mlockall2 3014 1 2650 0 LE+ *vm page 0xfffffe01104c0840 mlockall2 3013 1 2650 0 DL+ swread 0xfffffe021622bce8 mlockall2 3012 1 2650 0 DL+ swread 0xfffffe02165fbd28 mlockall2 3011 1 2650 0 RE+ CPU 1 mlockall2 3010 1 2650 0 RE+ CPU 3 mlockall2 3009 1 2650 0 LE+ *pmap pv 0xfffffe00151f36c0 mlockall2 3008 1 2650 0 DL+ swread 0xfffffe021668ce78 mlockall2 3007 1 2650 0 DL+ swread 0xfffffe02166472e8 mlockall2 3006 1 2650 0 LE+ *vm page 0xfffffe01104f2480 mlockall2 3005 1 2650 0 DL+ swread 0xfffffe021662fdf8 mlockall2 3004 1 2650 0 DL+ swread 0xfffffe021663daf8 mlockall2 3003 1 2650 0 LE+ *vm page 0xfffffe011021e900 mlockall2 3002 1 2650 0 LL+ *pmap pv 0xfffffe00151f36c0 mlockall2 3001 1 2650 0 DL+ swread 0xfffffe02166458e8 mlockall2 3000 1 2650 0 RE+ CPU 0 mlockall2 2999 1 2650 0 LE+ *pmap pv 0xfffffe00151f36c0 mlockall2 2998 1 2650 0 LE+ *pmap pv 0xfffffe00151f36c0 mlockall2 2997 1 2650 0 DL+ swread 0xfffffe0216656508 mlockall2 2996 1 2650 0 DL+ swread 0xfffffe021687b018 mlockall2 2995 1 2650 0 DL+ swread 0xfffffe02163ca898 mlockall2 2994 1 2650 0 LE+ *vm page 0xfffffe01104c0840 mlockall2 2993 1 2650 0 LL+ *pmap pv 0xfffffe00151f36c0 mlockall2 2992 1 2650 0 LL+ *vm objec 0xfffffe00151f3cc0 mlockall2 2991 1 2650 0 LL+ *pmap pv 0xfffffe00151f36c0 mlockall2 2990 1 2650 0 LE+ *vm page 0xfffffe01104c0840 mlockall2 2989 1 2650 0 LL+ *pmap pv 0xfffffe00151f36c0 mlockall2 2988 1 2650 0 LE+ *vm page 0xfffffe01104f2480 mlockall2 2987 1 2650 0 RE+ CPU 2 mlockall2 2986 1 2650 0 DL+ swread 0xfffffe02165dfd78 mlockall2 2985 1 2650 0 LL+ *pmap pv 0xfffffe00151f36c0 mlockall2 2984 1 2650 0 DL+ swread 0xfffffe021663ba78 mlockall2 2983 1 2650 0 DL+ swread 0xfffffe02163caa38 mlockall2 2969 2650 2650 0 S+ wait 0xfffffe011077e970 sh 2650 1195 2650 0 SW+ wait 0xfffffe01105814b8 sh 1195 1192 1195 0 SW+ wait 0xfffffe001aef54b8 bash 1192 1191 1192 0 SW+ pause 0xfffffe01100360a8 csh 1191 1187 1191 1001 SW+ wait 0xfffffe001aa3c4b8 su 1187 1186 1187 1001 SWs+ wait 0xfffffe0110036970 bash 1186 1184 1184 1001 S select 0xfffffe001a881b40 sshd 1184 941 1184 0 Ss select 0xfffffe001aa0a340 sshd 1070 1 1070 0 Ss+ ttyin 0xfffffe001556f4a8 getty 1069 1 1069 0 Ss+ ttyin 0xfffffe001556f8a8 getty 1068 1 1068 0 Ss+ ttyin 0xfffffe001556fca8 getty 1067 1 1067 0 Ss+ ttyin 0xfffffe00159370a8 getty 1066 1 1066 0 Ss+ ttyin 0xfffffe00159374a8 getty 1065 1 1065 0 Ss+ ttyin 0xfffffe00159378a8 getty 1064 1 1064 0 Ss+ ttyin 0xfffffe001556e0a8 getty 1063 1 1063 0 Ss+ ttyin 0xfffffe001556e4a8 getty 1062 1 1062 0 Ss+ ttyin 0xfffffe001556e8a8 getty 1023 1 1023 0 Ss select 0xfffffe001a881bc0 inetd 990 1 990 0 Ss select 0xfffffe001a8838c0 moused 970 1 970 0 Ss nanslp 0xffffffff813bd703 watchdogd 960 1 960 0 SWs nanslp 0xffffffff813bd701 cron 953 1 953 25 SWs pause 0xfffffe001aa3c0a8 sendmail 949 1 949 0 Ss select 0xfffffe001aa0a3c0 sendmail 941 1 941 0 Ss select 0xfffffe001a877240 sshd 850 1 850 0 Ss select 0xfffffe001a8772c0 ntpd 755 754 754 0 S (threaded) nfsd 100109 S rpcsvc 0xfffffe001a8b51a0 nfsd: service 100108 S rpcsvc 0xfffffe001a8b5120 nfsd: service 100107 S rpcsvc 0xfffffe001a8b2aa0 nfsd: service 100085 S rpcsvc 0xfffffe001a9020a0 nfsd: master 754 1 754 0 Ss select 0xfffffe001a94a9c0 nfsd 745 1 745 0 Ss select 0xfffffe001aa0a440 mountd 640 1 640 0 Ss select 0xfffffe001a877340 rpcbind 614 1 614 0 Ss select 0xfffffe001aa0b040 syslogd 433 1 433 0 Ss select 0xfffffe001aa0b0c0 devd 17 0 0 0 DL sdflush 0xffffffff815bc180 [softdepflush] 16 0 0 0 DL syncer 0xffffffff815b0780 [syncer] 9 0 0 0 DL vlruwt 0xfffffe001a768000 [vnlru] 8 0 0 0 DL psleep 0xffffffff815b01a0 [bufdaemon] 7 0 0 0 DL pgzero 0xffffffff815c5f34 [pagezero] 6 0 0 0 DL psleep 0xffffffff815c50f0 [vmdaemon] 5 0 0 0 LL *pmap pv 0xfffffe00151f36c0 [pagedaemon] 4 0 0 0 DL ccb_scan 0xffffffff8137dc60 [xpt_thrd] 3 0 0 0 DL waiting_ 0xffffffff815b64c0 [sctp_iterator] 2 0 0 0 DL - 0xfffffe0015900048 [fdc0] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xffffff8000952e18 [usbus5] 100057 D - 0xffffff8000952dc0 [usbus5] 100056 D - 0xffffff8000952d68 [usbus5] 100055 D - 0xffffff8000952d10 [usbus5] 100053 D - 0xffffff800094a460 [usbus4] 100052 D - 0xffffff800094a408 [usbus4] 100051 D - 0xffffff800094a3b0 [usbus4] 100050 D - 0xffffff800094a358 [usbus4] 100049 D - 0xffffff8000947460 [usbus3] 100048 D - 0xffffff8000947408 [usbus3] 100047 D - 0xffffff80009473b0 [usbus3] 100046 D - 0xffffff8000947358 [usbus3] 100045 D - 0xffffff8000944460 [usbus2] 100044 D - 0xffffff8000944408 [usbus2] 100043 D - 0xffffff80009443b0 [usbus2] 100042 D - 0xffffff8000944358 [usbus2] 100040 D - 0xffffff8000941460 [usbus1] 100039 D - 0xffffff8000941408 [usbus1] 100038 D - 0xffffff80009413b0 [usbus1] 100037 D - 0xffffff8000941358 [usbus1] 100035 D - 0xffffff800093e460 [usbus0] 100034 D - 0xffffff800093e408 [usbus0] 100033 D - 0xffffff800093e3b0 [usbus0] 100032 D - 0xffffff800093e358 [usbus0] 14 0 0 0 DL - 0xffffffff8139a5b0 [yarrow] 13 0 0 0 LL (threaded) [geom] 100015 D - 0xffffffff813b5310 [g_down] 100014 L *pmap pv 0xfffffe00151f36c0 [g_up] 100013 D - 0xffffffff813b52f8 [g_event] 12 0 0 0 WL (threaded) [intr] 100063 I [irq12: psm0] 100062 I [irq1: atkbd0] 100060 I [swi0: uart] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100023 I [swi6: task queue] 100022 I [swi6: Giant taskq] 100019 I [swi5: fast taskq] 100018 I [swi2: cambio] 100012 I [swi3: vm] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xfffffe0015483970 [init] 10 0 0 0 DL audit_wo 0xffffffff815bb0f0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100065 D - 0xffffffff813bc300 [deadlkres] 100064 D - 0xfffffe001546ed00 [mca taskq] 100027 D - 0xfffffe001546d100 [kqueue taskq] 100026 D - 0xfffffe001546d200 [acpi_task_2] 100025 D - 0xfffffe001546d200 [acpi_task_1] 100024 D - 0xfffffe001546d200 [acpi_task_0] 100021 D - 0xfffffe001546d500 [thread taskq] 100020 D - 0xfffffe001546d600 [ffs_trim taskq] 100016 D - 0xfffffe001546db00 [firmware taskq] 100000 D sched 0xffffffff813b5640 [swapper] db:0:ps> allt Tracing command rm pid 53790 tid 100282 td 0xfffffe0110697490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232a74280 mi_switch() at mi_switch+0x238/frame 0xffffff8232a742d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232a74310 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232a74340 _sleep() at _sleep+0x3fb/frame 0xffffff8232a743d0 bwait() at bwait+0x6e/frame 0xffffff8232a74410 vnode_pager_generic_getpages() at vnode_pager_generic_getpages+0xa23/frame 0xffffff8232a745a0 VOP_GETPAGES_APV() at VOP_GETPAGES_APV+0xc9/frame 0xffffff8232a745d0 vnode_pager_getpages() at vnode_pager_getpages+0x73/frame 0xffffff8232a74640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff8232a74920 vm_fault() at vm_fault+0x73/frame 0xffffff8232a74960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff8232a749f0 trap() at trap+0x604/frame 0xffffff8232a74bf0 calltrap() at calltrap+0x8/frame 0xffffff8232a74bf0 --- trap 0xc, rip = 0x8006053aa, rsp = 0x7fffffffd060, rbp = 0x80081bd00 --- Tracing command mlockall2 pid 3022 tid 101017 td 0xfffffe011021c000 sched_switch() at sched_switch+0x1b4/frame 0xffffff82329f24d0 mi_switch() at mi_switch+0x238/frame 0xffffff82329f2520 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff82329f2570 __mtx_lock_sleep() at __mtx_lock_sleep+0x12b/frame 0xffffff82329f25f0 __mtx_lock_flags() at __mtx_lock_flags+0x156/frame 0xffffff82329f2620 vm_object_terminate() at vm_object_terminate+0xaf/frame 0xffffff82329f2650 vm_object_deallocate() at vm_object_deallocate+0x2b/frame 0xffffff82329f26c0 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x4c/frame 0xffffff82329f26e0 vm_map_process_deferred() at vm_map_process_deferred+0x3d/frame 0xffffff82329f2710 vm_map_remove() at vm_map_remove+0x6f/frame 0xffffff82329f2740 vmspace_exit() at vmspace_exit+0xc7/frame 0xffffff82329f2770 exit1() at exit1+0x3e9/frame 0xffffff82329f2800 sigexit() at sigexit+0x8f/frame 0xffffff82329f2ac0 postsig() at postsig+0x417/frame 0xffffff82329f2bb0 ast() at ast+0x247/frame 0xffffff82329f2bf0 doreti_ast() at doreti_ast+0x1f/frame 0x6666666666666667 Tracing command mlockall2 pid 3021 tid 101016 td 0xfffffe01104c9490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82329ed470 mi_switch() at mi_switch+0x238/frame 0xffffff82329ed4c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82329ed500 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff82329ed530 _sleep() at _sleep+0x28d/frame 0xffffff82329ed5c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff82329ed640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff82329ed920 vm_fault() at vm_fault+0x73/frame 0xffffff82329ed960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff82329ed9f0 trap() at trap+0x604/frame 0xffffff82329edbf0 calltrap() at calltrap+0x8/frame 0xffffff82329edbf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 3020 tid 101015 td 0xfffffe0110508920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82329e84b0 mi_switch() at mi_switch+0x238/frame 0xffffff82329e8500 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff82329e8550 __rw_rlock() at __rw_rlock+0x3da/frame 0xffffff82329e85d0 pmap_page_is_mapped() at pmap_page_is_mapped+0x49/frame 0xffffff82329e8600 vm_page_free_toq() at vm_page_free_toq+0x30/frame 0xffffff82329e8620 vm_object_terminate() at vm_object_terminate+0x115/frame 0xffffff82329e8650 vm_object_deallocate() at vm_object_deallocate+0x2b/frame 0xffffff82329e86c0 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x4c/frame 0xffffff82329e86e0 vm_map_process_deferred() at vm_map_process_deferred+0x3d/frame 0xffffff82329e8710 vm_map_remove() at vm_map_remove+0x6f/frame 0xffffff82329e8740 vmspace_exit() at vmspace_exit+0xc7/frame 0xffffff82329e8770 exit1() at exit1+0x3e9/frame 0xffffff82329e8800 sigexit() at sigexit+0x8f/frame 0xffffff82329e8ac0 postsig() at postsig+0x417/frame 0xffffff82329e8bb0 ast() at ast+0x247/frame 0xffffff82329e8bf0 doreti_ast() at doreti_ast+0x1f/frame 0x6666666666666667 Tracing command mlockall2 pid 3019 tid 101013 td 0xfffffe001aefb490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82329e3480 mi_switch() at mi_switch+0x238/frame 0xffffff82329e34d0 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff82329e3520 __rw_rlock() at __rw_rlock+0x3da/frame 0xffffff82329e35a0 pmap_enter() at pmap_enter+0x14a/frame 0xffffff82329e3640 vm_fault_hold() at vm_fault_hold+0x171d/frame 0xffffff82329e3920 vm_fault() at vm_fault+0x73/frame 0xffffff82329e3960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff82329e39f0 trap() at trap+0x604/frame 0xffffff82329e3bf0 calltrap() at calltrap+0x8/frame 0xffffff82329e3bf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 3018 tid 101012 td 0xfffffe01104f0490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82329de470 mi_switch() at mi_switch+0x238/frame 0xffffff82329de4c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82329de500 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff82329de530 _sleep() at _sleep+0x28d/frame 0xffffff82329de5c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff82329de640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff82329de920 vm_fault() at vm_fault+0x73/frame 0xffffff82329de960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff82329de9f0 trap() at trap+0x604/frame 0xffffff82329debf0 calltrap() at calltrap+0x8/frame 0xffffff82329debf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 3017 tid 101011 td 0xfffffe011067a490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82329d9480 mi_switch() at mi_switch+0x238/frame 0xffffff82329d94d0 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff82329d9520 __rw_rlock() at __rw_rlock+0x3da/frame 0xffffff82329d95a0 pmap_enter() at pmap_enter+0x14a/frame 0xffffff82329d9640 vm_fault_hold() at vm_fault_hold+0x171d/frame 0xffffff82329d9920 vm_fault() at vm_fault+0x73/frame 0xffffff82329d9960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff82329d99f0 trap() at trap+0x604/frame 0xffffff82329d9bf0 calltrap() at calltrap+0x8/frame 0xffffff82329d9bf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 3016 tid 101009 td 0xfffffe011045c490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82329d4470 mi_switch() at mi_switch+0x238/frame 0xffffff82329d44c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82329d4500 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff82329d4530 _sleep() at _sleep+0x28d/frame 0xffffff82329d45c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff82329d4640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff82329d4920 vm_fault() at vm_fault+0x73/frame 0xffffff82329d4960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff82329d49f0 trap() at trap+0x604/frame 0xffffff82329d4bf0 calltrap() at calltrap+0x8/frame 0xffffff82329d4bf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 3015 tid 101008 td 0xfffffe011021c490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82329cf470 mi_switch() at mi_switch+0x238/frame 0xffffff82329cf4c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82329cf500 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff82329cf530 _sleep() at _sleep+0x28d/frame 0xffffff82329cf5c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff82329cf640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff82329cf920 vm_fault() at vm_fault+0x73/frame 0xffffff82329cf960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff82329cf9f0 trap() at trap+0x604/frame 0xffffff82329cfbf0 calltrap() at calltrap+0x8/frame 0xffffff82329cfbf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 3014 tid 101005 td 0xfffffe0110535920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82329ca4d0 mi_switch() at mi_switch+0x238/frame 0xffffff82329ca520 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff82329ca570 __mtx_lock_sleep() at __mtx_lock_sleep+0x12b/frame 0xffffff82329ca5f0 __mtx_lock_flags() at __mtx_lock_flags+0x156/frame 0xffffff82329ca620 vm_object_terminate() at vm_object_terminate+0xaf/frame 0xffffff82329ca650 vm_object_deallocate() at vm_object_deallocate+0x2b/frame 0xffffff82329ca6c0 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x4c/frame 0xffffff82329ca6e0 vm_map_process_deferred() at vm_map_process_deferred+0x3d/frame 0xffffff82329ca710 vm_map_remove() at vm_map_remove+0x6f/frame 0xffffff82329ca740 vmspace_exit() at vmspace_exit+0xc7/frame 0xffffff82329ca770 exit1() at exit1+0x3e9/frame 0xffffff82329ca800 sigexit() at sigexit+0x8f/frame 0xffffff82329caac0 postsig() at postsig+0x417/frame 0xffffff82329cabb0 ast() at ast+0x247/frame 0xffffff82329cabf0 doreti_ast() at doreti_ast+0x1f/frame 0x6666666666666667 Tracing command mlockall2 pid 3013 tid 101004 td 0xfffffe001a96d490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82329c5470 mi_switch() at mi_switch+0x238/frame 0xffffff82329c54c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82329c5500 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff82329c5530 _sleep() at _sleep+0x28d/frame 0xffffff82329c55c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff82329c5640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff82329c5920 vm_fault() at vm_fault+0x73/frame 0xffffff82329c5960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff82329c59f0 trap() at trap+0x604/frame 0xffffff82329c5bf0 calltrap() at calltrap+0x8/frame 0xffffff82329c5bf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 3012 tid 101003 td 0xfffffe011051c490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82329bb470 mi_switch() at mi_switch+0x238/frame 0xffffff82329bb4c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82329bb500 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff82329bb530 _sleep() at _sleep+0x28d/frame 0xffffff82329bb5c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff82329bb640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff82329bb920 vm_fault() at vm_fault+0x73/frame 0xffffff82329bb960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff82329bb9f0 trap() at trap+0x604/frame 0xffffff82329bbbf0 calltrap() at calltrap+0x8/frame 0xffffff82329bbbf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 3011 tid 101001 td 0xfffffe011021c920 cpustop_handler() at cpustop_handler+0x2c/frame 0xffffff800023ed00 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffff800023ed20 trap() at trap+0x335/frame 0xffffff800023ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff800023ef20 --- trap 0x13, rip = 0xffffffff80cb0233, rsp = 0xffffff800023efe0, rbp = 0xffffff82329b1740 --- pmap_remove_pages() at pmap_remove_pages+0x133/frame 0xffffff82329b1740 vmspace_exit() at vmspace_exit+0x9a/frame 0xffffff82329b1770 exit1() at exit1+0x3e9/frame 0xffffff82329b1800 sigexit() at sigexit+0x8f/frame 0xffffff82329b1ac0 postsig() at postsig+0x417/frame 0xffffff82329b1bb0 ast() at ast+0x247/frame 0xffffff82329b1bf0 doreti_ast() at doreti_ast+0x1f/frame 0x6666666666666667 Tracing command mlockall2 pid 3010 tid 101000 td 0xfffffe0110515920 cpustop_handler() at cpustop_handler+0x2c/frame 0xffffff800024cd00 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffff800024cd20 trap() at trap+0x335/frame 0xffffff800024cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff800024cf20 --- trap 0x13, rip = 0xffffffff809626e2, rsp = 0xffffff800024cfe0, rbp = 0xffffff82329ac650 --- witness_unlock() at witness_unlock+0x42/frame 0xffffff82329ac650 __mtx_unlock_flags() at __mtx_unlock_flags+0x99/frame 0xffffff82329ac690 pmap_remove_pages() at pmap_remove_pages+0x682/frame 0xffffff82329ac740 vmspace_exit() at vmspace_exit+0x9a/frame 0xffffff82329ac770 exit1() at exit1+0x3e9/frame 0xffffff82329ac800 sigexit() at sigexit+0x8f/frame 0xffffff82329acac0 postsig() at postsig+0x417/frame 0xffffff82329acbb0 ast() at ast+0x247/frame 0xffffff82329acbf0 doreti_ast() at doreti_ast+0x1f/frame 0x6666666666666667 Tracing command mlockall2 pid 3009 tid 100998 td 0xfffffe011045e000 sched_switch() at sched_switch+0x1b4/frame 0xffffff82329a74b0 mi_switch() at mi_switch+0x238/frame 0xffffff82329a7500 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff82329a7550 __rw_rlock() at __rw_rlock+0x3da/frame 0xffffff82329a75d0 pmap_page_is_mapped() at pmap_page_is_mapped+0x49/frame 0xffffff82329a7600 vm_page_free_toq() at vm_page_free_toq+0x30/frame 0xffffff82329a7620 vm_object_terminate() at vm_object_terminate+0x115/frame 0xffffff82329a7650 vm_object_deallocate() at vm_object_deallocate+0x2b/frame 0xffffff82329a76c0 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x4c/frame 0xffffff82329a76e0 vm_map_process_deferred() at vm_map_process_deferred+0x3d/frame 0xffffff82329a7710 vm_map_remove() at vm_map_remove+0x6f/frame 0xffffff82329a7740 vmspace_exit() at vmspace_exit+0xc7/frame 0xffffff82329a7770 exit1() at exit1+0x3e9/frame 0xffffff82329a7800 sigexit() at sigexit+0x8f/frame 0xffffff82329a7ac0 postsig() at postsig+0x417/frame 0xffffff82329a7bb0 ast() at ast+0x247/frame 0xffffff82329a7bf0 doreti_ast() at doreti_ast+0x1f/frame 0x6666666666666667 Tracing command mlockall2 pid 3008 tid 100997 td 0xfffffe0110697000 sched_switch() at sched_switch+0x1b4/frame 0xffffff82329a2470 mi_switch() at mi_switch+0x238/frame 0xffffff82329a24c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82329a2500 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff82329a2530 _sleep() at _sleep+0x28d/frame 0xffffff82329a25c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff82329a2640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff82329a2920 vm_fault() at vm_fault+0x73/frame 0xffffff82329a2960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff82329a29f0 trap() at trap+0x604/frame 0xffffff82329a2bf0 calltrap() at calltrap+0x8/frame 0xffffff82329a2bf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 3007 tid 100995 td 0xfffffe011054b490 sched_switch() at sched_switch+0x1b4/frame 0xffffff823299d470 mi_switch() at mi_switch+0x238/frame 0xffffff823299d4c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823299d500 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff823299d530 _sleep() at _sleep+0x28d/frame 0xffffff823299d5c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff823299d640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff823299d920 vm_fault() at vm_fault+0x73/frame 0xffffff823299d960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff823299d9f0 trap() at trap+0x604/frame 0xffffff823299dbf0 calltrap() at calltrap+0x8/frame 0xffffff823299dbf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 3006 tid 101148 td 0xfffffe0110529000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232a7e4d0 mi_switch() at mi_switch+0x238/frame 0xffffff8232a7e520 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff8232a7e570 __mtx_lock_sleep() at __mtx_lock_sleep+0x12b/frame 0xffffff8232a7e5f0 __mtx_lock_flags() at __mtx_lock_flags+0x156/frame 0xffffff8232a7e620 vm_object_terminate() at vm_object_terminate+0xaf/frame 0xffffff8232a7e650 vm_object_deallocate() at vm_object_deallocate+0x2b/frame 0xffffff8232a7e6c0 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x4c/frame 0xffffff8232a7e6e0 vm_map_process_deferred() at vm_map_process_deferred+0x3d/frame 0xffffff8232a7e710 vm_map_remove() at vm_map_remove+0x6f/frame 0xffffff8232a7e740 vmspace_exit() at vmspace_exit+0xc7/frame 0xffffff8232a7e770 exit1() at exit1+0x3e9/frame 0xffffff8232a7e800 sigexit() at sigexit+0x8f/frame 0xffffff8232a7eac0 postsig() at postsig+0x417/frame 0xffffff8232a7ebb0 ast() at ast+0x247/frame 0xffffff8232a7ebf0 doreti_ast() at doreti_ast+0x1f/frame 0x6666666666666667 Tracing command mlockall2 pid 3005 tid 101142 td 0xfffffe0110223000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232a51470 mi_switch() at mi_switch+0x238/frame 0xffffff8232a514c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232a51500 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8232a51530 _sleep() at _sleep+0x28d/frame 0xffffff8232a515c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff8232a51640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff8232a51920 vm_fault() at vm_fault+0x73/frame 0xffffff8232a51960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff8232a519f0 trap() at trap+0x604/frame 0xffffff8232a51bf0 calltrap() at calltrap+0x8/frame 0xffffff8232a51bf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 3004 tid 100830 td 0xfffffe011054a000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232a6a470 mi_switch() at mi_switch+0x238/frame 0xffffff8232a6a4c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232a6a500 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8232a6a530 _sleep() at _sleep+0x28d/frame 0xffffff8232a6a5c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff8232a6a640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff8232a6a920 vm_fault() at vm_fault+0x73/frame 0xffffff8232a6a960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff8232a6a9f0 trap() at trap+0x604/frame 0xffffff8232a6abf0 calltrap() at calltrap+0x8/frame 0xffffff8232a6abf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 3003 tid 101215 td 0xfffffe01104ec000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232a564d0 mi_switch() at mi_switch+0x238/frame 0xffffff8232a56520 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff8232a56570 __mtx_lock_sleep() at __mtx_lock_sleep+0x12b/frame 0xffffff8232a565f0 __mtx_lock_flags() at __mtx_lock_flags+0x156/frame 0xffffff8232a56620 vm_object_terminate() at vm_object_terminate+0xaf/frame 0xffffff8232a56650 vm_object_deallocate() at vm_object_deallocate+0x2b/frame 0xffffff8232a566c0 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x4c/frame 0xffffff8232a566e0 vm_map_process_deferred() at vm_map_process_deferred+0x3d/frame 0xffffff8232a56710 vm_map_remove() at vm_map_remove+0x6f/frame 0xffffff8232a56740 vmspace_exit() at vmspace_exit+0xc7/frame 0xffffff8232a56770 exit1() at exit1+0x3e9/frame 0xffffff8232a56800 sigexit() at sigexit+0x8f/frame 0xffffff8232a56ac0 postsig() at postsig+0x417/frame 0xffffff8232a56bb0 ast() at ast+0x247/frame 0xffffff8232a56bf0 doreti_ast() at doreti_ast+0x1f/frame 0x6666666666666667 Tracing command mlockall2 pid 3002 tid 100431 td 0xfffffe011054a490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232a1f480 mi_switch() at mi_switch+0x238/frame 0xffffff8232a1f4d0 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff8232a1f520 __rw_rlock() at __rw_rlock+0x3da/frame 0xffffff8232a1f5a0 pmap_enter() at pmap_enter+0x14a/frame 0xffffff8232a1f640 vm_fault_hold() at vm_fault_hold+0x171d/frame 0xffffff8232a1f920 vm_fault() at vm_fault+0x73/frame 0xffffff8232a1f960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff8232a1f9f0 trap() at trap+0x604/frame 0xffffff8232a1fbf0 calltrap() at calltrap+0x8/frame 0xffffff8232a1fbf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 3001 tid 100132 td 0xfffffe0110221000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232966470 mi_switch() at mi_switch+0x238/frame 0xffffff82329664c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232966500 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8232966530 _sleep() at _sleep+0x28d/frame 0xffffff82329665c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff8232966640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff8232966920 vm_fault() at vm_fault+0x73/frame 0xffffff8232966960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff82329669f0 trap() at trap+0x604/frame 0xffffff8232966bf0 calltrap() at calltrap+0x8/frame 0xffffff8232966bf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 3000 tid 101229 td 0xfffffe01104d1490 kdb_enter() at kdb_enter+0x3b/frame 0xffffff8232a83520 vpanic() at vpanic+0xe1/frame 0xffffff8232a83560 panic() at panic+0x67/frame 0xffffff8232a83640 __rw_assert() at __rw_assert+0xd3/frame 0xffffff8232a83650 vm_page_remove() at vm_page_remove+0x3c/frame 0xffffff8232a83670 vm_page_free_toq() at vm_page_free_toq+0x6d/frame 0xffffff8232a83690 pmap_remove_pages() at pmap_remove_pages+0x682/frame 0xffffff8232a83740 vmspace_exit() at vmspace_exit+0x9a/frame 0xffffff8232a83770 exit1() at exit1+0x3e9/frame 0xffffff8232a83800 sigexit() at sigexit+0x8f/frame 0xffffff8232a83ac0 postsig() at postsig+0x417/frame 0xffffff8232a83bb0 ast() at ast+0x247/frame 0xffffff8232a83bf0 doreti_ast() at doreti_ast+0x1f/frame 0x6666666666666667 Tracing command mlockall2 pid 2999 tid 100389 td 0xfffffe01104d1000 sched_switch() at sched_switch+0x1b4/frame 0xffffff82328f84b0 mi_switch() at mi_switch+0x238/frame 0xffffff82328f8500 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff82328f8550 __rw_rlock() at __rw_rlock+0x3da/frame 0xffffff82328f85d0 pmap_page_is_mapped() at pmap_page_is_mapped+0x49/frame 0xffffff82328f8600 vm_page_free_toq() at vm_page_free_toq+0x30/frame 0xffffff82328f8620 vm_object_terminate() at vm_object_terminate+0x115/frame 0xffffff82328f8650 vm_object_deallocate() at vm_object_deallocate+0x2b/frame 0xffffff82328f86c0 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x4c/frame 0xffffff82328f86e0 vm_map_process_deferred() at vm_map_process_deferred+0x3d/frame 0xffffff82328f8710 vm_map_remove() at vm_map_remove+0x6f/frame 0xffffff82328f8740 vmspace_exit() at vmspace_exit+0xc7/frame 0xffffff82328f8770 exit1() at exit1+0x3e9/frame 0xffffff82328f8800 sigexit() at sigexit+0x8f/frame 0xffffff82328f8ac0 postsig() at postsig+0x417/frame 0xffffff82328f8bb0 ast() at ast+0x247/frame 0xffffff82328f8bf0 doreti_ast() at doreti_ast+0x1f/frame 0x6666666666666667 Tracing command mlockall2 pid 2998 tid 100298 td 0xfffffe011068e000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823298e4b0 mi_switch() at mi_switch+0x238/frame 0xffffff823298e500 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff823298e550 __rw_rlock() at __rw_rlock+0x3da/frame 0xffffff823298e5d0 pmap_page_is_mapped() at pmap_page_is_mapped+0x49/frame 0xffffff823298e600 vm_page_free_toq() at vm_page_free_toq+0x30/frame 0xffffff823298e620 vm_object_terminate() at vm_object_terminate+0x115/frame 0xffffff823298e650 vm_object_deallocate() at vm_object_deallocate+0x2b/frame 0xffffff823298e6c0 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x4c/frame 0xffffff823298e6e0 vm_map_process_deferred() at vm_map_process_deferred+0x3d/frame 0xffffff823298e710 vm_map_remove() at vm_map_remove+0x6f/frame 0xffffff823298e740 vmspace_exit() at vmspace_exit+0xc7/frame 0xffffff823298e770 exit1() at exit1+0x3e9/frame 0xffffff823298e800 sigexit() at sigexit+0x8f/frame 0xffffff823298eac0 postsig() at postsig+0x417/frame 0xffffff823298ebb0 ast() at ast+0x247/frame 0xffffff823298ebf0 doreti_ast() at doreti_ast+0x1f/frame 0x6666666666666667 Tracing command mlockall2 pid 2997 tid 100758 td 0xfffffe0110568920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82328da470 mi_switch() at mi_switch+0x238/frame 0xffffff82328da4c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82328da500 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff82328da530 _sleep() at _sleep+0x28d/frame 0xffffff82328da5c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff82328da640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff82328da920 vm_fault() at vm_fault+0x73/frame 0xffffff82328da960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff82328da9f0 trap() at trap+0x604/frame 0xffffff82328dabf0 calltrap() at calltrap+0x8/frame 0xffffff82328dabf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 2996 tid 100727 td 0xfffffe0110501490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232a2e470 mi_switch() at mi_switch+0x238/frame 0xffffff8232a2e4c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232a2e500 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8232a2e530 _sleep() at _sleep+0x28d/frame 0xffffff8232a2e5c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff8232a2e640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff8232a2e920 vm_fault() at vm_fault+0x73/frame 0xffffff8232a2e960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff8232a2e9f0 trap() at trap+0x604/frame 0xffffff8232a2ebf0 calltrap() at calltrap+0x8/frame 0xffffff8232a2ebf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 2995 tid 100582 td 0xfffffe01104ee490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232ace470 mi_switch() at mi_switch+0x238/frame 0xffffff8232ace4c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232ace500 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8232ace530 _sleep() at _sleep+0x28d/frame 0xffffff8232ace5c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff8232ace640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff8232ace920 vm_fault() at vm_fault+0x73/frame 0xffffff8232ace960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff8232ace9f0 trap() at trap+0x604/frame 0xffffff8232acebf0 calltrap() at calltrap+0x8/frame 0xffffff8232acebf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 2994 tid 100386 td 0xfffffe011045e490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82328944d0 mi_switch() at mi_switch+0x238/frame 0xffffff8232894520 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff8232894570 __mtx_lock_sleep() at __mtx_lock_sleep+0x12b/frame 0xffffff82328945f0 __mtx_lock_flags() at __mtx_lock_flags+0x156/frame 0xffffff8232894620 vm_object_terminate() at vm_object_terminate+0xaf/frame 0xffffff8232894650 vm_object_deallocate() at vm_object_deallocate+0x2b/frame 0xffffff82328946c0 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x4c/frame 0xffffff82328946e0 vm_map_process_deferred() at vm_map_process_deferred+0x3d/frame 0xffffff8232894710 vm_map_remove() at vm_map_remove+0x6f/frame 0xffffff8232894740 vmspace_exit() at vmspace_exit+0xc7/frame 0xffffff8232894770 exit1() at exit1+0x3e9/frame 0xffffff8232894800 sigexit() at sigexit+0x8f/frame 0xffffff8232894ac0 postsig() at postsig+0x417/frame 0xffffff8232894bb0 ast() at ast+0x247/frame 0xffffff8232894bf0 doreti_ast() at doreti_ast+0x1f/frame 0x6666666666666667 Tracing command mlockall2 pid 2993 tid 101147 td 0xfffffe01104eb000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232abf480 mi_switch() at mi_switch+0x238/frame 0xffffff8232abf4d0 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff8232abf520 __rw_rlock() at __rw_rlock+0x3da/frame 0xffffff8232abf5a0 pmap_enter() at pmap_enter+0x14a/frame 0xffffff8232abf640 vm_fault_hold() at vm_fault_hold+0x171d/frame 0xffffff8232abf920 vm_fault() at vm_fault+0x73/frame 0xffffff8232abf960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff8232abf9f0 trap() at trap+0x604/frame 0xffffff8232abfbf0 calltrap() at calltrap+0x8/frame 0xffffff8232abfbf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 2992 tid 100466 td 0xfffffe011068d000 sched_switch() at sched_switch+0x1b4/frame 0xffffff82329c03f0 mi_switch() at mi_switch+0x238/frame 0xffffff82329c0440 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff82329c0490 __rw_wlock_hard() at __rw_wlock_hard+0x248/frame 0xffffff82329c0500 _rw_wlock_cookie() at _rw_wlock_cookie+0x112/frame 0xffffff82329c0530 _sleep() at _sleep+0x336/frame 0xffffff82329c05c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff82329c0640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff82329c0920 vm_fault() at vm_fault+0x73/frame 0xffffff82329c0960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff82329c09f0 trap() at trap+0x604/frame 0xffffff82329c0bf0 calltrap() at calltrap+0x8/frame 0xffffff82329c0bf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 2991 tid 100780 td 0xfffffe001a9fd000 sched_switch() at sched_switch+0x1b4/frame 0xffffff82328bc480 mi_switch() at mi_switch+0x238/frame 0xffffff82328bc4d0 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff82328bc520 __rw_rlock() at __rw_rlock+0x3da/frame 0xffffff82328bc5a0 pmap_enter() at pmap_enter+0x14a/frame 0xffffff82328bc640 vm_fault_hold() at vm_fault_hold+0x171d/frame 0xffffff82328bc920 vm_fault() at vm_fault+0x73/frame 0xffffff82328bc960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff82328bc9f0 trap() at trap+0x604/frame 0xffffff82328bcbf0 calltrap() at calltrap+0x8/frame 0xffffff82328bcbf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 2990 tid 101039 td 0xfffffe001aa3f920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232a794d0 mi_switch() at mi_switch+0x238/frame 0xffffff8232a79520 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff8232a79570 __mtx_lock_sleep() at __mtx_lock_sleep+0x12b/frame 0xffffff8232a795f0 __mtx_lock_flags() at __mtx_lock_flags+0x156/frame 0xffffff8232a79620 vm_object_terminate() at vm_object_terminate+0xaf/frame 0xffffff8232a79650 vm_object_deallocate() at vm_object_deallocate+0x2b/frame 0xffffff8232a796c0 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x4c/frame 0xffffff8232a796e0 vm_map_process_deferred() at vm_map_process_deferred+0x3d/frame 0xffffff8232a79710 vm_map_remove() at vm_map_remove+0x6f/frame 0xffffff8232a79740 vmspace_exit() at vmspace_exit+0xc7/frame 0xffffff8232a79770 exit1() at exit1+0x3e9/frame 0xffffff8232a79800 sigexit() at sigexit+0x8f/frame 0xffffff8232a79ac0 postsig() at postsig+0x417/frame 0xffffff8232a79bb0 ast() at ast+0x247/frame 0xffffff8232a79bf0 doreti_ast() at doreti_ast+0x1f/frame 0x6666666666666667 Tracing command mlockall2 pid 2989 tid 100969 td 0xfffffe01104ef000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823295c480 mi_switch() at mi_switch+0x238/frame 0xffffff823295c4d0 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff823295c520 __rw_rlock() at __rw_rlock+0x3da/frame 0xffffff823295c5a0 pmap_enter() at pmap_enter+0x14a/frame 0xffffff823295c640 vm_fault_hold() at vm_fault_hold+0x171d/frame 0xffffff823295c920 vm_fault() at vm_fault+0x73/frame 0xffffff823295c960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff823295c9f0 trap() at trap+0x604/frame 0xffffff823295cbf0 calltrap() at calltrap+0x8/frame 0xffffff823295cbf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 2988 tid 100632 td 0xfffffe01104ef920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232a3d4d0 mi_switch() at mi_switch+0x238/frame 0xffffff8232a3d520 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff8232a3d570 __mtx_lock_sleep() at __mtx_lock_sleep+0x12b/frame 0xffffff8232a3d5f0 __mtx_lock_flags() at __mtx_lock_flags+0x156/frame 0xffffff8232a3d620 vm_object_terminate() at vm_object_terminate+0xaf/frame 0xffffff8232a3d650 vm_object_deallocate() at vm_object_deallocate+0x2b/frame 0xffffff8232a3d6c0 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x4c/frame 0xffffff8232a3d6e0 vm_map_process_deferred() at vm_map_process_deferred+0x3d/frame 0xffffff8232a3d710 vm_map_remove() at vm_map_remove+0x6f/frame 0xffffff8232a3d740 vmspace_exit() at vmspace_exit+0xc7/frame 0xffffff8232a3d770 exit1() at exit1+0x3e9/frame 0xffffff8232a3d800 sigexit() at sigexit+0x8f/frame 0xffffff8232a3dac0 postsig() at postsig+0x417/frame 0xffffff8232a3dbb0 ast() at ast+0x247/frame 0xffffff8232a3dbf0 doreti_ast() at doreti_ast+0x1f/frame 0x6666666666666667 Tracing command mlockall2 pid 2987 tid 100993 td 0xfffffe011053a000 cpustop_handler() at cpustop_handler+0x2c/frame 0xffffff8000245d00 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffff8000245d20 trap() at trap+0x335/frame 0xffffff8000245f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000245f20 --- trap 0x13, rip = 0xffffffff80960a50, rsp = 0xffffff8000245fe0, rbp = 0xffffff8232993660 --- _isitmyx() at _isitmyx/frame 0xffffff8232993660 _rw_wlock_cookie() at _rw_wlock_cookie+0x69/frame 0xffffff8232993690 pmap_remove_pages() at pmap_remove_pages+0x2cb/frame 0xffffff8232993740 vmspace_exit() at vmspace_exit+0x9a/frame 0xffffff8232993770 exit1() at exit1+0x3e9/frame 0xffffff8232993800 sigexit() at sigexit+0x8f/frame 0xffffff8232993ac0 postsig() at postsig+0x417/frame 0xffffff8232993bb0 ast() at ast+0x247/frame 0xffffff8232993bf0 doreti_ast() at doreti_ast+0x1f/frame 0x6666666666666667 Tracing command mlockall2 pid 2986 tid 100398 td 0xfffffe0110517000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823297f470 mi_switch() at mi_switch+0x238/frame 0xffffff823297f4c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823297f500 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff823297f530 _sleep() at _sleep+0x28d/frame 0xffffff823297f5c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff823297f640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff823297f920 vm_fault() at vm_fault+0x73/frame 0xffffff823297f960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff823297f9f0 trap() at trap+0x604/frame 0xffffff823297fbf0 calltrap() at calltrap+0x8/frame 0xffffff823297fbf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 2985 tid 100882 td 0xfffffe001aefa000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232aba480 mi_switch() at mi_switch+0x238/frame 0xffffff8232aba4d0 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff8232aba520 __rw_rlock() at __rw_rlock+0x3da/frame 0xffffff8232aba5a0 pmap_enter() at pmap_enter+0x14a/frame 0xffffff8232aba640 vm_fault_hold() at vm_fault_hold+0x171d/frame 0xffffff8232aba920 vm_fault() at vm_fault+0x73/frame 0xffffff8232aba960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff8232aba9f0 trap() at trap+0x604/frame 0xffffff8232ababf0 calltrap() at calltrap+0x8/frame 0xffffff8232ababf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 2984 tid 101037 td 0xfffffe0110536000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232ae2470 mi_switch() at mi_switch+0x238/frame 0xffffff8232ae24c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232ae2500 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8232ae2530 _sleep() at _sleep+0x28d/frame 0xffffff8232ae25c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff8232ae2640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff8232ae2920 vm_fault() at vm_fault+0x73/frame 0xffffff8232ae2960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff8232ae29f0 trap() at trap+0x604/frame 0xffffff8232ae2bf0 calltrap() at calltrap+0x8/frame 0xffffff8232ae2bf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command mlockall2 pid 2983 tid 100925 td 0xfffffe0110539000 sched_switch() at sched_switch+0x1b4/frame 0xffffff82328cb470 mi_switch() at mi_switch+0x238/frame 0xffffff82328cb4c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82328cb500 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff82328cb530 _sleep() at _sleep+0x28d/frame 0xffffff82328cb5c0 swap_pager_getpages() at swap_pager_getpages+0x33c/frame 0xffffff82328cb640 vm_fault_hold() at vm_fault_hold+0x626/frame 0xffffff82328cb920 vm_fault() at vm_fault+0x73/frame 0xffffff82328cb960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff82328cb9f0 trap() at trap+0x604/frame 0xffffff82328cbbf0 calltrap() at calltrap+0x8/frame 0xffffff82328cbbf0 --- trap 0xc, rip = 0x400c10, rsp = 0x7fffffffd8d0, rbp = 0x6666666666666667 --- Tracing command sh pid 2969 tid 100991 td 0xfffffe001a947490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232989670 mi_switch() at mi_switch+0x238/frame 0xffffff82329896c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232989700 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff8232989760 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8232989780 _sleep() at _sleep+0x385/frame 0xffffff8232989810 kern_wait6() at kern_wait6+0x5fb/frame 0xffffff82329898b0 kern_wait() at kern_wait+0x9c/frame 0xffffff8232989a10 sys_wait4() at sys_wait4+0x35/frame 0xffffff8232989ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8232989bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8232989bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d323ca, rsp = 0x7fffffffd558, rbp = 0x1 --- Tracing command sh pid 2650 tid 100923 td 0xfffffe0110696490 Tracing command bash pid 1195 tid 100117 td 0xfffffe001ae80000 Tracing command csh pid 1192 tid 100129 td 0xfffffe0110222000 Tracing command su pid 1191 tid 100120 td 0xfffffe001aefb000 Tracing command bash pid 1187 tid 100127 td 0xfffffe0110222920 Tracing command sshd pid 1186 tid 100114 td 0xfffffe001a831920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823290c6a0 mi_switch() at mi_switch+0x238/frame 0xffffff823290c6f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823290c730 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff823290c790 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff823290c7b0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff823290c810 seltdwait() at seltdwait+0xdd/frame 0xffffff823290c850 kern_select() at kern_select+0x6c4/frame 0xffffff823290ca80 sys_select() at sys_select+0x5d/frame 0xffffff823290cad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff823290cbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff823290cbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80256dd0a, rsp = 0x7fffffffcc58, rbp = 0x7fffffffcce0 --- Tracing command sshd pid 1184 tid 100088 td 0xfffffe001a94c920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823288a780 mi_switch() at mi_switch+0x238/frame 0xffffff823288a7d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823288a810 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff823288a870 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff823288a890 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff823288a8f0 seltdwait() at seltdwait+0xdd/frame 0xffffff823288a930 sys_poll() at sys_poll+0x246/frame 0xffffff823288aad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff823288abf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff823288abf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8025076fa, rsp = 0x7fffffffccf8, rbp = 0x803c221c0 --- Tracing command getty pid 1070 tid 100124 td 0xfffffe0110223920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823293e710 mi_switch() at mi_switch+0x238/frame 0xffffff823293e760 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823293e7a0 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff823293e800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff823293e820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff823293e880 tty_wait() at tty_wait+0x4c/frame 0xffffff823293e8b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff823293e950 ttydev_read() at ttydev_read+0x95/frame 0xffffff823293e980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff823293e9f0 dofileread() at dofileread+0xa1/frame 0xffffff823293ea40 kern_readv() at kern_readv+0x6c/frame 0xffffff823293ea80 sys_read() at sys_read+0x64/frame 0xffffff823293ead0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff823293ebf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff823293ebf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4cd8a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command getty pid 1069 tid 100123 td 0xfffffe001a82d000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232939710 mi_switch() at mi_switch+0x238/frame 0xffffff8232939760 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82329397a0 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff8232939800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8232939820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff8232939880 tty_wait() at tty_wait+0x4c/frame 0xffffff82329398b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff8232939950 ttydev_read() at ttydev_read+0x95/frame 0xffffff8232939980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff82329399f0 dofileread() at dofileread+0xa1/frame 0xffffff8232939a40 kern_readv() at kern_readv+0x6c/frame 0xffffff8232939a80 sys_read() at sys_read+0x64/frame 0xffffff8232939ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8232939bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8232939bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4cd8a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command getty pid 1068 tid 100122 td 0xfffffe001a82d490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232934710 mi_switch() at mi_switch+0x238/frame 0xffffff8232934760 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82329347a0 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff8232934800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8232934820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff8232934880 tty_wait() at tty_wait+0x4c/frame 0xffffff82329348b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff8232934950 ttydev_read() at ttydev_read+0x95/frame 0xffffff8232934980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff82329349f0 dofileread() at dofileread+0xa1/frame 0xffffff8232934a40 kern_readv() at kern_readv+0x6c/frame 0xffffff8232934a80 sys_read() at sys_read+0x64/frame 0xffffff8232934ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8232934bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8232934bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4cd8a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command getty pid 1067 tid 100121 td 0xfffffe001a82d920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823292f710 mi_switch() at mi_switch+0x238/frame 0xffffff823292f760 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823292f7a0 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff823292f800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff823292f820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff823292f880 tty_wait() at tty_wait+0x4c/frame 0xffffff823292f8b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff823292f950 ttydev_read() at ttydev_read+0x95/frame 0xffffff823292f980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff823292f9f0 dofileread() at dofileread+0xa1/frame 0xffffff823292fa40 kern_readv() at kern_readv+0x6c/frame 0xffffff823292fa80 sys_read() at sys_read+0x64/frame 0xffffff823292fad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff823292fbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff823292fbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4cd8a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command getty pid 1066 tid 100106 td 0xfffffe001a9fe000 sched_switch() at sched_switch+0x1b4/frame 0xffffff82328e4710 mi_switch() at mi_switch+0x238/frame 0xffffff82328e4760 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82328e47a0 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff82328e4800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff82328e4820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff82328e4880 tty_wait() at tty_wait+0x4c/frame 0xffffff82328e48b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff82328e4950 ttydev_read() at ttydev_read+0x95/frame 0xffffff82328e4980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff82328e49f0 dofileread() at dofileread+0xa1/frame 0xffffff82328e4a40 kern_readv() at kern_readv+0x6c/frame 0xffffff82328e4a80 sys_read() at sys_read+0x64/frame 0xffffff82328e4ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff82328e4bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff82328e4bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4cd8a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command getty pid 1065 tid 100075 td 0xfffffe001a830490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232849710 mi_switch() at mi_switch+0x238/frame 0xffffff8232849760 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82328497a0 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff8232849800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8232849820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff8232849880 tty_wait() at tty_wait+0x4c/frame 0xffffff82328498b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff8232849950 ttydev_read() at ttydev_read+0x95/frame 0xffffff8232849980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff82328499f0 dofileread() at dofileread+0xa1/frame 0xffffff8232849a40 kern_readv() at kern_readv+0x6c/frame 0xffffff8232849a80 sys_read() at sys_read+0x64/frame 0xffffff8232849ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8232849bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8232849bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4cd8a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command getty pid 1064 tid 100079 td 0xfffffe001a998920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823285d710 mi_switch() at mi_switch+0x238/frame 0xffffff823285d760 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823285d7a0 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff823285d800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff823285d820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff823285d880 tty_wait() at tty_wait+0x4c/frame 0xffffff823285d8b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff823285d950 ttydev_read() at ttydev_read+0x95/frame 0xffffff823285d980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff823285d9f0 dofileread() at dofileread+0xa1/frame 0xffffff823285da40 kern_readv() at kern_readv+0x6c/frame 0xffffff823285da80 sys_read() at sys_read+0x64/frame 0xffffff823285dad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff823285dbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff823285dbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4cd8a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command getty pid 1063 tid 100089 td 0xfffffe001a94c490 sched_switch() at sched_switch+0x1b4/frame 0xffffff823288f710 mi_switch() at mi_switch+0x238/frame 0xffffff823288f760 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823288f7a0 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff823288f800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff823288f820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff823288f880 tty_wait() at tty_wait+0x4c/frame 0xffffff823288f8b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff823288f950 ttydev_read() at ttydev_read+0x95/frame 0xffffff823288f980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff823288f9f0 dofileread() at dofileread+0xa1/frame 0xffffff823288fa40 kern_readv() at kern_readv+0x6c/frame 0xffffff823288fa80 sys_read() at sys_read+0x64/frame 0xffffff823288fad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff823288fbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff823288fbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4cd8a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command getty pid 1062 tid 100081 td 0xfffffe001a998000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232867710 mi_switch() at mi_switch+0x238/frame 0xffffff8232867760 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82328677a0 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff8232867800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8232867820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff8232867880 tty_wait() at tty_wait+0x4c/frame 0xffffff82328678b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff8232867950 ttydev_read() at ttydev_read+0x95/frame 0xffffff8232867980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff82328679f0 dofileread() at dofileread+0xa1/frame 0xffffff8232867a40 kern_readv() at kern_readv+0x6c/frame 0xffffff8232867a80 sys_read() at sys_read+0x64/frame 0xffffff8232867ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8232867bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8232867bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4cd8a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command inetd pid 1023 tid 100116 td 0xfffffe001ae80490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82329166a0 mi_switch() at mi_switch+0x238/frame 0xffffff82329166f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232916730 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff8232916790 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff82329167b0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff8232916810 seltdwait() at seltdwait+0xdd/frame 0xffffff8232916850 kern_select() at kern_select+0x6c4/frame 0xffffff8232916a80 sys_select() at sys_select+0x5d/frame 0xffffff8232916ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8232916bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8232916bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800f61d0a, rsp = 0x7fffffffcd68, rbp = 0x1 --- Tracing command moused pid 990 tid 100100 td 0xfffffe001a82f000 sched_switch() at sched_switch+0x1b4/frame 0xffffff82328c66a0 mi_switch() at mi_switch+0x238/frame 0xffffff82328c66f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82328c6730 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff82328c6790 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff82328c67b0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff82328c6810 seltdwait() at seltdwait+0xdd/frame 0xffffff82328c6850 kern_select() at kern_select+0x6c4/frame 0xffffff82328c6a80 sys_select() at sys_select+0x5d/frame 0xffffff82328c6ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff82328c6bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff82328c6bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800d73d0a, rsp = 0x7fffffffd858, rbp = 0x7fffffffdf31 --- Tracing command watchdogd pid 970 tid 100082 td 0xfffffe001a97b920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823286c850 mi_switch() at mi_switch+0x238/frame 0xffffff823286c8a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823286c8e0 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff823286c940 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff823286c970 _sleep() at _sleep+0x3cb/frame 0xffffff823286ca00 kern_nanosleep() at kern_nanosleep+0xe8/frame 0xffffff823286ca70 sys_nanosleep() at sys_nanosleep+0x6e/frame 0xffffff823286cad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff823286cbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff823286cbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b29ffa, rsp = 0x7fffffffdb48, rbp = 0x7fffffffdd08 --- Tracing command cron pid 960 tid 100113 td 0xfffffe001a947000 Tracing command sendmail pid 953 tid 100091 td 0xfffffe001aa11000 Tracing command sendmail pid 949 tid 100102 td 0xfffffe001a9ff490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82328d0680 mi_switch() at mi_switch+0x238/frame 0xffffff82328d06d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82328d0710 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff82328d0770 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff82328d07a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1a4/frame 0xffffff82328d0810 seltdwait() at seltdwait+0x77/frame 0xffffff82328d0850 kern_select() at kern_select+0x6c4/frame 0xffffff82328d0a80 sys_select() at sys_select+0x5d/frame 0xffffff82328d0ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff82328d0bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff82328d0bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80144fd0a, rsp = 0x7fffffffb218, rbp = 0x7fffffffb2b0 --- Tracing command sshd pid 941 tid 100118 td 0xfffffe001aefb920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82329206a0 mi_switch() at mi_switch+0x238/frame 0xffffff82329206f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232920730 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff8232920790 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff82329207b0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff8232920810 seltdwait() at seltdwait+0xdd/frame 0xffffff8232920850 kern_select() at kern_select+0x6c4/frame 0xffffff8232920a80 sys_select() at sys_select+0x5d/frame 0xffffff8232920ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8232920bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8232920bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80256dd0a, rsp = 0x7fffffffcd78, rbp = 0x2 --- Tracing command ntpd pid 850 tid 100096 td 0xfffffe001a82f920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82328b26a0 mi_switch() at mi_switch+0x238/frame 0xffffff82328b26f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82328b2730 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff82328b2790 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff82328b27b0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff82328b2810 seltdwait() at seltdwait+0xdd/frame 0xffffff82328b2850 kern_select() at kern_select+0x6c4/frame 0xffffff82328b2a80 sys_select() at sys_select+0x5d/frame 0xffffff82328b2ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff82328b2bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff82328b2bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8013add0a, rsp = 0x7fffffffdbc8, rbp = 0x7fffffffdd08 --- Tracing command nfsd pid 755 tid 100109 td 0xfffffe001a82e000 sched_switch() at sched_switch+0x1b4/frame 0xffffff82328f38d0 mi_switch() at mi_switch+0x238/frame 0xffffff82328f3920 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82328f3960 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff82328f39c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff82328f39f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1a4/frame 0xffffff82328f3a60 svc_run_internal() at svc_run_internal+0x8a8/frame 0xffffff82328f3b90 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff82328f3ba0 fork_exit() at fork_exit+0x139/frame 0xffffff82328f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff82328f3bf0 --- trap 0xc, rip = 0x800886d3a, rsp = 0x7fffffffd578, rbp = 0x4 --- Tracing command nfsd pid 755 tid 100108 td 0xfffffe001a82e490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82328ee8d0 mi_switch() at mi_switch+0x238/frame 0xffffff82328ee920 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82328ee960 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff82328ee9c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff82328ee9f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1a4/frame 0xffffff82328eea60 svc_run_internal() at svc_run_internal+0x8a8/frame 0xffffff82328eeb90 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff82328eeba0 fork_exit() at fork_exit+0x139/frame 0xffffff82328eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff82328eebf0 --- trap 0xc, rip = 0x800886d3a, rsp = 0x7fffffffd578, rbp = 0x4 --- Tracing command nfsd pid 755 tid 100107 td 0xfffffe001a82e920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82328e98d0 mi_switch() at mi_switch+0x238/frame 0xffffff82328e9920 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82328e9960 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff82328e99c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff82328e99f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1a4/frame 0xffffff82328e9a60 svc_run_internal() at svc_run_internal+0x8a8/frame 0xffffff82328e9b90 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff82328e9ba0 fork_exit() at fork_exit+0x139/frame 0xffffff82328e9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff82328e9bf0 --- trap 0xc, rip = 0x800886d3a, rsp = 0x7fffffffd578, rbp = 0x4 --- Tracing command nfsd pid 755 tid 100085 td 0xfffffe001a94d000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823287b040 mi_switch() at mi_switch+0x238/frame 0xffffff823287b090 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823287b0d0 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff823287b130 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff823287b160 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1a4/frame 0xffffff823287b1d0 svc_run_internal() at svc_run_internal+0x8a8/frame 0xffffff823287b300 svc_run() at svc_run+0x94/frame 0xffffff823287b330 nfsrvd_nfsd() at nfsrvd_nfsd+0x1c7/frame 0xffffff823287b480 nfssvc_nfsd() at nfssvc_nfsd+0x9b/frame 0xffffff823287bab0 sys_nfssvc() at sys_nfssvc+0xb0/frame 0xffffff823287bad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff823287bbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff823287bbf0 --- syscall (155, FreeBSD ELF64, sys_nfssvc), rip = 0x800886d3a, rsp = 0x7fffffffd578, rbp = 0x4 --- Tracing command nfsd pid 754 tid 100099 td 0xfffffe001aa10000 sched_switch() at sched_switch+0x1b4/frame 0xffffff82328c16a0 mi_switch() at mi_switch+0x238/frame 0xffffff82328c16f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82328c1730 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff82328c1790 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff82328c17b0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff82328c1810 seltdwait() at seltdwait+0xdd/frame 0xffffff82328c1850 kern_select() at kern_select+0x6c4/frame 0xffffff82328c1a80 sys_select() at sys_select+0x5d/frame 0xffffff82328c1ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff82328c1bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff82328c1bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800939d0a, rsp = 0x7fffffffd828, rbp = 0x4 --- Tracing command mountd pid 745 tid 100077 td 0xfffffe001a94e490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82328536a0 mi_switch() at mi_switch+0x238/frame 0xffffff82328536f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232853730 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff8232853790 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff82328537b0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff8232853810 seltdwait() at seltdwait+0xdd/frame 0xffffff8232853850 kern_select() at kern_select+0x6c4/frame 0xffffff8232853a80 sys_select() at sys_select+0x5d/frame 0xffffff8232853ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8232853bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8232853bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b51d0a, rsp = 0x7fffffffdb78, rbp = 0x801419060 --- Tracing command rpcbind pid 640 tid 100097 td 0xfffffe001a82f490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82328b7760 mi_switch() at mi_switch+0x238/frame 0xffffff82328b77b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82328b77f0 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff82328b7850 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff82328b7880 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1a4/frame 0xffffff82328b78f0 seltdwait() at seltdwait+0x77/frame 0xffffff82328b7930 sys_poll() at sys_poll+0x246/frame 0xffffff82328b7ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff82328b7bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff82328b7bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800cf46fa, rsp = 0x7fffffffba48, rbp = 0x80141b020 --- Tracing command syslogd pid 614 tid 100092 td 0xfffffe001a97a490 sched_switch() at sched_switch+0x1b4/frame 0xffffff823289e6a0 mi_switch() at mi_switch+0x238/frame 0xffffff823289e6f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823289e730 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff823289e790 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff823289e7b0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff823289e810 seltdwait() at seltdwait+0xdd/frame 0xffffff823289e850 kern_select() at kern_select+0x6c4/frame 0xffffff823289ea80 sys_select() at sys_select+0x5d/frame 0xffffff823289ead0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff823289ebf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff823289ebf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b50d0a, rsp = 0x7fffffffd118, rbp = 0x80142c108 --- Tracing command devd pid 433 tid 100095 td 0xfffffe001a830000 sched_switch() at sched_switch+0x1b4/frame 0xffffff82328ad680 mi_switch() at mi_switch+0x238/frame 0xffffff82328ad6d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82328ad710 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff82328ad770 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff82328ad7a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1a4/frame 0xffffff82328ad810 seltdwait() at seltdwait+0x77/frame 0xffffff82328ad850 kern_select() at kern_select+0x6c4/frame 0xffffff82328ada80 sys_select() at sys_select+0x5d/frame 0xffffff82328adad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff82328adbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff82328adbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x44293a, rsp = 0x7fffffffbc28, rbp = 0x10 --- Tracing command softdepflush pid 17 tid 100074 td 0xfffffe001a830920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232844a10 mi_switch() at mi_switch+0x238/frame 0xffffff8232844a60 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232844aa0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8232844ad0 _sleep() at _sleep+0x28d/frame 0xffffff8232844b60 softdep_flush() at softdep_flush+0x213/frame 0xffffff8232844ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232844bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232844bf0 --- trap 0, rip = 0, rsp = 0xffffff8232844cb0, rbp = 0 --- Tracing command syncer pid 16 tid 100073 td 0xfffffe001a831000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823283f9e0 mi_switch() at mi_switch+0x238/frame 0xffffff823283fa30 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823283fa70 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff823283faa0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x1a4/frame 0xffffff823283fb10 sched_sync() at sched_sync+0x4fc/frame 0xffffff823283fba0 fork_exit() at fork_exit+0x139/frame 0xffffff823283fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823283fbf0 --- trap 0, rip = 0, rsp = 0xffffff823283fcb0, rbp = 0 --- Tracing command vnlru pid 9 tid 100072 td 0xfffffe001591c000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823283a9c0 mi_switch() at mi_switch+0x238/frame 0xffffff823283aa10 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823283aa50 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff823283aa80 _sleep() at _sleep+0x28d/frame 0xffffff823283ab10 vnlru_proc() at vnlru_proc+0x56a/frame 0xffffff823283aba0 fork_exit() at fork_exit+0x139/frame 0xffffff823283abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823283abf0 --- trap 0, rip = 0, rsp = 0xffffff823283acb0, rbp = 0 --- Tracing command bufdaemon pid 8 tid 100071 td 0xfffffe001591c490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232835a30 mi_switch() at mi_switch+0x238/frame 0xffffff8232835a80 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232835ac0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8232835af0 _sleep() at _sleep+0x28d/frame 0xffffff8232835b80 buf_daemon() at buf_daemon+0x1bc/frame 0xffffff8232835ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232835bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232835bf0 --- trap 0, rip = 0, rsp = 0xffffff8232835cb0, rbp = 0 --- Tracing command pagezero pid 7 tid 100070 td 0xfffffe001591c920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232830a30 mi_switch() at mi_switch+0x238/frame 0xffffff8232830a80 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232830ac0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8232830af0 _sleep() at _sleep+0x28d/frame 0xffffff8232830b80 vm_pagezero() at vm_pagezero+0x88/frame 0xffffff8232830ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232830bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232830bf0 --- trap 0, rip = 0, rsp = 0xffffff8232830cb0, rbp = 0 --- Tracing command vmdaemon pid 6 tid 100069 td 0xfffffe001591f000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823282b9d0 mi_switch() at mi_switch+0x238/frame 0xffffff823282ba20 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823282ba60 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823282ba90 _sleep() at _sleep+0x3fb/frame 0xffffff823282bb20 vm_daemon() at vm_daemon+0x57/frame 0xffffff823282bba0 fork_exit() at fork_exit+0x139/frame 0xffffff823282bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823282bbf0 --- trap 0, rip = 0, rsp = 0xffffff823282bcb0, rbp = 0 --- Tracing command pagedaemon pid 5 tid 100068 td 0xfffffe001591f490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82328268f0 mi_switch() at mi_switch+0x238/frame 0xffffff8232826940 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff8232826990 __rw_wlock_hard() at __rw_wlock_hard+0x248/frame 0xffffff8232826a00 _rw_wlock_cookie() at _rw_wlock_cookie+0x112/frame 0xffffff8232826a30 pmap_remove_all() at pmap_remove_all+0x3f/frame 0xffffff8232826a90 vm_pageout() at vm_pageout+0x1298/frame 0xffffff8232826ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232826bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232826bf0 --- trap 0, rip = 0, rsp = 0xffffff8232826cb0, rbp = 0 --- Tracing command xpt_thrd pid 4 tid 100067 td 0xfffffe001591f920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82326a1a20 mi_switch() at mi_switch+0x238/frame 0xffffff82326a1a70 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82326a1ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff82326a1ae0 _sleep() at _sleep+0x3fb/frame 0xffffff82326a1b70 xpt_scanner_thread() at xpt_scanner_thread+0xf2/frame 0xffffff82326a1ba0 fork_exit() at fork_exit+0x139/frame 0xffffff82326a1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff82326a1bf0 --- trap 0, rip = 0, rsp = 0xffffff82326a1cb0, rbp = 0 --- Tracing command sctp_iterator pid 3 tid 100066 td 0xfffffe0015921000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823269ca30 mi_switch() at mi_switch+0x238/frame 0xffffff823269ca80 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823269cac0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823269caf0 _sleep() at _sleep+0x3fb/frame 0xffffff823269cb80 sctp_iterator_thread() at sctp_iterator_thread+0x4b/frame 0xffffff823269cba0 fork_exit() at fork_exit+0x139/frame 0xffffff823269cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823269cbf0 --- trap 0, rip = 0, rsp = 0xffffff823269ccb0, rbp = 0 --- Tracing command fdc0 pid 2 tid 100061 td 0xfffffe0015922920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823267e990 mi_switch() at mi_switch+0x238/frame 0xffffff823267e9e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823267ea20 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff823267ea50 _sleep() at _sleep+0x28d/frame 0xffffff823267eae0 fdc_thread() at fdc_thread+0x846/frame 0xffffff823267eba0 fork_exit() at fork_exit+0x139/frame 0xffffff823267ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823267ebf0 --- trap 0, rip = 0, rsp = 0xffffff823267ecb0, rbp = 0 --- Tracing command usb pid 15 tid 100058 td 0xfffffe00158ec000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232638a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232638aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232638ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232638b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232638b70 usb_process() at usb_process+0x172/frame 0xffffff8232638ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232638bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232638bf0 --- trap 0, rip = 0, rsp = 0xffffff8232638cb0, rbp = 0 --- Tracing command usb pid 15 tid 100057 td 0xfffffe00158ec490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232633a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232633aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232633ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232633b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232633b70 usb_process() at usb_process+0x172/frame 0xffffff8232633ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232633bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232633bf0 --- trap 0, rip = 0, rsp = 0xffffff8232633cb0, rbp = 0 --- Tracing command usb pid 15 tid 100056 td 0xfffffe00158ec920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823262ea50 mi_switch() at mi_switch+0x238/frame 0xffffff823262eaa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823262eae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823262eb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff823262eb70 usb_process() at usb_process+0x172/frame 0xffffff823262eba0 fork_exit() at fork_exit+0x139/frame 0xffffff823262ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823262ebf0 --- trap 0, rip = 0, rsp = 0xffffff823262ecb0, rbp = 0 --- Tracing command usb pid 15 tid 100055 td 0xfffffe00158ed000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232629a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232629aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232629ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232629b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232629b70 usb_process() at usb_process+0x172/frame 0xffffff8232629ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232629bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232629bf0 --- trap 0, rip = 0, rsp = 0xffffff8232629cb0, rbp = 0 --- Tracing command usb pid 15 tid 100053 td 0xfffffe00158ed920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823249ca50 mi_switch() at mi_switch+0x238/frame 0xffffff823249caa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823249cae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823249cb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff823249cb70 usb_process() at usb_process+0x172/frame 0xffffff823249cba0 fork_exit() at fork_exit+0x139/frame 0xffffff823249cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823249cbf0 --- trap 0, rip = 0, rsp = 0xffffff823249ccb0, rbp = 0 --- Tracing command usb pid 15 tid 100052 td 0xfffffe00158ef000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232497a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232497aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232497ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232497b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232497b70 usb_process() at usb_process+0x172/frame 0xffffff8232497ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232497bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232497bf0 --- trap 0, rip = 0, rsp = 0xffffff8232497cb0, rbp = 0 --- Tracing command usb pid 15 tid 100051 td 0xfffffe00158ef490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232492a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232492aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232492ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232492b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232492b70 usb_process() at usb_process+0x172/frame 0xffffff8232492ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232492bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232492bf0 --- trap 0, rip = 0, rsp = 0xffffff8232492cb0, rbp = 0 --- Tracing command usb pid 15 tid 100050 td 0xfffffe00158ef920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823248da50 mi_switch() at mi_switch+0x238/frame 0xffffff823248daa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823248dae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823248db10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff823248db70 usb_process() at usb_process+0x172/frame 0xffffff823248dba0 fork_exit() at fork_exit+0x139/frame 0xffffff823248dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823248dbf0 --- trap 0, rip = 0, rsp = 0xffffff823248dcb0, rbp = 0 --- Tracing command usb pid 15 tid 100049 td 0xfffffe00158dd000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232444a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232444aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232444ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232444b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232444b70 usb_process() at usb_process+0x172/frame 0xffffff8232444ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232444bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232444bf0 --- trap 0, rip = 0, rsp = 0xffffff8232444cb0, rbp = 0 --- Tracing command usb pid 15 tid 100048 td 0xfffffe00158dd490 sched_switch() at sched_switch+0x1b4/frame 0xffffff823243fa50 mi_switch() at mi_switch+0x238/frame 0xffffff823243faa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823243fae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823243fb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff823243fb70 usb_process() at usb_process+0x172/frame 0xffffff823243fba0 fork_exit() at fork_exit+0x139/frame 0xffffff823243fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823243fbf0 --- trap 0, rip = 0, rsp = 0xffffff823243fcb0, rbp = 0 --- Tracing command usb pid 15 tid 100047 td 0xfffffe00158dd920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823243aa50 mi_switch() at mi_switch+0x238/frame 0xffffff823243aaa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823243aae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823243ab10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff823243ab70 usb_process() at usb_process+0x172/frame 0xffffff823243aba0 fork_exit() at fork_exit+0x139/frame 0xffffff823243abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823243abf0 --- trap 0, rip = 0, rsp = 0xffffff823243acb0, rbp = 0 --- Tracing command usb pid 15 tid 100046 td 0xfffffe00158de000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232435a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232435aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232435ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232435b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232435b70 usb_process() at usb_process+0x172/frame 0xffffff8232435ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232435bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232435bf0 --- trap 0, rip = 0, rsp = 0xffffff8232435cb0, rbp = 0 --- Tracing command usb pid 15 tid 100045 td 0xfffffe00158de490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82323eca50 mi_switch() at mi_switch+0x238/frame 0xffffff82323ecaa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82323ecae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff82323ecb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff82323ecb70 usb_process() at usb_process+0x172/frame 0xffffff82323ecba0 fork_exit() at fork_exit+0x139/frame 0xffffff82323ecbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff82323ecbf0 --- trap 0, rip = 0, rsp = 0xffffff82323eccb0, rbp = 0 --- Tracing command usb pid 15 tid 100044 td 0xfffffe00158de920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82323e7a50 mi_switch() at mi_switch+0x238/frame 0xffffff82323e7aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82323e7ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff82323e7b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff82323e7b70 usb_process() at usb_process+0x172/frame 0xffffff82323e7ba0 fork_exit() at fork_exit+0x139/frame 0xffffff82323e7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff82323e7bf0 --- trap 0, rip = 0, rsp = 0xffffff82323e7cb0, rbp = 0 --- Tracing command usb pid 15 tid 100043 td 0xfffffe00158e1000 sched_switch() at sched_switch+0x1b4/frame 0xffffff82323e2a50 mi_switch() at mi_switch+0x238/frame 0xffffff82323e2aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82323e2ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff82323e2b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff82323e2b70 usb_process() at usb_process+0x172/frame 0xffffff82323e2ba0 fork_exit() at fork_exit+0x139/frame 0xffffff82323e2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff82323e2bf0 --- trap 0, rip = 0, rsp = 0xffffff82323e2cb0, rbp = 0 --- Tracing command usb pid 15 tid 100042 td 0xfffffe00158e1490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82323dda50 mi_switch() at mi_switch+0x238/frame 0xffffff82323ddaa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82323ddae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff82323ddb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff82323ddb70 usb_process() at usb_process+0x172/frame 0xffffff82323ddba0 fork_exit() at fork_exit+0x139/frame 0xffffff82323ddbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff82323ddbf0 --- trap 0, rip = 0, rsp = 0xffffff82323ddcb0, rbp = 0 --- Tracing command usb pid 15 tid 100040 td 0xfffffe00158e2000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823238fa50 mi_switch() at mi_switch+0x238/frame 0xffffff823238faa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823238fae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823238fb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff823238fb70 usb_process() at usb_process+0x172/frame 0xffffff823238fba0 fork_exit() at fork_exit+0x139/frame 0xffffff823238fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823238fbf0 --- trap 0, rip = 0, rsp = 0xffffff823238fcb0, rbp = 0 --- Tracing command usb pid 15 tid 100039 td 0xfffffe00158d6000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823238aa50 mi_switch() at mi_switch+0x238/frame 0xffffff823238aaa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823238aae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823238ab10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff823238ab70 usb_process() at usb_process+0x172/frame 0xffffff823238aba0 fork_exit() at fork_exit+0x139/frame 0xffffff823238abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823238abf0 --- trap 0, rip = 0, rsp = 0xffffff823238acb0, rbp = 0 --- Tracing command usb pid 15 tid 100038 td 0xfffffe00158d6490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232385a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232385aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232385ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232385b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232385b70 usb_process() at usb_process+0x172/frame 0xffffff8232385ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232385bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232385bf0 --- trap 0, rip = 0, rsp = 0xffffff8232385cb0, rbp = 0 --- Tracing command usb pid 15 tid 100037 td 0xfffffe00158d6920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232380a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232380aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232380ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232380b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232380b70 usb_process() at usb_process+0x172/frame 0xffffff8232380ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232380bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232380bf0 --- trap 0, rip = 0, rsp = 0xffffff8232380cb0, rbp = 0 --- Tracing command usb pid 15 tid 100035 td 0xfffffe00158d7490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232332a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232332aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232332ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232332b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232332b70 usb_process() at usb_process+0x172/frame 0xffffff8232332ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232332bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232332bf0 --- trap 0, rip = 0, rsp = 0xffffff8232332cb0, rbp = 0 --- Tracing command usb pid 15 tid 100034 td 0xfffffe00158d7920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823232da50 mi_switch() at mi_switch+0x238/frame 0xffffff823232daa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823232dae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823232db10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff823232db70 usb_process() at usb_process+0x172/frame 0xffffff823232dba0 fork_exit() at fork_exit+0x139/frame 0xffffff823232dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823232dbf0 --- trap 0, rip = 0, rsp = 0xffffff823232dcb0, rbp = 0 --- Tracing command usb pid 15 tid 100033 td 0xfffffe00158d8000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232328a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232328aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232328ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232328b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232328b70 usb_process() at usb_process+0x172/frame 0xffffff8232328ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232328bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232328bf0 --- trap 0, rip = 0, rsp = 0xffffff8232328cb0, rbp = 0 --- Tracing command usb pid 15 tid 100032 td 0xfffffe00158d8490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232323a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232323aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232323ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232323b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232323b70 usb_process() at usb_process+0x172/frame 0xffffff8232323ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232323bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232323bf0 --- trap 0, rip = 0, rsp = 0xffffff8232323cb0, rbp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xfffffe00154bb920 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002a3a20 mi_switch() at mi_switch+0x238/frame 0xffffff80002a3a70 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff80002a3ab0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff80002a3ae0 msleep_spin_sbt() at msleep_spin_sbt+0x17f/frame 0xffffff80002a3b60 random_kthread() at random_kthread+0x190/frame 0xffffff80002a3ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002a3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002a3bf0 --- trap 0, rip = 0, rsp = 0xffffff80002a3cb0, rbp = 0 --- Tracing command geom pid 13 tid 100015 td 0xfffffe00154a3000 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002999e0 mi_switch() at mi_switch+0x238/frame 0xffffff8000299a30 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8000299a70 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8000299aa0 _sleep() at _sleep+0x3fb/frame 0xffffff8000299b30 g_io_schedule_down() at g_io_schedule_down+0x296/frame 0xffffff8000299b90 g_down_procbody() at g_down_procbody+0x7c/frame 0xffffff8000299ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000299bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000299bf0 --- trap 0, rip = 0, rsp = 0xffffff8000299cb0, rbp = 0 --- Tracing command geom pid 13 tid 100014 td 0xfffffe00154a3490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000294970 mi_switch() at mi_switch+0x238/frame 0xffffff80002949c0 turnstile_wait() at turnstile_wait+0x289/frame 0xffffff8000294a10 __rw_rlock() at __rw_rlock+0x3da/frame 0xffffff8000294a90 pmap_page_is_mapped() at pmap_page_is_mapped+0x49/frame 0xffffff8000294ac0 swp_pager_async_iodone() at swp_pager_async_iodone+0x2c8/frame 0xffffff8000294af0 bufdone() at bufdone+0x41/frame 0xffffff8000294b10 swapgeom_done() at swapgeom_done+0x3e/frame 0xffffff8000294b30 biodone() at biodone+0x8c/frame 0xffffff8000294b70 g_io_schedule_up() at g_io_schedule_up+0xa8/frame 0xffffff8000294b90 g_up_procbody() at g_up_procbody+0x7c/frame 0xffffff8000294ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000294bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000294bf0 --- trap 0, rip = 0, rsp = 0xffffff8000294cb0, rbp = 0 --- Tracing command geom pid 13 tid 100013 td 0xfffffe00154a3920 sched_switch() at sched_switch+0x1b4/frame 0xffffff800028fa10 mi_switch() at mi_switch+0x238/frame 0xffffff800028fa60 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff800028faa0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff800028fad0 _sleep() at _sleep+0x3fb/frame 0xffffff800028fb60 g_run_events() at g_run_events+0x45f/frame 0xffffff800028fba0 fork_exit() at fork_exit+0x139/frame 0xffffff800028fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800028fbf0 --- trap 0, rip = 0, rsp = 0xffffff800028fcb0, rbp = 0 --- Tracing command intr pid 12 tid 100063 td 0xfffffe0015922000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100062 td 0xfffffe0015922490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232683b00 mi_switch() at mi_switch+0x238/frame 0xffffff8232683b50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff8232683ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232683bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232683bf0 --- trap 0, rip = 0, rsp = 0xffffff8232683cb0, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffffe00158e2490 sched_switch() at sched_switch+0x1b4/frame 0xffffff823266fb00 mi_switch() at mi_switch+0x238/frame 0xffffff823266fb50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff823266fba0 fork_exit() at fork_exit+0x139/frame 0xffffff823266fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823266fbf0 --- trap 0, rip = 0, rsp = 0xffffff823266fcb0, rbp = 0 --- Tracing command intr pid 12 tid 100059 td 0xfffffe00158e2920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232660b00 mi_switch() at mi_switch+0x238/frame 0xffffff8232660b50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff8232660ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232660bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232660bf0 --- trap 0, rip = 0, rsp = 0xffffff8232660cb0, rbp = 0 --- Tracing command intr pid 12 tid 100054 td 0xfffffe00158ed490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xfffffe00158e1920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82323d8b00 mi_switch() at mi_switch+0x238/frame 0xffffff82323d8b50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff82323d8ba0 fork_exit() at fork_exit+0x139/frame 0xffffff82323d8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff82323d8bf0 --- trap 0, rip = 0, rsp = 0xffffff82323d8cb0, rbp = 0 --- Tracing command intr pid 12 tid 100036 td 0xfffffe00158d7000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823237bb00 mi_switch() at mi_switch+0x238/frame 0xffffff823237bb50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff823237bba0 fork_exit() at fork_exit+0x139/frame 0xffffff823237bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823237bbf0 --- trap 0, rip = 0, rsp = 0xffffff823237bcb0, rbp = 0 --- Tracing command intr pid 12 tid 100031 td 0xfffffe00158d8920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823231eb00 mi_switch() at mi_switch+0x238/frame 0xffffff823231eb50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff823231eba0 fork_exit() at fork_exit+0x139/frame 0xffffff823231ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823231ebf0 --- trap 0, rip = 0, rsp = 0xffffff823231ecb0, rbp = 0 --- Tracing command intr pid 12 tid 100030 td 0xfffffe00154bd490 sched_switch() at sched_switch+0x1b4/frame 0xffffff80003ecb00 mi_switch() at mi_switch+0x238/frame 0xffffff80003ecb50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff80003ecba0 fork_exit() at fork_exit+0x139/frame 0xffffff80003ecbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80003ecbf0 --- trap 0, rip = 0, rsp = 0xffffff80003eccb0, rbp = 0 --- Tracing command intr pid 12 tid 100029 td 0xfffffe00154bd920 sched_switch() at sched_switch+0x1b4/frame 0xffffff80003e7b00 mi_switch() at mi_switch+0x238/frame 0xffffff80003e7b50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff80003e7ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80003e7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80003e7bf0 --- trap 0, rip = 0, rsp = 0xffffff80003e7cb0, rbp = 0 --- Tracing command intr pid 12 tid 100028 td 0xfffffe001565c000 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002dbb00 mi_switch() at mi_switch+0x238/frame 0xffffff80002dbb50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff80002dbba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002dbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002dbbf0 --- trap 0, rip = 0, rsp = 0xffffff80002dbcb0, rbp = 0 --- Tracing command intr pid 12 tid 100023 td 0xfffffe001565d920 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002c2b00 mi_switch() at mi_switch+0x238/frame 0xffffff80002c2b50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff80002c2ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002c2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002c2bf0 --- trap 0, rip = 0, rsp = 0xffffff80002c2cb0, rbp = 0 --- Tracing command intr pid 12 tid 100022 td 0xfffffe00154ba000 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002bdb00 mi_switch() at mi_switch+0x238/frame 0xffffff80002bdb50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff80002bdba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002bdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002bdbf0 --- trap 0, rip = 0, rsp = 0xffffff80002bdcb0, rbp = 0 --- Tracing command intr pid 12 tid 100019 td 0xfffffe00154bb000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100018 td 0xfffffe00154bb490 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002a9b00 mi_switch() at mi_switch+0x238/frame 0xffffff80002a9b50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff80002a9ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002a9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002a9bf0 --- trap 0, rip = 0, rsp = 0xffffff80002a9cb0, rbp = 0 --- Tracing command intr pid 12 tid 100012 td 0xfffffe00154a4000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xfffffe00154a4490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100010 td 0xfffffe00154a4920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100009 td 0xfffffe0015486490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100008 td 0xfffffe0015486920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000276b00 mi_switch() at mi_switch+0x238/frame 0xffffff8000276b50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff8000276ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000276bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000276bf0 --- trap 0, rip = 0, rsp = 0xffffff8000276cb0, rbp = 0 --- Tracing command intr pid 12 tid 100007 td 0xfffffe0015491000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000271b00 mi_switch() at mi_switch+0x238/frame 0xffffff8000271b50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff8000271ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000271bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000271bf0 --- trap 0, rip = 0, rsp = 0xffffff8000271cb0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe0015491490 sched_switch() at sched_switch+0x1b4/frame 0xffffff800026cac0 mi_switch() at mi_switch+0x238/frame 0xffffff800026cb10 sched_idletd() at sched_idletd+0x1d3/frame 0xffffff800026cba0 fork_exit() at fork_exit+0x139/frame 0xffffff800026cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800026cbf0 --- trap 0, rip = 0, rsp = 0xffffff800026ccb0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe0015491920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000267ac0 mi_switch() at mi_switch+0x238/frame 0xffffff8000267b10 sched_idletd() at sched_idletd+0x323/frame 0xffffff8000267ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000267bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000267bf0 --- trap 0, rip = 0, rsp = 0xffffff8000267cb0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe0015485000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000262ac0 mi_switch() at mi_switch+0x238/frame 0xffffff8000262b10 sched_idletd() at sched_idletd+0x1d3/frame 0xffffff8000262ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000262bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000262bf0 --- trap 0, rip = 0, rsp = 0xffffff8000262cb0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe0015485490 sched_switch() at sched_switch+0x1b4/frame 0xffffff800025dac0 mi_switch() at mi_switch+0x238/frame 0xffffff800025db10 sched_idletd() at sched_idletd+0x323/frame 0xffffff800025dba0 fork_exit() at fork_exit+0x139/frame 0xffffff800025dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800025dbf0 --- trap 0, rip = 0, rsp = 0xffffff800025dcb0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe0015485920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000258670 mi_switch() at mi_switch+0x238/frame 0xffffff80002586c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8000258700 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff8000258760 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8000258780 _sleep() at _sleep+0x385/frame 0xffffff8000258810 kern_wait6() at kern_wait6+0x5fb/frame 0xffffff80002588b0 kern_wait() at kern_wait+0x9c/frame 0xffffff8000258a10 sys_wait4() at sys_wait4+0x35/frame 0xffffff8000258ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8000258bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8000258bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x41242a, rsp = 0x7fffffffd798, rbp = 0x8d --- Tracing command audit pid 10 tid 100001 td 0xfffffe0015486000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000253a00 mi_switch() at mi_switch+0x238/frame 0xffffff8000253a50 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8000253a90 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8000253ac0 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8000253b20 audit_worker() at audit_worker+0x77/frame 0xffffff8000253ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000253bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000253bf0 --- trap 0, rip = 0, rsp = 0xffffff8000253cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffffe0015921490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82326969c0 mi_switch() at mi_switch+0x238/frame 0xffffff8232696a10 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232696a50 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8232696a80 _sleep() at _sleep+0x28d/frame 0xffffff8232696b10 pause_sbt() at pause_sbt+0xc3/frame 0xffffff8232696b60 deadlkres() at deadlkres+0x2e5/frame 0xffffff8232696ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232696bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232696bf0 --- trap 0, rip = 0, rsp = 0xffffff8232696cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffffe0015921920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232691a30 mi_switch() at mi_switch+0x238/frame 0xffffff8232691a80 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232691ac0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232691af0 msleep_spin_sbt() at msleep_spin_sbt+0x22d/frame 0xffffff8232691b70 taskqueue_thread_loop() at taskqueue_thread_loop+0x9c/frame 0xffffff8232691ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232691bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232691bf0 --- trap 0, rip = 0, rsp = 0xffffff8232691cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe001565c490 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002d6a20 mi_switch() at mi_switch+0x238/frame 0xffffff80002d6a70 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff80002d6ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002d6ae0 _sleep() at _sleep+0x3fb/frame 0xffffff80002d6b70 taskqueue_thread_loop() at taskqueue_thread_loop+0x166/frame 0xffffff80002d6ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002d6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002d6bf0 --- trap 0, rip = 0, rsp = 0xffffff80002d6cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe001565c920 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002d1a30 mi_switch() at mi_switch+0x238/frame 0xffffff80002d1a80 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff80002d1ac0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002d1af0 msleep_spin_sbt() at msleep_spin_sbt+0x22d/frame 0xffffff80002d1b70 taskqueue_thread_loop() at taskqueue_thread_loop+0x9c/frame 0xffffff80002d1ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002d1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002d1bf0 --- trap 0, rip = 0, rsp = 0xffffff80002d1cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe001565d000 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002cca30 mi_switch() at mi_switch+0x238/frame 0xffffff80002cca80 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff80002ccac0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002ccaf0 msleep_spin_sbt() at msleep_spin_sbt+0x22d/frame 0xffffff80002ccb70 taskqueue_thread_loop() at taskqueue_thread_loop+0x9c/frame 0xffffff80002ccba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002ccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002ccbf0 --- trap 0, rip = 0, rsp = 0xffffff80002cccb0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe001565d490 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002c7a30 mi_switch() at mi_switch+0x238/frame 0xffffff80002c7a80 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff80002c7ac0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002c7af0 msleep_spin_sbt() at msleep_spin_sbt+0x22d/frame 0xffffff80002c7b70 taskqueue_thread_loop() at taskqueue_thread_loop+0x9c/frame 0xffffff80002c7ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002c7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002c7bf0 --- trap 0, rip = 0, rsp = 0xffffff80002c7cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe00154ba490 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002b8a20 mi_switch() at mi_switch+0x238/frame 0xffffff80002b8a70 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff80002b8ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002b8ae0 _sleep() at _sleep+0x3fb/frame 0xffffff80002b8b70 taskqueue_thread_loop() at taskqueue_thread_loop+0x166/frame 0xffffff80002b8ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002b8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002b8bf0 --- trap 0, rip = 0, rsp = 0xffffff80002b8cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe00154ba920 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002b3a20 mi_switch() at mi_switch+0x238/frame 0xffffff80002b3a70 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff80002b3ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002b3ae0 _sleep() at _sleep+0x3fb/frame 0xffffff80002b3b70 taskqueue_thread_loop() at taskqueue_thread_loop+0x166/frame 0xffffff80002b3ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002b3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002b3bf0 --- trap 0, rip = 0, rsp = 0xffffff80002b3cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe00154bd000 sched_switch() at sched_switch+0x1b4/frame 0xffffff800029ea20 mi_switch() at mi_switch+0x238/frame 0xffffff800029ea70 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff800029eab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff800029eae0 _sleep() at _sleep+0x3fb/frame 0xffffff800029eb70 taskqueue_thread_loop() at taskqueue_thread_loop+0x166/frame 0xffffff800029eba0 fork_exit() at fork_exit+0x139/frame 0xffffff800029ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800029ebf0 --- trap 0, rip = 0, rsp = 0xffffff800029ecb0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff813b5b00 sched_switch() at sched_switch+0x1b4/frame 0xffffffff81963af0 mi_switch() at mi_switch+0x238/frame 0xffffffff81963b40 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffffff81963b80 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffffff81963bb0 _sleep() at _sleep+0x28d/frame 0xffffffff81963c40 scheduler() at scheduler+0x2c4/frame 0xffffffff81963c90 mi_startup() at mi_startup+0x77/frame 0xffffffff81963cb0 btext() at btext+0x2c db:0:allt> call doadump Dumping 745 out of 8039 MB:..3%..11%..22%..31%..41%..52%..61%..71%..82%..91% Dump complete = 0 db:0:doadump> reset (kgdb) bt #0 doadump (textdump=0x15484000) at ../../../kern/kern_shutdown.c:264 #1 0xffffffff8033806c in db_fncall (dummy1=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:578 #2 0xffffffff8033831d in db_command (last_cmdp=0xffffffff8137f3a0, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:449 #3 0xffffffff8033ceb3 in db_script_exec (scriptname=0xffffffff8137fc40 "doadump", warnifnotfound=0x1) at ../../../ddb/db_script.c:302 #4 0xffffffff803383a1 in db_command (last_cmdp=0xffffffff8137f3a0, cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:449 #5 0xffffffff803385f0 in db_command_loop () at ../../../ddb/db_command.c:502 #6 0xffffffff8033a769 in db_trap (type=, code=) at ../../../ddb/db_main.c:231 #7 0xffffffff8094a508 in kdb_trap (type=0x3, code=0x0, tf=0xffffff8232a83450) at ../../../kern/subr_kdb.c:654 #8 0xffffffff80cba3cd in trap (frame=0xffffff8232a83450) at ../../../amd64/amd64/trap.c:579 #9 0xffffffff80ca3033 in calltrap () at ../../../amd64/amd64/exception.S:228 #10 0xffffffff80949f8b in kdb_enter (why=0xffffffff80f80dd6 "panic", msg=0x80
) at cpufunc.h:63 #11 0xffffffff8090e8d1 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:747 #12 0xffffffff8090e9d7 in panic (fmt=) at ../../../kern/kern_shutdown.c:683 #13 0xffffffff8090b063 in __rw_assert (c=, what=, file=, line=) at ../../../kern/kern_rwlock.c:1160 #14 0xffffffff80b9daac in vm_page_remove (m=0xfffffe0219118df8) at ../../../vm/vm_page.c:900 #15 0xffffffff80b9dcdd in vm_page_free_toq (m=0xfffffe0219118df8) at ../../../vm/vm_page.c:1916 #16 0xffffffff80cb0782 in pmap_remove_pages (pmap=) at ../../../amd64/amd64/pmap.c:4518 #17 0xffffffff80b9671a in vmspace_exit (td=0xfffffe01104d1490) at ../../../vm/vm_map.c:422 #18 0xffffffff808db829 in exit1 (td=0xfffffe01104d1490, rv=) at ../../../kern/kern_exit.c:322 #19 0xffffffff80910b7f in sigexit (td=0xfffffe01104d1490, sig=0x0) at ../../../kern/kern_sig.c:2940 #20 0xffffffff80913347 in postsig (sig=) at ../../../kern/kern_sig.c:2827 #21 0xffffffff8095a657 in ast (framep=0xffffff8232a83c00) at ../../../kern/subr_trap.c:271 #22 0xffffffff80ca4029 in doreti_ast () at ../../../amd64/amd64/exception.S:673 #23 0x0000000800b8e400 in ?? () #24 0x0000000800936110 in ?? () #25 0x000000000055f000 in ?? () #26 0x0000000801400000 in ?? () #27 0x000000001dc00000 in ?? () #28 0x0000000000000000 in ?? () (kgdb) f 14 #14 0xffffffff80b9daac in vm_page_remove (m=0xfffffe0219118df8) at ../../../vm/vm_page.c:900 900 VM_OBJECT_ASSERT_WLOCKED(object); (kgdb) l 895 896 if ((m->oflags & VPO_UNMANAGED) == 0) 897 vm_page_lock_assert(m, MA_OWNED); 898 if ((object = m->object) == NULL) 899 return; 900 VM_OBJECT_ASSERT_WLOCKED(object); 901 if (m->oflags & VPO_BUSY) { 902 m->oflags &= ~VPO_BUSY; 903 vm_page_flash(m); 904 } (kgdb) p *object $2 = {lock = {lock_object = {lo_name = 0xfffffe021bab0000 "0ɽ\033\002þÿÿPË\021\031\002þÿÿ", lo_flags = 0x1baf9c90, lo_data = 0xfffffe02, lo_witness = 0x0}, rw_lock = 0x0}, object_list = {tqe_next = 0x0, tqe_prev = 0x0}, shadow_head = {lh_first = 0x1108a2000}, shadow_list = {le_next = 0x0, le_prev = 0xfffffe021911cb88}, memq = {tqh_first = 0x6, tqh_last = 0x101000003ff}, rtree = { rt_root = 0x2040000000000}, size = 0x0, generation = 0x1b380c10, ref_count = 0xfffffe02, shadow_count = 0x1ab12458, memattr = 0x2, type = 0xfe, flags = 0xffff, pg_color = 0x0, paging_in_progress = 0x0, resident_page_count = 0x0, backing_object = 0x0, backing_object_offset = 0x0, pager_object_list = {tqe_next = 0x1108a3000, tqe_prev = 0x0}, rvq = { lh_first = 0xfffffe021911cbf0}, cache = {rt_root = 0x6}, handle = 0x10d000003ff, un_pager = {vnp = {vnp_size = 0x2040000000000, writemappings = 0x0}, devp = {devp_pglist = { tqh_first = 0x2040000000000, tqh_last = 0x0}, ops = 0xfffffe021c19d828, dev = 0xfffffe021c19b810}, sgp = {sgp_pglist = {tqh_first = 0x2040000000000, tqh_last = 0x0}}, swp = { swp_tmpfs = 0x2040000000000, swp_bcount = 0x0}}, cred = 0xfffffe021c19d828, charge = 0xfffffe021c19b820} (kgdb) info loc object = 0xfffffe021911cb50 (kgdb) p *m $3 = {pageq = {tqe_next = 0x0, tqe_prev = 0xffffffff815c58d8}, listq = {tqe_next = 0x0, tqe_prev = 0x0}, object = 0xfffffe021911cb50, pindex = 0x4005, phys_addr = 0x11080b000, md = {pv_list = { tqh_first = 0x0, tqh_last = 0xfffffe0219118e30}, pat_mode = 0x6}, queue = 0xff, segind = 0x3, hold_count = 0x0, order = 0xd, pool = 0x1, cow = 0x0, wire_count = 0x0, aflags = 0x0, oflags = 0x4, flags = 0x0, act_count = 0x0, busy = 0x0, valid = 0x0, dirty = 0x0} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/vm/vm_map.c =================================================================== --- /usr/src/sys/vm/vm_map.c (revision 251406) +++ /usr/src/sys/vm/vm_map.c (working copy) @@ -2225,6 +2225,7 @@ vm_map_unwire(vm_map_t map, vm_offset_t start, vm_ return (KERN_INVALID_ADDRESS); } } + vm_map_busy(map); last_timestamp = map->timestamp; entry = first_entry; while (entry != &map->header && entry->start < end) { @@ -2257,6 +2258,7 @@ vm_map_unwire(vm_map_t map, vm_offset_t start, vm_ /* * First_entry has been deleted. */ + vm_map_unbusy(map); vm_map_unlock(map); return (KERN_INVALID_ADDRESS); } @@ -2281,6 +2283,7 @@ vm_map_unwire(vm_map_t map, vm_offset_t start, vm_ * above.) */ entry->eflags |= MAP_ENTRY_IN_TRANSITION; + entry->wire_thread = curthread; /* * Check the map for holes in the specified region. * If VM_MAP_WIRE_HOLESOK was specified, skip this check. @@ -2333,6 +2336,7 @@ done: KASSERT(entry->eflags & MAP_ENTRY_IN_TRANSITION, ("vm_map_unwire: in-transition flag missing")); entry->eflags &= ~MAP_ENTRY_IN_TRANSITION; + entry->wire_thread = NULL; if (entry->eflags & MAP_ENTRY_NEEDS_WAKEUP) { entry->eflags &= ~MAP_ENTRY_NEEDS_WAKEUP; need_wakeup = TRUE; @@ -2340,6 +2344,7 @@ done: vm_map_simplify_entry(map, entry); entry = entry->next; } + vm_map_unbusy(map); vm_map_unlock(map); if (need_wakeup) vm_map_wakeup(map); @@ -2376,6 +2381,7 @@ vm_map_wire(vm_map_t map, vm_offset_t start, vm_of return (KERN_INVALID_ADDRESS); } } + vm_map_busy(map); last_timestamp = map->timestamp; entry = first_entry; while (entry != &map->header && entry->start < end) { @@ -2408,6 +2414,7 @@ vm_map_wire(vm_map_t map, vm_offset_t start, vm_of /* * first_entry has been deleted. */ + vm_map_unbusy(map); vm_map_unlock(map); return (KERN_INVALID_ADDRESS); } @@ -2432,6 +2439,7 @@ vm_map_wire(vm_map_t map, vm_offset_t start, vm_of * above.) */ entry->eflags |= MAP_ENTRY_IN_TRANSITION; + entry->wire_thread = curthread; if ((entry->protection & (VM_PROT_READ | VM_PROT_EXECUTE)) == 0 || (entry->protection & prot) != prot) { entry->eflags |= MAP_ENTRY_WIRE_SKIPPED; @@ -2451,14 +2459,12 @@ vm_map_wire(vm_map_t map, vm_offset_t start, vm_of OBJ_FICTITIOUS) != 0; /* * Release the map lock, relying on the in-transition - * mark. Mark the map busy for fork. + * mark. */ - vm_map_busy(map); vm_map_unlock(map); rv = vm_fault_wire(map, saved_start, saved_end, fictitious); vm_map_lock(map); - vm_map_unbusy(map); if (last_timestamp + 1 != map->timestamp) { /* * Look again for the entry because the map was @@ -2554,6 +2560,7 @@ done: KASSERT(entry->eflags & MAP_ENTRY_IN_TRANSITION, ("vm_map_wire: in-transition flag missing")); entry->eflags &= ~(MAP_ENTRY_IN_TRANSITION|MAP_ENTRY_WIRE_SKIPPED); + entry->wire_thread = NULL; if (entry->eflags & MAP_ENTRY_NEEDS_WAKEUP) { entry->eflags &= ~MAP_ENTRY_NEEDS_WAKEUP; need_wakeup = TRUE; @@ -2561,6 +2568,7 @@ done: vm_map_simplify_entry(map, entry); entry = entry->next; } + vm_map_unbusy(map); vm_map_unlock(map); if (need_wakeup) vm_map_wakeup(map); @@ -3193,6 +3201,7 @@ vmspace_fork(struct vmspace *vm1, vm_ooffset_t *fo *new_entry = *old_entry; new_entry->eflags &= ~(MAP_ENTRY_USER_WIRED | MAP_ENTRY_IN_TRANSITION); + new_entry->wire_thread = NULL; new_entry->wired_count = 0; if (new_entry->eflags & MAP_ENTRY_VN_WRITECNT) { vnode_pager_update_writecount(object, @@ -3227,6 +3236,7 @@ vmspace_fork(struct vmspace *vm1, vm_ooffset_t *fo */ new_entry->eflags &= ~(MAP_ENTRY_USER_WIRED | MAP_ENTRY_IN_TRANSITION | MAP_ENTRY_VN_WRITECNT); + new_entry->wire_thread = NULL; new_entry->wired_count = 0; new_entry->object.vm_object = NULL; new_entry->cred = NULL; Index: /usr/src/sys/vm/vm_map.h =================================================================== --- /usr/src/sys/vm/vm_map.h (revision 251406) +++ /usr/src/sys/vm/vm_map.h (working copy) @@ -116,6 +116,7 @@ struct vm_map_entry { int wired_count; /* can be paged if = 0 */ vm_pindex_t next_read; /* index of the next sequential read */ struct ucred *cred; /* tmp storage for creator ref */ + struct thread *wire_thread; }; #define MAP_ENTRY_NOSYNC 0x0001 Index: /usr/src/sys/vm/vm_object.c =================================================================== --- /usr/src/sys/vm/vm_object.c (revision 251406) +++ /usr/src/sys/vm/vm_object.c (working copy) @@ -1054,9 +1054,9 @@ vm_object_sync(vm_object_t object, vm_ooffset_t of */ flags = OBJPR_NOTMAPPED; else if (old_msync) - flags = 0; + flags = OBJPR_NOTWIRED; else - flags = OBJPR_CLEANONLY; + flags = OBJPR_CLEANONLY | OBJPR_NOTWIRED; vm_object_page_remove(object, OFF_TO_IDX(offset), OFF_TO_IDX(offset + size + PAGE_MASK), flags); } @@ -1912,7 +1912,8 @@ again: vm_page_lock(p); if ((wirings = p->wire_count) != 0 && (wirings = pmap_page_wired_mappings(p)) != p->wire_count) { - if ((options & OBJPR_NOTMAPPED) == 0) { + if ((options & (OBJPR_NOTWIRED | OBJPR_NOTMAPPED)) == + 0) { pmap_remove_all(p); /* Account for removal of wired mappings. */ if (wirings != 0) @@ -1922,8 +1923,7 @@ again: p->valid = 0; vm_page_undirty(p); } - vm_page_unlock(p); - continue; + goto next; } if (vm_page_sleep_if_busy(p, TRUE, "vmopar")) goto again; @@ -1932,12 +1932,12 @@ again: if ((options & OBJPR_CLEANONLY) != 0 && p->valid != 0) { if ((options & OBJPR_NOTMAPPED) == 0) pmap_remove_write(p); - if (p->dirty) { - vm_page_unlock(p); - continue; - } + if (p->dirty) + goto next; } if ((options & OBJPR_NOTMAPPED) == 0) { + if ((options & OBJPR_NOTWIRED) != 0 && wirings != 0) + goto next; pmap_remove_all(p); /* Account for removal of wired mappings. */ if (wirings != 0) { @@ -1949,6 +1949,7 @@ again: } } vm_page_free(p); +next: vm_page_unlock(p); } vm_object_pip_wakeup(object); Index: /usr/src/sys/vm/vm_fault.c =================================================================== --- /usr/src/sys/vm/vm_fault.c (revision 251406) +++ /usr/src/sys/vm/vm_fault.c (working copy) @@ -280,6 +280,19 @@ RetryFault:; (u_long)vaddr); } + if (fs.entry->eflags & MAP_ENTRY_IN_TRANSITION && + fs.entry->wire_thread != curthread) { + vm_map_unlock_read(fs.map); + vm_map_lock(fs.map); + if (vm_map_lookup_entry(fs.map, vaddr, &fs.entry) && + (fs.entry->eflags & MAP_ENTRY_IN_TRANSITION)) { + fs.entry->eflags |= MAP_ENTRY_NEEDS_WAKEUP; + vm_map_unlock_and_wait(fs.map, 0); + } else + vm_map_unlock(fs.map); + goto RetryFault; + } + /* * Make a reference to this object to prevent its disposal while we * are messing with it. Once we have the reference, the map is free Index: /usr/src/sys/vm/vm_object.h =================================================================== --- /usr/src/sys/vm/vm_object.h (revision 251406) +++ /usr/src/sys/vm/vm_object.h (working copy) @@ -205,6 +205,7 @@ struct vm_object { */ #define OBJPR_CLEANONLY 0x1 /* Don't remove dirty pages. */ #define OBJPR_NOTMAPPED 0x2 /* Don't unmap pages. */ +#define OBJPR_NOTWIRED 0x4 /* Don't remove wired pages. */ TAILQ_HEAD(object_q, vm_object); Index: /usr/src/sys/vm/vm_page.c =================================================================== --- /usr/src/sys/vm/vm_page.c (revision 251406) +++ /usr/src/sys/vm/vm_page.c (working copy) @@ -2611,8 +2611,6 @@ vm_page_set_invalid(vm_page_t m, int base, int siz vm_page_bits_t bits; VM_OBJECT_ASSERT_WLOCKED(m->object); - KASSERT((m->oflags & VPO_BUSY) == 0, - ("vm_page_set_invalid: page %p is busy", m)); bits = vm_page_bits(base, size); if (m->valid == VM_PAGE_BITS_ALL && bits != 0) pmap_remove_all(m); Index: /usr/src/sys/kern/vfs_bio.c =================================================================== --- /usr/src/sys/kern/vfs_bio.c (revision 251406) +++ /usr/src/sys/kern/vfs_bio.c (working copy) @@ -1567,7 +1567,8 @@ brelse(struct buf *bp) KASSERT(presid >= 0, ("brelse: extra page")); VM_OBJECT_WLOCK(obj); - vm_page_set_invalid(m, poffset, presid); + if (pmap_page_wired_mappings(m) == 0) + vm_page_set_invalid(m, poffset, presid); VM_OBJECT_WUNLOCK(obj); if (had_bogus) printf("avoided corruption bug in bogus_page/brelse code\n"); -- Test scenario: mlockall2.sh