GENERIC HEAD frcc 2020-07-30 00:53:56 UTC, r363687M, vmcore.869 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2020 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #0 r363687M: Thu Jul 30 13:30:19 CEST 2020 pho@t2.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 10.0.1 (git@github.com:llvm/llvm-project.git llvmorg-10.0.0-97-g6f71678ecd2) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.23-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206d7 Family=0x6 Model=0x2d Stepping=7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 66705432576 (63615 MB) : Trying to mount root from ufs:/dev/da0p2 [rw]... WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Expensive timeout(9) function: 0xffffffff80a2fa40(0xffffffff818e6898) 0.006696670 s uhub1: 4 ports with 4 removable, self powered WARNING: / was not properly dismounted uhub2: 2 ports with 2 removable, self powered uhub0: 2 ports with 2 removable, self powered Setting hostuuid: 2bde2bde-f4e2-e111-aab2-001e6756b69b. Setting hostid: 0x0035ff86. Starting file system checks: ugen0.2: at usbus0 uhub3 numa-domain 0 on uhub0 uhub3: on usbus0 ugen2.2: at usbus2 uhub4 numa-domain 0 on uhub2 uhub4: on usbus2 uhub3: 6 ports with 6 removable, self powered uhub4: 8 ports with 8 removable, self powered ugen2.3: at usbus2 uhub5 numa-domain 0 on uhub4 uhub5: on usbus2 uhub5: MTT enabled uhub5: 4 ports with 4 removable, self powered ugen2.4: at usbus2 ukbd0 numa-domain 0 on uhub4 ukbd0: on usbus2 kbd2 at ukbd0 /dev/da0p2: 3149284 files, 52948842 used, 46076859 free (1191235 frags, 5610703 blocks, 1.2% fragmentation) /dev/da0p3: 145260 files, 1775242 used, 23613885 free (6949 frags, 2950867 blocks, 0.0% fragmentation) Mounting local filesystems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc8 /usr/local/lib/gcc9 /usr/local/lib/mozjpeg /usr/local/lib/nss /usr/local/lib/perl5/5.30/mach/CORE /usr/local/lib/qt4 /usr/local/lib/qt5 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: t2.osted.lan. Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . lo0: link state changed to UP Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 igb0: flags=8863 metric 0 mtu 1500 options=4e527bb ether 00:1e:67:56:b6:9b inet 192.168.1.109 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::21e:67ff:fe56:b69b%igb0 prefixlen 64 scopeid 0x1 media: Ethernet autoselect (1000baseT ) status: active nd6 options=23 igb1: flags=8822 metric 0 mtu 1500 options=4e527bb ether 00:1e:67:56:b6:9c media: Ethernet autoselect status: no carrier nd6 options=29 Starting devd. Autoloading module: ioat.ko ioat0: mem 0xd7fa0000-0xd7fa3fff irq 31 at device 4.0 numa-domain 0 on pci0 ioat0: Capabilities: 2f7 ioat1: mem 0xd7f90000-0xd7f93fff irq 39 at device 4.1 numa-domain 0 on pci0 ioat1: Capabilities: 2f7 ioat2: mem 0xd7f80000-0xd7f83fff irq 31 at device 4.2 numa-domain 0 on pci0 ioat2: Capabilities: f7 ioat3: mem 0xd7f70000-0xd7f73fff irq 39 at device 4.3 numa-domain 0 on pci0 ioat3: Capabilities: f7 ioat4: mem 0xd7f60000-0xd7f63fff irq 31 at device 4.4 numa-domain 0 on pci0 ioat4: Capabilities: f7 ioat5: mem 0xd7f50000-0xd7f53fff irq 39 at device 4.5 numa-domain 0 on pci0 ioat5: Capabilities: f7 ioat6: mem 0xd7f40000-0xd7f43fff irq 31 at device 4.6 numa-domain 0 on pci0 ioat6: Capabilities: f7 ioat7: mem 0xd7f30000-0xd7f33fff irq 39 at device 4.7 numa-domain 0 on pci0 ioat7: Capabilities: f7 ioat8: mem 0xfbf70000-0xfbf73fff irq 55 at device 4.0 numa-domain 1 on pci11 ioat8: Capabilities: 2f7 ioat9: mem 0xfbf60000-0xfbf63fff irq 63 at device 4.1 numa-domain 1 on pci11 ioat9: Capabilities: 2f7 ioat10: mem 0xfbf50000-0xfbf53fff irq 55 at device 4.2 numa-domain 1 on pci11 ioat10: Capabilities: f7 ioat11: mem 0xfbf40000-0xfbf43fff irq 63 at device 4.3 numa-domain 1 on pci11 ioat11: Capabilities: f7 ioat12: mem 0xfbf30000-0xfbf33fff irq 55 at device 4.4 numa-domain 1 on pci11 ioat12: Capabilities: f7 ioat13: mem 0xfbf20000-0xfbf23fff irq 63 at device 4.5 numa-domain 1 on pci11 ioat13: Capabilities: f7 ioat14: mem 0xfbf10000-0xfbf13fff irq 55 at device 4.6 numa-domain 1 on pci11 ioat14: Capabilities: f7 ioat15: mem 0xfbf00000-0xfbf03fff irq 63 at device 4.7 numa-domain 1 on pci11 ioat15: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e527bb ether 00:1e:67:56:b6:9c media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Configuring vt: keymap. Autoloading module: uhid.ko Autoloading module: ums.ko ums0 numa-domain 0 on uhub4 ums0: on usbus2 ums0: 3 buttons and [Z] coordinates ID=0 Starting ums0 moused. add host 127.0.0.1: gateway lo0 fib 0: route already in table add net default: gateway 192.168.1.254 add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Starting rtsold. Creating and/or trimming log files. Starting syslogd. Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.23-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206d7 Family=0x6 Model=0x2d Stepping=7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics Done. Jul 30 17:31:38 t2 savecore[2443]: reboot Starting rpcbind. NFS access cache time=60 Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Starting statd. Starting lockd. Recovering vi editor sessions:. Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Starting sendmail_submit. Starting sendmail_msp_queue. Performing sanity check on sshd configuration. Starting sshd. Configuring vt: keymap blanktime. Starting cron. Local package initialization: backup. Starting nfscbd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Starting inetd. Thu Jul 30 17:38 FreeBSD/amd64 (t2.osted.lan) (ttyu1) login: root Password: Jul 30 17:44:08 t2 login[2844]: ROOT LOGIN (root) ON ttyu1 Last login: Thu Jul 30 14:07:41 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #0 r363687M: Thu Jul 30 13:30:19 CEST 2020 Welcome to FreeBSD! Release Notes, Errata: https://www.FreeBSD.org/releases/ Security Advisories: https://www.FreeBSD.org/security/ FreeBSD Handbook: https://www.FreeBSD.org/handbook/ FreeBSD FAQ: https://www.FreeBSD.org/faq/ Questions List: https://lists.FreeBSD.org/mailman/listinfo/freebsd-questions/ FreeBSD Forums: https://forums.FreeBSD.org/ Documents installed with the system are in the /usr/local/share/doc/freebsd/ directory, or can be installed later with: pkg install en-freebsd-doc For other languages, replace "en" with a language code like de or fr. Show the version of FreeBSD installed: freebsd-version ; uname -a Please include that output and any error messages when posting questions. Introduction to manual pages: man man FreeBSD directory layout: man hier Edit /etc/motd.template to change this login announcement. You have new mail. root@t2:~ # exec bash $ cd ~pho/stress2/misc $ ./all.sh -a force.sh Note: including known problem tests. 20200730 17:44:33 all: force.sh 20200730 17:44:33 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt pts leak: 1/2 mount leak: 1/50 20200730 17:44:53 all: force.sh 20200730 17:44:53 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/51 20200730 17:45:25 all: force.sh 20200730 17:45:25 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/52 20200730 17:46:04 all: force.sh 20200730 17:46:04 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/53 20200730 17:46:33 all: force.sh 20200730 17:46:33 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/54 20200730 17:47:05 all: force.sh 20200730 17:47:05 all (1/1): force.sh newfs -j md10 Jul 30 17:47:38 t2 kernel: pid 20163 (swap), jid 0, uid 1004, was killed: out of swap space UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/55 20200730 17:47:55 all: force.sh 20200730 17:47:55 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/56 20200730 17:48:46 all: force.sh 20200730 17:48:46 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/57 20200730 17:49:17 all: force.sh 20200730 17:49:17 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/58 20200730 17:49:58 all: force.sh 20200730 17:49:58 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/59 20200730 17:50:36 all: force.sh 20200730 17:50:36 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/60 20200730 17:51:05 all: force.sh 20200730 17:51:05 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/61 20200730 17:51:31 all: force.sh 20200730 17:51:31 all (1/1): force.sh newfs -j md10 Jul 30 17:52:41 t2 kernel: pid 43546 (swap), jid 0, uid 1004, was killed: out of swap space g_vfs_done():md10[WRITE(offset=463077376, length=32768)]error =UFS: forcibly unmounting /dev/md10 from /mnt 6 Note: force.sh's runtime was 102 seconds. N Min Max Median Avg Stddev x 623 11 202 35 40.394864 23.180851 mount leak: 1/62 20200730 17:53:17 all: force.sh 20200730 17:53:17 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/63 20200730 17:53:48 all: force.sh 20200730 17:53:48 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/64 20200730 17:54:21 all: force.sh 20200730 17:54:21 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/65 20200730 17:54:54 all: force.sh 20200730 17:54:54 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/66 20200730 17:55:29 all: force.sh 20200730 17:55:29 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/67 20200730 17:56:18 all: force.sh 20200730 17:56:18 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/68 20200730 17:57:06 all: force.sh 20200730 17:57:06 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/69 20200730 17:57:32 all: force.sh 20200730 17:57:32 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/70 20200730 17:58:41 all: force.sh 20200730 17:58:41 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/71 20200730 17:59:12 all: force.sh 20200730 17:59:12 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/72 20200730 18:00:08 all: force.sh 20200730 18:00:08 all (1/1): force.sh newfs -j md10 g_vfs_done():md10[WRITE(offset=543064064, length=32768)]error = 6 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/73 20200730 18:01:32 all: force.sh 20200730 18:01:32 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/74 20200730 18:02:25 all: force.sh 20200730 18:02:25 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/75 20200730 18:02:42 all: force.sh 20200730 18:02:42 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/76 20200730 18:03:05 all: force.sh 20200730 18:03:05 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/77 20200730 18:04:35 all: force.sh 20200730 18:04:35 all (1/1): force.sh newfs -j md10 Jul 30 18:05:15 t2 kernel: pid 96901 (swap), jid 0, uid 1004, was killed: out of swap space UFS: forcibly unmounting /dev/md10 from /mnt Note: force.sh's runtime was 91 seconds. N Min Max Median Avg Stddev x 639 11 202 35 40.511737 23.247734 mount leak: 1/78 20200730 18:06:10 all: force.sh 20200730 18:06:10 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/79 20200730 18:06:43 all: force.sh 20200730 18:06:43 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/80 20200730 18:07:20 all: force.sh 20200730 18:07:20 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/81 20200730 18:07:37 all: force.sh 20200730 18:07:37 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/82 20200730 18:08:07 all: force.sh 20200730 18:08:07 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/83 20200730 18:08:44 all: force.sh 20200730 18:08:44 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/84 20200730 18:09:16 all: force.sh 20200730 18:09:16 all (1/1): force.sh newfs -j md10 lock order reversal: 1st 0xfffff803f54b72f0 syncer (syncer) @ kern/vfs_subr.c:2498 2nd 0xfffff806d8103068 ufs (ufs) @ kern/vfs_subr.c:3332 stack backtrace: #0 0xffffffff80c40471 at witness_debugger+0x71 #1 0xffffffff80ba3c42 at lockmgr_lock_flags+0x172 #2 0xffffffff80e8927d at ffs_lock+0x7d #3 0xffffffff810c4ef0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cc6974 at _vn_lock+0x54 #5 0xffffffff80cb0615 at vput_final+0x135 #6 0xffffffff80caf86b at vget_finish+0x9b #7 0xffffffff80e87721 at ffs_sync+0x561 #8 0xffffffff80cbb72b at sync_fsync+0xeb #9 0xffffffff810c3b39 at VOP_FSYNC_APV+0x59 #10 0xffffffff80cb8f58 at sched_sync+0x3f8 #11 0xffffffff80b8f2b0 at fork_exit+0x80 #12 0xffffffff80fe74ce at fork_trampoline+0xe g_vfs_done():md10[WRITE(offset=466026496, length=131072)]error = 6 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/85 20200730 18:09:49 all: force.sh 20200730 18:09:49 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/86 20200730 18:10:58 all: force.sh 20200730 18:10:58 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/87 20200730 18:11:59 all: force.sh 20200730 18:11:59 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/88 20200730 18:12:26 all: force.sh 20200730 18:12:26 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/89 20200730 18:13:10 all: force.sh 20200730 18:13:10 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/90 20200730 18:13:46 all: force.sh 20200730 18:13:46 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/91 20200730 18:15:04 all: force.sh 20200730 18:15:04 all (1/1): force.sh newfs -j md10 /mnt: write failed, filesystem is full Jul 30 18:15:25 t2 kernel: pid 44418 (rw), uid 1004 inumber 95586 on /mnt: filesystem full UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/92 20200730 18:15:51 all: force.sh 20200730 18:15:51 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/93 20200730 18:16:24 all: force.sh 20200730 18:16:24 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 1/94 20200730 18:17:01 all: force.sh 20200730 18:17:01 all (1/1): force.sh newfs -j md10 UFS: forcibly unmounting /dev/md10 from /mnt UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 1004 58088 1 0 20 0 12972 2324 suspfs D u1 0:04.10 symlink 1004 58092 1 0 20 0 12972 2324 suspfs D u1 0:02.84 symlink 1004 58093 1 0 20 0 12972 2340 suspfs D u1 0:04.23 rw 1004 58095 1 0 20 0 12976 2328 suspfs D u1 0:05.27 openat 1004 58096 1 0 20 0 12972 2324 suspfs D u1 0:03.14 symlink 1004 58097 1 0 20 0 12972 2344 suspfs D u1 0:07.24 rw 1004 58098 1 0 20 0 15528 4400 suspfs D u1 0:00.11 fts 1004 58100 1 0 20 0 12976 2396 suspfs DE u1 0:05.45 openat 1004 58101 1 0 20 0 12972 2328 suspfs D u1 0:06.97 link 1004 58103 1 0 20 0 12972 2324 suspfs D u1 0:03.44 symlink 1004 58105 1 0 20 0 15528 4400 suspfs D u1 0:00.13 fts 1004 58106 1 0 20 0 12976 2328 suspfs D u1 0:02.98 openat 1004 58107 1 0 20 0 12972 2328 suspfs D u1 0:07.49 link 1004 58108 1 0 20 0 12972 2324 suspfs D u1 0:05.36 symlink 1004 58109 1 0 20 0 12972 2320 suspfs D u1 0:01.87 lockf 1004 58110 1 0 20 0 15528 4396 suspfs D u1 0:00.16 fts 1004 58223 1 0 20 0 12972 2328 suspfs D u1 0:00.18 rename 1004 58875 1 0 20 0 12972 2316 suspfs DE u1 0:01.59 lockf 1004 58876 1 0 20 0 12972 2316 suspfs DE u1 0:00.52 lockf ../tools/killall.sh FAIL @ 30 Note: force.sh's runtime was 187 seconds. N Min Max Median Avg Stddev x 656 11 202 34 40.496951 23.168154 mount leak: 14/108 GEOM leak: 4/181 ^C^Z [1]+ Stopped ./all.sh -a force.sh $ init 1 $ Stopping inetd. Waiting for PIDS: 2811. Stopping nfscbd. Waiting for PIDS: 2776 2777. Shutting down local packages:. Stopping cron. Waiting for PIDS: 2615. Stopping sshd. Waiting for PIDS: 2592. Stopping powerd. Waiting for PIDS: 2555. Stopping ntpd. Waiting for PIDS: 2552. Stopping lockd. Waiting for PIDS: 2509. Stopping statd. Waiting for PIDS: 2506. Stopping nfsd. Waiting for PIDS: 2502 2505. Stopping mountd. Waiting for PIDS: 2496. Stopping nfsuserd. Waiting for PIDS: 2485 2486 2487 2488 2490. Stopping rpcbind. Waiting for PIDS: 2455if_delmulti_locked: detaching ifnet instance 0xfffff80841b3b800 . Stopping rtsold. Waiting for PIDS: 2195if_delmulti_locked: detaching ifnet instance 0xfffff8000536f000 . Stopping devd. Waiting for PIDS: 2139. Writing entropy file: KDB: enter: Break to debugger [ thread pid 11 tid 100007 ] Stopped at kdb_alt_break_internal+0x155: movq $0,0x10b8aa8(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 2822 out of 65426 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 11 tid 100007 td 0xfffffe006a5be700 kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe0069ffb890 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0069ffb8a0 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe0069ffb8d0 uart_intr() at uart_intr+0x128/frame 0xfffffe0069ffb910 intr_event_handle() at intr_event_handle+0xde/frame 0xfffffe0069ffb960 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe0069ffb990 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe0069ffb990 --- interrupt, rip = 0xffffffff804c2d04, rsp = 0xfffffe0069ffba60, rbp = 0xfffffe0069ffbaa0 --- acpi_cpu_idle() at acpi_cpu_idle+0x294/frame 0xfffffe0069ffbaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe0069ffbac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe0069ffbae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe0069ffbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0069ffbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0069ffbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 4 cpuid = 0 dynamic pcpu = 0x795e80 curthread = 0xfffffe006a5c0300: pid 11 tid 100003 critnest 1 "idle: cpu0" curpcb = 0xfffffe006a5c0810 fpcurthread = none idlethread = 0xfffffe006a5c0300: tid 100003 "idle: cpu0" self = 0xffffffff82210000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82210384 rsp0 = 0xfffffe0069fe7cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x5c139dc2b gs32p = 0xffffffff82210404 ldt = 0xffffffff82210444 tss = 0xffffffff82210434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00eeff6e80 curthread = 0xfffffe006a5bfc00: pid 11 tid 100004 critnest 1 "idle: cpu1" curpcb = 0xfffffe006a5c0110 fpcurthread = none idlethread = 0xfffffe006a5bfc00: tid 100004 "idle: cpu1" self = 0xffffffff82211000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82211384 rsp0 = 0xfffffe0069feccc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x1a7b4291d gs32p = 0xffffffff82211404 ldt = 0xffffffff82211444 tss = 0xffffffff82211434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00eeffde80 curthread = 0xfffffe006a5bf500: pid 11 tid 100005 critnest 1 "idle: cpu2" curpcb = 0xfffffe006a5bfa10 fpcurthread = none idlethread = 0xfffffe006a5bf500: tid 100005 "idle: cpu2" self = 0xffffffff82212000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82212384 rsp0 = 0xfffffe0069ff1cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x2e6afa1a gs32p = 0xffffffff82212404 ldt = 0xffffffff82212444 tss = 0xffffffff82212434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00ef008e80 curthread = 0xfffffe006a5bee00: pid 11 tid 100006 critnest 1 "idle: cpu3" curpcb = 0xfffffe006a5bf310 fpcurthread = none idlethread = 0xfffffe006a5bee00: tid 100006 "idle: cpu3" self = 0xffffffff82213000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82213384 rsp0 = 0xfffffe0069ff6cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0xc2c9d31 gs32p = 0xffffffff82213404 ldt = 0xffffffff82213444 tss = 0xffffffff82213434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00ef00fe80 curthread = 0xfffffe006a5be700: pid 11 tid 100007 critnest 2 "idle: cpu4" curpcb = 0xfffffe006a5bec10 fpcurthread = none idlethread = 0xfffffe006a5be700: tid 100007 "idle: cpu4" self = 0xffffffff82214000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82214384 rsp0 = 0xfffffe0069ffbcc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x911e968bc gs32p = 0xffffffff82214404 ldt = 0xffffffff82214444 tss = 0xffffffff82214434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00ef01ae80 curthread = 0xfffffe006a5be000: pid 11 tid 100008 critnest 1 "idle: cpu5" curpcb = 0xfffffe006a5be510 fpcurthread = none idlethread = 0xfffffe006a5be000: tid 100008 "idle: cpu5" self = 0xffffffff82215000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82215384 rsp0 = 0xfffffe00e0530cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0xab0b07ede gs32p = 0xffffffff82215404 ldt = 0xffffffff82215444 tss = 0xffffffff82215434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00ef021e80 curthread = 0xfffffe006a5c8a00: pid 11 tid 100009 critnest 1 "idle: cpu6" curpcb = 0xfffffe006a5c8f10 fpcurthread = none idlethread = 0xfffffe006a5c8a00: tid 100009 "idle: cpu6" self = 0xffffffff82216000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82216384 rsp0 = 0xfffffe00e0535cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0xaa532dd7b gs32p = 0xffffffff82216404 ldt = 0xffffffff82216444 tss = 0xffffffff82216434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00ef02ce80 curthread = 0xfffffe006a5c8300: pid 11 tid 100010 critnest 1 "idle: cpu7" curpcb = 0xfffffe006a5c8810 fpcurthread = none idlethread = 0xfffffe006a5c8300: tid 100010 "idle: cpu7" self = 0xffffffff82217000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82217384 rsp0 = 0xfffffe00e053acc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0xa047c78e4 gs32p = 0xffffffff82217404 ldt = 0xffffffff82217444 tss = 0xffffffff82217434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00ef033e80 curthread = 0xfffffe006a5c7c00: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffffe006a5c8110 fpcurthread = none idlethread = 0xfffffe006a5c7c00: tid 100011 "idle: cpu8" self = 0xffffffff82218000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82218384 rsp0 = 0xfffffe00e053fcc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x2e3fcd2c gs32p = 0xffffffff82218404 ldt = 0xffffffff82218444 tss = 0xffffffff82218434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00ef03ee80 curthread = 0xfffffe006a5c7500: pid 11 tid 100012 critnest 1 "idle: cpu9" curpcb = 0xfffffe006a5c7a10 fpcurthread = none idlethread = 0xfffffe006a5c7500: tid 100012 "idle: cpu9" self = 0xffffffff82219000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82219384 rsp0 = 0xfffffe00e0544cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x46bb0dd4c gs32p = 0xffffffff82219404 ldt = 0xffffffff82219444 tss = 0xffffffff82219434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00ef045e80 curthread = 0xfffffe006a5c6e00: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffffe006a5c7310 fpcurthread = none idlethread = 0xfffffe006a5c6e00: tid 100013 "idle: cpu10" self = 0xffffffff8221a000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff8221a384 rsp0 = 0xfffffe00e0549cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x91178b8e2 gs32p = 0xffffffff8221a404 ldt = 0xffffffff8221a444 tss = 0xffffffff8221a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00ef050e80 curthread = 0xfffffe006a5c6700: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffffe006a5c6c10 fpcurthread = none idlethread = 0xfffffe006a5c6700: tid 100014 "idle: cpu11" self = 0xffffffff8221b000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff8221b384 rsp0 = 0xfffffe00e054ecc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x46bb0d8fe gs32p = 0xffffffff8221b404 ldt = 0xffffffff8221b444 tss = 0xffffffff8221b434 curvnet = 0 spin locks held: cpuid = 12 dynamic pcpu = 0xfffffe00e86a4e80 curthread = 0xfffffe006a5c6000: pid 11 tid 100015 critnest 1 "idle: cpu12" curpcb = 0xfffffe006a5c6510 fpcurthread = none idlethread = 0xfffffe006a5c6000: tid 100015 "idle: cpu12" self = 0xffffffff8221c000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff8221c384 rsp0 = 0xfffffe00e0553cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x2e6afedf gs32p = 0xffffffff8221c404 ldt = 0xffffffff8221c444 tss = 0xffffffff8221c434 curvnet = 0 spin locks held: cpuid = 13 dynamic pcpu = 0xfffffe00e86abe80 curthread = 0xfffffe006a5c1800: pid 11 tid 100016 critnest 1 "idle: cpu13" curpcb = 0xfffffe006a5c1d10 fpcurthread = none idlethread = 0xfffffe006a5c1800: tid 100016 "idle: cpu13" self = 0xffffffff8221d000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff8221d384 rsp0 = 0xfffffe00e0558cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0xc818c2ccd gs32p = 0xffffffff8221d404 ldt = 0xffffffff8221d444 tss = 0xffffffff8221d434 curvnet = 0 spin locks held: cpuid = 14 dynamic pcpu = 0xfffffe00e86b6e80 curthread = 0xfffffe006a5cc300: pid 11 tid 100017 critnest 1 "idle: cpu14" curpcb = 0xfffffe006a5cc810 fpcurthread = none idlethread = 0xfffffe006a5cc300: tid 100017 "idle: cpu14" self = 0xffffffff8221e000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff8221e384 rsp0 = 0xfffffe00e055dcc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x1a7bb1c90 gs32p = 0xffffffff8221e404 ldt = 0xffffffff8221e444 tss = 0xffffffff8221e434 curvnet = 0 spin locks held: cpuid = 15 dynamic pcpu = 0xfffffe00e86bde80 curthread = 0xfffffe0070c29300: pid 0 tid 100082 critnest 0 "thread taskq" curpcb = 0xfffffe0070c29810 fpcurthread = none idlethread = 0xfffffe006a5cbc00: tid 100018 "idle: cpu15" self = 0xffffffff8221f000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff8221f384 rsp0 = 0xfffffe01266a4cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x7afa40d0b gs32p = 0xffffffff8221f404 ldt = 0xffffffff8221f444 tss = 0xffffffff8221f434 curvnet = 0 spin locks held: cpuid = 16 dynamic pcpu = 0xfffffe00e86c8e80 curthread = 0xfffffe006a5cb500: pid 11 tid 100019 critnest 1 "idle: cpu16" curpcb = 0xfffffe006a5cba10 fpcurthread = none idlethread = 0xfffffe006a5cb500: tid 100019 "idle: cpu16" self = 0xffffffff82220000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82220384 rsp0 = 0xfffffe00e0567cc0 kcr3 = 0x800000000212514f ucr3 = 0xffffffffffffffff scr3 = 0xad58ffecc gs32p = 0xffffffff82220404 ldt = 0xffffffff82220444 tss = 0xffffffff82220434 curvnet = 0 spin locks held: cpuid = 17 dynamic pcpu = 0xfffffe00e86cfe80 curthread = 0xfffffe006a5cae00: pid 11 tid 100020 critnest 1 "idle: cpu17" curpcb = 0xfffffe006a5cb310 fpcurthread = none idlethread = 0xfffffe006a5cae00: tid 100020 "idle: cpu17" self = 0xffffffff82221000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82221384 rsp0 = 0xfffffe00e056ccc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x93333ec76 gs32p = 0xffffffff82221404 ldt = 0xffffffff82221444 tss = 0xffffffff82221434 curvnet = 0 spin locks held: cpuid = 18 dynamic pcpu = 0xfffffe00e86dae80 curthread = 0xfffffe006a5ca700: pid 11 tid 100021 critnest 1 "idle: cpu18" curpcb = 0xfffffe006a5cac10 fpcurthread = none idlethread = 0xfffffe006a5ca700: tid 100021 "idle: cpu18" self = 0xffffffff82222000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82222384 rsp0 = 0xfffffe00e0571cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x911312f94 gs32p = 0xffffffff82222404 ldt = 0xffffffff82222444 tss = 0xffffffff82222434 curvnet = 0 spin locks held: cpuid = 19 dynamic pcpu = 0xfffffe00e86e1e80 curthread = 0xfffffe006a5ca000: pid 11 tid 100022 critnest 1 "idle: cpu19" curpcb = 0xfffffe006a5ca510 fpcurthread = none idlethread = 0xfffffe006a5ca000: tid 100022 "idle: cpu19" self = 0xffffffff82223000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82223384 rsp0 = 0xfffffe00e0576cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0xb56a52b43 gs32p = 0xffffffff82223404 ldt = 0xffffffff82223444 tss = 0xffffffff82223434 curvnet = 0 spin locks held: cpuid = 20 dynamic pcpu = 0xfffffe00e86ece80 curthread = 0xfffffe006a5c9800: pid 11 tid 100023 critnest 1 "idle: cpu20" curpcb = 0xfffffe006a5c9d10 fpcurthread = none idlethread = 0xfffffe006a5c9800: tid 100023 "idle: cpu20" self = 0xffffffff82224000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82224384 rsp0 = 0xfffffe00e057bcc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x996100929 gs32p = 0xffffffff82224404 ldt = 0xffffffff82224444 tss = 0xffffffff82224434 curvnet = 0 spin locks held: cpuid = 21 dynamic pcpu = 0xfffffe00e86f3e80 curthread = 0xfffffe006a5c9100: pid 11 tid 100024 critnest 1 "idle: cpu21" curpcb = 0xfffffe006a5c9610 fpcurthread = none idlethread = 0xfffffe006a5c9100: tid 100024 "idle: cpu21" self = 0xffffffff82225000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82225384 rsp0 = 0xfffffe00e0580cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x3f94fbf85 gs32p = 0xffffffff82225404 ldt = 0xffffffff82225444 tss = 0xffffffff82225434 curvnet = 0 spin locks held: cpuid = 22 dynamic pcpu = 0xfffffe00e86fee80 curthread = 0xfffffe006a5cfc00: pid 11 tid 100025 critnest 1 "idle: cpu22" curpcb = 0xfffffe006a5d0110 fpcurthread = none idlethread = 0xfffffe006a5cfc00: tid 100025 "idle: cpu22" self = 0xffffffff82226000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82226384 rsp0 = 0xfffffe00e0585cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x88644ebfa gs32p = 0xffffffff82226404 ldt = 0xffffffff82226444 tss = 0xffffffff82226434 curvnet = 0 spin locks held: cpuid = 23 dynamic pcpu = 0xfffffe00e8705e80 curthread = 0xfffffe006a5cf500: pid 11 tid 100026 critnest 1 "idle: cpu23" curpcb = 0xfffffe006a5cfa10 fpcurthread = none idlethread = 0xfffffe006a5cf500: tid 100026 "idle: cpu23" self = 0xffffffff82227000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82227384 rsp0 = 0xfffffe00e058acc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x46bb0d9dd gs32p = 0xffffffff82227404 ldt = 0xffffffff82227444 tss = 0xffffffff82227434 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 73353 (ls) thread 0xfffffe01299c1a00 (100958) shared lockmgr ufs (ufs) r = 0 (0xfffff80841e9b2f0) locked @ kern/vfs_lookup.c:788 Process 0 (kernel) thread 0xfffffe0070c29300 (100082) exclusive sleep mutex vnode interlock (vnode interlock) r = 0 (0xfffff8023fe183b8) locked @ kern/vfs_subr.c:6622 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8000c73b2f0) locked @ kern/vfs_mount.c:1696 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff80841e9b288: type VDIR usecount 1499, writecount 0, refcount 4 seqc users 0 mountedhere 0 hold count flags () flags (VV_ROOT|VMP_LAZYLIST) v_object 0xfffff80841eccd68 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) with exclusive waiters pending with shared waiters pending #0 0xffffffff80ba3ca5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80e8927d at ffs_lock+0x7d #2 0xffffffff810c4ef0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cc6974 at _vn_lock+0x54 #4 0xffffffff80ca21ed at lookup+0xdd #5 0xffffffff80ca1c2c at namei+0x59c #6 0xffffffff80cbf209 at kern_funlinkat+0xa9 #7 0xffffffff80cbf158 at sys_unlink+0x28 #8 0xffffffff81014289 at amd64_syscall+0x159 #9 0xffffffff80fe6d9e at fast_syscall_common+0xf8 nlink=28, effnlink=28, size=1536, extsize 0 generation=13887ec7, uid=0, gid=0, flags=0x0 ino 2, on dev da0p2 vnode 0xfffff8000c73b288: type VDIR usecount 2, writecount 0, refcount 2 seqc users 1 mountedhere 0xfffffe012ad9bb80 hold count flags () flags () v_object 0xfffff80911e6cc60 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe0070c29300 (pid 0, kernel, tid 100082) with shared waiters pending #0 0xffffffff80ba3ca5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80e8927d at ffs_lock+0x7d #2 0xffffffff810c4ef0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cc6974 at _vn_lock+0x54 #4 0xffffffff80ca7446 at dounmount+0x66 #5 0xffffffff80e8361d at ffs_fsfail_unmount+0x2d #6 0xffffffff80c3261a at taskqueue_run_locked+0xaa #7 0xffffffff80c33694 at taskqueue_thread_loop+0x94 #8 0xffffffff80b8f2b0 at fork_exit+0x80 #9 0xffffffff80fe74ce at fork_trampoline+0xe nlink=2, effnlink=2, size=512, extsize 0 generation=f0e8da3e, uid=0, gid=0, flags=0x0 ino 10192512, on dev da0p2 db:1:pho1> show allchains chain 1: thread 100312 (pid 82175, logger) is blocked on lockmgr ufsSHARED (count 1) chain 2: thread 100481 (pid 74122, rm) is blocked on lockmgr ufsSHARED (count 1) chain 3: thread 100958 (pid 73353, ls) is blocked on lockmgr ufsEXCL thread 100082 (pid 0, thread taskq) is running on CPU 15 chain 4: thread 100814 (pid 58889, sh) is sleeping on 0xfffffe012ad9bb80 "vfs_busy" chain 5: thread 100366 (pid 58876, lockf) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 6: thread 100840 (pid 58875, lockf) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 7: thread 100287 (pid 58223, rename) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 8: thread 100431 (pid 58110, fts) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 9: thread 100817 (pid 58109, lockf) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 10: thread 101024 (pid 58108, symlink) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 11: thread 100920 (pid 58107, link) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 12: thread 100823 (pid 58106, openat) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 13: thread 100869 (pid 58105, fts) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 14: thread 100324 (pid 58103, symlink) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 15: thread 100323 (pid 58101, link) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 16: thread 100362 (pid 58100, openat) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 17: thread 100778 (pid 58098, fts) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 18: thread 100417 (pid 58097, rw) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 19: thread 100272 (pid 58096, symlink) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 20: thread 100465 (pid 58095, openat) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 21: thread 100926 (pid 58093, rw) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 22: thread 100948 (pid 58092, symlink) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 23: thread 100294 (pid 58088, symlink) is sleeping on 0xfffffe012ad9bc00 "suspfs" chain 24: thread 100262 (pid 4231, bash) is sleeping on 0xfffff80028033e40 "select" chain 25: thread 100428 (pid 4228, sshd) is blocked on lockmgr ufsSHARED (count 1) chain 26: thread 100275 (pid 3522, bash) is blocked on lockmgr ufsSHARED (count 1) chain 27: thread 100341 (pid 3124, sshd) is blocked on lockmgr ufsSHARED (count 1) chain 28: thread 100271 (pid 2572, sendmail) is blocked on lockmgr ufsSHARED (count 1) chain 29: thread 100281 (pid 2569, sendmail) is blocked on lockmgr ufsSHARED (count 1) chain 30: thread 100374 (pid 2292, syslogd) is blocked on lockmgr ufsSHARED (count 1) chain 31: thread 100220 (pid 44, vnlru) is sleeping on 0xfffff80841e1f520 "vlruwt" chain 32: thread 100217 (pid 43, syncer) is sleeping on 0xffffffff81d96908 "syncer" chain 33: thread 100207 (pid 42, bufdaemon) is sleeping on 0xffffffff81d95c30 "qsleep" chain 34: thread 100208 (pid 42, bufspacedaemon-0) is sleeping on 0xffffffff8180aa80 "-" chain 35: thread 100209 (pid 42, bufspacedaemon-1) is sleeping on 0xffffffff81812d40 "-" chain 36: thread 100210 (pid 42, bufspacedaemon-2) is sleeping on 0xffffffff8181b000 "-" chain 37: thread 100211 (pid 42, bufspacedaemon-3) is sleeping on 0xffffffff818232c0 "-" chain 38: thread 100212 (pid 42, bufspacedaemon-4) is sleeping on 0xffffffff8182b580 "-" chain 39: thread 100213 (pid 42, bufspacedaemon-5) is sleeping on 0xffffffff81833840 "-" chain 40: thread 100214 (pid 42, bufspacedaemon-6) is sleeping on 0xffffffff8183bb00 "-" chain 41: thread 100242 (pid 42, / worker) is sleeping on 0xfffff8000c62ace8 "sdflush" chain 42: thread 100249 (pid 42, /tmp worker) is sleeping on 0xfffff8000c69bce8 "sdflush" chain 43: thread 101086 (pid 42, /mnt worker) is sleeping on 0xfffff80d78b028e8 "sdflush" chain 44: thread 100206 (pid 41, vmdaemon) is sleeping on 0xffffffff81dbaa88 "psleep" chain 45: thread 100205 (pid 40, dom0) is sleeping on 0xffffffff81daef18 "psleep" chain 46: thread 100215 (pid 40, laundry: dom0) is sleeping on 0xffffffff81daef24 "launds" chain 47: thread 100216 (pid 40, dom1) is sleeping on 0xffffffff81daf598 "psleep" chain 48: thread 100218 (pid 40, laundry: dom1) is sleeping on 0xffffffff81daf5a4 "launds" chain 49: thread 100219 (pid 40, uma) is sleeping on 0xffffffff80ea6b10 "umarcl" chain 50: thread 100204 (pid 39, enc_daemon0) is sleeping on 0xfffff80841d22000 "idle" chain 51: thread 100201 (pid 38, rand_harvestq) is sleeping on 0xffffffff81adf588 "-" chain 52: thread 100197 (pid 37, soaiod4) is sleeping on 0xffffffff81d9556c "-" chain 53: thread 100196 (pid 36, soaiod3) is sleeping on 0xffffffff81d9556c "-" chain 54: thread 100195 (pid 35, soaiod2) is sleeping on 0xffffffff81d9556c "-" chain 55: thread 100194 (pid 34, soaiod1) is sleeping on 0xffffffff81d9556c "-" chain 56: thread 100171 (pid 33, usbus0) is sleeping on 0xfffffe0070c60cf0 "-" chain 57: thread 100172 (pid 33, usbus0) is sleeping on 0xfffffe0070c60d48 "-" chain 58: thread 100173 (pid 33, usbus0) is sleeping on 0xfffffe0070c60da0 "-" chain 59: thread 100174 (pid 33, usbus0) is sleeping on 0xfffffe0070c60df8 "-" chain 60: thread 100175 (pid 33, usbus0) is sleeping on 0xfffffe0070c60e50 "-" chain 61: thread 100178 (pid 33, usbus1) is sleeping on 0xfffffe0127384440 "-" chain 62: thread 100179 (pid 33, usbus1) is sleeping on 0xfffffe0127384498 "-" chain 63: thread 100180 (pid 33, usbus1) is sleeping on 0xfffffe01273844f0 "-" chain 64: thread 100181 (pid 33, usbus1) is sleeping on 0xfffffe0127384548 "-" chain 65: thread 100182 (pid 33, usbus1) is sleeping on 0xfffffe01273845a0 "-" chain 66: thread 100184 (pid 33, usbus2) is sleeping on 0xfffffe0126f30cf0 "-" chain 67: thread 100185 (pid 33, usbus2) is sleeping on 0xfffffe0126f30d48 "-" chain 68: thread 100186 (pid 33, usbus2) is sleeping on 0xfffffe0126f30da0 "-" chain 69: thread 100187 (pid 33, usbus2) is sleeping on 0xfffffe0126f30df8 "-" chain 70: thread 100188 (pid 33, usbus2) is sleeping on 0xfffffe0126f30e50 "-" chain 71: thread 100164 (pid 32, doneq1) is sleeping on 0xffffffff819b7340 "-" chain 72: thread 100165 (pid 32, doneq2) is sleeping on 0xffffffff819b73c0 "-" chain 73: thread 100166 (pid 32, doneq3) is sleeping on 0xffffffff819b7440 "-" chain 74: thread 100167 (pid 32, doneq4) is sleeping on 0xffffffff819b74c0 "-" chain 75: thread 100203 (pid 32, scanner) is sleeping on 0xffffffff819b7190 "-" chain 76: thread 100162 (pid 31, crypto returns 23) is sleeping on 0xfffff80003d488d0 "crypto_ret_wait" chain 77: thread 100161 (pid 30, crypto returns 22) is sleeping on 0xfffff80003d48870 "crypto_ret_wait" chain 78: thread 100160 (pid 29, crypto returns 21) is sleeping on 0xfffff80003d48810 "crypto_ret_wait" chain 79: thread 100159 (pid 28, crypto returns 20) is sleeping on 0xfffff80003d487b0 "crypto_ret_wait" chain 80: thread 100158 (pid 27, crypto returns 19) is sleeping on 0xfffff80003d48750 "crypto_ret_wait" chain 81: thread 100157 (pid 26, crypto returns 18) is sleeping on 0xfffff80003d486f0 "crypto_ret_wait" chain 82: thread 100156 (pid 25, crypto returns 17) is sleeping on 0xfffff80003d48690 "crypto_ret_wait" chain 83: thread 100155 (pid 24, crypto returns 16) is sleeping on 0xfffff80003d48630 "crypto_ret_wait" chain 84: thread 100154 (pid 23, crypto returns 15) is sleeping on 0xfffff80003d485d0 "crypto_ret_wait" chain 85: thread 100153 (pid 22, crypto returns 14) is sleeping on 0xfffff80003d48570 "crypto_ret_wait" chain 86: thread 100152 (pid 21, crypto returns 13) is sleeping on 0xfffff80003d48510 "crypto_ret_wait" chain 87: thread 100151 (pid 20, crypto returns 12) is sleeping on 0xfffff80003d484b0 "crypto_ret_wait" chain 88: thread 100150 (pid 19, crypto returns 11) is sleeping on 0xfffff80003d48450 "crypto_ret_wait" chain 89: thread 100149 (pid 18, crypto returns 10) is sleeping on 0xfffff80003d483f0 "crypto_ret_wait" chain 90: thread 100148 (pid 17, crypto returns 9) is sleeping on 0xfffff80003d48390 "crypto_ret_wait" chain 91: thread 100147 (pid 16, crypto returns 8) is sleeping on 0xfffff80003d48330 "crypto_ret_wait" chain 92: thread 100146 (pid 15, crypto returns 7) is sleeping on 0xfffff80003d482d0 "crypto_ret_wait" chain 93: thread 100145 (pid 9, crypto returns 6) is sleeping on 0xfffff80003d48270 "crypto_ret_wait" chain 94: thread 100144 (pid 8, crypto returns 5) is sleeping on 0xfffff80003d48210 "crypto_ret_wait" chain 95: thread 100143 (pid 7, crypto returns 4) is sleeping on 0xfffff80003d481b0 "crypto_ret_wait" chain 96: thread 100142 (pid 6, crypto returns 3) is sleeping on 0xfffff80003d48150 "crypto_ret_wait" chain 97: thread 100141 (pid 5, crypto returns 2) is sleeping on 0xfffff80003d480f0 "crypto_ret_wait" chain 98: thread 100140 (pid 4, crypto returns 1) is sleeping on 0xfffff80003d48090 "crypto_ret_wait" chain 99: thread 100139 (pid 3, crypto returns 0) is sleeping on 0xfffff80003d48030 "crypto_ret_wait" chain 100: thread 100138 (pid 2, crypto) is sleeping on 0xffffffff81dac7d0 "crypto_wait" chain 101: thread 100113 (pid 14, sequencer 00) is sleeping on 0xfffff80003d2cc88 "seqstate" chain 102: thread 100110 (pid 13, g_event) is sleeping on 0xffffffff81c8a950 "-" chain 103: thread 100111 (pid 13, g_up) is sleeping on 0xffffffff81c8a958 "-" chain 104: thread 100112 (pid 13, g_down) is sleeping on 0xffffffff81c8a960 "-" chain 105: thread 100002 (pid 1, init) is blocked on lockmgr ufsSHARED (count 1) chain 106: thread 100001 (pid 10, audit) is sleeping on 0xffffffff81dacbe8 "audit_worker_cv" chain 107: thread 100000 (pid 0, swapper) is sleeping on 0xffffffff81c8aef0 "swapin" chain 108: thread 100027 (pid 0, if_io_tqg_0) is sleeping on 0xfffff800039fb000 "-" chain 109: thread 100028 (pid 0, if_io_tqg_1) is sleeping on 0xfffff800039fae00 "-" chain 110: thread 100029 (pid 0, if_io_tqg_2) is sleeping on 0xfffff800039fad00 "-" chain 111: thread 100030 (pid 0, if_io_tqg_3) is sleeping on 0xfffff800039fac00 "-" chain 112: thread 100031 (pid 0, if_io_tqg_4) is sleeping on 0xfffff800039fab00 "-" chain 113: thread 100032 (pid 0, if_io_tqg_5) is sleeping on 0xfffff800039faa00 "-" chain 114: thread 100033 (pid 0, if_io_tqg_6) is sleeping on 0xfffff800039fa900 "-" chain 115: thread 100034 (pid 0, if_io_tqg_7) is sleeping on 0xfffff800039fa800 "-" chain 116: thread 100035 (pid 0, if_io_tqg_8) is sleeping on 0xfffff800039fa700 "-" chain 117: thread 100036 (pid 0, if_io_tqg_9) is sleeping on 0xfffff800039fa600 "-" chain 118: thread 100037 (pid 0, if_io_tqg_10) is sleeping on 0xfffff800039fa500 "-" chain 119: thread 100038 (pid 0, if_io_tqg_11) is sleeping on 0xfffff800039fa400 "-" chain 120: thread 100039 (pid 0, if_io_tqg_12) is sleeping on 0xfffff800039fa300 "-" chain 121: thread 100040 (pid 0, if_io_tqg_13) is sleeping on 0xfffff800039fa200 "-" chain 122: thread 100041 (pid 0, if_io_tqg_14) is sleeping on 0xfffff800039fa100 "-" chain 123: thread 100042 (pid 0, if_io_tqg_15) is sleeping on 0xfffff800039fa000 "-" chain 124: thread 100043 (pid 0, if_io_tqg_16) is sleeping on 0xfffff800039f9e00 "-" chain 125: thread 100044 (pid 0, if_io_tqg_17) is sleeping on 0xfffff800039f9d00 "-" chain 126: thread 100045 (pid 0, if_io_tqg_18) is sleeping on 0xfffff800039f9c00 "-" chain 127: thread 100046 (pid 0, if_io_tqg_19) is sleeping on 0xfffff800039f9b00 "-" chain 128: thread 100047 (pid 0, if_io_tqg_20) is sleeping on 0xfffff800039f9a00 "-" chain 129: thread 100048 (pid 0, if_io_tqg_21) is sleeping on 0xfffff800039f9900 "-" chain 130: thread 100049 (pid 0, if_io_tqg_22) is sleeping on 0xfffff800039f9800 "-" chain 131: thread 100050 (pid 0, if_io_tqg_23) is sleeping on 0xfffff800039f9700 "-" chain 132: thread 100051 (pid 0, if_config_tqg_0) is sleeping on 0xfffff800039f9600 "-" chain 133: thread 100052 (pid 0, softirq_0) is sleeping on 0xfffff800039f9500 "-" chain 134: thread 100053 (pid 0, softirq_1) is sleeping on 0xfffff800039f9400 "-" chain 135: thread 100054 (pid 0, softirq_2) is sleeping on 0xfffff800039f9300 "-" chain 136: thread 100055 (pid 0, softirq_3) is sleeping on 0xfffff800039f9200 "-" chain 137: thread 100056 (pid 0, softirq_4) is sleeping on 0xfffff800039f9100 "-" chain 138: thread 100057 (pid 0, softirq_5) is sleeping on 0xfffff800039f9000 "-" chain 139: thread 100058 (pid 0, softirq_6) is sleeping on 0xfffff800039f8e00 "-" chain 140: thread 100059 (pid 0, softirq_7) is sleeping on 0xfffff800039f8d00 "-" chain 141: thread 100060 (pid 0, softirq_8) is sleeping on 0xfffff800039f8c00 "-" chain 142: thread 100061 (pid 0, softirq_9) is sleeping on 0xfffff800039f8b00 "-" chain 143: thread 100062 (pid 0, softirq_10) is sleeping on 0xfffff800039f8a00 "-" chain 144: thread 100063 (pid 0, softirq_11) is sleeping on 0xfffff800039f8900 "-" chain 145: thread 100064 (pid 0, softirq_12) is sleeping on 0xfffff800039f8800 "-" chain 146: thread 100065 (pid 0, softirq_13) is sleeping on 0xfffff800039f8700 "-" chain 147: thread 100066 (pid 0, softirq_14) is sleeping on 0xfffff800039f8600 "-" chain 148: thread 100067 (pid 0, softirq_15) is sleeping on 0xfffff800039f8500 "-" chain 149: thread 100068 (pid 0, softirq_16) is sleeping on 0xfffff800039f8400 "-" chain 150: thread 100069 (pid 0, softirq_17) is sleeping on 0xfffff800039f8300 "-" chain 151: thread 100070 (pid 0, softirq_18) is sleeping on 0xfffff800039f8200 "-" chain 152: thread 100071 (pid 0, softirq_19) is sleeping on 0xfffff800039f8100 "-" chain 153: thread 100072 (pid 0, softirq_20) is sleeping on 0xfffff800039f8000 "-" chain 154: thread 100073 (pid 0, softirq_21) is sleeping on 0xfffff800039f7e00 "-" chain 155: thread 100074 (pid 0, softirq_22) is sleeping on 0xfffff800039f7d00 "-" chain 156: thread 100075 (pid 0, softirq_23) is sleeping on 0xfffff800039f7c00 "-" chain 157: thread 100076 (pid 0, in6m_free taskq) is sleeping on 0xfffff80003b85000 "-" chain 158: thread 100078 (pid 0, aiod_kick taskq) is sleeping on 0xfffff80003b86b00 "-" chain 159: thread 100079 (pid 0, kqueue_ctx taskq) is sleeping on 0xfffff80003b86900 "-" chain 160: thread 100109 (pid 0, firmware taskq) is sleeping on 0xfffff80003c7c900 "-" chain 161: thread 100114 (pid 0, crypto_0) is sleeping on 0xfffff80003c7c100 "-" chain 162: thread 100115 (pid 0, crypto_1) is sleeping on 0xfffff80003c7c100 "-" chain 163: thread 100116 (pid 0, crypto_2) is sleeping on 0xfffff80003c7c100 "-" chain 164: thread 100117 (pid 0, crypto_3) is sleeping on 0xfffff80003c7c100 "-" chain 165: thread 100118 (pid 0, crypto_4) is sleeping on 0xfffff80003c7c100 "-" chain 166: thread 100119 (pid 0, crypto_5) is sleeping on 0xfffff80003c7c100 "-" chain 167: thread 100120 (pid 0, crypto_6) is sleeping on 0xfffff80003c7c100 "-" chain 168: thread 100121 (pid 0, crypto_7) is sleeping on 0xfffff80003c7c100 "-" chain 169: thread 100122 (pid 0, crypto_8) is sleeping on 0xfffff80003c7c100 "-" chain 170: thread 100123 (pid 0, crypto_9) is sleeping on 0xfffff80003c7c100 "-" chain 171: thread 100124 (pid 0, crypto_10) is sleeping on 0xfffff80003c7c100 "-" chain 172: thread 100125 (pid 0, crypto_11) is sleeping on 0xfffff80003c7c100 "-" chain 173: thread 100126 (pid 0, crypto_12) is sleeping on 0xfffff80003c7c100 "-" chain 174: thread 100127 (pid 0, crypto_13) is sleeping on 0xfffff80003c7c100 "-" chain 175: thread 100128 (pid 0, crypto_14) is sleeping on 0xfffff80003c7c100 "-" chain 176: thread 100129 (pid 0, crypto_15) is sleeping on 0xfffff80003c7c100 "-" chain 177: thread 100130 (pid 0, crypto_16) is sleeping on 0xfffff80003c7c100 "-" chain 178: thread 100131 (pid 0, crypto_17) is sleeping on 0xfffff80003c7c100 "-" chain 179: thread 100132 (pid 0, crypto_18) is sleeping on 0xfffff80003c7c100 "-" chain 180: thread 100133 (pid 0, crypto_19) is sleeping on 0xfffff80003c7c100 "-" chain 181: thread 100134 (pid 0, crypto_20) is sleeping on 0xfffff80003c7c100 "-" chain 182: thread 100135 (pid 0, crypto_21) is sleeping on 0xfffff80003c7c100 "-" chain 183: thread 100136 (pid 0, crypto_22) is sleeping on 0xfffff80003c7c100 "-" chain 184: thread 100137 (pid 0, crypto_23) is sleeping on 0xfffff80003c7c100 "-" chain 185: thread 100193 (pid 0, mca taskq) is sleeping on 0xfffff800070fe200 "-" chain 186: thread 100198 (pid 0, acpi_task_0) is sleeping on 0xfffff80841ae3000 "-" chain 187: thread 100199 (pid 0, acpi_task_1) is sleeping on 0xfffff80841ae3000 "-" chain 188: thread 100200 (pid 0, acpi_task_2) is sleeping on 0xfffff80841ae3000 "-" chain 189: thread 100202 (pid 0, CAM taskq) is sleeping on 0xfffff80003d4bc00 "-" db:1:pho1> show mount 0xfffffe012c531280 /dev/da0p2 on / (ufs) 0xfffffe012f1ff280 devfs on /dev (devfs) 0xfffffe012e93b280 /dev/da0p3 on /tmp (ufs) 0xfffffe012e93a700 procfs on /proc (procfs) 0xfffffe012ad9bb80 /dev/md10 on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 88948 Buf domain 0 freebufs 10482 lofreebufs 438 hifreebufs 658 bufspace 116748288 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 4556 (114339840) dirtyq count 0 (0) wakeup 0 lim 12 CPU 1, 6, 1, 4, 2, 8, 0, 0, 6, 7, 4, 4, 0, 0, 4, 5, 7, 3, 8, 8, 0, 8, 9, 0, Locked buffers: 0 space 0 Total buffers: 25382 space 116748288 Buf domain 1 freebufs 11918 lofreebufs 438 hifreebufs 658 bufspace 72519680 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 3129 (70144000) dirtyq count 0 (0) wakeup 0 lim 12 CPU 10, 7, 0, 3, 4, 0, 7, 5, 2, 0, 5, 7, 0, 0, 3, 7, 2, 3, 10, 2, 1, 0, 7, 0, Locked buffers: 1 space 32768 Total buffers: 46411 space 72519680 Buf domain 2 freebufs 14613 lofreebufs 438 hifreebufs 658 bufspace 13570048 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 428 (11399168) dirtyq count 0 (0) wakeup 0 lim 12 CPU 0, 3, 5, 10, 2, 0, 1, 10, 5, 6, 8, 4, 0, 1, 0, 0, 8, 8, 8, 0, 1, 4, 3, 5, Locked buffers: 0 space 0 Total buffers: 2140 space 13570048 Buf domain 3 freebufs 12516 lofreebufs 438 hifreebufs 658 bufspace 50913280 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2558 (50118656) dirtyq count 0 (0) wakeup 0 lim 12 CPU 1, 0, 8, 7, 3, 2, 0, 6, 0, 7, 0, 10, 0, 1, 1, 0, 0, 2, 0, 1, 0, 0, 10, 0, Locked buffers: 0 space 0 Total buffers: 5874 space 50913280 Buf domain 4 freebufs 14800 lofreebufs 438 hifreebufs 658 bufspace 7573504 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 291 (7188480) dirtyq count 0 (0) wakeup 0 lim 12 CPU 1, 0, 0, 8, 4, 3, 0, 6, 1, 0, 1, 5, 0, 1, 0, 0, 0, 2, 1, 0, 0, 0, 6, 3, Locked buffers: 0 space 0 Total buffers: 19260 space 7573504 Buf domain 5 freebufs 12643 lofreebufs 438 hifreebufs 658 bufspace 46477312 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2443 (45809664) dirtyq count 0 (0) wakeup 0 lim 12 CPU 0, 3, 1, 5, 3, 1, 0, 7, 0, 5, 4, 8, 1, 0, 1, 0, 0, 1, 0, 0, 0, 1, 6, 0, Locked buffers: 0 space 0 Total buffers: 3977 space 46477312 Buf domain 6 freebufs 14874 lofreebufs 438 hifreebufs 658 bufspace 5218304 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 203 (4292608) dirtyq count 0 (0) wakeup 0 lim 12 CPU 0, 4, 2, 8, 4, 1, 0, 5, 2, 11, 6, 7, 1, 0, 1, 0, 0, 2, 0, 1, 0, 0, 1, 0, Locked buffers: 0 space 0 Total buffers: 2887 space 5218304 db:1:pho1> show page vm_cnt.v_free_count: 15935364 vm_cnt.v_inactive_count: 29028 vm_cnt.v_active_count: 3660 vm_cnt.v_laundry_count: 289 vm_cnt.v_wire_count: 336591 vm_cnt.v_free_reserved: 21373 vm_cnt.v_free_min: 102941 vm_cnt.v_free_target: 347645 vm_cnt.v_inactive_target: 521467 db:1:pho1> show pageq pq_free 15935364 dom 0 page_cnt 8147349 free 7868632 pq_act 1875 pq_inact 26298 pq_laund 118 pq_unsw 0 dom 1 page_cnt 8166485 free 8066732 pq_act 1785 pq_inact 2730 pq_laund 171 pq_unsw 0 db:0:pho> show di_queue gen 3642099 inv 0 td 0 tid -1 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 001270 | 000000 11 (008192K) | 000327 | 000000 10 (004096K) | 000443 | 000000 09 (002048K) | 000492 | 000000 08 (001024K) | 000609 | 000001 07 (000512K) | 001855 | 000002 06 (000256K) | 003571 | 000016 05 (000128K) | 006052 | 000047 04 (000064K) | 009849 | 000188 03 (000032K) | 014308 | 000554 02 (000016K) | 020106 | 001215 01 (000008K) | 024082 | 001939 00 (000004K) | 008719 | 001971 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000001 | 000000 03 (000032K) | 000001 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000001 | 000000 DOMAIN: 1 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 001287 | 000000 11 (008192K) | 000498 | 000000 10 (004096K) | 000675 | 000000 09 (002048K) | 000544 | 000000 08 (001024K) | 001154 | 000001 07 (000512K) | 001525 | 000004 06 (000256K) | 001853 | 000019 05 (000128K) | 002069 | 000046 04 (000064K) | 002410 | 000172 03 (000032K) | 003198 | 000515 02 (000016K) | 004409 | 001226 01 (000008K) | 007053 | 001928 00 (000004K) | 003783 | 000779 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> acttrace Tracing command idle pid 11 tid 100003 td 0xfffffe006a5c0300 (CPU 0) cpustop_handler() at cpustop_handler+0x26/frame 0xffffffff81de3b20 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81de3b30 trap() at trap+0x56/frame 0xffffffff81de3c40 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81de3c40 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe0069fe7a50, rbp = 0xfffffe0069fe7a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe0069fe7a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe0069fe7aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe0069fe7ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe0069fe7ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe0069fe7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0069fe7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0069fe7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe006a5bfc00 (CPU 1) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe007097ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe007097ee10 trap() at trap+0x56/frame 0xfffffe007097ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe007097ef20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe0069feca50, rbp = 0xfffffe0069feca50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe0069feca50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe0069fecaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe0069fecac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe0069fecae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe0069fecbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0069fecbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0069fecbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe006a5bf500 (CPU 2) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe0070985e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe0070985e10 trap() at trap+0x56/frame 0xfffffe0070985f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0070985f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe0069ff1a50, rbp = 0xfffffe0069ff1a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe0069ff1a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe0069ff1aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe0069ff1ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe0069ff1ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe0069ff1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0069ff1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0069ff1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe006a5bee00 (CPU 3) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe0070990e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe0070990e10 trap() at trap+0x56/frame 0xfffffe0070990f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0070990f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe0069ff6a50, rbp = 0xfffffe0069ff6a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe0069ff6a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe0069ff6aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe0069ff6ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe0069ff6ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe0069ff6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0069ff6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0069ff6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe006a5be700 (CPU 4) kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe0069ffb890 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0069ffb8a0 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe0069ffb8d0 uart_intr() at uart_intr+0x128/frame 0xfffffe0069ffb910 intr_event_handle() at intr_event_handle+0xde/frame 0xfffffe0069ffb960 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe0069ffb990 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe0069ffb990 --- interrupt, rip = 0xffffffff804c2d04, rsp = 0xfffffe0069ffba60, rbp = 0xfffffe0069ffbaa0 --- acpi_cpu_idle() at acpi_cpu_idle+0x294/frame 0xfffffe0069ffbaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe0069ffbac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe0069ffbae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe0069ffbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0069ffbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0069ffbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe006a5be000 (CPU 5) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe00709a2e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00709a2e10 trap() at trap+0x56/frame 0xfffffe00709a2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00709a2f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0530a50, rbp = 0xfffffe00e0530a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0530a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0530aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0530ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0530ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0530bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0530bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0530bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe006a5c8a00 (CPU 6) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe00709a9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00709a9e10 trap() at trap+0x56/frame 0xfffffe00709a9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00709a9f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0535a50, rbp = 0xfffffe00e0535a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0535a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0535aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0535ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0535ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0535bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0535bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0535bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe006a5c8300 (CPU 7) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe00709b4e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00709b4e10 trap() at trap+0x56/frame 0xfffffe00709b4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00709b4f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e053aa50, rbp = 0xfffffe00e053aa50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e053aa50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e053aaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e053aac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e053aae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e053abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e053abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e053abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe006a5c7c00 (CPU 8) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe00709bbe00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00709bbe10 trap() at trap+0x56/frame 0xfffffe00709bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00709bbf20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e053fa50, rbp = 0xfffffe00e053fa50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e053fa50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e053faa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e053fac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e053fae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e053fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e053fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e053fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe006a5c7500 (CPU 9) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe00709c6e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00709c6e10 trap() at trap+0x56/frame 0xfffffe00709c6f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00709c6f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0544a50, rbp = 0xfffffe00e0544a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0544a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0544aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0544ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0544ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0544bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0544bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0544bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe006a5c6e00 (CPU 10) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe00709cde00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00709cde10 trap() at trap+0x56/frame 0xfffffe00709cdf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00709cdf20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0549a50, rbp = 0xfffffe00e0549a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0549a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0549aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0549ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0549ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0549bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0549bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0549bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe006a5c6700 (CPU 11) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe00709d8e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00709d8e10 trap() at trap+0x56/frame 0xfffffe00709d8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00709d8f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e054ea50, rbp = 0xfffffe00e054ea50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e054ea50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e054eaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e054eac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e054eae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e054ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e054ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e054ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100015 td 0xfffffe006a5c6000 (CPU 12) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a02ce00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a02ce10 trap() at trap+0x56/frame 0xfffffe006a02cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a02cf20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0553a50, rbp = 0xfffffe00e0553a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0553a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0553aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0553ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0553ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0553bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0553bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0553bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100016 td 0xfffffe006a5c1800 (CPU 13) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a033e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a033e10 trap() at trap+0x56/frame 0xfffffe006a033f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a033f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0558a50, rbp = 0xfffffe00e0558a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0558a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0558aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0558ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0558ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0558bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0558bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0558bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100017 td 0xfffffe006a5cc300 (CPU 14) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a03ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a03ee10 trap() at trap+0x56/frame 0xfffffe006a03ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a03ef20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e055da50, rbp = 0xfffffe00e055da50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e055da50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e055daa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e055dac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e055dae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e055dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e055dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e055dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100019 td 0xfffffe006a5cb500 (CPU 16) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a050e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a050e10 trap() at trap+0x56/frame 0xfffffe006a050f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a050f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0567a50, rbp = 0xfffffe00e0567a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0567a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0567aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0567ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0567ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0567bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0567bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0567bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100020 td 0xfffffe006a5cae00 (CPU 17) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a057e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a057e10 trap() at trap+0x56/frame 0xfffffe006a057f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a057f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e056ca50, rbp = 0xfffffe00e056ca50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e056ca50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e056caa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e056cac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e056cae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e056cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e056cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e056cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100021 td 0xfffffe006a5ca700 (CPU 18) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a062e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a062e10 trap() at trap+0x56/frame 0xfffffe006a062f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a062f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0571a50, rbp = 0xfffffe00e0571a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0571a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0571aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0571ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0571ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0571bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0571bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0571bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100022 td 0xfffffe006a5ca000 (CPU 19) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a069e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a069e10 trap() at trap+0x56/frame 0xfffffe006a069f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a069f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0576a50, rbp = 0xfffffe00e0576a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0576a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0576aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0576ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0576ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100023 td 0xfffffe006a5c9800 (CPU 20) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a074e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a074e10 trap() at trap+0x56/frame 0xfffffe006a074f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a074f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e057ba50, rbp = 0xfffffe00e057ba50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e057ba50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e057baa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e057bac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e057bae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e057bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e057bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e057bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100024 td 0xfffffe006a5c9100 (CPU 21) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a07be00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a07be10 trap() at trap+0x56/frame 0xfffffe006a07bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a07bf20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0580a50, rbp = 0xfffffe00e0580a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0580a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0580aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0580ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0580ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0580bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0580bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0580bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100025 td 0xfffffe006a5cfc00 (CPU 22) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a086e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a086e10 trap() at trap+0x56/frame 0xfffffe006a086f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a086f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0585a50, rbp = 0xfffffe00e0585a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0585a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0585aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0585ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0585ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0585bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0585bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0585bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100026 td 0xfffffe006a5cf500 (CPU 23) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a08de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a08de10 trap() at trap+0x56/frame 0xfffffe006a08df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a08df20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e058aa50, rbp = 0xfffffe00e058aa50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e058aa50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e058aaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e058aac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e058aae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e058abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e058abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e058abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100082 td 0xfffffe0070c29300 (CPU 15) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a045e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a045e10 trap() at trap+0x56/frame 0xfffffe006a045f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a045f20 --- trap 0x13, rip = 0xffffffff80e87377, rsp = 0xfffffe01266a4900, rbp = 0xfffffe01266a49a0 --- ffs_sync() at ffs_sync+0x1b7/frame 0xfffffe01266a49a0 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe01266a49e0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe01266a4a10 ffs_unmount() at ffs_unmount+0x6d/frame 0xfffffe01266a4a80 dounmount() at dounmount+0x43d/frame 0xfffffe01266a4ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe01266a4b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe01266a4b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe01266a4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01266a4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01266a4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 82175 1 72847 0 D+ ufs 0xfffff80841e9b2f0 logger 74122 1 72847 0 D+ ufs 0xfffff80841e9b2f0 rm 73353 1 2872 0 D+ ufs 0xfffff8000c73b2f0 ls 58889 1 57264 1004 D+ vfs_bus 0xfffffe012ad9bb80 sh 58876 1 57264 1004 DE+ suspfs 0xfffffe012ad9bc00 lockf 58875 1 57264 1004 DE+ suspfs 0xfffffe012ad9bc00 lockf 58223 1 57264 1004 D+ suspfs 0xfffffe012ad9bc00 rename 58110 1 57264 1004 D+ suspfs 0xfffffe012ad9bc00 fts 58109 1 57264 1004 D+ suspfs 0xfffffe012ad9bc00 lockf 58108 1 57264 1004 D+ suspfs 0xfffffe012ad9bc00 symlink 58107 1 57264 1004 D+ suspfs 0xfffffe012ad9bc00 link 58106 1 57264 1004 D+ suspfs 0xfffffe012ad9bc00 openat 58105 1 57264 1004 D+ suspfs 0xfffffe012ad9bc00 fts 58103 1 57264 1004 D+ suspfs 0xfffffe012ad9bc00 symlink 58101 1 57264 1004 D+ suspfs 0xfffffe012ad9bc00 link 58100 1 57264 1004 DE+ suspfs 0xfffffe012ad9bc00 openat 58098 1 57264 1004 D+ suspfs 0xfffffe012ad9bc00 fts 58097 1 57264 1004 D+ suspfs 0xfffffe012ad9bc00 rw 58096 1 57264 1004 D+ suspfs 0xfffffe012ad9bc00 symlink 58095 1 57264 1004 D+ suspfs 0xfffffe012ad9bc00 openat 58093 1 57264 1004 D+ suspfs 0xfffffe012ad9bc00 rw 58092 1 57264 1004 D+ suspfs 0xfffffe012ad9bc00 symlink 58088 1 57264 1004 D+ suspfs 0xfffffe012ad9bc00 symlink 4231 1 4231 1001 Ss+ select 0xfffff80028033e40 bash 4228 1 4228 0 Ds ufs 0xfffff80841e9b2f0 sshd 3522 1 3522 1001 Ds+ ufs 0xfffff80841e9b2f0 bash 3124 1 3124 0 Ds ufs 0xfffff80841e9b2f0 sshd 2572 1 2572 25 Ds ufs 0xfffff80841e9b2f0 sendmail 2569 1 2569 0 Ds ufs 0xfffff80841e9b2f0 sendmail 2292 1 2292 0 Ds ufs 0xfffff80841e9b2f0 syslogd 44 0 0 0 DL vlruwt 0xfffff80841e1f520 [vnlru] 43 0 0 0 DL syncer 0xffffffff81d96908 [syncer] 42 0 0 0 DL (threaded) [bufdaemon] 100207 D qsleep 0xffffffff81d95c30 [bufdaemon] 100208 D - 0xffffffff8180aa80 [bufspacedaemon-0] 100209 D - 0xffffffff81812d40 [bufspacedaemon-1] 100210 D - 0xffffffff8181b000 [bufspacedaemon-2] 100211 D - 0xffffffff818232c0 [bufspacedaemon-3] 100212 D - 0xffffffff8182b580 [bufspacedaemon-4] 100213 D - 0xffffffff81833840 [bufspacedaemon-5] 100214 D - 0xffffffff8183bb00 [bufspacedaemon-6] 100242 D sdflush 0xfffff8000c62ace8 [/ worker] 100249 D sdflush 0xfffff8000c69bce8 [/tmp worker] 101086 D sdflush 0xfffff80d78b028e8 [/mnt worker] 41 0 0 0 DL psleep 0xffffffff81dbaa88 [vmdaemon] 40 0 0 0 DL (threaded) [pagedaemon] 100205 D psleep 0xffffffff81daef18 [dom0] 100215 D launds 0xffffffff81daef24 [laundry: dom0] 100216 D psleep 0xffffffff81daf598 [dom1] 100218 D launds 0xffffffff81daf5a4 [laundry: dom1] 100219 D umarcl 0xffffffff80ea6b10 [uma] 39 0 0 0 DL idle 0xfffff80841d22000 [enc_daemon0] 38 0 0 0 DL - 0xffffffff81adf588 [rand_harvestq] 37 0 0 0 DL - 0xffffffff81d9556c [soaiod4] 36 0 0 0 DL - 0xffffffff81d9556c [soaiod3] 35 0 0 0 DL - 0xffffffff81d9556c [soaiod2] 34 0 0 0 DL - 0xffffffff81d9556c [soaiod1] 33 0 0 0 DL (threaded) [usb] 100171 D - 0xfffffe0070c60cf0 [usbus0] 100172 D - 0xfffffe0070c60d48 [usbus0] 100173 D - 0xfffffe0070c60da0 [usbus0] 100174 D - 0xfffffe0070c60df8 [usbus0] 100175 D - 0xfffffe0070c60e50 [usbus0] 100178 D - 0xfffffe0127384440 [usbus1] 100179 D - 0xfffffe0127384498 [usbus1] 100180 D - 0xfffffe01273844f0 [usbus1] 100181 D - 0xfffffe0127384548 [usbus1] 100182 D - 0xfffffe01273845a0 [usbus1] 100184 D - 0xfffffe0126f30cf0 [usbus2] 100185 D - 0xfffffe0126f30d48 [usbus2] 100186 D - 0xfffffe0126f30da0 [usbus2] 100187 D - 0xfffffe0126f30df8 [usbus2] 100188 D - 0xfffffe0126f30e50 [usbus2] 32 0 0 0 RL (threaded) [cam] 100163 RunQ [doneq0] 100164 D - 0xffffffff819b7340 [doneq1] 100165 D - 0xffffffff819b73c0 [doneq2] 100166 D - 0xffffffff819b7440 [doneq3] 100167 D - 0xffffffff819b74c0 [doneq4] 100203 D - 0xffffffff819b7190 [scanner] 31 0 0 0 DL crypto_ 0xfffff80003d488d0 [crypto returns 23] 30 0 0 0 DL crypto_ 0xfffff80003d48870 [crypto returns 22] 29 0 0 0 DL crypto_ 0xfffff80003d48810 [crypto returns 21] 28 0 0 0 DL crypto_ 0xfffff80003d487b0 [crypto returns 20] 27 0 0 0 DL crypto_ 0xfffff80003d48750 [crypto returns 19] 26 0 0 0 DL crypto_ 0xfffff80003d486f0 [crypto returns 18] 25 0 0 0 DL crypto_ 0xfffff80003d48690 [crypto returns 17] 24 0 0 0 DL crypto_ 0xfffff80003d48630 [crypto returns 16] 23 0 0 0 DL crypto_ 0xfffff80003d485d0 [crypto returns 15] 22 0 0 0 DL crypto_ 0xfffff80003d48570 [crypto returns 14] 21 0 0 0 DL crypto_ 0xfffff80003d48510 [crypto returns 13] 20 0 0 0 DL crypto_ 0xfffff80003d484b0 [crypto returns 12] 19 0 0 0 DL crypto_ 0xfffff80003d48450 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff80003d483f0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003d48390 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003d48330 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff80003d482d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003d48270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003d48210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff80003d481b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003d48150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff80003d480f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003d48090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003d48030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81dac7d0 [crypto] 14 0 0 0 DL seqstat 0xfffff80003d2cc88 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100110 D - 0xffffffff81c8a950 [g_event] 100111 D - 0xffffffff81c8a958 [g_up] 100112 D - 0xffffffff81c8a960 [g_down] 12 0 0 0 WL (threaded) [intr] 100077 I [swi5: fast taskq] 100080 I [swi6: task queue] 100081 I [swi6: Giant taskq] 100083 I [swi4: clock (0)] 100084 I [swi4: clock (1)] 100085 I [swi4: clock (2)] 100086 I [swi4: clock (3)] 100087 I [swi4: clock (4)] 100088 I [swi4: clock (5)] 100089 I [swi4: clock (6)] 100090 I [swi4: clock (7)] 100091 I [swi4: clock (8)] 100092 I [swi4: clock (9)] 100093 I [swi4: clock (10)] 100094 I [swi4: clock (11)] 100095 I [swi4: clock (12)] 100096 I [swi4: clock (13)] 100097 I [swi4: clock (14)] 100098 I [swi4: clock (15)] 100099 I [swi4: clock (16)] 100100 I [swi4: clock (17)] 100101 I [swi4: clock (18)] 100102 I [swi4: clock (19)] 100103 I [swi4: clock (20)] 100104 I [swi4: clock (21)] 100105 I [swi4: clock (22)] 100106 I [swi4: clock (23)] 100107 I [swi3: vm] 100108 I [swi1: netisr 0] 100168 I [irq80: isci0] 100169 I [irq81: isci0] 100170 I [irq22: ehci0] 100176 I [irq82: hdac0] 100177 I [irq97: xhci0] 100183 I [irq20: ehci1] 100189 I [irq98: ahci0] 100190 I [irq99: hdac1] 100191 I [swi4: apei] 100192 I [swi0: uart] 100376 I [irq100: ioat0] 100377 I [irq101: ioat1] 100378 I [irq102: ioat2] 100379 I [irq103: ioat3] 100380 I [irq104: ioat4] 100381 I [irq105: ioat5] 100382 I [irq106: ioat6] 100383 I [irq107: ioat7] 100384 I [irq108: ioat8] 100385 I [irq109: ioat9] 100386 I [irq110: ioat10] 100387 I [irq111: ioat11] 100388 I [irq112: ioat12] 100389 I [irq113: ioat13] 100390 I [irq114: ioat14] 100391 I [irq115: ioat15] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 100015 Run CPU 12 [idle: cpu12] 100016 Run CPU 13 [idle: cpu13] 100017 Run CPU 14 [idle: cpu14] 100018 CanRun [idle: cpu15] 100019 Run CPU 16 [idle: cpu16] 100020 Run CPU 17 [idle: cpu17] 100021 Run CPU 18 [idle: cpu18] 100022 Run CPU 19 [idle: cpu19] 100023 Run CPU 20 [idle: cpu20] 100024 Run CPU 21 [idle: cpu21] 100025 Run CPU 22 [idle: cpu22] 100026 Run CPU 23 [idle: cpu23] 1 0 1 0 DLs ufs 0xfffff80841e9b2f0 [init] 10 0 0 0 DL audit_w 0xffffffff81dacbe8 [audit] 0 0 0 0 RLs (threaded) [kernel] 100000 D swapin 0xffffffff81c8aef0 [swapper] 100027 D - 0xfffff800039fb000 [if_io_tqg_0] 100028 D - 0xfffff800039fae00 [if_io_tqg_1] 100029 D - 0xfffff800039fad00 [if_io_tqg_2] 100030 D - 0xfffff800039fac00 [if_io_tqg_3] 100031 D - 0xfffff800039fab00 [if_io_tqg_4] 100032 D - 0xfffff800039faa00 [if_io_tqg_5] 100033 D - 0xfffff800039fa900 [if_io_tqg_6] 100034 D - 0xfffff800039fa800 [if_io_tqg_7] 100035 D - 0xfffff800039fa700 [if_io_tqg_8] 100036 D - 0xfffff800039fa600 [if_io_tqg_9] 100037 D - 0xfffff800039fa500 [if_io_tqg_10] 100038 D - 0xfffff800039fa400 [if_io_tqg_11] 100039 D - 0xfffff800039fa300 [if_io_tqg_12] 100040 D - 0xfffff800039fa200 [if_io_tqg_13] 100041 D - 0xfffff800039fa100 [if_io_tqg_14] 100042 D - 0xfffff800039fa000 [if_io_tqg_15] 100043 D - 0xfffff800039f9e00 [if_io_tqg_16] 100044 D - 0xfffff800039f9d00 [if_io_tqg_17] 100045 D - 0xfffff800039f9c00 [if_io_tqg_18] 100046 D - 0xfffff800039f9b00 [if_io_tqg_19] 100047 D - 0xfffff800039f9a00 [if_io_tqg_20] 100048 D - 0xfffff800039f9900 [if_io_tqg_21] 100049 D - 0xfffff800039f9800 [if_io_tqg_22] 100050 D - 0xfffff800039f9700 [if_io_tqg_23] 100051 D - 0xfffff800039f9600 [if_config_tqg_0] 100052 D - 0xfffff800039f9500 [softirq_0] 100053 D - 0xfffff800039f9400 [softirq_1] 100054 D - 0xfffff800039f9300 [softirq_2] 100055 D - 0xfffff800039f9200 [softirq_3] 100056 D - 0xfffff800039f9100 [softirq_4] 100057 D - 0xfffff800039f9000 [softirq_5] 100058 D - 0xfffff800039f8e00 [softirq_6] 100059 D - 0xfffff800039f8d00 [softirq_7] 100060 D - 0xfffff800039f8c00 [softirq_8] 100061 D - 0xfffff800039f8b00 [softirq_9] 100062 D - 0xfffff800039f8a00 [softirq_10] 100063 D - 0xfffff800039f8900 [softirq_11] 100064 D - 0xfffff800039f8800 [softirq_12] 100065 D - 0xfffff800039f8700 [softirq_13] 100066 D - 0xfffff800039f8600 [softirq_14] 100067 D - 0xfffff800039f8500 [softirq_15] 100068 D - 0xfffff800039f8400 [softirq_16] 100069 D - 0xfffff800039f8300 [softirq_17] 100070 D - 0xfffff800039f8200 [softirq_18] 100071 D - 0xfffff800039f8100 [softirq_19] 100072 D - 0xfffff800039f8000 [softirq_20] 100073 D - 0xfffff800039f7e00 [softirq_21] 100074 D - 0xfffff800039f7d00 [softirq_22] 100075 D - 0xfffff800039f7c00 [softirq_23] 100076 D - 0xfffff80003b85000 [in6m_free taskq] 100078 D - 0xfffff80003b86b00 [aiod_kick taskq] 100079 D - 0xfffff80003b86900 [kqueue_ctx taskq] 100082 Run CPU 15 [thread taskq] 100109 D - 0xfffff80003c7c900 [firmware taskq] 100114 D - 0xfffff80003c7c100 [crypto_0] 100115 D - 0xfffff80003c7c100 [crypto_1] 100116 D - 0xfffff80003c7c100 [crypto_2] 100117 D - 0xfffff80003c7c100 [crypto_3] 100118 D - 0xfffff80003c7c100 [crypto_4] 100119 D - 0xfffff80003c7c100 [crypto_5] 100120 D - 0xfffff80003c7c100 [crypto_6] 100121 D - 0xfffff80003c7c100 [crypto_7] 100122 D - 0xfffff80003c7c100 [crypto_8] 100123 D - 0xfffff80003c7c100 [crypto_9] 100124 D - 0xfffff80003c7c100 [crypto_10] 100125 D - 0xfffff80003c7c100 [crypto_11] 100126 D - 0xfffff80003c7c100 [crypto_12] 100127 D - 0xfffff80003c7c100 [crypto_13] 100128 D - 0xfffff80003c7c100 [crypto_14] 100129 D - 0xfffff80003c7c100 [crypto_15] 100130 D - 0xfffff80003c7c100 [crypto_16] 100131 D - 0xfffff80003c7c100 [crypto_17] 100132 D - 0xfffff80003c7c100 [crypto_18] 100133 D - 0xfffff80003c7c100 [crypto_19] 100134 D - 0xfffff80003c7c100 [crypto_20] 100135 D - 0xfffff80003c7c100 [crypto_21] 100136 D - 0xfffff80003c7c100 [crypto_22] 100137 D - 0xfffff80003c7c100 [crypto_23] 100193 D - 0xfffff800070fe200 [mca taskq] 100198 D - 0xfffff80841ae3000 [acpi_task_0] 100199 D - 0xfffff80841ae3000 [acpi_task_1] 100200 D - 0xfffff80841ae3000 [acpi_task_2] 100202 D - 0xfffff80003d4bc00 [CAM taskq] 3359 3124 3124 1001 Z sshd 85562 1 2966 0 Z sleep 2126 1 2126 0 Z moused 4230 4228 4228 1001 Z sshd 74121 1 72847 0 Z+ sh 72847 1 72847 0 Z+ sh 72850 1 72847 0 Z+ sh 2966 1 2966 0 Z sh 2987 1 2966 0 Z sh 2988 1 2966 0 Z awk 2989 1 2966 0 Z sh 82172 1 72847 0 Z+ logger db:0:pho> allt Tracing command logger pid 82175 tid 100312 td 0xfffffe012c58d000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013c8bb490 mi_switch() at mi_switch+0x155/frame 0xfffffe013c8bb4b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013c8bb4f0 sleeplk() at sleeplk+0x106/frame 0xfffffe013c8bb550 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe013c8bb5f0 ffs_lock() at ffs_lock+0x7d/frame 0xfffffe013c8bb630 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe013c8bb650 _vn_lock() at _vn_lock+0x54/frame 0xfffffe013c8bb6b0 lookup() at lookup+0xdd/frame 0xfffffe013c8bb750 namei() at namei+0x59c/frame 0xfffffe013c8bb810 vn_open_cred() at vn_open_cred+0x31b/frame 0xfffffe013c8bb960 kern_openat() at kern_openat+0x1fa/frame 0xfffffe013c8bbad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe013c8bbbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013c8bbbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8004343ba, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe3a0 --- Tracing command rm pid 74122 tid 100481 td 0xfffffe012d5fa500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe01394c84f0 mi_switch() at mi_switch+0x155/frame 0xfffffe01394c8510 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe01394c8550 sleeplk() at sleeplk+0x106/frame 0xfffffe01394c85b0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3f5/frame 0xfffffe01394c8650 ffs_lock() at ffs_lock+0x7d/frame 0xfffffe01394c8690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe01394c86b0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01394c8710 lookup() at lookup+0x50d/frame 0xfffffe01394c87b0 namei() at namei+0x59c/frame 0xfffffe01394c8870 kern_funlinkat() at kern_funlinkat+0xa9/frame 0xfffffe01394c8ab0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe01394c8ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe01394c8bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01394c8bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x8004219fa, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffeb00 --- Tracing command ls pid 73353 tid 100958 td 0xfffffe01299c1a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013e9b23d0 mi_switch() at mi_switch+0x155/frame 0xfffffe013e9b23f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013e9b2430 sleeplk() at sleeplk+0x106/frame 0xfffffe013e9b2490 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe013e9b2530 ffs_lock() at ffs_lock+0x7d/frame 0xfffffe013e9b2570 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe013e9b2590 _vn_lock() at _vn_lock+0x54/frame 0xfffffe013e9b25f0 vget_finish() at vget_finish+0x7a/frame 0xfffffe013e9b2620 cache_lookup() at cache_lookup+0x795/frame 0xfffffe013e9b26e0 vfs_cache_lookup() at vfs_cache_lookup+0x7d/frame 0xfffffe013e9b2730 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe013e9b2750 lookup() at lookup+0x601/frame 0xfffffe013e9b27f0 namei() at namei+0x59c/frame 0xfffffe013e9b28b0 kern_statat() at kern_statat+0x7f/frame 0xfffffe013e9b29d0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe013e9b2ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe013e9b2bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013e9b2bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x8004b725a, rsp = 0x7fffffffde38, rbp = 0x7fffffffdef0 --- Tracing command sh pid 58889 tid 100814 td 0xfffffe012a970500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0138ae6fc0 mi_switch() at mi_switch+0x155/frame 0xfffffe0138ae6fe0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0138ae7020 _sleep() at _sleep+0x2cd/frame 0xfffffe0138ae70c0 vfs_busy() at vfs_busy+0x2e3/frame 0xfffffe0138ae7100 vn_vget_ino_gen() at vn_vget_ino_gen+0xa2/frame 0xfffffe0138ae7170 vn_vget_ino() at vn_vget_ino+0x21/frame 0xfffffe0138ae7190 ufs_lookup_ino() at ufs_lookup_ino+0x4c1/frame 0xfffffe0138ae72a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x56/frame 0xfffffe0138ae72c0 vfs_cache_lookup() at vfs_cache_lookup+0xa8/frame 0xfffffe0138ae7310 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe0138ae7330 lookup() at lookup+0x601/frame 0xfffffe0138ae73d0 namei() at namei+0x59c/frame 0xfffffe0138ae7490 vn_open_cred() at vn_open_cred+0x31b/frame 0xfffffe0138ae75e0 vop_stdvptocnp() at vop_stdvptocnp+0x152/frame 0xfffffe0138ae7930 VOP_VPTOCNP_APV() at VOP_VPTOCNP_APV+0x59/frame 0xfffffe0138ae7950 vn_vptocnp() at vn_vptocnp+0xe7/frame 0xfffffe0138ae79d0 vn_fullpath_dir() at vn_fullpath_dir+0x154/frame 0xfffffe0138ae7a30 vn_fullpath_any() at vn_fullpath_any+0x69/frame 0xfffffe0138ae7a90 sys___getcwd() at sys___getcwd+0x77/frame 0xfffffe0138ae7ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0138ae7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0138ae7bf0 --- syscall (326, FreeBSD ELF64, sys___getcwd), rip = 0x80038b7ca, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe410 --- Tracing command lockf pid 58876 tid 100366 td 0xfffffe012c544a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013c9c9370 mi_switch() at mi_switch+0x155/frame 0xfffffe013c9c9390 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013c9c93d0 _sleep() at _sleep+0x2cd/frame 0xfffffe013c9c9470 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe013c9c94c0 vn_close1() at vn_close1+0x8b/frame 0xfffffe013c9c9530 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe013c9c95b0 _fdrop() at _fdrop+0x1a/frame 0xfffffe013c9c95d0 closef() at closef+0x1db/frame 0xfffffe013c9c9660 fdescfree_fds() at fdescfree_fds+0x9c/frame 0xfffffe013c9c96c0 fdescfree() at fdescfree+0x3e3/frame 0xfffffe013c9c9790 exit1() at exit1+0x487/frame 0xfffffe013c9c9800 sigexit() at sigexit+0x15c/frame 0xfffffe013c9c9ae0 postsig() at postsig+0x2cc/frame 0xfffffe013c9c9bb0 ast() at ast+0x54b/frame 0xfffffe013c9c9bf0 fast_syscall_common() at fast_syscall_common+0x1a5/frame 0xfffffe013c9c9bf0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x800445bda, rsp = 0x7fffffffe468, rbp = 0x7fffffffe4b0 --- Tracing command lockf pid 58875 tid 100840 td 0xfffffe012a5ea500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0138b69370 mi_switch() at mi_switch+0x155/frame 0xfffffe0138b69390 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0138b693d0 _sleep() at _sleep+0x2cd/frame 0xfffffe0138b69470 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe0138b694c0 vn_close1() at vn_close1+0x8b/frame 0xfffffe0138b69530 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe0138b695b0 _fdrop() at _fdrop+0x1a/frame 0xfffffe0138b695d0 closef() at closef+0x1db/frame 0xfffffe0138b69660 fdescfree_fds() at fdescfree_fds+0x9c/frame 0xfffffe0138b696c0 fdescfree() at fdescfree+0x3e3/frame 0xfffffe0138b69790 exit1() at exit1+0x487/frame 0xfffffe0138b69800 sigexit() at sigexit+0x15c/frame 0xfffffe0138b69ae0 postsig() at postsig+0x2cc/frame 0xfffffe0138b69bb0 ast() at ast+0x54b/frame 0xfffffe0138b69bf0 fast_syscall_common() at fast_syscall_common+0x1a5/frame 0xfffffe0138b69bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80044407a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe4d0 --- Tracing command rename pid 58223 tid 100287 td 0xfffffe012c1afe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013c8266c0 mi_switch() at mi_switch+0x155/frame 0xfffffe013c8266e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013c826720 _sleep() at _sleep+0x2cd/frame 0xfffffe013c8267c0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe013c826810 vn_open_cred() at vn_open_cred+0x67/frame 0xfffffe013c826960 kern_openat() at kern_openat+0x1fa/frame 0xfffffe013c826ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe013c826bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013c826bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80043f3ba, rsp = 0x7fffffffe2d8, rbp = 0x7fffffffe3c0 --- Tracing command fts pid 58110 tid 100431 td 0xfffffe012b5fe800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013cb6e7a0 mi_switch() at mi_switch+0x155/frame 0xfffffe013cb6e7c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013cb6e800 _sleep() at _sleep+0x2cd/frame 0xfffffe013cb6e8a0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe013cb6e8f0 vn_close1() at vn_close1+0x8b/frame 0xfffffe013cb6e960 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe013cb6e9e0 _fdrop() at _fdrop+0x1a/frame 0xfffffe013cb6ea00 closef() at closef+0x1db/frame 0xfffffe013cb6ea90 closefp() at closefp+0x96/frame 0xfffffe013cb6ead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe013cb6ebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013cb6ebf0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x80044309a, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe470 --- Tracing command lockf pid 58109 tid 100817 td 0xfffffe012e9c2e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0138af66d0 mi_switch() at mi_switch+0x155/frame 0xfffffe0138af66f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0138af6730 _sleep() at _sleep+0x2cd/frame 0xfffffe0138af67d0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe0138af6820 vn_start_write() at vn_start_write+0x71/frame 0xfffffe0138af6870 kern_funlinkat() at kern_funlinkat+0x68/frame 0xfffffe0138af6ab0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe0138af6ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0138af6bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0138af6bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80043b9fa, rsp = 0x7fffffffe4d8, rbp = 0x7fffffffe500 --- Tracing command symlink pid 58108 tid 101024 td 0xfffffe01298d9100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f63b710 mi_switch() at mi_switch+0x155/frame 0xfffffe012f63b730 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f63b770 _sleep() at _sleep+0x2cd/frame 0xfffffe012f63b810 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe012f63b860 vn_start_write() at vn_start_write+0x71/frame 0xfffffe012f63b8b0 kern_symlinkat() at kern_symlinkat+0x11d/frame 0xfffffe012f63bad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe012f63bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe012f63bbf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002fb64a, rsp = 0x7fffffffe448, rbp = 0x7fffffffe4f0 --- Tracing command link pid 58107 tid 100920 td 0xfffffe01299c2800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013e8f46d0 mi_switch() at mi_switch+0x155/frame 0xfffffe013e8f46f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013e8f4730 _sleep() at _sleep+0x2cd/frame 0xfffffe013e8f47d0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe013e8f4820 vn_start_write() at vn_start_write+0x71/frame 0xfffffe013e8f4870 kern_funlinkat() at kern_funlinkat+0x68/frame 0xfffffe013e8f4ab0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe013e8f4ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe013e8f4bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013e8f4bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80043b9fa, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe500 --- Tracing command openat pid 58106 tid 100823 td 0xfffffe012a5ec100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0138b147a0 mi_switch() at mi_switch+0x155/frame 0xfffffe0138b147c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0138b14800 _sleep() at _sleep+0x2cd/frame 0xfffffe0138b148a0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe0138b148f0 vn_close1() at vn_close1+0x8b/frame 0xfffffe0138b14960 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe0138b149e0 _fdrop() at _fdrop+0x1a/frame 0xfffffe0138b14a00 closef() at closef+0x1db/frame 0xfffffe0138b14a90 closefp() at closefp+0x96/frame 0xfffffe0138b14ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0138b14bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0138b14bf0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x80044409a, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe500 --- Tracing command fts pid 58105 tid 100869 td 0xfffffe012a5e9700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0138bfa7a0 mi_switch() at mi_switch+0x155/frame 0xfffffe0138bfa7c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0138bfa800 _sleep() at _sleep+0x2cd/frame 0xfffffe0138bfa8a0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe0138bfa8f0 vn_close1() at vn_close1+0x8b/frame 0xfffffe0138bfa960 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe0138bfa9e0 _fdrop() at _fdrop+0x1a/frame 0xfffffe0138bfaa00 closef() at closef+0x1db/frame 0xfffffe0138bfaa90 closefp() at closefp+0x96/frame 0xfffffe0138bfaad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0138bfabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0138bfabf0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x80044309a, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe470 --- Tracing command symlink pid 58103 tid 100324 td 0xfffffe012e9c7c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013c8f7710 mi_switch() at mi_switch+0x155/frame 0xfffffe013c8f7730 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013c8f7770 _sleep() at _sleep+0x2cd/frame 0xfffffe013c8f7810 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe013c8f7860 vn_start_write() at vn_start_write+0x71/frame 0xfffffe013c8f78b0 kern_symlinkat() at kern_symlinkat+0x11d/frame 0xfffffe013c8f7ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe013c8f7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013c8f7bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002fb64a, rsp = 0x7fffffffe448, rbp = 0x7fffffffe4f0 --- Tracing command link pid 58101 tid 100323 td 0xfffffe012e9c8300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013c8f26d0 mi_switch() at mi_switch+0x155/frame 0xfffffe013c8f26f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013c8f2730 _sleep() at _sleep+0x2cd/frame 0xfffffe013c8f27d0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe013c8f2820 vn_start_write() at vn_start_write+0x71/frame 0xfffffe013c8f2870 kern_funlinkat() at kern_funlinkat+0x68/frame 0xfffffe013c8f2ab0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe013c8f2ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe013c8f2bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013c8f2bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80043b9fa, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe500 --- Tracing command openat pid 58100 tid 100362 td 0xfffffe012c545100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013c9b5630 mi_switch() at mi_switch+0x155/frame 0xfffffe013c9b5650 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013c9b5690 _sleep() at _sleep+0x2cd/frame 0xfffffe013c9b5730 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe013c9b5780 vn_close1() at vn_close1+0x8b/frame 0xfffffe013c9b57f0 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe013c9b5870 _fdrop() at _fdrop+0x1a/frame 0xfffffe013c9b5890 closef() at closef+0x1db/frame 0xfffffe013c9b5920 fdescfree_fds() at fdescfree_fds+0x9c/frame 0xfffffe013c9b5980 fdescfree() at fdescfree+0x3e3/frame 0xfffffe013c9b5a50 exit1() at exit1+0x487/frame 0xfffffe013c9b5ac0 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe013c9b5ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe013c9b5bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013c9b5bf0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x80043f3da, rsp = 0x7fffffffe278, rbp = 0x7fffffffe290 --- Tracing command fts pid 58098 tid 100778 td 0xfffffe012a5af000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0138a337a0 mi_switch() at mi_switch+0x155/frame 0xfffffe0138a337c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0138a33800 _sleep() at _sleep+0x2cd/frame 0xfffffe0138a338a0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe0138a338f0 vn_close1() at vn_close1+0x8b/frame 0xfffffe0138a33960 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe0138a339e0 _fdrop() at _fdrop+0x1a/frame 0xfffffe0138a33a00 closef() at closef+0x1db/frame 0xfffffe0138a33a90 closefp() at closefp+0x96/frame 0xfffffe0138a33ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0138a33bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0138a33bf0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x80044309a, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe470 --- Tracing command rw pid 58097 tid 100417 td 0xfffffe012e931700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013cb28600 mi_switch() at mi_switch+0x155/frame 0xfffffe013cb28620 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013cb28660 _sleep() at _sleep+0x2cd/frame 0xfffffe013cb28700 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe013cb28750 vn_write() at vn_write+0xf0/frame 0xfffffe013cb287e0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe013cb28840 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe013cb28990 vn_io_fault() at vn_io_fault+0x1bb/frame 0xfffffe013cb28a10 dofilewrite() at dofilewrite+0x81/frame 0xfffffe013cb28a60 sys_write() at sys_write+0xc0/frame 0xfffffe013cb28ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe013cb28bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013cb28bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80044403a, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command symlink pid 58096 tid 100272 td 0xfffffe012ec8e500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe01381c0710 mi_switch() at mi_switch+0x155/frame 0xfffffe01381c0730 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe01381c0770 _sleep() at _sleep+0x2cd/frame 0xfffffe01381c0810 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe01381c0860 vn_start_write() at vn_start_write+0x71/frame 0xfffffe01381c08b0 kern_symlinkat() at kern_symlinkat+0x11d/frame 0xfffffe01381c0ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe01381c0bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01381c0bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002fb64a, rsp = 0x7fffffffe448, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 58095 tid 100465 td 0xfffffe012c58ec00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe01394186d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01394186f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0139418730 _sleep() at _sleep+0x2cd/frame 0xfffffe01394187d0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe0139418820 vn_start_write() at vn_start_write+0x71/frame 0xfffffe0139418870 kern_funlinkat() at kern_funlinkat+0x68/frame 0xfffffe0139418ab0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe0139418ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0139418bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0139418bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80043b9fa, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe500 --- Tracing command rw pid 58093 tid 100926 td 0xfffffe01299a1300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013e912600 mi_switch() at mi_switch+0x155/frame 0xfffffe013e912620 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013e912660 _sleep() at _sleep+0x2cd/frame 0xfffffe013e912700 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe013e912750 vn_write() at vn_write+0xf0/frame 0xfffffe013e9127e0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe013e912840 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe013e912990 vn_io_fault() at vn_io_fault+0x1bb/frame 0xfffffe013e912a10 dofilewrite() at dofilewrite+0x81/frame 0xfffffe013e912a60 sys_write() at sys_write+0xc0/frame 0xfffffe013e912ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe013e912bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013e912bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80044403a, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command symlink pid 58092 tid 100948 td 0xfffffe0129560500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013e980710 mi_switch() at mi_switch+0x155/frame 0xfffffe013e980730 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013e980770 _sleep() at _sleep+0x2cd/frame 0xfffffe013e980810 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe013e980860 vn_start_write() at vn_start_write+0x71/frame 0xfffffe013e9808b0 kern_symlinkat() at kern_symlinkat+0x11d/frame 0xfffffe013e980ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe013e980bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013e980bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002fb64a, rsp = 0x7fffffffe448, rbp = 0x7fffffffe4f0 --- Tracing command symlink pid 58088 tid 100294 td 0xfffffe012e983100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013c861710 mi_switch() at mi_switch+0x155/frame 0xfffffe013c861730 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013c861770 _sleep() at _sleep+0x2cd/frame 0xfffffe013c861810 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe013c861860 vn_start_write() at vn_start_write+0x71/frame 0xfffffe013c8618b0 kern_symlinkat() at kern_symlinkat+0x11d/frame 0xfffffe013c861ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe013c861bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013c861bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002fb64a, rsp = 0x7fffffffe448, rbp = 0x7fffffffe4f0 --- Tracing command bash pid 4231 tid 100262 td 0xfffffe012ec97000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013818e700 mi_switch() at mi_switch+0x155/frame 0xfffffe013818e720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013818e760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe013818e7c0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe013818e7d0 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe013818e830 seltdwait() at seltdwait+0x8d/frame 0xfffffe013818e870 kern_select() at kern_select+0x87a/frame 0xfffffe013818ea50 sys_pselect() at sys_pselect+0x127/frame 0xfffffe013818ead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe013818ebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013818ebf0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x80054331a, rsp = 0x7fffffffd688, rbp = 0x7fffffffd750 --- Tracing command sshd pid 4228 tid 100428 td 0xfffffe012b5f7700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013cb5f490 mi_switch() at mi_switch+0x155/frame 0xfffffe013cb5f4b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013cb5f4f0 sleeplk() at sleeplk+0x106/frame 0xfffffe013cb5f550 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe013cb5f5f0 ffs_lock() at ffs_lock+0x7d/frame 0xfffffe013cb5f630 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe013cb5f650 _vn_lock() at _vn_lock+0x54/frame 0xfffffe013cb5f6b0 lookup() at lookup+0xdd/frame 0xfffffe013cb5f750 namei() at namei+0x59c/frame 0xfffffe013cb5f810 vn_open_cred() at vn_open_cred+0x10b/frame 0xfffffe013cb5f960 kern_openat() at kern_openat+0x1fa/frame 0xfffffe013cb5fad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe013cb5fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013cb5fbf0 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x8008e89ba, rsp = 0x7fffffffe058, rbp = 0x7fffffffe160 --- Tracing command bash pid 3522 tid 100275 td 0xfffffe012ec8de00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe01381cf490 mi_switch() at mi_switch+0x155/frame 0xfffffe01381cf4b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe01381cf4f0 sleeplk() at sleeplk+0x106/frame 0xfffffe01381cf550 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe01381cf5f0 ffs_lock() at ffs_lock+0x7d/frame 0xfffffe01381cf630 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe01381cf650 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01381cf6b0 lookup() at lookup+0xdd/frame 0xfffffe01381cf750 namei() at namei+0x59c/frame 0xfffffe01381cf810 vn_open_cred() at vn_open_cred+0x31b/frame 0xfffffe01381cf960 kern_openat() at kern_openat+0x1fa/frame 0xfffffe01381cfad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe01381cfbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01381cfbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8005ad3ba, rsp = 0x7fffffffd6b8, rbp = 0x7fffffffd7a0 --- Tracing command sshd pid 3124 tid 100341 td 0xfffffe012c9f8100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013c94c490 mi_switch() at mi_switch+0x155/frame 0xfffffe013c94c4b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013c94c4f0 sleeplk() at sleeplk+0x106/frame 0xfffffe013c94c550 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe013c94c5f0 ffs_lock() at ffs_lock+0x7d/frame 0xfffffe013c94c630 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe013c94c650 _vn_lock() at _vn_lock+0x54/frame 0xfffffe013c94c6b0 lookup() at lookup+0xdd/frame 0xfffffe013c94c750 namei() at namei+0x59c/frame 0xfffffe013c94c810 vn_open_cred() at vn_open_cred+0x10b/frame 0xfffffe013c94c960 kern_openat() at kern_openat+0x1fa/frame 0xfffffe013c94cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe013c94cbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013c94cbf0 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x8008e89ba, rsp = 0x7fffffffe058, rbp = 0x7fffffffe160 --- Tracing command sendmail pid 2572 tid 100271 td 0xfffffe0127450c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe01381bb4f0 mi_switch() at mi_switch+0x155/frame 0xfffffe01381bb510 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe01381bb550 sleeplk() at sleeplk+0x106/frame 0xfffffe01381bb5b0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe01381bb650 ffs_lock() at ffs_lock+0x7d/frame 0xfffffe01381bb690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe01381bb6b0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01381bb710 lookup() at lookup+0xdd/frame 0xfffffe01381bb7b0 namei() at namei+0x59c/frame 0xfffffe01381bb870 kern_funlinkat() at kern_funlinkat+0xa9/frame 0xfffffe01381bbab0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe01381bbad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe01381bbbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01381bbbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x8008579fa, rsp = 0x7fffffffd398, rbp = 0x7fffffffd850 --- Tracing command sendmail pid 2569 tid 100281 td 0xfffffe012ecb2100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe01381ed4f0 mi_switch() at mi_switch+0x155/frame 0xfffffe01381ed510 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe01381ed550 sleeplk() at sleeplk+0x106/frame 0xfffffe01381ed5b0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe01381ed650 ffs_lock() at ffs_lock+0x7d/frame 0xfffffe01381ed690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe01381ed6b0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01381ed710 lookup() at lookup+0xdd/frame 0xfffffe01381ed7b0 namei() at namei+0x59c/frame 0xfffffe01381ed870 kern_funlinkat() at kern_funlinkat+0xa9/frame 0xfffffe01381edab0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe01381edad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe01381edbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01381edbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x8008579fa, rsp = 0x7fffffffc8f8, rbp = 0x7fffffffcdb0 --- Tracing command syslogd pid 2292 tid 100374 td 0xfffffe012eca4c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013c9f1490 mi_switch() at mi_switch+0x155/frame 0xfffffe013c9f14b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013c9f14f0 sleeplk() at sleeplk+0x106/frame 0xfffffe013c9f1550 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe013c9f15f0 ffs_lock() at ffs_lock+0x7d/frame 0xfffffe013c9f1630 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe013c9f1650 _vn_lock() at _vn_lock+0x54/frame 0xfffffe013c9f16b0 lookup() at lookup+0xdd/frame 0xfffffe013c9f1750 namei() at namei+0x59c/frame 0xfffffe013c9f1810 vn_open_cred() at vn_open_cred+0x31b/frame 0xfffffe013c9f1960 kern_openat() at kern_openat+0x1fa/frame 0xfffffe013c9f1ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe013c9f1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013c9f1bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8004473ba, rsp = 0x7fffffffd1c8, rbp = 0x7fffffffd2b0 --- Tracing command vnlru pid 44 tid 100220 td 0xfffffe012c92d000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe01380a49d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01380a49f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe01380a4a30 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01380a4a70 _sleep() at _sleep+0x26c/frame 0xfffffe01380a4b10 vnlru_proc() at vnlru_proc+0xaac/frame 0xfffffe01380a4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01380a4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01380a4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 43 tid 100217 td 0xfffffe012c92d700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0130bf3a10 mi_switch() at mi_switch+0x155/frame 0xfffffe0130bf3a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0130bf3a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0130bf3ab0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x184/frame 0xfffffe0130bf3b20 sched_sync() at sched_sync+0x68b/frame 0xfffffe0130bf3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0130bf3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0130bf3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100207 td 0xfffffe012c92de00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f6dea20 mi_switch() at mi_switch+0x155/frame 0xfffffe012f6dea40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f6dea80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe012f6deac0 _sleep() at _sleep+0x26c/frame 0xfffffe012f6deb60 buf_daemon() at buf_daemon+0x112/frame 0xfffffe012f6debb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012f6debf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012f6debf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100208 td 0xfffffe0070c3e800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f763a10 mi_switch() at mi_switch+0x155/frame 0xfffffe012f763a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f763a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe012f763ab0 _sleep() at _sleep+0x26c/frame 0xfffffe012f763b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe012f763bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012f763bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012f763bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100209 td 0xfffffe0070c3e100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f7e8a10 mi_switch() at mi_switch+0x155/frame 0xfffffe012f7e8a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f7e8a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe012f7e8ab0 _sleep() at _sleep+0x26c/frame 0xfffffe012f7e8b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe012f7e8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012f7e8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012f7e8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100210 td 0xfffffe0070c3da00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f7eda10 mi_switch() at mi_switch+0x155/frame 0xfffffe012f7eda30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f7eda70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe012f7edab0 _sleep() at _sleep+0x26c/frame 0xfffffe012f7edb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe012f7edbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012f7edbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012f7edbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100211 td 0xfffffe012f16a100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f7f2a10 mi_switch() at mi_switch+0x155/frame 0xfffffe012f7f2a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f7f2a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe012f7f2ab0 _sleep() at _sleep+0x26c/frame 0xfffffe012f7f2b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe012f7f2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012f7f2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012f7f2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100212 td 0xfffffe012f169a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f7f7a10 mi_switch() at mi_switch+0x155/frame 0xfffffe012f7f7a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f7f7a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe012f7f7ab0 _sleep() at _sleep+0x26c/frame 0xfffffe012f7f7b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe012f7f7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012f7f7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012f7f7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100213 td 0xfffffe012f169300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f7fca10 mi_switch() at mi_switch+0x155/frame 0xfffffe012f7fca30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f7fca70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe012f7fcab0 _sleep() at _sleep+0x26c/frame 0xfffffe012f7fcb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe012f7fcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012f7fcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012f7fcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100214 td 0xfffffe012f168c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0130a04a10 mi_switch() at mi_switch+0x155/frame 0xfffffe0130a04a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0130a04a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0130a04ab0 _sleep() at _sleep+0x26c/frame 0xfffffe0130a04b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0130a04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0130a04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0130a04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100242 td 0xfffffe012e92b700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013812aa40 mi_switch() at mi_switch+0x155/frame 0xfffffe013812aa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013812aaa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe013812aae0 _sleep() at _sleep+0x26c/frame 0xfffffe013812ab80 softdep_flush() at softdep_flush+0x16e/frame 0xfffffe013812abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe013812abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe013812abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100249 td 0xfffffe012f167e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe013814da40 mi_switch() at mi_switch+0x155/frame 0xfffffe013814da60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe013814daa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe013814dae0 _sleep() at _sleep+0x26c/frame 0xfffffe013814db80 softdep_flush() at softdep_flush+0x16e/frame 0xfffffe013814dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe013814dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe013814dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 101086 td 0xfffffe012adb2100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126beca40 mi_switch() at mi_switch+0x155/frame 0xfffffe0126beca60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126becaa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0126becae0 _sleep() at _sleep+0x26c/frame 0xfffffe0126becb80 softdep_flush() at softdep_flush+0x16e/frame 0xfffffe0126becbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126becbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126becbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 41 tid 100206 td 0xfffffe012c92e500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f6d9a40 mi_switch() at mi_switch+0x155/frame 0xfffffe012f6d9a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f6d9aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe012f6d9b40 vm_daemon() at vm_daemon+0x82/frame 0xfffffe012f6d9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012f6d9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012f6d9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 40 tid 100205 td 0xfffffe012c92ec00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f6d4670 mi_switch() at mi_switch+0x155/frame 0xfffffe012f6d4690 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f6d46d0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe012f6d4710 _sleep() at _sleep+0x26c/frame 0xfffffe012f6d47b0 vm_pageout_worker() at vm_pageout_worker+0x279/frame 0xfffffe012f6d4b70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe012f6d4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012f6d4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012f6d4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 40 tid 100215 td 0xfffffe012f16da00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0130be9830 mi_switch() at mi_switch+0x155/frame 0xfffffe0130be9850 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0130be9890 _sleep() at _sleep+0x2cd/frame 0xfffffe0130be9930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xc21/frame 0xfffffe0130be9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0130be9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0130be9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 40 tid 100216 td 0xfffffe012f16d300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0130bee6b0 mi_switch() at mi_switch+0x155/frame 0xfffffe0130bee6d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0130bee710 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0130bee750 _sleep() at _sleep+0x26c/frame 0xfffffe0130bee7f0 vm_pageout_worker() at vm_pageout_worker+0x279/frame 0xfffffe0130beebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0130beebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0130beebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 40 tid 100218 td 0xfffffe012f16cc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0130bf8830 mi_switch() at mi_switch+0x155/frame 0xfffffe0130bf8850 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0130bf8890 _sleep() at _sleep+0x2cd/frame 0xfffffe0130bf8930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xc21/frame 0xfffffe0130bf8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0130bf8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0130bf8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 40 tid 100219 td 0xfffffe012f16c500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0130bfda40 mi_switch() at mi_switch+0x155/frame 0xfffffe0130bfda60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0130bfdaa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0130bfdae0 _sleep() at _sleep+0x26c/frame 0xfffffe0130bfdb80 uma_reclaim_worker() at uma_reclaim_worker+0xb8/frame 0xfffffe0130bfdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0130bfdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0130bfdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 39 tid 100204 td 0xfffffe012c9f7300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f6cfa40 mi_switch() at mi_switch+0x155/frame 0xfffffe012f6cfa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f6cfaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe012f6cfb40 enc_daemon() at enc_daemon+0xe4/frame 0xfffffe012f6cfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012f6cfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012f6cfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 38 tid 100201 td 0xfffffe012c88f000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f6c09f0 mi_switch() at mi_switch+0x155/frame 0xfffffe012f6c0a10 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f6c0a50 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe012f6c0a90 _sleep() at _sleep+0x26c/frame 0xfffffe012f6c0b30 random_kthread() at random_kthread+0x67/frame 0xfffffe012f6c0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012f6c0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012f6c0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 37 tid 100197 td 0xfffffe012c890c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f694a30 mi_switch() at mi_switch+0x155/frame 0xfffffe012f694a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f694a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe012f694ad0 _sleep() at _sleep+0x26c/frame 0xfffffe012f694b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe012f694bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012f694bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012f694bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 36 tid 100196 td 0xfffffe012c891300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126bfea30 mi_switch() at mi_switch+0x155/frame 0xfffffe0126bfea50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126bfea90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0126bfead0 _sleep() at _sleep+0x26c/frame 0xfffffe0126bfeb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0126bfebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126bfebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126bfebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 35 tid 100195 td 0xfffffe012c891a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126bf9a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0126bf9a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126bf9a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0126bf9ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0126bf9b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0126bf9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126bf9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126bf9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 34 tid 100194 td 0xfffffe012c892100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126bf4a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0126bf4a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126bf4a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0126bf4ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0126bf4b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0126bf4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126bf4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126bf4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 33 tid 100171 td 0xfffffe0070d99000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b39ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b39ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b39b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0126b39b70 usb_process() at usb_process+0xc3/frame 0xfffffe0126b39bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b39bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b39bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 33 tid 100172 td 0xfffffe0070c56800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b3eab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b3ead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b3eb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0126b3eb70 usb_process() at usb_process+0xc3/frame 0xfffffe0126b3ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b3ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b3ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 33 tid 100173 td 0xfffffe0070c56100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b43ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b43ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b43b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0126b43b70 usb_process() at usb_process+0xc3/frame 0xfffffe0126b43bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b43bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b43bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 33 tid 100174 td 0xfffffe0070c55a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b48ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b48ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b48b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0126b48b70 usb_process() at usb_process+0xc3/frame 0xfffffe0126b48bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b48bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b48bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 33 tid 100175 td 0xfffffe0070c55300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b4dab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b4dad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b4db10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0126b4db70 usb_process() at usb_process+0xc3/frame 0xfffffe0126b4dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b4dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b4dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 33 tid 100178 td 0xfffffe0127142000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b74ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b74ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b74b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0126b74b70 usb_process() at usb_process+0xc3/frame 0xfffffe0126b74bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b74bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b74bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 33 tid 100179 td 0xfffffe0126f3d800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b79ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b79ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b79b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0126b79b70 usb_process() at usb_process+0xc3/frame 0xfffffe0126b79bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b79bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b79bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 33 tid 100180 td 0xfffffe0126f3d100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b7eab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b7ead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b7eb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0126b7eb70 usb_process() at usb_process+0xc3/frame 0xfffffe0126b7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 33 tid 100181 td 0xfffffe0126f3ca00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b83ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b83ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b83b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0126b83b70 usb_process() at usb_process+0xc3/frame 0xfffffe0126b83bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b83bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b83bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 33 tid 100182 td 0xfffffe0126f3c300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b88ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b88ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b88b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0126b88b70 usb_process() at usb_process+0xc3/frame 0xfffffe0126b88bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b88bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b88bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 33 tid 100184 td 0xfffffe0126f3b500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b92ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b92ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b92b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0126b92b70 usb_process() at usb_process+0xc3/frame 0xfffffe0126b92bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b92bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b92bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 33 tid 100185 td 0xfffffe012744f000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b97ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b97ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b97b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0126b97b70 usb_process() at usb_process+0xc3/frame 0xfffffe0126b97bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b97bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b97bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 33 tid 100186 td 0xfffffe0127145800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b9cab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b9cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b9cb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0126b9cb70 usb_process() at usb_process+0xc3/frame 0xfffffe0126b9cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b9cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b9cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 33 tid 100187 td 0xfffffe0127145100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126ba1ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126ba1ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126ba1b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0126ba1b70 usb_process() at usb_process+0xc3/frame 0xfffffe0126ba1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126ba1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126ba1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 33 tid 100188 td 0xfffffe0127144a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126ba6ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126ba6ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126ba6b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0126ba6b70 usb_process() at usb_process+0xc3/frame 0xfffffe0126ba6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126ba6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126ba6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 32 tid 100163 td 0xfffffe0070c54c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b11a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b11a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b11ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126b11b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0126b11bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b11bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b11bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 32 tid 100164 td 0xfffffe0070c54500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b16a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b16a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b16ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126b16b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0126b16bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b16bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b16bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 32 tid 100165 td 0xfffffe0070c53e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b1ba60 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b1ba80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b1bac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126b1bb60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0126b1bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b1bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b1bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 32 tid 100166 td 0xfffffe0070c53700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b20a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b20a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b20ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126b20b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0126b20bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b20bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b20bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 32 tid 100167 td 0xfffffe0070c53000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b25a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b25a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b25ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126b25b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0126b25bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b25bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b25bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 32 tid 100203 td 0xfffffe012c92f300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f6caa70 mi_switch() at mi_switch+0x155/frame 0xfffffe012f6caa90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f6caad0 _sleep() at _sleep+0x2cd/frame 0xfffffe012f6cab70 xpt_scanner_thread() at xpt_scanner_thread+0x68/frame 0xfffffe012f6cabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012f6cabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012f6cabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 23 pid 31 tid 100162 td 0xfffffe007098e100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b0ca50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b0ca70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b0cab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126b0cb50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126b0cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b0cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b0cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 22 pid 30 tid 100161 td 0xfffffe007098e800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b07a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b07a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b07ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126b07b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126b07bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b07bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b07bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 21 pid 29 tid 100160 td 0xfffffe0070c3b000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b02a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b02a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126b02ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126b02b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126b02bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b02bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b02bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 20 pid 28 tid 100159 td 0xfffffe0070c3b700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126afda50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126afda70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126afdab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126afdb50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126afdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126afdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126afdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 19 pid 27 tid 100158 td 0xfffffe0070c3be00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126af8a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126af8a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126af8ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126af8b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126af8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126af8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126af8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 18 pid 26 tid 100157 td 0xfffffe0070c3c500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126af3a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126af3a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126af3ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126af3b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126af3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126af3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126af3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 17 pid 25 tid 100156 td 0xfffffe0070c3cc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126aeea50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126aeea70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126aeeab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126aeeb50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126aeebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126aeebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126aeebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 16 pid 24 tid 100155 td 0xfffffe0070c3d300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126ae9a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126ae9a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126ae9ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126ae9b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126ae9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126ae9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126ae9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 15 pid 23 tid 100154 td 0xfffffe00709a0800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126ae4a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126ae4a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126ae4ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126ae4b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126ae4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126ae4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126ae4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 14 pid 22 tid 100153 td 0xfffffe007098b000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126adfa50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126adfa70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126adfab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126adfb50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126adfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126adfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126adfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 13 pid 21 tid 100152 td 0xfffffe007098b700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126adaa50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126adaa70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126adaab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126adab50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126adabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126adabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126adabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 12 pid 20 tid 100151 td 0xfffffe007098be00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126ad5a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126ad5a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126ad5ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126ad5b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126ad5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126ad5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126ad5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100150 td 0xfffffe007098c500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126ad0a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126ad0a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126ad0ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126ad0b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126ad0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126ad0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126ad0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100149 td 0xfffffe007098cc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126acba50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126acba70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126acbab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126acbb50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126acbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126acbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126acbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100148 td 0xfffffe007098d300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126ac6a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126ac6a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126ac6ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126ac6b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126ac6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126ac6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126ac6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100147 td 0xfffffe007098da00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126ac1a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126ac1a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126ac1ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126ac1b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126ac1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126ac1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126ac1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100146 td 0xfffffe007099d000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126abca50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126abca70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126abcab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126abcb50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126abcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126abcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126abcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100145 td 0xfffffe007099d700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126ab7a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126ab7a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126ab7ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126ab7b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126ab7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126ab7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126ab7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100144 td 0xfffffe007099de00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126ab2a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126ab2a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126ab2ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126ab2b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126ab2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126ab2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126ab2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100143 td 0xfffffe007099e500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126aada50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126aada70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126aadab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126aadb50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126aadbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126aadbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126aadbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100142 td 0xfffffe007099ec00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126aa8a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126aa8a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126aa8ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126aa8b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126aa8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126aa8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126aa8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100141 td 0xfffffe007099f300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126aa3a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126aa3a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126aa3ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126aa3b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126aa3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126aa3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126aa3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100140 td 0xfffffe007099fa00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a9ea50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a9ea70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a9eab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a9eb50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126a9ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a9ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a9ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100139 td 0xfffffe00709a0100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a99a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a99a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a99ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a99b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0126a99bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a99bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a99bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100138 td 0xfffffe00709af700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a94a70 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a94a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a94ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a94b70 crypto_proc() at crypto_proc+0x25f/frame 0xfffffe0126a94bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a94bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a94bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100113 td 0xfffffe00709f3300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe01267ffa70 mi_switch() at mi_switch+0x155/frame 0xfffffe01267ffa90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe01267ffad0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe01267ffb30 seq_eventthread() at seq_eventthread+0x91/frame 0xfffffe01267ffbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01267ffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01267ffbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100110 td 0xfffffe00709f4800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe01267f0a70 mi_switch() at mi_switch+0x155/frame 0xfffffe01267f0a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe01267f0ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe01267f0b70 g_run_events() at g_run_events+0x64/frame 0xfffffe01267f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01267f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01267f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100111 td 0xfffffe00709f4100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe01267f5a70 mi_switch() at mi_switch+0x155/frame 0xfffffe01267f5a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe01267f5ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe01267f5b70 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe01267f5ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe01267f5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01267f5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01267f5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100112 td 0xfffffe00709f3a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe01267faa70 mi_switch() at mi_switch+0x155/frame 0xfffffe01267faa90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe01267faad0 _sleep() at _sleep+0x2cd/frame 0xfffffe01267fab70 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe01267faba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe01267fabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01267fabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01267fabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100077 td 0xfffffe0070c24500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100080 td 0xfffffe0070c23000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012669ab00 mi_switch() at mi_switch+0x155/frame 0xfffffe012669ab20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe012669abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012669abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012669abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100081 td 0xfffffe0070c29a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012669fb00 mi_switch() at mi_switch+0x155/frame 0xfffffe012669fb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe012669fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012669fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012669fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100083 td 0xfffffe006a21e300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126709b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0126709b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0126709bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126709bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126709bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100084 td 0xfffffe006a21dc00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100085 td 0xfffffe006a21d500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100086 td 0xfffffe006a21ce00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100087 td 0xfffffe006a21c700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100088 td 0xfffffe006a21c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100089 td 0xfffffe0070c2a800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100090 td 0xfffffe0070c2a100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100091 td 0xfffffe00709f8c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100092 td 0xfffffe00709f8500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100093 td 0xfffffe00709f7e00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffffe00709f7700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100095 td 0xfffffe00709f7000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126745b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0126745b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0126745bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126745bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126745bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100096 td 0xfffffe006a21f800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100097 td 0xfffffe006a21f100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100098 td 0xfffffe006a21ea00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100099 td 0xfffffe00709f2500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100100 td 0xfffffe00709f1e00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100101 td 0xfffffe00709f1700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100102 td 0xfffffe00709f1000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100103 td 0xfffffe00709fa800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100104 td 0xfffffe00709fa100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100105 td 0xfffffe00709f9a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100106 td 0xfffffe00709f9300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100107 td 0xfffffe00709ebe00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100108 td 0xfffffe00709eb700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126786b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0126786b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0126786bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126786bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126786bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100168 td 0xfffffe0070d9a500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b2ab00 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b2ab20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0126b2abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b2abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b2abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100169 td 0xfffffe0070d99e00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100170 td 0xfffffe0070d99700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b34b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b34b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0126b34bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b34bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b34bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100176 td 0xfffffe0126f3ae00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b52b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b52b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0126b52bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b52bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b52bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100177 td 0xfffffe0127142700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffffe0126f3bc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126b8db00 mi_switch() at mi_switch+0x155/frame 0xfffffe0126b8db20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0126b8dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126b8dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126b8dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100189 td 0xfffffe0127144300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126babb00 mi_switch() at mi_switch+0x155/frame 0xfffffe0126babb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0126babbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126babbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126babbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100190 td 0xfffffe0127143c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126bb0b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0126bb0b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0126bb0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126bb0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126bb0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100191 td 0xfffffe0127143500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100192 td 0xfffffe0127142e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126bbab00 mi_switch() at mi_switch+0x155/frame 0xfffffe0126bbab20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0126bbabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126bbabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126bbabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100376 td 0xfffffe012ec99300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100377 td 0xfffffe012e5f8500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100378 td 0xfffffe012e5f7e00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100379 td 0xfffffe012e5f7700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100380 td 0xfffffe012e5f7000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100381 td 0xfffffe012e9cd800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100382 td 0xfffffe012e9cd100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100383 td 0xfffffe012e9cca00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100384 td 0xfffffe012e9cc300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100385 td 0xfffffe012e5fbe00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100386 td 0xfffffe012e5fb700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100387 td 0xfffffe012e5fb000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100388 td 0xfffffe012e5fa800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100389 td 0xfffffe012e5fa100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100390 td 0xfffffe012e5f9a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100391 td 0xfffffe012e5f9300 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffffe006a5c0300 (CPU 0) cpustop_handler() at cpustop_handler+0x26/frame 0xffffffff81de3b20 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81de3b30 trap() at trap+0x56/frame 0xffffffff81de3c40 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81de3c40 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe0069fe7a50, rbp = 0xfffffe0069fe7a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe0069fe7a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe0069fe7aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe0069fe7ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe0069fe7ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe0069fe7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0069fe7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0069fe7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe006a5bfc00 (CPU 1) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe007097ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe007097ee10 trap() at trap+0x56/frame 0xfffffe007097ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe007097ef20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe0069feca50, rbp = 0xfffffe0069feca50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe0069feca50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe0069fecaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe0069fecac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe0069fecae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe0069fecbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0069fecbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0069fecbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe006a5bf500 (CPU 2) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe0070985e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe0070985e10 trap() at trap+0x56/frame 0xfffffe0070985f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0070985f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe0069ff1a50, rbp = 0xfffffe0069ff1a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe0069ff1a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe0069ff1aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe0069ff1ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe0069ff1ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe0069ff1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0069ff1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0069ff1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe006a5bee00 (CPU 3) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe0070990e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe0070990e10 trap() at trap+0x56/frame 0xfffffe0070990f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0070990f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe0069ff6a50, rbp = 0xfffffe0069ff6a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe0069ff6a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe0069ff6aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe0069ff6ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe0069ff6ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe0069ff6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0069ff6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0069ff6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe006a5be700 (CPU 4) kdb_alt_break_internal() at kdb_alt_break_internal+0x155/frame 0xfffffe0069ffb890 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0069ffb8a0 uart_intr_rxready() at uart_intr_rxready+0xf5/frame 0xfffffe0069ffb8d0 uart_intr() at uart_intr+0x128/frame 0xfffffe0069ffb910 intr_event_handle() at intr_event_handle+0xde/frame 0xfffffe0069ffb960 intr_execute_handlers() at intr_execute_handlers+0x66/frame 0xfffffe0069ffb990 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe0069ffb990 --- interrupt, rip = 0xffffffff804c2d04, rsp = 0xfffffe0069ffba60, rbp = 0xfffffe0069ffbaa0 --- acpi_cpu_idle() at acpi_cpu_idle+0x294/frame 0xfffffe0069ffbaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe0069ffbac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe0069ffbae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe0069ffbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0069ffbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0069ffbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe006a5be000 (CPU 5) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe00709a2e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00709a2e10 trap() at trap+0x56/frame 0xfffffe00709a2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00709a2f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0530a50, rbp = 0xfffffe00e0530a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0530a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0530aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0530ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0530ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0530bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0530bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0530bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe006a5c8a00 (CPU 6) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe00709a9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00709a9e10 trap() at trap+0x56/frame 0xfffffe00709a9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00709a9f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0535a50, rbp = 0xfffffe00e0535a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0535a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0535aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0535ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0535ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0535bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0535bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0535bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe006a5c8300 (CPU 7) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe00709b4e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00709b4e10 trap() at trap+0x56/frame 0xfffffe00709b4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00709b4f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e053aa50, rbp = 0xfffffe00e053aa50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e053aa50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e053aaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e053aac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e053aae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e053abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e053abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e053abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe006a5c7c00 (CPU 8) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe00709bbe00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00709bbe10 trap() at trap+0x56/frame 0xfffffe00709bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00709bbf20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e053fa50, rbp = 0xfffffe00e053fa50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e053fa50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e053faa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e053fac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e053fae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e053fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e053fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e053fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe006a5c7500 (CPU 9) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe00709c6e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00709c6e10 trap() at trap+0x56/frame 0xfffffe00709c6f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00709c6f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0544a50, rbp = 0xfffffe00e0544a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0544a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0544aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0544ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0544ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0544bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0544bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0544bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe006a5c6e00 (CPU 10) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe00709cde00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00709cde10 trap() at trap+0x56/frame 0xfffffe00709cdf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00709cdf20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0549a50, rbp = 0xfffffe00e0549a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0549a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0549aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0549ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0549ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0549bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0549bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0549bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe006a5c6700 (CPU 11) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe00709d8e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00709d8e10 trap() at trap+0x56/frame 0xfffffe00709d8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00709d8f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e054ea50, rbp = 0xfffffe00e054ea50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e054ea50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e054eaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e054eac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e054eae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e054ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e054ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e054ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100015 td 0xfffffe006a5c6000 (CPU 12) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a02ce00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a02ce10 trap() at trap+0x56/frame 0xfffffe006a02cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a02cf20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0553a50, rbp = 0xfffffe00e0553a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0553a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0553aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0553ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0553ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0553bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0553bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0553bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100016 td 0xfffffe006a5c1800 (CPU 13) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a033e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a033e10 trap() at trap+0x56/frame 0xfffffe006a033f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a033f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0558a50, rbp = 0xfffffe00e0558a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0558a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0558aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0558ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0558ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0558bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0558bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0558bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100017 td 0xfffffe006a5cc300 (CPU 14) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a03ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a03ee10 trap() at trap+0x56/frame 0xfffffe006a03ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a03ef20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e055da50, rbp = 0xfffffe00e055da50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e055da50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e055daa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e055dac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e055dae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e055dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e055dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e055dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100018 td 0xfffffe006a5cbc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e0562ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0562ae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00e0562bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0562bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0562bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100019 td 0xfffffe006a5cb500 (CPU 16) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a050e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a050e10 trap() at trap+0x56/frame 0xfffffe006a050f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a050f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0567a50, rbp = 0xfffffe00e0567a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0567a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0567aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0567ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0567ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0567bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0567bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0567bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100020 td 0xfffffe006a5cae00 (CPU 17) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a057e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a057e10 trap() at trap+0x56/frame 0xfffffe006a057f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a057f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e056ca50, rbp = 0xfffffe00e056ca50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e056ca50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e056caa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e056cac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e056cae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e056cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e056cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e056cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100021 td 0xfffffe006a5ca700 (CPU 18) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a062e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a062e10 trap() at trap+0x56/frame 0xfffffe006a062f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a062f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0571a50, rbp = 0xfffffe00e0571a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0571a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0571aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0571ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0571ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0571bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0571bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0571bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100022 td 0xfffffe006a5ca000 (CPU 19) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a069e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a069e10 trap() at trap+0x56/frame 0xfffffe006a069f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a069f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0576a50, rbp = 0xfffffe00e0576a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0576a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0576aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0576ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0576ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0576bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0576bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0576bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100023 td 0xfffffe006a5c9800 (CPU 20) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a074e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a074e10 trap() at trap+0x56/frame 0xfffffe006a074f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a074f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e057ba50, rbp = 0xfffffe00e057ba50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e057ba50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e057baa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e057bac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e057bae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e057bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e057bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e057bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100024 td 0xfffffe006a5c9100 (CPU 21) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a07be00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a07be10 trap() at trap+0x56/frame 0xfffffe006a07bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a07bf20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0580a50, rbp = 0xfffffe00e0580a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0580a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0580aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0580ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0580ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0580bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0580bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0580bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100025 td 0xfffffe006a5cfc00 (CPU 22) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a086e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a086e10 trap() at trap+0x56/frame 0xfffffe006a086f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a086f20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e0585a50, rbp = 0xfffffe00e0585a50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e0585a50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e0585aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e0585ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e0585ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e0585bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0585bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0585bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100026 td 0xfffffe006a5cf500 (CPU 23) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a08de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a08de10 trap() at trap+0x56/frame 0xfffffe006a08df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a08df20 --- trap 0x13, rip = 0xffffffff80fcfb70, rsp = 0xfffffe00e058aa50, rbp = 0xfffffe00e058aa50 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x70/frame 0xfffffe00e058aa50 acpi_cpu_idle() at acpi_cpu_idle+0x1bc/frame 0xfffffe00e058aaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00e058aac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00e058aae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00e058abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e058abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e058abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe006a5c0a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0069fe2570 mi_switch() at mi_switch+0x155/frame 0xfffffe0069fe2590 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0069fe25d0 sleeplk() at sleeplk+0x106/frame 0xfffffe0069fe2630 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe0069fe26d0 ffs_lock() at ffs_lock+0x7d/frame 0xfffffe0069fe2710 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe0069fe2730 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0069fe2790 lookup() at lookup+0xdd/frame 0xfffffe0069fe2830 namei() at namei+0x59c/frame 0xfffffe0069fe28f0 sys_revoke() at sys_revoke+0x50/frame 0xfffffe0069fe2ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0069fe2bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0069fe2bf0 --- syscall (56, FreeBSD ELF64, sys_revoke), rip = 0x24e90a, rsp = 0x7fffffffe788, rbp = 0x7fffffffe790 --- Tracing command audit pid 10 tid 100001 td 0xfffffe006a5c1100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0069fdda90 mi_switch() at mi_switch+0x155/frame 0xfffffe0069fddab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0069fddaf0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0069fddb50 audit_worker() at audit_worker+0x9f/frame 0xfffffe0069fddbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0069fddbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0069fddbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81c8b420 sched_switch() at sched_switch+0x5b2/frame 0xffffffff8211ead0 mi_switch() at mi_switch+0x155/frame 0xffffffff8211eaf0 sleepq_switch() at sleepq_switch+0x11a/frame 0xffffffff8211eb30 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff8211eb70 _sleep() at _sleep+0x26c/frame 0xffffffff8211ec10 swapper() at swapper+0x75/frame 0xffffffff8211ec60 mi_startup() at mi_startup+0x2ed/frame 0xffffffff8211ecb0 btext() at btext+0x2c Tracing command kernel pid 0 tid 100027 td 0xfffffe006a5cee00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e058fab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e058fad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e058fb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e058fb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e058fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e058fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e058fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe006a5ce700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e0594ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0594ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e0594b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e0594b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e0594bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0594bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0594bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe006a5ce000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e0599ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0599ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e0599b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e0599b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e0599bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0599bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0599bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe006a5cd800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e059eab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e059ead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e059eb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e059eb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e059ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e059ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e059ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe006a5cd100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05a3ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05a3ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05a3b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05a3b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05a3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05a3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05a3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe006a5cca00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05a8ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05a8ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05a8b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05a8b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05a8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05a8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05a8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe006a5f7500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05adab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05adad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05adb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05adb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05adbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05adbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05adbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe006a5f6e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05b2ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05b2ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05b2b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05b2b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05b2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05b2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05b2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe006a5f6700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05b7ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05b7ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05b7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05b7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05b7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05b7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05b7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe006a5f6000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05bcab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05bcad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05bcb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05bcb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05bcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05bcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05bcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe006a5d1800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05c1ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05c1ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05c1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05c1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05c1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05c1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05c1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe006a5d1100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05c6ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05c6ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05c6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05c6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05c6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05c6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05c6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe006a5d0a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05cbab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05cbad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05cbb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05cbb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05cbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05cbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05cbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe006a5d0300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05d0ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05d0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05d0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05d0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05d0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05d0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05d0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffffe006a5fae00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05d5ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05d5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05d5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05d5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05d5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05d5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05d5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffffe006a5fa700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05daab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05daad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05dab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05dab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05dabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05dabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05dabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffffe006a5fa000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05dfab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05dfad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05dfb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05dfb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05dfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05dfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05dfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffffe006a5f9800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05e4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05e4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05e4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05e4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05e4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05e4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05e4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffffe006a5f9100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05e9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05e9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05e9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05e9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05e9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05e9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05e9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffffe006a5f8a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05eeab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05eead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05eeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05eeb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100047 td 0xfffffe006a5f8300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05f3ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05f3ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05f3b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05f3b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100048 td 0xfffffe006a5f7c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05f8ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05f8ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05f8b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05f8b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100049 td 0xfffffe0070c19700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05fdab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05fdad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05fdb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e05fdb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e05fdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e05fdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e05fdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100050 td 0xfffffe0070c19000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126604ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126604ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126604b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126604b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe0126604bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126604bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126604bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100051 td 0xfffffe006a5fd800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126609ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126609ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126609b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126609b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe0126609bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126609bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126609bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100052 td 0xfffffe006a5fd100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012660eab0 mi_switch() at mi_switch+0x155/frame 0xfffffe012660ead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012660eb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe012660eb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe012660ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012660ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012660ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffffe006a5fca00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126613ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126613ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126613b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126613b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe0126613bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126613bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126613bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100054 td 0xfffffe006a5fc300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126618ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126618ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126618b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126618b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe0126618bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126618bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126618bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100055 td 0xfffffe006a5fbc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012661dab0 mi_switch() at mi_switch+0x155/frame 0xfffffe012661dad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012661db10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe012661db80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe012661dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012661dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012661dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffffe006a5fb500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126622ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126622ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126622b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126622b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe0126622bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126622bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126622bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100057 td 0xfffffe0070c1f000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126627ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126627ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126627b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126627b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe0126627bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126627bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126627bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffffe0070c1c800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012662cab0 mi_switch() at mi_switch+0x155/frame 0xfffffe012662cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012662cb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe012662cb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe012662cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012662cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012662cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffffe0070c1c100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126631ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126631ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126631b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126631b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe0126631bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126631bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126631bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffffe0070c1ba00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126636ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126636ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126636b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126636b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe0126636bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126636bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126636bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe0070c1b300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012663bab0 mi_switch() at mi_switch+0x155/frame 0xfffffe012663bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012663bb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe012663bb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe012663bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012663bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012663bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffffe0070c1ac00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126640ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126640ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126640b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126640b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe0126640bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126640bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126640bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffffe0070c1a500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126645ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126645ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126645b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126645b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe0126645bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126645bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126645bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffffe0070c19e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012664aab0 mi_switch() at mi_switch+0x155/frame 0xfffffe012664aad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012664ab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe012664ab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe012664abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012664abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012664abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffffe0070c22800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012664fab0 mi_switch() at mi_switch+0x155/frame 0xfffffe012664fad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012664fb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe012664fb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe012664fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012664fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012664fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe0070c22100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126654ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126654ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126654b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126654b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe0126654bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126654bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126654bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe0070c21a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126659ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126659ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126659b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126659b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe0126659bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126659bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126659bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe0070c21300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012665eab0 mi_switch() at mi_switch+0x155/frame 0xfffffe012665ead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012665eb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe012665eb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe012665ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012665ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012665ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe0070c20c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126663ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126663ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126663b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126663b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe0126663bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126663bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126663bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe0070c20500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126668ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126668ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126668b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126668b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe0126668bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126668bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126668bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe0070c1fe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012666dab0 mi_switch() at mi_switch+0x155/frame 0xfffffe012666dad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012666db10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe012666db80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe012666dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012666dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012666dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe0070c1f700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126672ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126672ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126672b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126672b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe0126672bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126672bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126672bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe0070c26100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126677ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126677ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126677b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126677b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe0126677bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126677bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126677bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe0070c25a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012667cab0 mi_switch() at mi_switch+0x155/frame 0xfffffe012667cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012667cb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe012667cb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe012667cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012667cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012667cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe0070c25300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126681ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126681ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126681b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126681b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe0126681bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126681bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126681bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe0070c24c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126686a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126686aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126686ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126686b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126686bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126686bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126686bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100078 td 0xfffffe0070c23e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126690a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126690aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126690ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126690b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126690bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126690bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126690bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100079 td 0xfffffe0070c23700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126695a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126695aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126695ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126695b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126695bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126695bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126695bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100082 td 0xfffffe0070c29300 (CPU 15) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe006a045e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe006a045e10 trap() at trap+0x56/frame 0xfffffe006a045f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe006a045f20 --- trap 0x13, rip = 0xffffffff80e87377, rsp = 0xfffffe01266a4900, rbp = 0xfffffe01266a49a0 --- ffs_sync() at ffs_sync+0x1b7/frame 0xfffffe01266a49a0 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe01266a49e0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe01266a4a10 ffs_unmount() at ffs_unmount+0x6d/frame 0xfffffe01266a4a80 dounmount() at dounmount+0x43d/frame 0xfffffe01266a4ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe01266a4b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe01266a4b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe01266a4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01266a4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01266a4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100109 td 0xfffffe00709eb000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe01267eba80 mi_switch() at mi_switch+0x155/frame 0xfffffe01267ebaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe01267ebae0 _sleep() at _sleep+0x2cd/frame 0xfffffe01267ebb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe01267ebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01267ebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01267ebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffffe00709f2c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a1ca80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a1caa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a1cae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a1cb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a1cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a1cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a1cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100115 td 0xfffffe00709c1700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a21a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a21aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a21ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a21b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a21bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a21bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a21bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100116 td 0xfffffe00709c1000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a26a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a26aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a26ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a26b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a26bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a26bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a26bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100117 td 0xfffffe00709ee800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a2ba80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a2baa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a2bae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a2bb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a2bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a2bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a2bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100118 td 0xfffffe00709ee100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a30a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a30aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a30ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a30b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a30bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a30bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a30bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100119 td 0xfffffe00709eda00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a35a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a35aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a35ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a35b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a35bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a35bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a35bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffffe00709ed300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a3aa80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a3aaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a3aae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a3ab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a3abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a3abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a3abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffffe00709ecc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a3fa80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a3faa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a3fae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a3fb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a3fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a3fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a3fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffffe00709ec500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a44a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a44aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a44ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a44b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a44bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a44bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a44bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffffe00709af000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a49a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a49aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a49ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a49b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a49bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a49bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a49bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffffe00709c4800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a4ea80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a4eaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a4eae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a4eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a4ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a4ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a4ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100125 td 0xfffffe00709c4100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a53a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a53aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a53ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a53b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a53bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a53bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a53bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100126 td 0xfffffe00709c3a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a58a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a58aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a58ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a58b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a58bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a58bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a58bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100127 td 0xfffffe00709c3300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a5da80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a5daa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a5dae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a5db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a5dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a5dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a5dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100128 td 0xfffffe00709c2c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a62a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a62aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a62ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a62b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a62bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a62bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a62bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100129 td 0xfffffe00709c2500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a67a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a67aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a67ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a67b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a67bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a67bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a67bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100130 td 0xfffffe00709c1e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a6ca80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a6caa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a6cae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a6cb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a6cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a6cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a6cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100131 td 0xfffffe00709b2800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a71a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a71aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a71ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a71b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a71bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a71bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a71bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100132 td 0xfffffe00709b2100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a76a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a76aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a76ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a76b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a76bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a76bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a76bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100133 td 0xfffffe00709b1a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a7ba80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a7baa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a7bae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a7bb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a7bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a7bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a7bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100134 td 0xfffffe00709b1300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a80a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a80aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a80ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a80b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a80bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a80bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a80bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100135 td 0xfffffe00709b0c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a85a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a85aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a85ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a85b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a85bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a85bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a85bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100136 td 0xfffffe00709b0500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a8aa80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a8aaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a8aae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a8ab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a8abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a8abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a8abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100137 td 0xfffffe00709afe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126a8fa80 mi_switch() at mi_switch+0x155/frame 0xfffffe0126a8faa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126a8fae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0126a8fb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0126a8fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126a8fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126a8fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100193 td 0xfffffe0127452800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0126bbfab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0126bbfad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0126bbfb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0126bbfb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe0126bbfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0126bbfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0126bbfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100198 td 0xfffffe012c890500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f6b1ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe012f6b1ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f6b1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe012f6b1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe012f6b1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012f6b1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012f6b1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100199 td 0xfffffe012c88fe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f6b6ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe012f6b6ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f6b6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe012f6b6b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe012f6b6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012f6b6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012f6b6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100200 td 0xfffffe012c88f700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f6bbab0 mi_switch() at mi_switch+0x155/frame 0xfffffe012f6bbad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f6bbb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe012f6bbb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe012f6bbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012f6bbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012f6bbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100202 td 0xfffffe012c92fa00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe012f6c5a80 mi_switch() at mi_switch+0x155/frame 0xfffffe012f6c5aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe012f6c5ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe012f6c5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe012f6c5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe012f6c5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012f6c5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 4 $ svnlite diff -x -p /usr/src/sys Index: /usr/src/sys/amd64/amd64/pmap.c =================================================================== --- /usr/src/sys/amd64/amd64/pmap.c (revision 363687) +++ /usr/src/sys/amd64/amd64/pmap.c (working copy) @@ -121,6 +121,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include #include @@ -171,6 +172,13 @@ __FBSDID("$FreeBSD$"); #define PMAP_MEMDOM 1 #endif +#define PC_FREE0 0xfffffffffffffffful +#define PC_FREE1 0xfffffffffffffffful +#define PC_FREE2 0x000000fffffffffful + +_Static_assert(sizeof(struct pv_chunk) <= PAGE_SIZE, ""); +_Static_assert(NBBY * sizeof(uint64_t) * _NPCM >= _NPCPV, ""); + static __inline boolean_t pmap_type_guest(pmap_t pmap) { @@ -316,6 +324,9 @@ pmap_pku_mask_bit(pmap_t pmap) #define PMAP_INLINE #endif +static TAILQ_HEAD(, pmap) all_pmaps; +static struct mtx all_pmaps_lock; + #ifdef PV_STATS #define PV_STAT(x) do { x ; } while (0) #else @@ -331,14 +342,6 @@ pmap_pku_mask_bit(pmap_t pmap) }) #define pa_to_pmdp(pa) (&pv_table[pa_index(pa)]) #define pa_to_pvh(pa) (&(pa_to_pmdp(pa)->pv_page)) -#define PHYS_TO_PV_LIST_LOCK(pa) ({ \ - struct rwlock *_lock; \ - if (__predict_false((pa) > pmap_last_pa)) \ - _lock = &pv_dummy_large.pv_lock; \ - else \ - _lock = &(pa_to_pmdp(pa)->pv_lock); \ - _lock; \ -}) #else #define pa_index(pa) ((pa) >> PDRSHIFT) #define pa_to_pvh(pa) (&pv_table[pa_index(pa)]) @@ -345,37 +348,46 @@ pmap_pku_mask_bit(pmap_t pmap) #define NPV_LIST_LOCKS MAXCPU -#define PHYS_TO_PV_LIST_LOCK(pa) \ - (&pv_list_locks[pa_index(pa) % NPV_LIST_LOCKS]) #endif +#define PHYS_TO_PV_LIST_LOCK(pa) PHYS_TO_VM_PAGE(pa) + #define CHANGE_PV_LIST_LOCK_TO_PHYS(lockp, pa) do { \ - struct rwlock **_lockp = (lockp); \ - struct rwlock *_new_lock; \ + PVLL **_lockp = (lockp); \ + PVLL *_new_lock; \ \ _new_lock = PHYS_TO_PV_LIST_LOCK(pa); \ if (_new_lock != *_lockp) { \ if (*_lockp != NULL) \ - rw_wunlock(*_lockp); \ + pmap_pv_list_unlock(*_lockp); \ + if (_new_lock == NULL) \ + _new_lock = &pv_fake_page; \ *_lockp = _new_lock; \ - rw_wlock(*_lockp); \ + pmap_pv_list_lock(*_lockp); \ } \ } while (0) -#define CHANGE_PV_LIST_LOCK_TO_VM_PAGE(lockp, m) \ - CHANGE_PV_LIST_LOCK_TO_PHYS(lockp, VM_PAGE_TO_PHYS(m)) +#define CHANGE_PV_LIST_LOCK_TO_VM_PAGE(lockp, m) do { \ + PVLL **_lockp = (lockp); \ + \ + if (m != *_lockp) { \ + if (*_lockp != NULL) \ + pmap_pv_list_unlock(*_lockp); \ + *_lockp = m; \ + pmap_pv_list_lock(m); \ + } \ +} while (0) #define RELEASE_PV_LIST_LOCK(lockp) do { \ - struct rwlock **_lockp = (lockp); \ + PVLL **_lockp = (lockp); \ \ if (*_lockp != NULL) { \ - rw_wunlock(*_lockp); \ + pmap_pv_list_unlock(*_lockp); \ *_lockp = NULL; \ } \ } while (0) -#define VM_PAGE_TO_PV_LIST_LOCK(m) \ - PHYS_TO_PV_LIST_LOCK(VM_PAGE_TO_PHYS(m)) +#define VM_PAGE_TO_PV_LIST_LOCK(m) (m) struct pmap kernel_pmap_store; @@ -428,48 +440,160 @@ static int pmap_initialized; * Data for the pv entry allocation mechanism. * Updates to pv_invl_gen are protected by the pv list lock but reads are not. */ -#ifdef NUMA -static __inline int -pc_to_domain(struct pv_chunk *pc) -{ - return (_vm_phys_domain(DMAP_TO_PHYS((vm_offset_t)pc))); -} -#else -static __inline int -pc_to_domain(struct pv_chunk *pc __unused) -{ +typedef struct vm_page PVLL; - return (0); -} -#endif - -struct pv_chunks_list { - struct mtx pvc_lock; - TAILQ_HEAD(pch, pv_chunk) pvc_list; - int active_reclaims; -} __aligned(CACHE_LINE_SIZE); - -struct pv_chunks_list __exclusive_cache_line pv_chunks[PMAP_MEMDOM]; - #ifdef NUMA struct pmap_large_md_page { - struct rwlock pv_lock; - struct md_page pv_page; + struct lock_object lo; + uintptr_t pad; + struct md_page pv_page; u_long pv_invl_gen; }; +/* + * We strongly depend on the size being a power of two, so the assert + * is overzealous. However, should the struct be resized to a + * different power of two, the code below needs to be revisited. + */ +_Static_assert(sizeof(struct pmap_large_md_page) == 64, "pmap_large_md_page"); + __exclusive_cache_line static struct pmap_large_md_page pv_dummy_large; #define pv_dummy pv_dummy_large.pv_page __read_mostly static struct pmap_large_md_page *pv_table; __read_mostly vm_paddr_t pmap_last_pa; +static struct lock_object * +pv_list_lock_object(vm_paddr_t pa) +{ + if (__predict_false(pa) > pmap_last_pa) + return (&pv_dummy_large.lo); + return (&pa_to_pmdp(pa)->lo); +} #else -static struct rwlock __exclusive_cache_line pv_list_locks[NPV_LIST_LOCKS]; +static struct lock_object __exclusive_cache_line pv_lo[NPV_LIST_LOCKS]; static u_long pv_invl_gen[NPV_LIST_LOCKS]; static struct md_page *pv_table; static struct md_page pv_dummy; +static struct lock_object * +pv_list_lock_object(vm_paddr_t pa) +{ + return (&pv_lo[pa_index(pa) % NPV_LIST_LOCKS]); +} #endif +__read_mostly static struct vm_page pv_fake_page; +static void +pmap_pv_list_lock(vm_page_t m) +{ + obm_lock(&m->md.pv_lock, pv_list_lock_object(VM_PAGE_TO_PHYS(m))); +} + +static void +pmap_pv_list_unlock(vm_page_t m) +{ + obm_unlock(&m->md.pv_lock, pv_list_lock_object(VM_PAGE_TO_PHYS(m))); +} + /* + * Locks all pv lists for 4k pages constituting the superpage that + * contains the passed page. The page's pv list is locked according + * to pte_locked. + * + * Returns false if the initial trylock failed and the page's pv list + * was unlocked in the process, which typically means that the caller + * must restart. + */ +static void +pmap_pv_list_lock_pde1(vm_page_t m, bool pte_locked) +{ + vm_page_t mt, sm; + struct lock_object *lo; + int i; + + if (pte_locked) + obm_assert_locked(&m->md.pv_lock); + + sm = m - atop(VM_PAGE_TO_PHYS(m) - (VM_PAGE_TO_PHYS(m) & PG_PS_FRAME)); + lo = pv_list_lock_object(VM_PAGE_TO_PHYS(m)); + + if (pte_locked) { + /* + * Fast attempt. If we either own or can get the pv + * list lock of the first page in the superpage, all + * other owners must release their locks without + * waiting for us. + */ + if (m == sm || obm_trylock(&sm->md.pv_lock)) { + for (i = 1, mt = sm + 1; i < NPDEPG; i++, mt++) { + if (m != mt) + obm_lock(&mt->md.pv_lock, lo); + } + return; + } + + obm_unlock(&m->md.pv_lock, lo); + } + + for (i = 0, mt = sm; i < NPDEPG; i++, mt++) { + obm_lock(&mt->md.pv_lock, lo); + } +} + +/* + * If *lockp points to one of the ordinary pages from the superpage we + * are demoting or promoting, then we keep this page' pv list locked + * after pmap_pv_list_unlock_pde(). Otherwise, we just unlock whatever + * was locked, and unlock all run on pmap_pv_list_unlock_pde(). + */ +static void +pmap_pv_list_lock_pde(vm_paddr_t pa, PVLL **lockp) +{ + vm_page_t m; + + m = PHYS_TO_VM_PAGE(pa); + KASSERT(m != NULL, + ("pmap_pv_list_lock_pde: unmanaged phys addr %#lx", pa)); + + if (*lockp == NULL) { + pmap_pv_list_lock_pde1(m, false); + return; + } + if ((VM_PAGE_TO_PHYS(*lockp) & PG_PS_FRAME) != (pa & PG_PS_FRAME)) { + pmap_pv_list_unlock(*lockp); + *lockp = NULL; + pmap_pv_list_lock_pde1(m, false); + return; + } + pmap_pv_list_lock_pde1(*lockp, true); +} + +static void +pmap_pv_list_unlock_pde(vm_paddr_t pa, PVLL **lockp) +{ + vm_page_t m, mt, sm; + struct lock_object *lo; + int i; + bool pte_locked; + + m = *lockp; + pte_locked = m != NULL; + if (!pte_locked) { + m = PHYS_TO_VM_PAGE(pa); + if (m == NULL) + m = &pv_fake_page; + } + + sm = m - atop(VM_PAGE_TO_PHYS(m) - (VM_PAGE_TO_PHYS(m) & PG_PS_FRAME)); + lo = pv_list_lock_object(VM_PAGE_TO_PHYS(m)); + obm_assert_locked(&m->md.pv_lock); + obm_assert_locked(&sm->md.pv_lock); + + for (i = 0, mt = sm; i < NPDEPG; i++, mt++) { + if (!pte_locked || mt != m) + obm_unlock(&mt->md.pv_lock, lo); + } +} + +/* * All those kernel PT submaps that BSD is so fond of */ pt_entry_t *CMAP1 = NULL; @@ -1153,7 +1277,7 @@ pmap_delayed_invl_page(vm_page_t m) { u_long gen, *m_gen; - rw_assert(VM_PAGE_TO_PV_LIST_LOCK(m), RA_WLOCKED); + obm_assert_locked(&m->md.pv_lock); gen = curthread->td_md.md_invl_gen.gen; if (gen == 0) return; @@ -1186,22 +1310,22 @@ TAILQ_HEAD(pv_chunklist, pv_chunk); static void free_pv_chunk(struct pv_chunk *pc); static void free_pv_chunk_batch(struct pv_chunklist *batch); static void free_pv_entry(pmap_t pmap, pv_entry_t pv); -static pv_entry_t get_pv_entry(pmap_t pmap, struct rwlock **lockp); +static pv_entry_t get_pv_entry(pmap_t pmap, PVLL **lockp); static int popcnt_pc_map_pq(uint64_t *map); -static vm_page_t reclaim_pv_chunk(pmap_t locked_pmap, struct rwlock **lockp); -static void reserve_pv_entries(pmap_t pmap, int needed, - struct rwlock **lockp); +static vm_page_t reclaim_pv_chunk(pmap_t locked_pmap, PVLL **lockp, + bool avoid_locked_pmap); +static void reserve_pv_entries(pmap_t pmap, int needed, PVLL **lockp); static void pmap_pv_demote_pde(pmap_t pmap, vm_offset_t va, vm_paddr_t pa, - struct rwlock **lockp); + PVLL **lockp); static bool pmap_pv_insert_pde(pmap_t pmap, vm_offset_t va, pd_entry_t pde, - u_int flags, struct rwlock **lockp); + u_int flags, PVLL **lockp); #if VM_NRESERVLEVEL > 0 static void pmap_pv_promote_pde(pmap_t pmap, vm_offset_t va, vm_paddr_t pa, - struct rwlock **lockp); + PVLL **lockp); #endif static void pmap_pvh_free(struct md_page *pvh, pmap_t pmap, vm_offset_t va); static pv_entry_t pmap_pvh_remove(struct md_page *pvh, pmap_t pmap, - vm_offset_t va); + vm_offset_t va); static void pmap_abort_ptp(pmap_t pmap, vm_offset_t va, vm_page_t mpte); static int pmap_change_props_locked(vm_offset_t va, vm_size_t size, @@ -1208,15 +1332,15 @@ static int pmap_change_props_locked(vm_offset_t va vm_prot_t prot, int mode, int flags); static boolean_t pmap_demote_pde(pmap_t pmap, pd_entry_t *pde, vm_offset_t va); static boolean_t pmap_demote_pde_locked(pmap_t pmap, pd_entry_t *pde, - vm_offset_t va, struct rwlock **lockp); + vm_offset_t va, PVLL **lockp); static boolean_t pmap_demote_pdpe(pmap_t pmap, pdp_entry_t *pdpe, vm_offset_t va); static bool pmap_enter_2mpage(pmap_t pmap, vm_offset_t va, vm_page_t m, - vm_prot_t prot, struct rwlock **lockp); + vm_prot_t prot, PVLL **lockp); static int pmap_enter_pde(pmap_t pmap, vm_offset_t va, pd_entry_t newpde, - u_int flags, vm_page_t m, struct rwlock **lockp); + u_int flags, vm_page_t m, PVLL **lockp); static vm_page_t pmap_enter_quick_locked(pmap_t pmap, vm_offset_t va, - vm_page_t m, vm_prot_t prot, vm_page_t mpte, struct rwlock **lockp); + vm_page_t m, vm_prot_t prot, vm_page_t mpte, PVLL **lockp); static void pmap_fill_ptp(pt_entry_t *firstpte, pt_entry_t newpte); static int pmap_insert_pt_page(pmap_t pmap, vm_page_t mpte, bool promoted); static void pmap_invalidate_cache_range_selfsnoop(vm_offset_t sva, @@ -1224,13 +1348,13 @@ static void pmap_invalidate_cache_range_selfsnoop( static void pmap_invalidate_cache_range_all(vm_offset_t sva, vm_offset_t eva); static void pmap_invalidate_pde_page(pmap_t pmap, vm_offset_t va, - pd_entry_t pde); + pd_entry_t pde); static void pmap_kenter_attr(vm_offset_t va, vm_paddr_t pa, int mode); static vm_page_t pmap_large_map_getptp_unlocked(void); static vm_paddr_t pmap_large_map_kextract(vm_offset_t va); #if VM_NRESERVLEVEL > 0 static void pmap_promote_pde(pmap_t pmap, pd_entry_t *pde, vm_offset_t va, - struct rwlock **lockp); + PVLL **lockp); #endif static boolean_t pmap_protect_pde(pmap_t pmap, pd_entry_t *pde, vm_offset_t sva, vm_prot_t prot); @@ -1241,27 +1365,26 @@ static pdp_entry_t *pmap_pti_pdpe(vm_offset_t va); static pd_entry_t *pmap_pti_pde(vm_offset_t va); static void pmap_pti_wire_pte(void *pte); static int pmap_remove_pde(pmap_t pmap, pd_entry_t *pdq, vm_offset_t sva, - struct spglist *free, struct rwlock **lockp); + struct spglist *free, PVLL **lockp); static int pmap_remove_pte(pmap_t pmap, pt_entry_t *ptq, vm_offset_t sva, - pd_entry_t ptepde, struct spglist *free, struct rwlock **lockp); + pd_entry_t ptepde, struct spglist *free, PVLL **lockp); static vm_page_t pmap_remove_pt_page(pmap_t pmap, vm_offset_t va); static void pmap_remove_page(pmap_t pmap, vm_offset_t va, pd_entry_t *pde, struct spglist *free); static bool pmap_remove_ptes(pmap_t pmap, vm_offset_t sva, vm_offset_t eva, - pd_entry_t *pde, struct spglist *free, - struct rwlock **lockp); + pd_entry_t *pde, struct spglist *free, PVLL **lockp); static boolean_t pmap_try_insert_pv_entry(pmap_t pmap, vm_offset_t va, - vm_page_t m, struct rwlock **lockp); + vm_page_t m, PVLL **lockp); static void pmap_update_pde(pmap_t pmap, vm_offset_t va, pd_entry_t *pde, pd_entry_t newpde); static void pmap_update_pde_invalidate(pmap_t, vm_offset_t va, pd_entry_t pde); static vm_page_t _pmap_allocpte(pmap_t pmap, vm_pindex_t ptepindex, - struct rwlock **lockp); + PVLL **lockp); static pd_entry_t *pmap_alloc_pde(pmap_t pmap, vm_offset_t va, vm_page_t *pdpgp, - struct rwlock **lockp); + PVLL **lockp); static vm_page_t pmap_allocpte(pmap_t pmap, vm_offset_t va, - struct rwlock **lockp); + PVLL **lockp); static void _pmap_unwire_ptp(pmap_t pmap, vm_offset_t va, vm_page_t m, struct spglist *free); @@ -1724,6 +1847,9 @@ pmap_bootstrap(vm_paddr_t *firstaddr) cr4 |= CR4_SMAP; load_cr4(cr4); + TAILQ_INIT(&all_pmaps); + mtx_init(&all_pmaps_lock, "allpms", NULL, MTX_DEF); + /* * Initialize the kernel pmap (which is statically allocated). * Count bootstrap data as being resident in case any of this data is @@ -1900,6 +2026,7 @@ pmap_page_init(vm_page_t m) TAILQ_INIT(&m->md.pv_list); m->md.pat_mode = PAT_WRITE_BACK; + obm_init(&m->md.pv_lock); } static int pmap_allow_2m_x_ept; @@ -1957,13 +2084,6 @@ pmap_init_pv_table(void) int domain, i, j, pages; /* - * We strongly depend on the size being a power of two, so the assert - * is overzealous. However, should the struct be resized to a - * different power of two, the code below needs to be revisited. - */ - CTASSERT((sizeof(*pvd) == 64)); - - /* * Calculate the size of the array. */ pmap_last_pa = vm_phys_segs[vm_phys_nsegs - 1].end; @@ -1997,12 +2117,13 @@ pmap_init_pv_table(void) vm_page_t m = vm_page_alloc_domain(NULL, 0, domain, VM_ALLOC_NORMAL | VM_ALLOC_NOOBJ); if (m == NULL) - panic("vm_page_alloc_domain failed for %lx\n", (vm_offset_t)pvd + j); + panic("vm_page_alloc_domain failed for %lx\n", + (vm_offset_t)pvd + j); pmap_qenter((vm_offset_t)pvd + j, &m, 1); } for (j = 0; j < s / sizeof(*pvd); j++) { - rw_init_flags(&pvd->pv_lock, "pmap pv list", RW_NEW); + obm_init_lo(&pvd->lo, "pmap pv list"); TAILQ_INIT(&pvd->pv_page.pv_list); pvd->pv_page.pv_gen = 0; pvd->pv_page.pat_mode = 0; @@ -2011,8 +2132,19 @@ pmap_init_pv_table(void) } } pvd = &pv_dummy_large; - rw_init_flags(&pvd->pv_lock, "pmap pv list dummy", RW_NEW); + obm_init_lo(&pvd->lo, "pmap pv list dummy"); TAILQ_INIT(&pvd->pv_page.pv_list); + + /* + * Initialize pv_fake page, which is used to ake all physical + * addresses work for pv_list locking. It is needed by + * pv_list_lock_object() and CHANGE_PV_LIST_LOCK_TO_PHYS() to + * provide fallback in case the passed physical address is not + * covered by vm_page_array[]. + */ + pmap_page_init(&pv_fake_page); + pv_fake_page.phys_addr = pmap_last_pa + PAGE_SIZE; + pvd->pv_page.pv_gen = 0; pvd->pv_page.pat_mode = 0; pvd->pv_invl_gen = 0; @@ -2028,7 +2160,7 @@ pmap_init_pv_table(void) * Initialize the pool of pv list locks. */ for (i = 0; i < NPV_LIST_LOCKS; i++) - rw_init(&pv_list_locks[i], "pmap pv list"); + obm_init_lo(&pv_lo[i], "pmap pv list"); /* * Calculate the size of the pv head table for superpages. @@ -2044,6 +2176,10 @@ pmap_init_pv_table(void) for (i = 0; i < pv_npg; i++) TAILQ_INIT(&pv_table[i].pv_list); TAILQ_INIT(&pv_dummy.pv_list); + + /* See explanation above for NUMA case. */ + pmap_page_init(&pv_fake_page); + pv_fake_page.phys_addr = vm_phys_segs[vm_phys_nsegs - 1].end + PAGE_SIZE; } #endif @@ -2059,6 +2195,10 @@ pmap_init(void) vm_page_t m, mpte; int error, i, ret, skz63; + /* Compiler cannot evaluate this at compile time. */ + MPASS(__bitcount64(PC_FREE0) + __bitcount64(PC_FREE1) + + __bitcount64(PC_FREE2) == _NPCPV); + /* L1TF, reserve page @0 unconditionally */ vm_page_blacklist_add(0, bootverbose); @@ -2143,13 +2283,6 @@ pmap_init(void) pagesizes[1] = NBPDR; } - /* - * Initialize pv chunk lists. - */ - for (i = 0; i < PMAP_MEMDOM; i++) { - mtx_init(&pv_chunks[i].pvc_lock, "pmap pv chunk list", NULL, MTX_DEF); - TAILQ_INIT(&pv_chunks[i].pvc_list); - } pmap_init_pv_table(); pmap_initialized = 1; @@ -3652,6 +3785,21 @@ pmap_abort_ptp(pmap_t pmap, vm_offset_t va, vm_pag } void +pmap_lock_init(pmap_t pmap) +{ + mtx_init(&pmap->pm_mtx, "pmap", NULL, MTX_DEF | MTX_DUPOK); + + /* + * Add pmap to the global list, to be used during the pv + * chunks reclamation. Pmap is never removed from the list, + * relying on type-stability of the vmspace zone. + */ + mtx_lock(&all_pmaps_lock); + TAILQ_INSERT_TAIL(&all_pmaps, pmap, pm_allpmaps); + mtx_unlock(&all_pmaps_lock); +} + +void pmap_pinit0(pmap_t pmap) { struct proc *p; @@ -3834,7 +3982,7 @@ pmap_pinit(pmap_t pmap) * it is statically allocated by pmap_pinit() and not by _pmap_allocpte(). */ static vm_page_t -_pmap_allocpte(pmap_t pmap, vm_pindex_t ptepindex, struct rwlock **lockp) +_pmap_allocpte(pmap_t pmap, vm_pindex_t ptepindex, PVLL **lockp) { vm_page_t m, pdppg, pdpg; pt_entry_t PG_A, PG_M, PG_RW, PG_V; @@ -3981,7 +4129,7 @@ static vm_page_t static pd_entry_t * pmap_alloc_pde(pmap_t pmap, vm_offset_t va, vm_page_t *pdpgp, - struct rwlock **lockp) + PVLL **lockp) { pdp_entry_t *pdpe, PG_V; pd_entry_t *pde; @@ -4020,7 +4168,7 @@ retry: } static vm_page_t -pmap_allocpte(pmap_t pmap, vm_offset_t va, struct rwlock **lockp) +pmap_allocpte(pmap_t pmap, vm_offset_t va, PVLL **lockp) { vm_pindex_t ptepindex; pd_entry_t *pd, PG_V; @@ -4266,10 +4414,6 @@ pmap_growkernel(vm_offset_t addr) * page management routines. ***************************************************/ -CTASSERT(sizeof(struct pv_chunk) == PAGE_SIZE); -CTASSERT(_NPCM == 3); -CTASSERT(_NPCPV == 168); - static __inline struct pv_chunk * pv_to_chunk(pv_entry_t pv) { @@ -4279,10 +4423,6 @@ pv_to_chunk(pv_entry_t pv) #define PV_PMAP(pv) (pv_to_chunk(pv)->pc_pmap) -#define PC_FREE0 0xfffffffffffffffful -#define PC_FREE1 0xfffffffffffffffful -#define PC_FREE2 0x000000fffffffffful - static const uint64_t pc_freemask[_NPCM] = { PC_FREE0, PC_FREE1, PC_FREE2 }; #ifdef PV_STATS @@ -4310,130 +4450,33 @@ SYSCTL_INT(_vm_pmap, OID_AUTO, pv_entry_spare, CTL "Current number of spare pv entries"); #endif -static void -reclaim_pv_chunk_leave_pmap(pmap_t pmap, pmap_t locked_pmap, bool start_di) +static bool +reclaim_pv_chunk_handle_pmap(pmap_t pmap, pmap_t locked_pmap, + bool avoid_locked_pmap, PVLL **lockp, struct spglist *free) { - - if (pmap == NULL) - return; - pmap_invalidate_all(pmap); - if (pmap != locked_pmap) - PMAP_UNLOCK(pmap); - if (start_di) - pmap_delayed_invl_finish(); -} - -/* - * We are in a serious low memory condition. Resort to - * drastic measures to free some pages so we can allocate - * another pv entry chunk. - * - * Returns NULL if PV entries were reclaimed from the specified pmap. - * - * We do not, however, unmap 2mpages because subsequent accesses will - * allocate per-page pv entries until repromotion occurs, thereby - * exacerbating the shortage of free pv entries. - */ -static vm_page_t -reclaim_pv_chunk_domain(pmap_t locked_pmap, struct rwlock **lockp, int domain) -{ - struct pv_chunks_list *pvc; - struct pv_chunk *pc, *pc_marker, *pc_marker_end; - struct pv_chunk_header pc_marker_b, pc_marker_end_b; + struct pv_chunk *pc, *pcn; + pv_entry_t pv; + vm_offset_t va; + vm_page_t m, m_pc; struct md_page *pvh; pd_entry_t *pde; - pmap_t next_pmap, pmap; pt_entry_t *pte, tpte; pt_entry_t PG_G, PG_A, PG_M, PG_RW; - pv_entry_t pv; - vm_offset_t va; - vm_page_t m, m_pc; - struct spglist free; uint64_t inuse; int bit, field, freed; - bool start_di, restart; + bool ret; - PMAP_LOCK_ASSERT(locked_pmap, MA_OWNED); - KASSERT(lockp != NULL, ("reclaim_pv_chunk: lockp is NULL")); - pmap = NULL; - m_pc = NULL; - PG_G = PG_A = PG_M = PG_RW = 0; - SLIST_INIT(&free); - bzero(&pc_marker_b, sizeof(pc_marker_b)); - bzero(&pc_marker_end_b, sizeof(pc_marker_end_b)); - pc_marker = (struct pv_chunk *)&pc_marker_b; - pc_marker_end = (struct pv_chunk *)&pc_marker_end_b; + PMAP_LOCK_ASSERT(pmap, MA_OWNED); - /* - * A delayed invalidation block should already be active if - * pmap_advise() or pmap_remove() called this function by way - * of pmap_demote_pde_locked(). - */ - start_di = pmap_not_in_di(); + ret = false; + PG_G = pmap_global_bit(pmap); + PG_A = pmap_accessed_bit(pmap); + PG_M = pmap_modified_bit(pmap); + PG_RW = pmap_rw_bit(pmap); - pvc = &pv_chunks[domain]; - mtx_lock(&pvc->pvc_lock); - pvc->active_reclaims++; - TAILQ_INSERT_HEAD(&pvc->pvc_list, pc_marker, pc_lru); - TAILQ_INSERT_TAIL(&pvc->pvc_list, pc_marker_end, pc_lru); - while ((pc = TAILQ_NEXT(pc_marker, pc_lru)) != pc_marker_end && - SLIST_EMPTY(&free)) { - next_pmap = pc->pc_pmap; - if (next_pmap == NULL) { - /* - * The next chunk is a marker. However, it is - * not our marker, so active_reclaims must be - * > 1. Consequently, the next_chunk code - * will not rotate the pv_chunks list. - */ - goto next_chunk; - } - mtx_unlock(&pvc->pvc_lock); - + TAILQ_FOREACH_REVERSE_SAFE(pc, &pmap->pm_pvchunk, pvchunks, + pc_list, pcn) { /* - * A pv_chunk can only be removed from the pc_lru list - * when both pc_chunks_mutex is owned and the - * corresponding pmap is locked. - */ - if (pmap != next_pmap) { - restart = false; - reclaim_pv_chunk_leave_pmap(pmap, locked_pmap, - start_di); - pmap = next_pmap; - /* Avoid deadlock and lock recursion. */ - if (pmap > locked_pmap) { - RELEASE_PV_LIST_LOCK(lockp); - PMAP_LOCK(pmap); - if (start_di) - pmap_delayed_invl_start(); - mtx_lock(&pvc->pvc_lock); - restart = true; - } else if (pmap != locked_pmap) { - if (PMAP_TRYLOCK(pmap)) { - if (start_di) - pmap_delayed_invl_start(); - mtx_lock(&pvc->pvc_lock); - restart = true; - } else { - pmap = NULL; /* pmap is not locked */ - mtx_lock(&pvc->pvc_lock); - pc = TAILQ_NEXT(pc_marker, pc_lru); - if (pc == NULL || - pc->pc_pmap != next_pmap) - continue; - goto next_chunk; - } - } else if (start_di) - pmap_delayed_invl_start(); - PG_G = pmap_global_bit(pmap); - PG_A = pmap_accessed_bit(pmap); - PG_M = pmap_modified_bit(pmap); - PG_RW = pmap_rw_bit(pmap); - if (restart) - continue; - } - - /* * Destroy every non-wired, 4 KB page mapping in the chunk. */ freed = 0; @@ -4470,84 +4513,156 @@ SYSCTL_INT(_vm_pmap, OID_AUTO, pv_entry_spare, CTL } pmap_delayed_invl_page(m); pc->pc_map[field] |= 1UL << bit; - pmap_unuse_pt(pmap, va, *pde, &free); + pmap_unuse_pt(pmap, va, *pde, free); freed++; } } - if (freed == 0) { - mtx_lock(&pvc->pvc_lock); - goto next_chunk; - } + if (freed == 0) + continue; + /* Every freed mapping is for a 4 KB page. */ pmap_resident_count_dec(pmap, freed); PV_STAT(atomic_add_long(&pv_entry_frees, freed)); PV_STAT(atomic_add_int(&pv_entry_spare, freed)); PV_STAT(atomic_subtract_long(&pv_entry_count, freed)); - TAILQ_REMOVE(&pmap->pm_pvchunk, pc, pc_list); if (pc->pc_map[0] == PC_FREE0 && pc->pc_map[1] == PC_FREE1 && pc->pc_map[2] == PC_FREE2) { - PV_STAT(atomic_subtract_int(&pv_entry_spare, _NPCPV)); - PV_STAT(atomic_subtract_int(&pc_chunk_count, 1)); - PV_STAT(atomic_add_int(&pc_chunk_frees, 1)); - /* Entire chunk is free; return it. */ - m_pc = PHYS_TO_VM_PAGE(DMAP_TO_PHYS((vm_offset_t)pc)); - dump_drop_page(m_pc->phys_addr); - mtx_lock(&pvc->pvc_lock); - TAILQ_REMOVE(&pvc->pvc_list, pc, pc_lru); - break; + if (!avoid_locked_pmap || locked_pmap != pmap) { + TAILQ_REMOVE(&pmap->pm_pvchunk, pc, pc_list); + PV_STAT(atomic_subtract_int(&pv_entry_spare, + _NPCPV)); + PV_STAT(atomic_subtract_int(&pc_chunk_count, 1)); + PV_STAT(atomic_add_int(&pc_chunk_frees, 1)); + /* Entire chunk is free; return it. */ + m_pc = PHYS_TO_VM_PAGE(DMAP_TO_PHYS( + (vm_offset_t)pc)); + dump_drop_page(m_pc->phys_addr); + m_pc->ref_count = 0; + SLIST_INSERT_HEAD(free, m_pc, plinks.s.ss); + break; + } + } else { + /* + * Re-insert at head because allocator bails + * out if it finds fully populated chunk. + */ + TAILQ_REMOVE(&pmap->pm_pvchunk, pc, pc_list); + TAILQ_INSERT_HEAD(&pmap->pm_pvchunk, pc, pc_list); } - TAILQ_INSERT_HEAD(&pmap->pm_pvchunk, pc, pc_list); - mtx_lock(&pvc->pvc_lock); /* One freed pv entry in locked_pmap is sufficient. */ - if (pmap == locked_pmap) + if (pmap == locked_pmap) { + ret = true; break; -next_chunk: - TAILQ_REMOVE(&pvc->pvc_list, pc_marker, pc_lru); - TAILQ_INSERT_AFTER(&pvc->pvc_list, pc, pc_marker, pc_lru); - if (pvc->active_reclaims == 1 && pmap != NULL) { - /* - * Rotate the pv chunks list so that we do not - * scan the same pv chunks that could not be - * freed (because they contained a wired - * and/or superpage mapping) on every - * invocation of reclaim_pv_chunk(). - */ - while ((pc = TAILQ_FIRST(&pvc->pvc_list)) != pc_marker) { - MPASS(pc->pc_pmap != NULL); - TAILQ_REMOVE(&pvc->pvc_list, pc, pc_lru); - TAILQ_INSERT_TAIL(&pvc->pvc_list, pc, pc_lru); - } } } - TAILQ_REMOVE(&pvc->pvc_list, pc_marker, pc_lru); - TAILQ_REMOVE(&pvc->pvc_list, pc_marker_end, pc_lru); - pvc->active_reclaims--; - mtx_unlock(&pvc->pvc_lock); - reclaim_pv_chunk_leave_pmap(pmap, locked_pmap, start_di); - if (m_pc == NULL && !SLIST_EMPTY(&free)) { - m_pc = SLIST_FIRST(&free); - SLIST_REMOVE_HEAD(&free, plinks.s.ss); - /* Recycle a freed page table page. */ - m_pc->ref_count = 1; - } - vm_page_free_pages_toq(&free, true); - return (m_pc); + return (ret); } +/* + * We are in a serious low memory condition. Resort to + * drastic measures to free some pages so we can allocate + * another pv entry chunk. + * + * Returns NULL if PV entries were reclaimed from the specified pmap, + * otherwise, returns a free page to be used for a PV chunk. + * + * If avoid_locked_pmap is true, chunks are not freed from the + * locked_pmap (but pv entries are). + * + * We do not, however, unmap 2mpages because subsequent accesses will + * allocate per-page pv entries until repromotion occurs, thereby + * exacerbating the shortage of free pv entries. + */ static vm_page_t -reclaim_pv_chunk(pmap_t locked_pmap, struct rwlock **lockp) +reclaim_pv_chunk(pmap_t locked_pmap, PVLL **lockp, bool avoid_locked_pmap) { vm_page_t m; - int i, domain; + pmap_t next_pmap, pmap; + struct spglist free; + bool res, start_di; - domain = PCPU_GET(domain); - for (i = 0; i < vm_ndomains; i++) { - m = reclaim_pv_chunk_domain(locked_pmap, lockp, domain); - if (m != NULL) + PMAP_LOCK_ASSERT(locked_pmap, MA_OWNED); + KASSERT(lockp != NULL, ("reclaim_pv_chunk: lockp is NULL")); + pmap = NULL; + m = NULL; + res = false; + SLIST_INIT(&free); + + /* + * A delayed invalidation block should already be active if + * pmap_advise() or pmap_remove() called this function by way + * of pmap_demote_pde_locked(). + */ + start_di = pmap_not_in_di(); + + for (;;) { + /* + * A parallel reclaim_pv_chunk() could move our cursor + * to the end of the list, which causes earlier + * termination of the loop. Since all callers are + * prepared to the reclaim_pv_chunk() failure, it only + * means that callers retry with the page allocator + * before trying to reclaim one more time. + */ + mtx_lock(&all_pmaps_lock); + next_pmap = pmap == NULL ? TAILQ_FIRST(&all_pmaps) : + TAILQ_NEXT(pmap, pm_allpmaps); + mtx_unlock(&all_pmaps_lock); + if (next_pmap == NULL) break; - domain = (domain + 1) % vm_ndomains; + pmap = next_pmap; + + /* + * This lockless check is fine, we would either + * process a pmap without any pv chunks or skip some + * potentially consumable pmap. But it is still + * useful to cheaply skip freed pmaps which are kept + * on the list due to type stability. + */ + if (pmap->pm_stats.resident_count == 0) + continue; + + /* Avoid deadlock and lock recursion. */ + if (pmap > locked_pmap) { + RELEASE_PV_LIST_LOCK(lockp); + PMAP_LOCK(pmap); + if (start_di) + pmap_delayed_invl_start(); + } else if (pmap != locked_pmap) { + if (PMAP_TRYLOCK(pmap)) { + if (start_di) + pmap_delayed_invl_start(); + } else { + /* The pmap is not locked, skip it. */ + continue; + } + } else if (start_di) + pmap_delayed_invl_start(); + + if (pmap->pm_stats.resident_count != 0) { + res = reclaim_pv_chunk_handle_pmap(pmap, locked_pmap, + avoid_locked_pmap, lockp, &free); + } + pmap_invalidate_all(pmap); + if (pmap != locked_pmap) + PMAP_UNLOCK(pmap); + if (start_di) + pmap_delayed_invl_finish(); + if (res || !SLIST_EMPTY(&free)) { + mtx_lock(&all_pmaps_lock); + TAILQ_REMOVE(&all_pmaps, pmap, pm_allpmaps); + TAILQ_INSERT_TAIL(&all_pmaps, pmap, pm_allpmaps); + mtx_unlock(&all_pmaps_lock); + break; + } } - + if (!res && !SLIST_EMPTY(&free)) { + m = SLIST_FIRST(&free); + SLIST_REMOVE_HEAD(&free, plinks.s.ss); + /* Recycle a freed page table page. */ + m->ref_count = 1; + } + vm_page_free_pages_toq(&free, true); return (m); } @@ -4583,7 +4698,7 @@ free_pv_entry(pmap_t pmap, pv_entry_t pv) } static void -free_pv_chunk_dequeued(struct pv_chunk *pc) +free_pv_chunk(struct pv_chunk *pc) { vm_page_t m; @@ -4598,40 +4713,13 @@ static void } static void -free_pv_chunk(struct pv_chunk *pc) -{ - struct pv_chunks_list *pvc; - - pvc = &pv_chunks[pc_to_domain(pc)]; - mtx_lock(&pvc->pvc_lock); - TAILQ_REMOVE(&pvc->pvc_list, pc, pc_lru); - mtx_unlock(&pvc->pvc_lock); - free_pv_chunk_dequeued(pc); -} - -static void free_pv_chunk_batch(struct pv_chunklist *batch) { - struct pv_chunks_list *pvc; struct pv_chunk *pc, *npc; - int i; - for (i = 0; i < vm_ndomains; i++) { - if (TAILQ_EMPTY(&batch[i])) - continue; - pvc = &pv_chunks[i]; - mtx_lock(&pvc->pvc_lock); - TAILQ_FOREACH(pc, &batch[i], pc_list) { - TAILQ_REMOVE(&pvc->pvc_list, pc, pc_lru); - } - mtx_unlock(&pvc->pvc_lock); + TAILQ_FOREACH_SAFE(pc, batch, pc_list, npc) { + free_pv_chunk(pc); } - - for (i = 0; i < vm_ndomains; i++) { - TAILQ_FOREACH_SAFE(pc, &batch[i], pc_list, npc) { - free_pv_chunk_dequeued(pc); - } - } } /* @@ -4643,9 +4731,8 @@ free_pv_chunk_batch(struct pv_chunklist *batch) * The given PV list lock may be released. */ static pv_entry_t -get_pv_entry(pmap_t pmap, struct rwlock **lockp) +get_pv_entry(pmap_t pmap, PVLL **lockp) { - struct pv_chunks_list *pvc; int bit, field; pv_entry_t pv; struct pv_chunk *pc; @@ -4685,7 +4772,7 @@ retry: PV_STAT(pc_chunk_tryfail++); return (NULL); } - m = reclaim_pv_chunk(pmap, lockp); + m = reclaim_pv_chunk(pmap, lockp, false); if (m == NULL) goto retry; } @@ -4697,10 +4784,6 @@ retry: pc->pc_map[0] = PC_FREE0 & ~1ul; /* preallocated bit 0 */ pc->pc_map[1] = PC_FREE1; pc->pc_map[2] = PC_FREE2; - pvc = &pv_chunks[_vm_phys_domain(m->phys_addr)]; - mtx_lock(&pvc->pvc_lock); - TAILQ_INSERT_TAIL(&pvc->pvc_list, pc, pc_lru); - mtx_unlock(&pvc->pvc_lock); pv = &pc->pc_pventry[0]; TAILQ_INSERT_HEAD(&pmap->pm_pvchunk, pc, pc_list); PV_STAT(atomic_add_long(&pv_entry_count, 1)); @@ -4744,26 +4827,16 @@ popcnt_pc_map_pq(uint64_t *map) * The given PV list lock may be released. */ static void -reserve_pv_entries(pmap_t pmap, int needed, struct rwlock **lockp) +reserve_pv_entries(pmap_t pmap, int needed, PVLL **lockp) { - struct pv_chunks_list *pvc; - struct pch new_tail[PMAP_MEMDOM]; struct pv_chunk *pc; vm_page_t m; - int avail, free, i; + int avail, free; bool reclaimed; PMAP_LOCK_ASSERT(pmap, MA_OWNED); KASSERT(lockp != NULL, ("reserve_pv_entries: lockp is NULL")); - /* - * Newly allocated PV chunks must be stored in a private list until - * the required number of PV chunks have been allocated. Otherwise, - * reclaim_pv_chunk() could recycle one of these chunks. In - * contrast, these chunks must be added to the pmap upon allocation. - */ - for (i = 0; i < PMAP_MEMDOM; i++) - TAILQ_INIT(&new_tail[i]); retry: avail = 0; TAILQ_FOREACH(pc, &pmap->pm_pvchunk, pc_list) { @@ -4784,7 +4857,7 @@ retry: m = vm_page_alloc(NULL, 0, VM_ALLOC_NORMAL | VM_ALLOC_NOOBJ | VM_ALLOC_WIRED); if (m == NULL) { - m = reclaim_pv_chunk(pmap, lockp); + m = reclaim_pv_chunk(pmap, lockp, true); if (m == NULL) goto retry; reclaimed = true; @@ -4798,7 +4871,6 @@ retry: pc->pc_map[1] = PC_FREE1; pc->pc_map[2] = PC_FREE2; TAILQ_INSERT_HEAD(&pmap->pm_pvchunk, pc, pc_list); - TAILQ_INSERT_TAIL(&new_tail[pc_to_domain(pc)], pc, pc_lru); PV_STAT(atomic_add_int(&pv_entry_spare, _NPCPV)); /* @@ -4809,14 +4881,6 @@ retry: if (reclaimed) goto retry; } - for (i = 0; i < vm_ndomains; i++) { - if (TAILQ_EMPTY(&new_tail[i])) - continue; - pvc = &pv_chunks[i]; - mtx_lock(&pvc->pvc_lock); - TAILQ_CONCAT(&pvc->pvc_list, &new_tail[i], pc_lru); - mtx_unlock(&pvc->pvc_lock); - } } /* @@ -4847,7 +4911,7 @@ pmap_pvh_remove(struct md_page *pvh, pmap_t pmap, */ static void pmap_pv_demote_pde(pmap_t pmap, vm_offset_t va, vm_paddr_t pa, - struct rwlock **lockp) + PVLL **lockp) { struct md_page *pvh; struct pv_chunk *pc; @@ -4859,7 +4923,6 @@ pmap_pv_demote_pde(pmap_t pmap, vm_offset_t va, vm PMAP_LOCK_ASSERT(pmap, MA_OWNED); KASSERT((pa & PDRMASK) == 0, ("pmap_pv_demote_pde: pa is not 2mpage aligned")); - CHANGE_PV_LIST_LOCK_TO_PHYS(lockp, pa); /* * Transfer the 2mpage's pv entry for this mapping to the first @@ -4916,7 +4979,7 @@ out: */ static void pmap_pv_promote_pde(pmap_t pmap, vm_offset_t va, vm_paddr_t pa, - struct rwlock **lockp) + PVLL **lockp) { struct md_page *pvh; pv_entry_t pv; @@ -4925,7 +4988,6 @@ pmap_pv_promote_pde(pmap_t pmap, vm_offset_t va, v KASSERT((pa & PDRMASK) == 0, ("pmap_pv_promote_pde: pa is not 2mpage aligned")); - CHANGE_PV_LIST_LOCK_TO_PHYS(lockp, pa); /* * Transfer the first page's pv entry for this mapping to the 2mpage's @@ -4972,7 +5034,7 @@ pmap_pvh_free(struct md_page *pvh, pmap_t pmap, vm */ static boolean_t pmap_try_insert_pv_entry(pmap_t pmap, vm_offset_t va, vm_page_t m, - struct rwlock **lockp) + PVLL **lockp) { pv_entry_t pv; @@ -4995,7 +5057,7 @@ pmap_try_insert_pv_entry(pmap_t pmap, vm_offset_t */ static bool pmap_pv_insert_pde(pmap_t pmap, vm_offset_t va, pd_entry_t pde, u_int flags, - struct rwlock **lockp) + PVLL **lockp) { struct md_page *pvh; pv_entry_t pv; @@ -5036,13 +5098,13 @@ pmap_fill_ptp(pt_entry_t *firstpte, pt_entry_t new static boolean_t pmap_demote_pde(pmap_t pmap, pd_entry_t *pde, vm_offset_t va) { - struct rwlock *lock; + PVLL *lock; boolean_t rv; lock = NULL; rv = pmap_demote_pde_locked(pmap, pde, va, &lock); if (lock != NULL) - rw_wunlock(lock); + pmap_pv_list_unlock(lock); return (rv); } @@ -5075,7 +5137,7 @@ pmap_demote_pde_check(pt_entry_t *firstpte __unuse static void pmap_demote_pde_abort(pmap_t pmap, vm_offset_t va, pd_entry_t *pde, - pd_entry_t oldpde, struct rwlock **lockp) + pd_entry_t oldpde, PVLL **lockp) { struct spglist free; vm_offset_t sva; @@ -5092,7 +5154,7 @@ pmap_demote_pde_abort(pmap_t pmap, vm_offset_t va, static boolean_t pmap_demote_pde_locked(pmap_t pmap, pd_entry_t *pde, vm_offset_t va, - struct rwlock **lockp) + PVLL **lockp) { pd_entry_t newpde, oldpde; pt_entry_t *firstpte, newpte; @@ -5226,8 +5288,11 @@ pmap_demote_pde_locked(pmap_t pmap, pd_entry_t *pd /* * Demote the PV entry. */ - if ((oldpde & PG_MANAGED) != 0) + if ((oldpde & PG_MANAGED) != 0) { + pmap_pv_list_lock_pde(oldpde & PG_PS_FRAME, lockp); pmap_pv_demote_pde(pmap, va, oldpde & PG_PS_FRAME, lockp); + pmap_pv_list_unlock_pde(oldpde & PG_PS_FRAME, lockp); + } atomic_add_long(&pmap_pde_demotions, 1); CTR2(KTR_PMAP, "pmap_demote_pde: success for va %#lx in pmap %p", @@ -5280,7 +5345,7 @@ pmap_remove_kernel_pde(pmap_t pmap, pd_entry_t *pd */ static int pmap_remove_pde(pmap_t pmap, pd_entry_t *pdq, vm_offset_t sva, - struct spglist *free, struct rwlock **lockp) + struct spglist *free, PVLL **lockp) { struct md_page *pvh; pd_entry_t oldpde; @@ -5309,6 +5374,7 @@ pmap_remove_pde(pmap_t pmap, pd_entry_t *pdq, vm_o eva = sva + NBPDR; for (va = sva, m = PHYS_TO_VM_PAGE(oldpde & PG_PS_FRAME); va < eva; va += PAGE_SIZE, m++) { + CHANGE_PV_LIST_LOCK_TO_VM_PAGE(lockp, m); if ((oldpde & (PG_M | PG_RW)) == (PG_M | PG_RW)) vm_page_dirty(m); if (oldpde & PG_A) @@ -5341,7 +5407,7 @@ pmap_remove_pde(pmap_t pmap, pd_entry_t *pdq, vm_o */ static int pmap_remove_pte(pmap_t pmap, pt_entry_t *ptq, vm_offset_t va, - pd_entry_t ptepde, struct spglist *free, struct rwlock **lockp) + pd_entry_t ptepde, struct spglist *free, PVLL **lockp) { struct md_page *pvh; pt_entry_t oldpte, PG_A, PG_M, PG_RW; @@ -5382,7 +5448,7 @@ static void pmap_remove_page(pmap_t pmap, vm_offset_t va, pd_entry_t *pde, struct spglist *free) { - struct rwlock *lock; + PVLL *lock; pt_entry_t *pte, PG_V; PG_V = pmap_valid_bit(pmap); @@ -5395,7 +5461,7 @@ pmap_remove_page(pmap_t pmap, vm_offset_t va, pd_e lock = NULL; pmap_remove_pte(pmap, pte, va, *pde, free, &lock); if (lock != NULL) - rw_wunlock(lock); + pmap_pv_list_unlock(lock); pmap_invalidate_page(pmap, va); } @@ -5404,7 +5470,7 @@ pmap_remove_page(pmap_t pmap, vm_offset_t va, pd_e */ static bool pmap_remove_ptes(pmap_t pmap, vm_offset_t sva, vm_offset_t eva, - pd_entry_t *pde, struct spglist *free, struct rwlock **lockp) + pd_entry_t *pde, struct spglist *free, PVLL **lockp) { pt_entry_t PG_G, *pte; vm_offset_t va; @@ -5446,7 +5512,7 @@ pmap_remove_ptes(pmap_t pmap, vm_offset_t sva, vm_ void pmap_remove(pmap_t pmap, vm_offset_t sva, vm_offset_t eva) { - struct rwlock *lock; + PVLL *lock; vm_offset_t va_next; pml4_entry_t *pml4e; pdp_entry_t *pdpe; @@ -5559,7 +5625,7 @@ pmap_remove(pmap_t pmap, vm_offset_t sva, vm_offse anyvalid = 1; } if (lock != NULL) - rw_wunlock(lock); + pmap_pv_list_unlock(lock); out: if (anyvalid) pmap_invalidate_all(pmap); @@ -5587,7 +5653,7 @@ pmap_remove_all(vm_page_t m) struct md_page *pvh; pv_entry_t pv; pmap_t pmap; - struct rwlock *lock; + PVLL *lock; pt_entry_t *pte, tpte, PG_A, PG_M, PG_RW; pd_entry_t *pde; vm_offset_t va; @@ -5601,16 +5667,16 @@ pmap_remove_all(vm_page_t m) pvh = (m->flags & PG_FICTITIOUS) != 0 ? &pv_dummy : pa_to_pvh(VM_PAGE_TO_PHYS(m)); retry: - rw_wlock(lock); + pmap_pv_list_lock(lock); while ((pv = TAILQ_FIRST(&pvh->pv_list)) != NULL) { pmap = PV_PMAP(pv); if (!PMAP_TRYLOCK(pmap)) { pvh_gen = pvh->pv_gen; - rw_wunlock(lock); + pmap_pv_list_unlock(lock); PMAP_LOCK(pmap); - rw_wlock(lock); + pmap_pv_list_lock(lock); if (pvh_gen != pvh->pv_gen) { - rw_wunlock(lock); + pmap_pv_list_unlock(lock); PMAP_UNLOCK(pmap); goto retry; } @@ -5619,6 +5685,8 @@ retry: pde = pmap_pde(pmap, va); (void)pmap_demote_pde_locked(pmap, pde, va, &lock); PMAP_UNLOCK(pmap); + if (lock != m) + CHANGE_PV_LIST_LOCK_TO_VM_PAGE(&lock, m); } while ((pv = TAILQ_FIRST(&m->md.pv_list)) != NULL) { pmap = PV_PMAP(pv); @@ -5625,11 +5693,11 @@ retry: if (!PMAP_TRYLOCK(pmap)) { pvh_gen = pvh->pv_gen; md_gen = m->md.pv_gen; - rw_wunlock(lock); + pmap_pv_list_unlock(lock); PMAP_LOCK(pmap); - rw_wlock(lock); + pmap_pv_list_lock(lock); if (pvh_gen != pvh->pv_gen || md_gen != m->md.pv_gen) { - rw_wunlock(lock); + pmap_pv_list_unlock(lock); PMAP_UNLOCK(pmap); goto retry; } @@ -5661,7 +5729,7 @@ retry: PMAP_UNLOCK(pmap); } vm_page_aflag_clear(m, PGA_WRITEABLE); - rw_wunlock(lock); + pmap_pv_list_unlock(lock); pmap_delayed_invl_wait(m); vm_page_free_pages_toq(&free, true); } @@ -5877,8 +5945,7 @@ pmap_pde_ept_executable(pmap_t pmap, pd_entry_t pd * identical characteristics. */ static void -pmap_promote_pde(pmap_t pmap, pd_entry_t *pde, vm_offset_t va, - struct rwlock **lockp) +pmap_promote_pde(pmap_t pmap, pd_entry_t *pde, vm_offset_t va, PVLL **lockp) { pd_entry_t newpde; pt_entry_t *firstpte, oldpte, pa, *pte; @@ -5980,8 +6047,11 @@ setpte: /* * Promote the pv entries. */ - if ((newpde & PG_MANAGED) != 0) + if ((newpde & PG_MANAGED) != 0) { + pmap_pv_list_lock_pde(newpde & PG_PS_FRAME, lockp); pmap_pv_promote_pde(pmap, va, newpde & PG_PS_FRAME, lockp); + pmap_pv_list_unlock_pde(newpde & PG_PS_FRAME, lockp); + } /* * Propagate the PAT index to its proper position. @@ -6022,7 +6092,7 @@ int pmap_enter(pmap_t pmap, vm_offset_t va, vm_page_t m, vm_prot_t prot, u_int flags, int8_t psind) { - struct rwlock *lock; + PVLL *lock; pd_entry_t *pde; pt_entry_t *pte, PG_G, PG_A, PG_M, PG_RW, PG_V; pt_entry_t newpte, origpte; @@ -6228,7 +6298,7 @@ retry: pv = get_pv_entry(pmap, &lock); pv->pv_va = va; } - CHANGE_PV_LIST_LOCK_TO_PHYS(&lock, pa); + CHANGE_PV_LIST_LOCK_TO_VM_PAGE(&lock, m); TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_next); m->md.pv_gen++; if ((newpte & PG_RW) != 0) @@ -6281,7 +6351,7 @@ unchanged: rv = KERN_SUCCESS; out: if (lock != NULL) - rw_wunlock(lock); + pmap_pv_list_unlock(lock); PMAP_UNLOCK(pmap); return (rv); } @@ -6295,7 +6365,7 @@ out: */ static bool pmap_enter_2mpage(pmap_t pmap, vm_offset_t va, vm_page_t m, vm_prot_t prot, - struct rwlock **lockp) + PVLL **lockp) { pd_entry_t newpde; pt_entry_t PG_V; @@ -6346,7 +6416,7 @@ pmap_every_pte_zero(vm_paddr_t pa) */ static int pmap_enter_pde(pmap_t pmap, vm_offset_t va, pd_entry_t newpde, u_int flags, - vm_page_t m, struct rwlock **lockp) + vm_page_t m, PVLL **lockp) { struct spglist free; pd_entry_t oldpde, *pde; @@ -6494,7 +6564,7 @@ void pmap_enter_object(pmap_t pmap, vm_offset_t start, vm_offset_t end, vm_page_t m_start, vm_prot_t prot) { - struct rwlock *lock; + PVLL *lock; vm_offset_t va; vm_page_t m, mpte; vm_pindex_t diff, psize; @@ -6519,7 +6589,7 @@ pmap_enter_object(pmap_t pmap, vm_offset_t start, m = TAILQ_NEXT(m, listq); } if (lock != NULL) - rw_wunlock(lock); + pmap_pv_list_unlock(lock); PMAP_UNLOCK(pmap); } @@ -6535,19 +6605,19 @@ pmap_enter_object(pmap_t pmap, vm_offset_t start, void pmap_enter_quick(pmap_t pmap, vm_offset_t va, vm_page_t m, vm_prot_t prot) { - struct rwlock *lock; + PVLL *lock; lock = NULL; PMAP_LOCK(pmap); (void)pmap_enter_quick_locked(pmap, va, m, prot, NULL, &lock); if (lock != NULL) - rw_wunlock(lock); + pmap_pv_list_unlock(lock); PMAP_UNLOCK(pmap); } static vm_page_t pmap_enter_quick_locked(pmap_t pmap, vm_offset_t va, vm_page_t m, - vm_prot_t prot, vm_page_t mpte, struct rwlock **lockp) + vm_prot_t prot, vm_page_t mpte, PVLL **lockp) { pt_entry_t newpte, *pte, PG_V; @@ -6841,7 +6911,7 @@ void pmap_copy(pmap_t dst_pmap, pmap_t src_pmap, vm_offset_t dst_addr, vm_size_t len, vm_offset_t src_addr) { - struct rwlock *lock; + PVLL *lock; pml4_entry_t *pml4e; pdp_entry_t *pdpe; pd_entry_t *pde, srcptepaddr; @@ -6978,7 +7048,7 @@ pmap_copy(pmap_t dst_pmap, pmap_t src_pmap, vm_off } out: if (lock != NULL) - rw_wunlock(lock); + pmap_pv_list_unlock(lock); PMAP_UNLOCK(src_pmap); PMAP_UNLOCK(dst_pmap); } @@ -7093,7 +7163,7 @@ boolean_t pmap_page_exists_quick(pmap_t pmap, vm_page_t m) { struct md_page *pvh; - struct rwlock *lock; + PVLL *lock; pv_entry_t pv; int loops = 0; boolean_t rv; @@ -7102,7 +7172,7 @@ pmap_page_exists_quick(pmap_t pmap, vm_page_t m) ("pmap_page_exists_quick: page %p is not managed", m)); rv = FALSE; lock = VM_PAGE_TO_PV_LIST_LOCK(m); - rw_rlock(lock); + pmap_pv_list_lock(lock); TAILQ_FOREACH(pv, &m->md.pv_list, pv_next) { if (PV_PMAP(pv) == pmap) { rv = TRUE; @@ -7124,7 +7194,7 @@ pmap_page_exists_quick(pmap_t pmap, vm_page_t m) break; } } - rw_runlock(lock); + pmap_pv_list_unlock(lock); return (rv); } @@ -7137,7 +7207,7 @@ pmap_page_exists_quick(pmap_t pmap, vm_page_t m) int pmap_page_wired_mappings(vm_page_t m) { - struct rwlock *lock; + PVLL *lock; struct md_page *pvh; pmap_t pmap; pt_entry_t *pte; @@ -7147,7 +7217,7 @@ pmap_page_wired_mappings(vm_page_t m) if ((m->oflags & VPO_UNMANAGED) != 0) return (0); lock = VM_PAGE_TO_PV_LIST_LOCK(m); - rw_rlock(lock); + pmap_pv_list_lock(lock); restart: count = 0; TAILQ_FOREACH(pv, &m->md.pv_list, pv_next) { @@ -7154,9 +7224,9 @@ restart: pmap = PV_PMAP(pv); if (!PMAP_TRYLOCK(pmap)) { md_gen = m->md.pv_gen; - rw_runlock(lock); + pmap_pv_list_unlock(lock); PMAP_LOCK(pmap); - rw_rlock(lock); + pmap_pv_list_lock(lock); if (md_gen != m->md.pv_gen) { PMAP_UNLOCK(pmap); goto restart; @@ -7174,9 +7244,9 @@ restart: if (!PMAP_TRYLOCK(pmap)) { md_gen = m->md.pv_gen; pvh_gen = pvh->pv_gen; - rw_runlock(lock); + pmap_pv_list_unlock(lock); PMAP_LOCK(pmap); - rw_rlock(lock); + pmap_pv_list_lock(lock); if (md_gen != m->md.pv_gen || pvh_gen != pvh->pv_gen) { PMAP_UNLOCK(pmap); @@ -7189,7 +7259,7 @@ restart: PMAP_UNLOCK(pmap); } } - rw_runlock(lock); + pmap_pv_list_unlock(lock); return (count); } @@ -7200,17 +7270,17 @@ restart: boolean_t pmap_page_is_mapped(vm_page_t m) { - struct rwlock *lock; + PVLL *lock; boolean_t rv; if ((m->oflags & VPO_UNMANAGED) != 0) return (FALSE); lock = VM_PAGE_TO_PV_LIST_LOCK(m); - rw_rlock(lock); + pmap_pv_list_lock(lock); rv = !TAILQ_EMPTY(&m->md.pv_list) || ((m->flags & PG_FICTITIOUS) == 0 && !TAILQ_EMPTY(&pa_to_pvh(VM_PAGE_TO_PHYS(m))->pv_list)); - rw_runlock(lock); + pmap_pv_list_unlock(lock); return (rv); } @@ -7246,15 +7316,15 @@ pmap_remove_pages(pmap_t pmap) pt_entry_t *pte, tpte; pt_entry_t PG_M, PG_RW, PG_V; struct spglist free; - struct pv_chunklist free_chunks[PMAP_MEMDOM]; + struct pv_chunklist free_chunks; vm_page_t m, mpte, mt; pv_entry_t pv; struct md_page *pvh; struct pv_chunk *pc, *npc; - struct rwlock *lock; + PVLL *lock; int64_t bit; uint64_t inuse, bitmask; - int allfree, field, freed, i, idx; + int allfree, field, freed, idx; boolean_t superpage; vm_paddr_t pa; @@ -7282,8 +7352,7 @@ pmap_remove_pages(pmap_t pmap) PG_V = pmap_valid_bit(pmap); PG_RW = pmap_rw_bit(pmap); - for (i = 0; i < PMAP_MEMDOM; i++) - TAILQ_INIT(&free_chunks[i]); + TAILQ_INIT(&free_chunks); SLIST_INIT(&free); PMAP_LOCK(pmap); TAILQ_FOREACH_SAFE(pc, &pmap->pm_pvchunk, pc_list, npc) { @@ -7411,11 +7480,11 @@ pmap_remove_pages(pmap_t pmap) PV_STAT(atomic_subtract_long(&pv_entry_count, freed)); if (allfree) { TAILQ_REMOVE(&pmap->pm_pvchunk, pc, pc_list); - TAILQ_INSERT_TAIL(&free_chunks[pc_to_domain(pc)], pc, pc_list); + TAILQ_INSERT_TAIL(&free_chunks, pc, pc_list); } } if (lock != NULL) - rw_wunlock(lock); + pmap_pv_list_unlock(lock); pmap_invalidate_all(pmap); pmap_pkru_deassign_all(pmap); free_pv_chunk_batch((struct pv_chunklist *)&free_chunks); @@ -7426,7 +7495,7 @@ pmap_remove_pages(pmap_t pmap) static boolean_t pmap_page_test_mappings(vm_page_t m, boolean_t accessed, boolean_t modified) { - struct rwlock *lock; + PVLL *lock; pv_entry_t pv; struct md_page *pvh; pt_entry_t *pte, mask; @@ -7437,15 +7506,15 @@ pmap_page_test_mappings(vm_page_t m, boolean_t acc rv = FALSE; lock = VM_PAGE_TO_PV_LIST_LOCK(m); - rw_rlock(lock); + pmap_pv_list_lock(lock); restart: TAILQ_FOREACH(pv, &m->md.pv_list, pv_next) { pmap = PV_PMAP(pv); if (!PMAP_TRYLOCK(pmap)) { md_gen = m->md.pv_gen; - rw_runlock(lock); + pmap_pv_list_unlock(lock); PMAP_LOCK(pmap); - rw_rlock(lock); + pmap_pv_list_lock(lock); if (md_gen != m->md.pv_gen) { PMAP_UNLOCK(pmap); goto restart; @@ -7475,9 +7544,9 @@ restart: if (!PMAP_TRYLOCK(pmap)) { md_gen = m->md.pv_gen; pvh_gen = pvh->pv_gen; - rw_runlock(lock); + pmap_pv_list_unlock(lock); PMAP_LOCK(pmap); - rw_rlock(lock); + pmap_pv_list_lock(lock); if (md_gen != m->md.pv_gen || pvh_gen != pvh->pv_gen) { PMAP_UNLOCK(pmap); @@ -7503,7 +7572,7 @@ restart: } } out: - rw_runlock(lock); + pmap_pv_list_unlock(lock); return (rv); } @@ -7576,7 +7645,7 @@ pmap_remove_write(vm_page_t m) { struct md_page *pvh; pmap_t pmap; - struct rwlock *lock; + PVLL *lock; pv_entry_t next_pv, pv; pd_entry_t *pde; pt_entry_t oldpte, *pte, PG_M, PG_RW; @@ -7594,17 +7663,18 @@ pmap_remove_write(vm_page_t m) pvh = (m->flags & PG_FICTITIOUS) != 0 ? &pv_dummy : pa_to_pvh(VM_PAGE_TO_PHYS(m)); retry_pv_loop: - rw_wlock(lock); + pmap_pv_list_lock(lock); +retry_pv_loop_locked: + pvh_gen = pvh->pv_gen; TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_next, next_pv) { pmap = PV_PMAP(pv); if (!PMAP_TRYLOCK(pmap)) { - pvh_gen = pvh->pv_gen; - rw_wunlock(lock); + pmap_pv_list_unlock(lock); PMAP_LOCK(pmap); - rw_wlock(lock); + pmap_pv_list_lock(lock); if (pvh_gen != pvh->pv_gen) { PMAP_UNLOCK(pmap); - rw_wunlock(lock); + pmap_pv_list_unlock(lock); goto retry_pv_loop; } } @@ -7613,10 +7683,11 @@ retry_pv_loop: pde = pmap_pde(pmap, va); if ((*pde & PG_RW) != 0) (void)pmap_demote_pde_locked(pmap, pde, va, &lock); - KASSERT(lock == VM_PAGE_TO_PV_LIST_LOCK(m), - ("inconsistent pv lock %p %p for page %p", - lock, VM_PAGE_TO_PV_LIST_LOCK(m), m)); PMAP_UNLOCK(pmap); + if (lock != m || pvh_gen != pvh->pv_gen) { + CHANGE_PV_LIST_LOCK_TO_VM_PAGE(&lock, m); + goto retry_pv_loop_locked; + } } TAILQ_FOREACH(pv, &m->md.pv_list, pv_next) { pmap = PV_PMAP(pv); @@ -7623,13 +7694,13 @@ retry_pv_loop: if (!PMAP_TRYLOCK(pmap)) { pvh_gen = pvh->pv_gen; md_gen = m->md.pv_gen; - rw_wunlock(lock); + pmap_pv_list_unlock(lock); PMAP_LOCK(pmap); - rw_wlock(lock); + pmap_pv_list_lock(lock); if (pvh_gen != pvh->pv_gen || md_gen != m->md.pv_gen) { PMAP_UNLOCK(pmap); - rw_wunlock(lock); + pmap_pv_list_unlock(lock); goto retry_pv_loop; } } @@ -7652,7 +7723,7 @@ retry: } PMAP_UNLOCK(pmap); } - rw_wunlock(lock); + pmap_pv_list_unlock(lock); vm_page_aflag_clear(m, PGA_WRITEABLE); pmap_delayed_invl_wait(m); } @@ -7710,7 +7781,7 @@ pmap_ts_referenced(vm_page_t m) struct md_page *pvh; pv_entry_t pv, pvf; pmap_t pmap; - struct rwlock *lock; + PVLL *lock; pd_entry_t oldpde, *pde; pt_entry_t *pte, PG_A, PG_M, PG_RW; vm_offset_t va; @@ -7726,7 +7797,7 @@ pmap_ts_referenced(vm_page_t m) pa = VM_PAGE_TO_PHYS(m); lock = PHYS_TO_PV_LIST_LOCK(pa); pvh = (m->flags & PG_FICTITIOUS) != 0 ? &pv_dummy : pa_to_pvh(pa); - rw_wlock(lock); + pmap_pv_list_lock(lock); retry: not_cleared = 0; if ((pvf = TAILQ_FIRST(&pvh->pv_list)) == NULL) @@ -7733,14 +7804,14 @@ retry: goto small_mappings; pv = pvf; do { + pvh_gen = pvh->pv_gen; if (pvf == NULL) pvf = pv; pmap = PV_PMAP(pv); if (!PMAP_TRYLOCK(pmap)) { - pvh_gen = pvh->pv_gen; - rw_wunlock(lock); + pmap_pv_list_unlock(lock); PMAP_LOCK(pmap); - rw_wlock(lock); + pmap_pv_list_lock(lock); if (pvh_gen != pvh->pv_gen) { PMAP_UNLOCK(pmap); goto retry; @@ -7805,7 +7876,6 @@ retry: pmap_invalidate_page(pmap, va); } else demoted = TRUE; - if (demoted) { /* * The superpage mapping was removed @@ -7817,9 +7887,10 @@ retry: pv = NULL; } cleared++; - KASSERT(lock == VM_PAGE_TO_PV_LIST_LOCK(m), - ("inconsistent pv lock %p %p for page %p", - lock, VM_PAGE_TO_PV_LIST_LOCK(m), m)); + if (lock != m || pvh_gen != pvh->pv_gen) { + CHANGE_PV_LIST_LOCK_TO_VM_PAGE(&lock, m); + goto retry; + } } else not_cleared++; } @@ -7844,9 +7915,9 @@ small_mappings: if (!PMAP_TRYLOCK(pmap)) { pvh_gen = pvh->pv_gen; md_gen = m->md.pv_gen; - rw_wunlock(lock); + pmap_pv_list_unlock(lock); PMAP_LOCK(pmap); - rw_wlock(lock); + pmap_pv_list_lock(lock); if (pvh_gen != pvh->pv_gen || md_gen != m->md.pv_gen) { PMAP_UNLOCK(pmap); goto retry; @@ -7897,7 +7968,7 @@ small_mappings: } while ((pv = TAILQ_FIRST(&m->md.pv_list)) != pvf && cleared + not_cleared < PMAP_TS_REFERENCED_MAX); out: - rw_wunlock(lock); + pmap_pv_list_unlock(lock); vm_page_free_pages_toq(&free, true); return (cleared + not_cleared); } @@ -7910,7 +7981,7 @@ out: void pmap_advise(pmap_t pmap, vm_offset_t sva, vm_offset_t eva, int advice) { - struct rwlock *lock; + PVLL *lock; pml4_entry_t *pml4e; pdp_entry_t *pdpe; pd_entry_t oldpde, *pde; @@ -7967,7 +8038,7 @@ pmap_advise(pmap_t pmap, vm_offset_t sva, vm_offse lock = NULL; if (!pmap_demote_pde_locked(pmap, pde, sva, &lock)) { if (lock != NULL) - rw_wunlock(lock); + pmap_pv_list_unlock(lock); /* * The large page mapping was destroyed. @@ -7999,7 +8070,7 @@ pmap_advise(pmap_t pmap, vm_offset_t sva, vm_offse anychanged = true; } if (lock != NULL) - rw_wunlock(lock); + pmap_pv_list_unlock(lock); } if (va_next > eva) va_next = eva; @@ -8056,7 +8127,7 @@ pmap_clear_modify(vm_page_t m) pv_entry_t next_pv, pv; pd_entry_t oldpde, *pde; pt_entry_t *pte, PG_M, PG_RW; - struct rwlock *lock; + PVLL *lock; vm_offset_t va; int md_gen, pvh_gen; @@ -8069,15 +8140,15 @@ pmap_clear_modify(vm_page_t m) pvh = (m->flags & PG_FICTITIOUS) != 0 ? &pv_dummy : pa_to_pvh(VM_PAGE_TO_PHYS(m)); lock = VM_PAGE_TO_PV_LIST_LOCK(m); - rw_wlock(lock); + pmap_pv_list_lock(lock); restart: + pvh_gen = pvh->pv_gen; TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_next, next_pv) { pmap = PV_PMAP(pv); if (!PMAP_TRYLOCK(pmap)) { - pvh_gen = pvh->pv_gen; - rw_wunlock(lock); + pmap_pv_list_unlock(lock); PMAP_LOCK(pmap); - rw_wlock(lock); + pmap_pv_list_lock(lock); if (pvh_gen != pvh->pv_gen) { PMAP_UNLOCK(pmap); goto restart; @@ -8103,6 +8174,10 @@ restart: pmap_invalidate_page(pmap, va); } PMAP_UNLOCK(pmap); + if (lock != m || pvh_gen != pvh->pv_gen) { + CHANGE_PV_LIST_LOCK_TO_VM_PAGE(&lock, m); + goto restart; + } } TAILQ_FOREACH(pv, &m->md.pv_list, pv_next) { pmap = PV_PMAP(pv); @@ -8109,9 +8184,9 @@ restart: if (!PMAP_TRYLOCK(pmap)) { md_gen = m->md.pv_gen; pvh_gen = pvh->pv_gen; - rw_wunlock(lock); + pmap_pv_list_unlock(lock); PMAP_LOCK(pmap); - rw_wlock(lock); + pmap_pv_list_lock(lock); if (pvh_gen != pvh->pv_gen || md_gen != m->md.pv_gen) { PMAP_UNLOCK(pmap); goto restart; @@ -8129,7 +8204,7 @@ restart: } PMAP_UNLOCK(pmap); } - rw_wunlock(lock); + pmap_pv_list_unlock(lock); } /* @@ -9041,7 +9116,7 @@ int pmap_emulate_accessed_dirty(pmap_t pmap, vm_offset_t va, int ftype) { int rv; - struct rwlock *lock; + PVLL *lock; #if VM_NRESERVLEVEL > 0 vm_page_t m, mpte; #endif @@ -9128,7 +9203,7 @@ pmap_emulate_accessed_dirty(pmap_t pmap, vm_offset rv = 0; /* success */ done: if (lock != NULL) - rw_wunlock(lock); + pmap_pv_list_unlock(lock); PMAP_UNLOCK(pmap); return (rv); } Index: /usr/src/sys/amd64/include/pmap.h =================================================================== --- /usr/src/sys/amd64/include/pmap.h (revision 363687) +++ /usr/src/sys/amd64/include/pmap.h (working copy) @@ -249,6 +249,7 @@ #include #include #include +#include #include #include @@ -313,7 +314,9 @@ struct pv_chunk; struct md_page { TAILQ_HEAD(, pv_entry) pv_list; /* (p) */ int pv_gen; /* (p) */ - int pat_mode; + obm_lock_t pv_lock; + uint8_t pat_mode; + uint8_t pad0[2]; }; enum pmap_type { @@ -327,6 +330,8 @@ struct pmap_pcids { uint32_t pm_gen; }; +TAILQ_HEAD(pvchunks, pv_chunk); + /* * The kernel virtual address (KVA) of the level 4 page table page is always * within the direct map (DMAP) region. @@ -337,7 +342,7 @@ struct pmap { pml4_entry_t *pm_pml4u; /* KVA of user l4 page table */ uint64_t pm_cr3; uint64_t pm_ucr3; - TAILQ_HEAD(,pv_chunk) pm_pvchunk; /* list of mappings in pmap */ + struct pvchunks pm_pvchunk; /* list of mappings in pmap */ cpuset_t pm_active; /* active on cpus */ enum pmap_type pm_type; /* regular or nested tables */ struct pmap_statistics pm_stats; /* pmap statistics */ @@ -346,6 +351,7 @@ struct pmap { int pm_flags; struct pmap_pcids pm_pcids[MAXCPU]; struct rangeset pm_pkru; + TAILQ_ENTRY(pmap) pm_allpmaps; }; /* flags */ @@ -364,8 +370,7 @@ extern struct pmap kernel_pmap_store; #define PMAP_LOCK_ASSERT(pmap, type) \ mtx_assert(&(pmap)->pm_mtx, (type)) #define PMAP_LOCK_DESTROY(pmap) mtx_destroy(&(pmap)->pm_mtx) -#define PMAP_LOCK_INIT(pmap) mtx_init(&(pmap)->pm_mtx, "pmap", \ - NULL, MTX_DEF | MTX_DUPOK) +#define PMAP_LOCK_INIT(pmap) pmap_lock_init(pmap) #define PMAP_LOCKED(pmap) mtx_owned(&(pmap)->pm_mtx) #define PMAP_MTX(pmap) (&(pmap)->pm_mtx) #define PMAP_TRYLOCK(pmap) mtx_trylock(&(pmap)->pm_mtx) @@ -393,8 +398,7 @@ typedef struct pv_entry { #define PV_CHUNK_HEADER \ pmap_t pc_pmap; \ TAILQ_ENTRY(pv_chunk) pc_list; \ - uint64_t pc_map[_NPCM]; /* bitmap; 1 = free */ \ - TAILQ_ENTRY(pv_chunk) pc_lru; + uint64_t pc_map[_NPCM]; /* bitmap; 1 = free */ struct pv_chunk_header { PV_CHUNK_HEADER @@ -439,6 +443,7 @@ void pmap_kremove(vm_offset_t); int pmap_large_map(vm_paddr_t, vm_size_t, void **, vm_memattr_t); void pmap_large_map_wb(void *sva, vm_size_t len); void pmap_large_unmap(void *sva, vm_size_t len); +void pmap_lock_init(pmap_t pmap); void *pmap_mapbios(vm_paddr_t, vm_size_t); void *pmap_mapdev(vm_paddr_t, vm_size_t); void *pmap_mapdev_attr(vm_paddr_t, vm_size_t, int); Index: /usr/src/sys/conf/files =================================================================== --- /usr/src/sys/conf/files (revision 363687) +++ /usr/src/sys/conf/files (working copy) @@ -3746,6 +3746,7 @@ kern/kern_module.c standard kern/kern_mtxpool.c standard kern/kern_mutex.c standard kern/kern_ntptime.c standard +kern/kern_obm.c standard kern/kern_osd.c standard kern/kern_physio.c standard kern/kern_pmc.c standard