GENERIC 2013-07-13 00:52:12 UTC, r253314M, vmcore.5 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #1 r253314M: Sun Jul 14 10:25:28 CEST 2013 pho@t2.osted.lan:/var/tmp/vmobj-readlock/sys/amd64/compile/PHO amd64 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.24-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x206d7 Family = 0x6 Model = 0x2d Stepping = 7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 31063347200 (29624 MB) : Trying to mount root from ufs:/dev/da0p2 [rw]... Setting hostuuid: 2bde2bde-f4e2-e111-aab2-001e6756b69b. Setting hostid: 0x0035ff86. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/da0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p2: clean, 94114496 free (29776 frags, 11760590 blocks, 0.0% fragmentation) /dev/da0p3: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p3: clean, 24100788 free (116 frags, 3012584 blocks, 0.0% fragmentation) Mounting local file systems:. Writing entropy file:. Setting hostname: t2.osted.lan. Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 igb0: flags=8843 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:b6:9b inet 192.168.1.109 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::21e:67ff:fe56:b69b%igb0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active igb1: flags=8c02 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:b6:9c nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: igb1. igb1: flags=8c02 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:b6:9c nd6 options=29 media: Ethernet autoselect status: no carrier Configuring keyboard: keymap. ums0: on usbus2 ums0: 3 buttons and [Z] coordinates ID=0 Starting ums0 moused. Expensive timeout(9) function: 0xffffffff807134c0(0xffffffff8159cfd0) 0.011713256 s add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib 32-bit compatibility ldconfig path: /usr/lib32 Creating and/or trimming log files. Starting syslogd. No core dumps found. Starting rpcbind. NFS access cache time=60 Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Configuring syscons: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Local package initialization: backup watchdogd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Sun Jul 14 10:29:24 CEST 2013 FreeBSD/amd64 (t2.osted.lan) (console) login: Jul 14 10:29:41 t2 su: pho to root on /dev/pts/0 20130714 10:29:52 all (1/1): mmap4.sh root Password: Jul 14 10:30:58 t2 login: ROOT LOGIN (root) ON console Last login: Wed Jul 10 22:22:58 on console FreeBSD 10.0-CURRENT (PHO) #1 r253314M: Sun Jul 14 10:25:28 CEST 2013 Welcome to FreeBSD! Before seeking technical support, please use the following resources: o Security advisories and updated errata information for all releases are at http://www.FreeBSD.org/releases/ - always consult the ERRATA section for your release first as it's updated frequently. o The Handbook and FAQ documents are at http://www.FreeBSD.org/ and, along with the mailing lists, can be searched by going to http://www.FreeBSD.org/search/. If the doc package has been installed (or fetched via pkg install lang-freebsd-doc, where lang is the 2-letter language code, e.g. en), they are also available formatted in /usr/local/share/doc/freebsd. If you still have a question or problem, please take the output of `uname -a', along with any relevant error messages, and email it as a question to the questions@FreeBSD.org mailing list. If you are unfamiliar with FreeBSD's directory layout, please refer to the hier(7) manual page. If you are not familiar with manual pages, type `man man'. Edit /etc/motd to change this login announcement. root@t2:~ # init 6 Shutting down local packages:. Stopping cron. Waiting for PIDS: 954. Stopping sshd. Waiting for PIDS: 944. Stopping powerd. Waiting for PIDS: 917. Stopping ntpd. Waiting for PIDS: 914. Stopping nfsd. Waiting for PIDS: 874 875, 874. Stopping mountd. Waiting for PIDS: 868, 868. Stopping nfsuserd. Waiting for PIDS: 857 858 859 860 861. Stopping rpcbind. Waiting for PIDS: 828. Stopping watchdogd. Waiting for PIDS: 96590 second watchdog timeout expired. Shutdown terminated. Sun Jul 14 10:32:31 CEST 2013 Jul 14 10:32:31 t2 init: /bin/sh on /etc/rc.shutdown terminated abnormally, going to single user mode Jul 14 10:32:31 t2 syslogd: exiting on signal 15 Jul 14 10:32:51 init: some processes would not die; ps axl advised Waiting (max 60 seconds) for system process `vnlru' to stop...done Waiting (max 60 seconds) for system process `bufdaemon' to stop...done Waiting (max 60 seconds) for system process `syncer' to stop... Syncing disks, vnodes remaining...5 5 5 4 4 4 4 4 4 4 4 3 4 4 4 4 4 4 4 4 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 timed out Syncing disks, buffers remaining... 5 5 5 5 5 5 5 3 5 5 3 5 5 3 5 5 3 5 5 3 5 3 5 3 5 5 3 5 3 1: buf:0xffffff8789f13440, vnode:0xfffffe01380f64e0, flags:20000820, blkno:0, lblkno:0, buflock:lock type bufwait: EXCL by thread 0xfffffe0089b4f920 (pid 1191, mmap4, tid 100214) #0 0xffffffff8089e289 at __lockmgr_args+0x9a9 #1 0xffffffff80948f7e at getnewbuf+0x2fe #2 0xffffffff809461e4 at getblk+0x724 #3 0xffffffff80ae58e5 at ffs_balloc_ufs2+0xcd5 #4 0xffffffff80b0c6a0 at ffs_write+0x310 #5 0xffffffff80d55853 at VOP_WRITE_APV+0x183 #6 0xffffffff80b4be60 at vnode_pager_generic_putpages+0x270 #7 0xffffffff80d5851e at VOP_PUTPAGES_APV+0x10e #8 0xffffffff80b49fcd at vnode_pager_putpages+0x9d #9 0xffffffff80b413f9 at vm_pageout_flush+0x119 #10 0xffffffff80b3a685 at vm_object_page_collect_flush+0x1b5 #11 0xffffffff80b3a3de at vm_object_page_clean+0x15e #12 0xffffffff80960875 at vinactive+0x125 #13 0xffffffff80960d90 at vputx+0x370 #14 0xffffffff80b3995c at vm_object_deallocate+0x61c #15 0xffffffff80b30729 at vm_map_process_deferred+0x89 #16 0xffffffff80b349d8 at vm_map_remove+0xc8 #17 0xffffffff80b3056d at vmspace_exit+0xcd 2: buf:0xffffff8789f13150, vnode:0xfffffe0059e5dc30, flags:20000000, blkno:1152, lblkno:1152, buflock: 3 Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0x80 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff8089f035 stack pointer = 0x28:0xffffff800030a870 frame pointer = 0x28:0xffffff800030a890 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 1 (init) [ thread pid 1 tid 100002 ] Stopped at lockmgr_printinfo+0x55: movl 0x90(%rdx),%r9d db> run pho db:0:pho> bt Tracing pid 1 tid 100002 td 0xfffffe00502aa000 lockmgr_printinfo() at lockmgr_printinfo+0x55/frame 0xffffff800030a890 kern_reboot() at kern_reboot+0x6f6/frame 0xffffff800030a970 sys_reboot() at sys_reboot+0x80/frame 0xffffff800030a9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff800030aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff800030aab0 --- syscall (55, FreeBSD ELF64, sys_reboot), rip = 0x40ecdc, rsp = 0x7fffffffd6d8, rbp = 0x7fffffffd7c0 --- db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x5d1480 curthread = 0xfffffe00502aa000: pid 1 "init" curpcb = 0xffffff800030ab80 fpcurthread = none idlethread = 0xfffffe00502a9920: tid 100003 "idle: cpu0" curpmap = 0xfffffe00597145e8 tssp = 0xffffffff815f0290 commontssp = 0xffffffff815f0290 rsp0 = 0xffffff800030ab80 gs32p = 0xffffffff815f1ce8 ldt = 0xffffffff815f1d28 tss = 0xffffffff815f1d18 spin locks held: cpuid = 1 dynamic pcpu = 0xffffff807ef0e480 curthread = 0xfffffe00502a9490: pid 11 "idle: cpu1" curpcb = 0xffffff8000314b80 fpcurthread = none idlethread = 0xfffffe00502a9490: tid 100004 "idle: cpu1" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f02f8 commontssp = 0xffffffff815f02f8 rsp0 = 0xffffff8000314b80 gs32p = 0xffffffff815f1d50 ldt = 0xffffffff815f1d90 tss = 0xffffffff815f1d80 spin locks held: cpuid = 2 dynamic pcpu = 0xffffff807ef15480 curthread = 0xfffffe00502a9000: pid 11 "idle: cpu2" curpcb = 0xffffff8000319b80 fpcurthread = none idlethread = 0xfffffe00502a9000: tid 100005 "idle: cpu2" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f0360 commontssp = 0xffffffff815f0360 rsp0 = 0xffffff8000319b80 gs32p = 0xffffffff815f1db8 ldt = 0xffffffff815f1df8 tss = 0xffffffff815f1de8 spin locks held: cpuid = 3 dynamic pcpu = 0xffffff807ef1c480 curthread = 0xfffffe00502b8000: pid 11 "idle: cpu3" curpcb = 0xffffff800031eb80 fpcurthread = none idlethread = 0xfffffe00502b8000: tid 100006 "idle: cpu3" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f03c8 commontssp = 0xffffffff815f03c8 rsp0 = 0xffffff800031eb80 gs32p = 0xffffffff815f1e20 ldt = 0xffffffff815f1e60 tss = 0xffffffff815f1e50 spin locks held: cpuid = 4 dynamic pcpu = 0xffffff807ef23480 curthread = 0xfffffe00502b7920: pid 11 "idle: cpu4" curpcb = 0xffffff8000323b80 fpcurthread = none idlethread = 0xfffffe00502b7920: tid 100007 "idle: cpu4" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f0430 commontssp = 0xffffffff815f0430 rsp0 = 0xffffff8000323b80 gs32p = 0xffffffff815f1e88 ldt = 0xffffffff815f1ec8 tss = 0xffffffff815f1eb8 spin locks held: cpuid = 5 dynamic pcpu = 0xffffff807ef2a480 curthread = 0xfffffe00502b7490: pid 11 "idle: cpu5" curpcb = 0xffffff8000328b80 fpcurthread = none idlethread = 0xfffffe00502b7490: tid 100008 "idle: cpu5" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f0498 commontssp = 0xffffffff815f0498 rsp0 = 0xffffff8000328b80 gs32p = 0xffffffff815f1ef0 ldt = 0xffffffff815f1f30 tss = 0xffffffff815f1f20 spin locks held: cpuid = 6 dynamic pcpu = 0xffffff807ef31480 curthread = 0xfffffe00502b7000: pid 11 "idle: cpu6" curpcb = 0xffffff800032db80 fpcurthread = none idlethread = 0xfffffe00502b7000: tid 100009 "idle: cpu6" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f0500 commontssp = 0xffffffff815f0500 rsp0 = 0xffffff800032db80 gs32p = 0xffffffff815f1f58 ldt = 0xffffffff815f1f98 tss = 0xffffffff815f1f88 spin locks held: cpuid = 7 dynamic pcpu = 0xffffff807ef38480 curthread = 0xfffffe00502aa920: pid 11 "idle: cpu7" curpcb = 0xffffff8000332b80 fpcurthread = none idlethread = 0xfffffe00502aa920: tid 100010 "idle: cpu7" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f0568 commontssp = 0xffffffff815f0568 rsp0 = 0xffffff8000332b80 gs32p = 0xffffffff815f1fc0 ldt = 0xffffffff815f2000 tss = 0xffffffff815f1ff0 spin locks held: cpuid = 8 dynamic pcpu = 0xffffff807ef3f480 curthread = 0xfffffe00502b9920: pid 11 "idle: cpu8" curpcb = 0xffffff8000337b80 fpcurthread = none idlethread = 0xfffffe00502b9920: tid 100011 "idle: cpu8" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f05d0 commontssp = 0xffffffff815f05d0 rsp0 = 0xffffff8000337b80 gs32p = 0xffffffff815f2028 ldt = 0xffffffff815f2068 tss = 0xffffffff815f2058 spin locks held: cpuid = 9 dynamic pcpu = 0xffffff807ef46480 curthread = 0xfffffe00502b9490: pid 11 "idle: cpu9" curpcb = 0xffffff800033cb80 fpcurthread = none idlethread = 0xfffffe00502b9490: tid 100012 "idle: cpu9" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f0638 commontssp = 0xffffffff815f0638 rsp0 = 0xffffff800033cb80 gs32p = 0xffffffff815f2090 ldt = 0xffffffff815f20d0 tss = 0xffffffff815f20c0 spin locks held: cpuid = 10 dynamic pcpu = 0xffffff807ef4d480 curthread = 0xfffffe00502b9000: pid 11 "idle: cpu10" curpcb = 0xffffff8000341b80 fpcurthread = none idlethread = 0xfffffe00502b9000: tid 100013 "idle: cpu10" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f06a0 commontssp = 0xffffffff815f06a0 rsp0 = 0xffffff8000341b80 gs32p = 0xffffffff815f20f8 ldt = 0xffffffff815f2138 tss = 0xffffffff815f2128 spin locks held: cpuid = 11 dynamic pcpu = 0xffffff807ef54480 curthread = 0xfffffe00502b8920: pid 11 "idle: cpu11" curpcb = 0xffffff8000346b80 fpcurthread = none idlethread = 0xfffffe00502b8920: tid 100014 "idle: cpu11" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f0708 commontssp = 0xffffffff815f0708 rsp0 = 0xffffff8000346b80 gs32p = 0xffffffff815f2160 ldt = 0xffffffff815f21a0 tss = 0xffffffff815f2190 spin locks held: cpuid = 12 dynamic pcpu = 0xffffff807ef5b480 curthread = 0xfffffe00502b8490: pid 11 "idle: cpu12" curpcb = 0xffffff800034bb80 fpcurthread = none idlethread = 0xfffffe00502b8490: tid 100015 "idle: cpu12" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f0770 commontssp = 0xffffffff815f0770 rsp0 = 0xffffff800034bb80 gs32p = 0xffffffff815f21c8 ldt = 0xffffffff815f2208 tss = 0xffffffff815f21f8 spin locks held: cpuid = 13 dynamic pcpu = 0xffffff807ef62480 curthread = 0xfffffe00502bb490: pid 11 "idle: cpu13" curpcb = 0xffffff8000350b80 fpcurthread = none idlethread = 0xfffffe00502bb490: tid 100016 "idle: cpu13" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f07d8 commontssp = 0xffffffff815f07d8 rsp0 = 0xffffff8000350b80 gs32p = 0xffffffff815f2230 ldt = 0xffffffff815f2270 tss = 0xffffffff815f2260 spin locks held: cpuid = 14 dynamic pcpu = 0xffffff807ef69480 curthread = 0xfffffe00502bb000: pid 11 "idle: cpu14" curpcb = 0xffffff8000355b80 fpcurthread = none idlethread = 0xfffffe00502bb000: tid 100017 "idle: cpu14" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f0840 commontssp = 0xffffffff815f0840 rsp0 = 0xffffff8000355b80 gs32p = 0xffffffff815f2298 ldt = 0xffffffff815f22d8 tss = 0xffffffff815f22c8 spin locks held: cpuid = 15 dynamic pcpu = 0xffffff807ef70480 curthread = 0xfffffe00502ba920: pid 11 "idle: cpu15" curpcb = 0xffffff800035ab80 fpcurthread = none idlethread = 0xfffffe00502ba920: tid 100018 "idle: cpu15" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f08a8 commontssp = 0xffffffff815f08a8 rsp0 = 0xffffff800035ab80 gs32p = 0xffffffff815f2300 ldt = 0xffffffff815f2340 tss = 0xffffffff815f2330 spin locks held: cpuid = 16 dynamic pcpu = 0xffffff807ef77480 curthread = 0xfffffe00502ba490: pid 11 "idle: cpu16" curpcb = 0xffffff800035fb80 fpcurthread = none idlethread = 0xfffffe00502ba490: tid 100019 "idle: cpu16" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f0910 commontssp = 0xffffffff815f0910 rsp0 = 0xffffff800035fb80 gs32p = 0xffffffff815f2368 ldt = 0xffffffff815f23a8 tss = 0xffffffff815f2398 spin locks held: cpuid = 17 dynamic pcpu = 0xffffff807ef7e480 curthread = 0xfffffe00502ba000: pid 11 "idle: cpu17" curpcb = 0xffffff8000364b80 fpcurthread = none idlethread = 0xfffffe00502ba000: tid 100020 "idle: cpu17" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f0978 commontssp = 0xffffffff815f0978 rsp0 = 0xffffff8000364b80 gs32p = 0xffffffff815f23d0 ldt = 0xffffffff815f2410 tss = 0xffffffff815f2400 spin locks held: cpuid = 18 dynamic pcpu = 0xffffff807ef85480 curthread = 0xfffffe00502bd000: pid 11 "idle: cpu18" curpcb = 0xffffff8000369b80 fpcurthread = none idlethread = 0xfffffe00502bd000: tid 100021 "idle: cpu18" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f09e0 commontssp = 0xffffffff815f09e0 rsp0 = 0xffffff8000369b80 gs32p = 0xffffffff815f2438 ldt = 0xffffffff815f2478 tss = 0xffffffff815f2468 spin locks held: cpuid = 19 dynamic pcpu = 0xffffff807ef8c480 curthread = 0xfffffe00502bc920: pid 11 "idle: cpu19" curpcb = 0xffffff800036eb80 fpcurthread = none idlethread = 0xfffffe00502bc920: tid 100022 "idle: cpu19" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f0a48 commontssp = 0xffffffff815f0a48 rsp0 = 0xffffff800036eb80 gs32p = 0xffffffff815f24a0 ldt = 0xffffffff815f24e0 tss = 0xffffffff815f24d0 spin locks held: cpuid = 20 dynamic pcpu = 0xffffff807ef93480 curthread = 0xfffffe00502bc490: pid 11 "idle: cpu20" curpcb = 0xffffff8000373b80 fpcurthread = none idlethread = 0xfffffe00502bc490: tid 100023 "idle: cpu20" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f0ab0 commontssp = 0xffffffff815f0ab0 rsp0 = 0xffffff8000373b80 gs32p = 0xffffffff815f2508 ldt = 0xffffffff815f2548 tss = 0xffffffff815f2538 spin locks held: cpuid = 21 dynamic pcpu = 0xffffff807ef9a480 curthread = 0xfffffe00502bc000: pid 11 "idle: cpu21" curpcb = 0xffffff8000378b80 fpcurthread = none idlethread = 0xfffffe00502bc000: tid 100024 "idle: cpu21" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f0b18 commontssp = 0xffffffff815f0b18 rsp0 = 0xffffff8000378b80 gs32p = 0xffffffff815f2570 ldt = 0xffffffff815f25b0 tss = 0xffffffff815f25a0 spin locks held: cpuid = 22 dynamic pcpu = 0xffffff807efa1480 curthread = 0xfffffe00502bb920: pid 11 "idle: cpu22" curpcb = 0xffffff800037db80 fpcurthread = none idlethread = 0xfffffe00502bb920: tid 100025 "idle: cpu22" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f0b80 commontssp = 0xffffffff815f0b80 rsp0 = 0xffffff800037db80 gs32p = 0xffffffff815f25d8 ldt = 0xffffffff815f2618 tss = 0xffffffff815f2608 spin locks held: cpuid = 23 dynamic pcpu = 0xffffff807efa8480 curthread = 0xfffffe00502be920: pid 11 "idle: cpu23" curpcb = 0xffffff8000382b80 fpcurthread = none idlethread = 0xfffffe00502be920: tid 100026 "idle: cpu23" curpmap = 0xffffffff815d94a8 tssp = 0xffffffff815f0be8 commontssp = 0xffffffff815f0be8 rsp0 = 0xffffff8000382b80 gs32p = 0xffffffff815f2640 ldt = 0xffffffff815f2680 tss = 0xffffffff815f2670 spin locks held: db:0:allpcpu> show alllocks Process 1195 (ls) thread 0xfffffe00597e0490 (100144) shared lockmgr ufs (ufs) r = 0 (0xfffffe0059a3ca28) locked @ kern/vfs_lookup.c:517 Process 1191 (mmap4) thread 0xfffffe0089b4f920 (100214) exclusive lockmgr bufwait (bufwait) r = 0 (0xffffff8789f134c8) locked @ kern/vfs_bio.c:2298 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe01380f6548) locked @ vm/vm_object.c:477 Process 1 (init) thread 0xfffffe00502aa000 (100002) exclusive sleep mutex Giant (Giant) r = 0 (0xffffffff815d9928) locked @ dev/usb/usb_transfer.c:3262 db:0:alllocks> show lockedvnods Locked vnodes 0xfffffe0059a3c9c0: tag ufs, type VDIR usecount 3, writecount 0, refcount 6 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xfffffe005988ec30 ref 0 pages 1 lock type ufs: SHARED (count 1) #0 0xffffffff8089e997 at __lockmgr_args+0x10b7 #1 0xffffffff80b0cba2 at ffs_lock+0x92 #2 0xffffffff80d572c5 at VOP_LOCK1_APV+0xf5 #3 0xffffffff80970b66 at _vn_lock+0xc6 #4 0xffffffff80955867 at lookup+0x107 #5 0xffffffff809553f4 at namei+0x484 #6 0xffffffff8096b9e9 at kern_statat_vnhook+0x99 #7 0xffffffff8096bb60 at sys_lstat+0x30 #8 0xffffffff80cac7e2 at amd64_syscall+0x282 #9 0xffffffff80c94fcb at Xfast_syscall+0xfb ino 2, on dev md5a 0xfffffe01380f64e0: tag ufs, type VREG usecount 0, writecount 0, refcount 6 mountedhere 0 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffffe0059aa5c30 ref 0 pages 25608 lock type ufs: EXCL by thread 0xfffffe0089b4f920 (pid 1191, mmap4, tid 100214) with shared waiters pending #0 0xffffffff8089e289 at __lockmgr_args+0x9a9 #1 0xffffffff80b0cba2 at ffs_lock+0x92 #2 0xffffffff80d572c5 at VOP_LOCK1_APV+0xf5 #3 0xffffffff80970b66 at _vn_lock+0xc6 #4 0xffffffff80b398a9 at vm_object_deallocate+0x569 #5 0xffffffff80b30729 at vm_map_process_deferred+0x89 #6 0xffffffff80b349d8 at vm_map_remove+0xc8 #7 0xffffffff80b3056d at vmspace_exit+0xcd #8 0xffffffff8088635e at exit1+0x52e #9 0xffffffff80885e2e at sys_sys_exit+0xe #10 0xffffffff80cac7e2 at amd64_syscall+0x282 #11 0xffffffff80c94fcb at Xfast_syscall+0xfb ino 4, on dev md5a db:0:lockedvnods> show mount 0xfffffe00596a4b58 /dev/da0p2 on / (ufs) 0xfffffe00596a5000 devfs on /dev (devfs) 0xfffffe0059dc03c8 /dev/da0p3 on /tmp (ufs) 0xfffffe0138012790 /dev/md5a on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 1195 1 965 0 D ufs 0xfffffe01380f6548 ls 1191 1 1046 0 DE+ pgrbwt 0xfffffe07d7f77a00 mmap4 1187 0 0 0 DL mdwait 0xfffffe01380c0800 [md5] 17 0 0 0 DL sdflush 0xffffffff81582bfc [softdepflush] 16 0 0 0 DL syncer 0xffffffff8157bf30 [syncer] 9 0 0 0 DL kpsusp 0xfffffe005035e5e0 [vnlru] 8 0 0 0 DL kpsusp 0xfffffe005035ea98 [bufdaemon] 7 0 0 0 DL pgzero 0xffffffff815846fc [pagezero] 6 0 0 0 DL psleep 0xffffffff81583950 [vmdaemon] 5 0 0 0 DL psleep 0xffffffff815f0004 [pagedaemon] 4 0 0 0 DL idle 0xfffffe00502a8970 [enc_daemon0] 3 0 0 0 DL ccb_scan 0xffffffff813589b0 [xpt_thrd] 2 0 0 0 DL waiting_ 0xffffffff815e4068 [sctp_iterator] 15 0 0 0 DL (threaded) [usb] 100119 D - 0xffffff8001160e18 [usbus2] 100118 D - 0xffffff8001160dc0 [usbus2] 100117 D - 0xffffff8001160d68 [usbus2] 100116 D - 0xffffff8001160d10 [usbus2] 100114 D - 0xffffff80011591b0 [usbus1] 100113 D - 0xffffff8001159158 [usbus1] 100112 D - 0xffffff8001159100 [usbus1] 100111 D - 0xffffff80011590a8 [usbus1] 100074 D - 0xffffff8000ea6e18 [usbus0] 100073 D - 0xffffff8000ea6dc0 [usbus0] 100072 D - 0xffffff8000ea6d68 [usbus0] 100071 D - 0xffffff8000ea6d10 [usbus0] 14 0 0 0 DL - 0xffffffff81371ba8 [yarrow] 13 0 0 0 DL (threaded) [geom] 100055 D - 0xffffffff815d8940 [g_down] 100054 D - 0xffffffff815d8938 [g_up] 100053 D - 0xffffffff815d8930 [g_event] 12 0 0 0 RL (threaded) [intr] 100122 I [swi0: uart] 100121 I [irq287: hdac1] 100120 I [irq286: ahci0] 100115 I [irq20: ehci1] 100110 I [irq285: xhci0] 100109 I [irq284: igb1:link] 100107 I [irq283: igb1:que 7] 100105 I [irq282: igb1:que 6] 100103 I [irq281: igb1:que 5] 100101 I [irq280: igb1:que 4] 100099 I [irq279: igb1:que 3] 100097 I [irq278: igb1:que 2] 100095 I [irq277: igb1:que 1] 100093 I [irq276: igb1:que 0] 100092 I [irq275: igb0:link] 100090 I [irq274: igb0:que 7] 100088 I [irq273: igb0:que 6] 100086 I [irq272: igb0:que 5] 100084 I [irq271: igb0:que 4] 100082 I [irq270: igb0:que 3] 100080 I [irq269: igb0:que 2] 100078 I [irq268: igb0:que 1] 100076 I [irq267: igb0:que 0] 100075 I [irq266: hdac0] 100070 I [irq22: ehci0] 100069 I [irq265: isci0] 100068 I [irq264: isci0] 100067 I [swi6: task queue] 100065 I [swi2: cambio] 100061 I [swi5: fast taskq] 100059 I [swi6: Giant taskq] 100052 I [swi1: netisr 0] 100051 I [swi4: clock] 100050 I [swi4: clock] 100049 I [swi4: clock] 100048 I [swi4: clock] 100047 I [swi4: clock] 100046 I [swi4: clock] 100045 I [swi4: clock] 100044 I [swi4: clock] 100043 I [swi4: clock] 100042 I [swi4: clock] 100041 I [swi4: clock] 100040 I [swi4: clock] 100039 I [swi4: clock] 100038 I [swi4: clock] 100037 I [swi4: clock] 100036 I [swi4: clock] 100035 I [swi4: clock] 100034 I [swi4: clock] 100033 I [swi4: clock] 100032 I [swi4: clock] 100031 I [swi4: clock] 100030 I [swi4: clock] 100029 I [swi4: clock] 100028 RunQ [swi4: clock] 100027 I [swi3: vm] 11 0 0 0 RL (threaded) [idle] 100026 Run CPU 23 [idle: cpu23] 100025 Run CPU 22 [idle: cpu22] 100024 Run CPU 21 [idle: cpu21] 100023 Run CPU 20 [idle: cpu20] 100022 Run CPU 19 [idle: cpu19] 100021 Run CPU 18 [idle: cpu18] 100020 Run CPU 17 [idle: cpu17] 100019 Run CPU 16 [idle: cpu16] 100018 Run CPU 15 [idle: cpu15] 100017 Run CPU 14 [idle: cpu14] 100016 Run CPU 13 [idle: cpu13] 100015 Run CPU 12 [idle: cpu12] 100014 Run CPU 11 [idle: cpu11] 100013 Run CPU 10 [idle: cpu10] 100012 Run CPU 9 [idle: cpu9] 100011 Run CPU 8 [idle: cpu8] 100010 Run CPU 7 [idle: cpu7] 100009 Run CPU 6 [idle: cpu6] 100008 Run CPU 5 [idle: cpu5] 100007 Run CPU 4 [idle: cpu4] 100006 Run CPU 3 [idle: cpu3] 100005 Run CPU 2 [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 RLs CPU 0 [init] 10 0 0 0 DL audit_wo 0xffffffff815e77d8 [audit] 0 0 0 0 DLs (threaded) [kernel] 100124 D - 0xffffffff8138d744 [deadlkres] 100123 D - 0xfffffe0058128d00 [mca taskq] 100108 D - 0xfffffe005184b900 [igb1 que] 100106 D - 0xfffffe005184ba00 [igb1 que] 100104 D - 0xfffffe005184bb00 [igb1 que] 100102 D - 0xfffffe005184bc00 [igb1 que] 100100 D - 0xfffffe005184bd00 [igb1 que] 100098 D - 0xfffffe005184be00 [igb1 que] 100096 D - 0xfffffe0051891000 [igb1 que] 100094 D - 0xfffffe0051891100 [igb1 que] 100091 D - 0xfffffe0051891200 [igb0 que] 100089 D - 0xfffffe0051891300 [igb0 que] 100087 D - 0xfffffe0051891400 [igb0 que] 100085 D - 0xfffffe0051891500 [igb0 que] 100083 D - 0xfffffe0051891600 [igb0 que] 100081 D - 0xfffffe0051891700 [igb0 que] 100079 D - 0xfffffe0051891800 [igb0 que] 100077 D - 0xfffffe0051891900 [igb0 que] 100066 D - 0xfffffe0050306700 [kqueue taskq] 100064 D - 0xfffffe0050306800 [acpi_task_2] 100063 D - 0xfffffe0050306800 [acpi_task_1] 100062 D - 0xfffffe0050306800 [acpi_task_0] 100060 D - 0xfffffe0050306a00 [thread taskq] 100058 D - 0xfffffe0050306c00 [ffs_trim taskq] 100056 D - 0xfffffe0050306e00 [firmware taskq] 100000 D sched 0xffffffff815d8a38 [swapper] db:0:ps> allt Tracing command ls pid 1195 tid 100144 td 0xfffffe00597e0490 sched_switch() at sched_switch+0x482/frame 0xffffff8821e42030 mi_switch() at mi_switch+0x179/frame 0xffffff8821e42070 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821e420b0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff8821e420e0 sleeplk() at sleeplk+0x11a/frame 0xffffff8821e42130 __lockmgr_args() at __lockmgr_args+0x698/frame 0xffffff8821e42260 ffs_lock() at ffs_lock+0x92/frame 0xffffff8821e422b0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf5/frame 0xffffff8821e422e0 _vn_lock() at _vn_lock+0xc6/frame 0xffffff8821e42350 vget() at vget+0x70/frame 0xffffff8821e423a0 vfs_hash_get() at vfs_hash_get+0xf5/frame 0xffffff8821e423f0 ffs_vgetf() at ffs_vgetf+0x41/frame 0xffffff8821e42480 ufs_lookup_ino() at ufs_lookup_ino+0xcc8/frame 0xffffff8821e42590 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x108/frame 0xffffff8821e425c0 vfs_cache_lookup() at vfs_cache_lookup+0xcf/frame 0xffffff8821e42610 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x108/frame 0xffffff8821e42640 lookup() at lookup+0x5a0/frame 0xffffff8821e426d0 namei() at namei+0x484/frame 0xffffff8821e42780 kern_statat_vnhook() at kern_statat_vnhook+0x99/frame 0xffffff8821e42900 sys_lstat() at sys_lstat+0x30/frame 0xffffff8821e429a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821e42ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821e42ab0 --- syscall (190, FreeBSD ELF64, sys_lstat), rip = 0x800d94dda, rsp = 0x7fffffffd378, rbp = 0x7fffffffd410 --- Tracing command mmap4 pid 1191 tid 100214 td 0xfffffe0089b4f920 sched_switch() at sched_switch+0x482/frame 0xffffff8821facd20 mi_switch() at mi_switch+0x179/frame 0xffffff8821facd60 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821facda0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff8821facdd0 _sleep() at _sleep+0x33d/frame 0xffffff8821face60 vm_page_busy_sleep() at vm_page_busy_sleep+0xbb/frame 0xffffff8821face90 vm_page_sleep_if_busy() at vm_page_sleep_if_busy+0x14b/frame 0xffffff8821facee0 vm_page_grab() at vm_page_grab+0x167/frame 0xffffff8821facf30 allocbuf() at allocbuf+0x2d6/frame 0xffffff8821facfa0 getblk() at getblk+0x8ba/frame 0xffffff8821fad050 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcd5/frame 0xffffff8821fad210 ffs_write() at ffs_write+0x310/frame 0xffffff8821fad2c0 VOP_WRITE_APV() at VOP_WRITE_APV+0x183/frame 0xffffff8821fad3d0 vnode_pager_generic_putpages() at vnode_pager_generic_putpages+0x270/frame 0xffffff8821fad4a0 VOP_PUTPAGES_APV() at VOP_PUTPAGES_APV+0x10e/frame 0xffffff8821fad4d0 vnode_pager_putpages() at vnode_pager_putpages+0x9d/frame 0xffffff8821fad550 vm_pageout_flush() at vm_pageout_flush+0x119/frame 0xffffff8821fad610 vm_object_page_collect_flush() at vm_object_page_collect_flush+0x1b5/frame 0xffffff8821fad700 vm_object_page_clean() at vm_object_page_clean+0x15e/frame 0xffffff8821fad770 vinactive() at vinactive+0x125/frame 0xffffff8821fad7c0 vputx() at vputx+0x370/frame 0xffffff8821fad820 vm_object_deallocate() at vm_object_deallocate+0x61c/frame 0xffffff8821fad880 vm_map_process_deferred() at vm_map_process_deferred+0x89/frame 0xffffff8821fad8b0 vm_map_remove() at vm_map_remove+0xc8/frame 0xffffff8821fad8e0 vmspace_exit() at vmspace_exit+0xcd/frame 0xffffff8821fad920 exit1() at exit1+0x52e/frame 0xffffff8821fad990 sys_sys_exit() at sys_sys_exit+0xe/frame 0xffffff8821fad9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821fadab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821fadab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8008de52a, rsp = 0x7fffffffd6b8, rbp = 0x7fffffffd6d0 --- Tracing command md5 pid 1187 tid 100247 td 0xfffffe0059da4920 sched_switch() at sched_switch+0x482/frame 0xffffff88220528e0 mi_switch() at mi_switch+0x179/frame 0xffffff8822052920 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8822052960 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff8822052990 _sleep() at _sleep+0x33d/frame 0xffffff8822052a20 md_kthread() at md_kthread+0xd5/frame 0xffffff8822052a70 fork_exit() at fork_exit+0x84/frame 0xffffff8822052ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8822052ab0 --- trap 0, rip = 0, rsp = 0xffffff8822052b70, rbp = 0 --- Tracing command softdepflush pid 17 tid 100134 td 0xfffffe0059114920 sched_switch() at sched_switch+0x482/frame 0xffffff8821c748f0 mi_switch() at mi_switch+0x179/frame 0xffffff8821c74930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821c74970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff8821c749a0 _sleep() at _sleep+0x312/frame 0xffffff8821c74a30 softdep_flush() at softdep_flush+0x20c/frame 0xffffff8821c74a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821c74ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821c74ab0 --- trap 0, rip = 0, rsp = 0xffffff8821c74b70, rbp = 0 --- Tracing command syncer pid 16 tid 100133 td 0xfffffe0059239000 sched_switch() at sched_switch+0x482/frame 0xffffff8821c6f8a0 mi_switch() at mi_switch+0x179/frame 0xffffff8821c6f8e0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821c6f920 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff8821c6f950 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x1fe/frame 0xffffff8821c6f9d0 sched_sync() at sched_sync+0x5cb/frame 0xffffff8821c6fa70 fork_exit() at fork_exit+0x84/frame 0xffffff8821c6fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821c6fab0 --- trap 0, rip = 0, rsp = 0xffffff8821c6fb70, rbp = 0 --- Tracing command vnlru pid 9 tid 100132 td 0xfffffe0059239490 sched_switch() at sched_switch+0x482/frame 0xffffff8821c6a880 mi_switch() at mi_switch+0x179/frame 0xffffff8821c6a8c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821c6a900 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff8821c6a930 _sleep() at _sleep+0x33d/frame 0xffffff8821c6a9c0 kproc_suspend_check() at kproc_suspend_check+0x7c/frame 0xffffff8821c6a9f0 vnlru_proc() at vnlru_proc+0x51/frame 0xffffff8821c6aa70 fork_exit() at fork_exit+0x84/frame 0xffffff8821c6aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821c6aab0 --- trap 0, rip = 0, rsp = 0xffffff8821c6ab70, rbp = 0 --- Tracing command bufdaemon pid 8 tid 100131 td 0xfffffe0059239920 sched_switch() at sched_switch+0x482/frame 0xffffff8821c658d0 mi_switch() at mi_switch+0x179/frame 0xffffff8821c65910 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821c65950 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff8821c65980 _sleep() at _sleep+0x33d/frame 0xffffff8821c65a10 kproc_suspend_check() at kproc_suspend_check+0x7c/frame 0xffffff8821c65a40 buf_daemon() at buf_daemon+0x9a/frame 0xffffff8821c65a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821c65ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821c65ab0 --- trap 0, rip = 0, rsp = 0xffffff8821c65b70, rbp = 0 --- Tracing command pagezero pid 7 tid 100130 td 0xfffffe0058087920 sched_switch() at sched_switch+0x482/frame 0xffffff8821c60900 mi_switch() at mi_switch+0x179/frame 0xffffff8821c60940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821c60980 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff8821c609b0 _sleep() at _sleep+0x312/frame 0xffffff8821c60a40 vm_pagezero() at vm_pagezero+0x88/frame 0xffffff8821c60a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821c60ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821c60ab0 --- trap 0, rip = 0, rsp = 0xffffff8821c60b70, rbp = 0 --- Tracing command vmdaemon pid 6 tid 100129 td 0xfffffe0059113000 sched_switch() at sched_switch+0x482/frame 0xffffff8821c5b8c0 mi_switch() at mi_switch+0x179/frame 0xffffff8821c5b900 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821c5b940 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff8821c5b970 _sleep() at _sleep+0x33d/frame 0xffffff8821c5ba00 vm_daemon() at vm_daemon+0x7e/frame 0xffffff8821c5ba70 fork_exit() at fork_exit+0x84/frame 0xffffff8821c5bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821c5bab0 --- trap 0, rip = 0, rsp = 0xffffff8821c5bb70, rbp = 0 --- Tracing command pagedaemon pid 5 tid 100128 td 0xfffffe0059113490 sched_switch() at sched_switch+0x482/frame 0xffffff8821c56840 mi_switch() at mi_switch+0x179/frame 0xffffff8821c56880 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821c568c0 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff8821c568f0 _sleep() at _sleep+0x312/frame 0xffffff8821c56980 vm_pageout() at vm_pageout+0x24b/frame 0xffffff8821c56a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821c56ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821c56ab0 --- trap 0, rip = 0, rsp = 0xffffff8821c56b70, rbp = 0 --- Tracing command enc_daemon0 pid 4 tid 100127 td 0xfffffe0059113920 sched_switch() at sched_switch+0x482/frame 0xffffff8821c518c0 mi_switch() at mi_switch+0x179/frame 0xffffff8821c51900 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821c51940 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff8821c51970 _sleep() at _sleep+0x33d/frame 0xffffff8821c51a00 enc_daemon() at enc_daemon+0x109/frame 0xffffff8821c51a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821c51ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821c51ab0 --- trap 0, rip = 0, rsp = 0xffffff8821c51b70, rbp = 0 --- Tracing command xpt_thrd pid 3 tid 100126 td 0xfffffe0059114000 sched_switch() at sched_switch+0x482/frame 0xffffff8821a8c900 mi_switch() at mi_switch+0x179/frame 0xffffff8821a8c940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821a8c980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff8821a8c9b0 _sleep() at _sleep+0x33d/frame 0xffffff8821a8ca40 xpt_scanner_thread() at xpt_scanner_thread+0xdc/frame 0xffffff8821a8ca70 fork_exit() at fork_exit+0x84/frame 0xffffff8821a8cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821a8cab0 --- trap 0, rip = 0, rsp = 0xffffff8821a8cb70, rbp = 0 --- Tracing command sctp_iterator pid 2 tid 100125 td 0xfffffe0058083000 sched_switch() at sched_switch+0x482/frame 0xffffff8821a87910 mi_switch() at mi_switch+0x179/frame 0xffffff8821a87950 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821a87990 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff8821a879c0 _sleep() at _sleep+0x33d/frame 0xffffff8821a87a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xffffff8821a87a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821a87ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821a87ab0 --- trap 0, rip = 0, rsp = 0xffffff8821a87b70, rbp = 0 --- Tracing command usb pid 15 tid 100119 td 0xfffffe0051915920 sched_switch() at sched_switch+0x482/frame 0xffffff881f9e4920 mi_switch() at mi_switch+0x179/frame 0xffffff881f9e4960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f9e49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f9e49d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f9e4a40 usb_process() at usb_process+0xd4/frame 0xffffff881f9e4a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f9e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f9e4ab0 --- trap 0, rip = 0, rsp = 0xffffff881f9e4b70, rbp = 0 --- Tracing command usb pid 15 tid 100118 td 0xfffffe005191d000 sched_switch() at sched_switch+0x482/frame 0xffffff881f9df920 mi_switch() at mi_switch+0x179/frame 0xffffff881f9df960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f9df9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f9df9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f9dfa40 usb_process() at usb_process+0xd4/frame 0xffffff881f9dfa70 fork_exit() at fork_exit+0x84/frame 0xffffff881f9dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f9dfab0 --- trap 0, rip = 0, rsp = 0xffffff881f9dfb70, rbp = 0 --- Tracing command usb pid 15 tid 100117 td 0xfffffe005191d490 sched_switch() at sched_switch+0x482/frame 0xffffff881f9da920 mi_switch() at mi_switch+0x179/frame 0xffffff881f9da960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f9da9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f9da9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f9daa40 usb_process() at usb_process+0xd4/frame 0xffffff881f9daa70 fork_exit() at fork_exit+0x84/frame 0xffffff881f9daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f9daab0 --- trap 0, rip = 0, rsp = 0xffffff881f9dab70, rbp = 0 --- Tracing command usb pid 15 tid 100116 td 0xfffffe005191d920 sched_switch() at sched_switch+0x482/frame 0xffffff881f9d5920 mi_switch() at mi_switch+0x179/frame 0xffffff881f9d5960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f9d59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f9d59d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f9d5a40 usb_process() at usb_process+0xd4/frame 0xffffff881f9d5a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f9d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f9d5ab0 --- trap 0, rip = 0, rsp = 0xffffff881f9d5b70, rbp = 0 --- Tracing command usb pid 15 tid 100114 td 0xfffffe0051914000 sched_switch() at sched_switch+0x482/frame 0xffffff881f848920 mi_switch() at mi_switch+0x179/frame 0xffffff881f848960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f8489a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f8489d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f848a40 usb_process() at usb_process+0xd4/frame 0xffffff881f848a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f848ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f848ab0 --- trap 0, rip = 0, rsp = 0xffffff881f848b70, rbp = 0 --- Tracing command usb pid 15 tid 100113 td 0xfffffe0051914490 sched_switch() at sched_switch+0x482/frame 0xffffff881f843920 mi_switch() at mi_switch+0x179/frame 0xffffff881f843960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f8439a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f8439d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f843a40 usb_process() at usb_process+0xd4/frame 0xffffff881f843a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f843ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f843ab0 --- trap 0, rip = 0, rsp = 0xffffff881f843b70, rbp = 0 --- Tracing command usb pid 15 tid 100112 td 0xfffffe0051914920 sched_switch() at sched_switch+0x482/frame 0xffffff881f83e920 mi_switch() at mi_switch+0x179/frame 0xffffff881f83e960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f83e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f83e9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f83ea40 usb_process() at usb_process+0xd4/frame 0xffffff881f83ea70 fork_exit() at fork_exit+0x84/frame 0xffffff881f83eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f83eab0 --- trap 0, rip = 0, rsp = 0xffffff881f83eb70, rbp = 0 --- Tracing command usb pid 15 tid 100111 td 0xfffffe0051915000 sched_switch() at sched_switch+0x482/frame 0xffffff881f839920 mi_switch() at mi_switch+0x179/frame 0xffffff881f839960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f8399a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f8399d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f839a40 usb_process() at usb_process+0xd4/frame 0xffffff881f839a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f839ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f839ab0 --- trap 0, rip = 0, rsp = 0xffffff881f839b70, rbp = 0 --- Tracing command usb pid 15 tid 100074 td 0xfffffe0050496920 sched_switch() at sched_switch+0x482/frame 0xffffff881f6d4920 mi_switch() at mi_switch+0x179/frame 0xffffff881f6d4960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f6d49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f6d49d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f6d4a40 usb_process() at usb_process+0xd4/frame 0xffffff881f6d4a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f6d4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f6d4ab0 --- trap 0, rip = 0, rsp = 0xffffff881f6d4b70, rbp = 0 --- Tracing command usb pid 15 tid 100073 td 0xfffffe00518c5000 sched_switch() at sched_switch+0x482/frame 0xffffff881f6cf920 mi_switch() at mi_switch+0x179/frame 0xffffff881f6cf960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f6cf9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f6cf9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f6cfa40 usb_process() at usb_process+0xd4/frame 0xffffff881f6cfa70 fork_exit() at fork_exit+0x84/frame 0xffffff881f6cfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f6cfab0 --- trap 0, rip = 0, rsp = 0xffffff881f6cfb70, rbp = 0 --- Tracing command usb pid 15 tid 100072 td 0xfffffe00518c5490 sched_switch() at sched_switch+0x482/frame 0xffffff881f6ca920 mi_switch() at mi_switch+0x179/frame 0xffffff881f6ca960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f6ca9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f6ca9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f6caa40 usb_process() at usb_process+0xd4/frame 0xffffff881f6caa70 fork_exit() at fork_exit+0x84/frame 0xffffff881f6caab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f6caab0 --- trap 0, rip = 0, rsp = 0xffffff881f6cab70, rbp = 0 --- Tracing command usb pid 15 tid 100071 td 0xfffffe00518c5920 sched_switch() at sched_switch+0x482/frame 0xffffff881f6c5920 mi_switch() at mi_switch+0x179/frame 0xffffff881f6c5960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f6c59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f6c59d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f6c5a40 usb_process() at usb_process+0xd4/frame 0xffffff881f6c5a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f6c5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f6c5ab0 --- trap 0, rip = 0, rsp = 0xffffff881f6c5b70, rbp = 0 --- Tracing command yarrow pid 14 tid 100057 td 0xfffffe005030c490 sched_switch() at sched_switch+0x482/frame 0xffffff878ea3f8f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ea3f930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea3f970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff878ea3f9a0 msleep_spin_sbt() at msleep_spin_sbt+0x1f0/frame 0xffffff878ea3fa30 random_kthread() at random_kthread+0x68/frame 0xffffff878ea3fa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea3fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea3fab0 --- trap 0, rip = 0, rsp = 0xffffff878ea3fb70, rbp = 0 --- Tracing command geom pid 13 tid 100055 td 0xfffffe00502f1920 sched_switch() at sched_switch+0x482/frame 0xffffff878ea358d0 mi_switch() at mi_switch+0x179/frame 0xffffff878ea35910 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea35950 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea35980 _sleep() at _sleep+0x33d/frame 0xffffff878ea35a10 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xffffff878ea35a60 g_down_procbody() at g_down_procbody+0x7d/frame 0xffffff878ea35a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea35ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea35ab0 --- trap 0, rip = 0, rsp = 0xffffff878ea35b70, rbp = 0 --- Tracing command geom pid 13 tid 100054 td 0xfffffe00502f2000 sched_switch() at sched_switch+0x482/frame 0xffffff878ea308f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ea30930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea30970 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea309a0 _sleep() at _sleep+0x33d/frame 0xffffff878ea30a30 g_io_schedule_up() at g_io_schedule_up+0xbc/frame 0xffffff878ea30a60 g_up_procbody() at g_up_procbody+0x7d/frame 0xffffff878ea30a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea30ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea30ab0 --- trap 0, rip = 0, rsp = 0xffffff878ea30b70, rbp = 0 --- Tracing command geom pid 13 tid 100053 td 0xfffffe00502f2490 sched_switch() at sched_switch+0x482/frame 0xffffff878ea2b8f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ea2b930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea2b970 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea2b9a0 _sleep() at _sleep+0x33d/frame 0xffffff878ea2ba30 g_run_events() at g_run_events+0x4f4/frame 0xffffff878ea2ba70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea2bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea2bab0 --- trap 0, rip = 0, rsp = 0xffffff878ea2bb70, rbp = 0 --- Tracing command intr pid 12 tid 100122 td 0xfffffe0058087000 sched_switch() at sched_switch+0x482/frame 0xffffff8821a739f0 mi_switch() at mi_switch+0x179/frame 0xffffff8821a73a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff8821a73a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821a73ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821a73ab0 --- trap 0, rip = 0, rsp = 0xffffff8821a73b70, rbp = 0 --- Tracing command intr pid 12 tid 100121 td 0xfffffe0058087490 sched_switch() at sched_switch+0x482/frame 0xffffff8821a6b9f0 mi_switch() at mi_switch+0x179/frame 0xffffff8821a6ba30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff8821a6ba70 fork_exit() at fork_exit+0x84/frame 0xffffff8821a6bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821a6bab0 --- trap 0, rip = 0, rsp = 0xffffff8821a6bb70, rbp = 0 --- Tracing command intr pid 12 tid 100120 td 0xfffffe0051915490 sched_switch() at sched_switch+0x482/frame 0xffffff881f9e99f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f9e9a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f9e9a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f9e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f9e9ab0 --- trap 0, rip = 0, rsp = 0xffffff881f9e9b70, rbp = 0 --- Tracing command intr pid 12 tid 100115 td 0xfffffe0051909920 sched_switch() at sched_switch+0x482/frame 0xffffff881f9d09f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f9d0a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f9d0a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f9d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f9d0ab0 --- trap 0, rip = 0, rsp = 0xffffff881f9d0b70, rbp = 0 --- Tracing command intr pid 12 tid 100110 td 0xfffffe0051908000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100109 td 0xfffffe0051908490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100107 td 0xfffffe0051909000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100105 td 0xfffffe0051906490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100103 td 0xfffffe0051907000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100101 td 0xfffffe0051907920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100099 td 0xfffffe0051901000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100097 td 0xfffffe0051901920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100095 td 0xfffffe00518e8000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100093 td 0xfffffe00518e8920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100092 td 0xfffffe00518e9000 sched_switch() at sched_switch+0x482/frame 0xffffff881f7789f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f778a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f778a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f778ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f778ab0 --- trap 0, rip = 0, rsp = 0xffffff881f778b70, rbp = 0 --- Tracing command intr pid 12 tid 100090 td 0xfffffe00518e6490 sched_switch() at sched_switch+0x482/frame 0xffffff881f76e9f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f76ea30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f76ea70 fork_exit() at fork_exit+0x84/frame 0xffffff881f76eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f76eab0 --- trap 0, rip = 0, rsp = 0xffffff881f76eb70, rbp = 0 --- Tracing command intr pid 12 tid 100088 td 0xfffffe00518e7000 sched_switch() at sched_switch+0x482/frame 0xffffff881f7649f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f764a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f764a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f764ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f764ab0 --- trap 0, rip = 0, rsp = 0xffffff881f764b70, rbp = 0 --- Tracing command intr pid 12 tid 100086 td 0xfffffe00518e7920 sched_switch() at sched_switch+0x482/frame 0xffffff881f75a9f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f75aa30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f75aa70 fork_exit() at fork_exit+0x84/frame 0xffffff881f75aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f75aab0 --- trap 0, rip = 0, rsp = 0xffffff881f75ab70, rbp = 0 --- Tracing command intr pid 12 tid 100084 td 0xfffffe00518e5000 sched_switch() at sched_switch+0x482/frame 0xffffff881f7509f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f750a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f750a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f750ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f750ab0 --- trap 0, rip = 0, rsp = 0xffffff881f750b70, rbp = 0 --- Tracing command intr pid 12 tid 100082 td 0xfffffe00518e5920 sched_switch() at sched_switch+0x482/frame 0xffffff881f7469f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f746a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f746a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f746ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f746ab0 --- trap 0, rip = 0, rsp = 0xffffff881f746b70, rbp = 0 --- Tracing command intr pid 12 tid 100080 td 0xfffffe00518e3000 sched_switch() at sched_switch+0x482/frame 0xffffff881f73c9f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f73ca30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f73ca70 fork_exit() at fork_exit+0x84/frame 0xffffff881f73cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f73cab0 --- trap 0, rip = 0, rsp = 0xffffff881f73cb70, rbp = 0 --- Tracing command intr pid 12 tid 100078 td 0xfffffe00518e3920 sched_switch() at sched_switch+0x482/frame 0xffffff881f7329f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f732a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f732a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f732ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f732ab0 --- trap 0, rip = 0, rsp = 0xffffff881f732b70, rbp = 0 --- Tracing command intr pid 12 tid 100076 td 0xfffffe00518e4490 sched_switch() at sched_switch+0x482/frame 0xffffff881f7289f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f728a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f728a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f728ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f728ab0 --- trap 0, rip = 0, rsp = 0xffffff881f728b70, rbp = 0 --- Tracing command intr pid 12 tid 100075 td 0xfffffe0050496490 sched_switch() at sched_switch+0x482/frame 0xffffff881f6d99f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f6d9a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f6d9a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f6d9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f6d9ab0 --- trap 0, rip = 0, rsp = 0xffffff881f6d9b70, rbp = 0 --- Tracing command intr pid 12 tid 100070 td 0xfffffe0050489920 sched_switch() at sched_switch+0x482/frame 0xffffff881f6c09f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f6c0a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f6c0a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f6c0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f6c0ab0 --- trap 0, rip = 0, rsp = 0xffffff881f6c0b70, rbp = 0 --- Tracing command intr pid 12 tid 100069 td 0xfffffe0050495000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100068 td 0xfffffe0050495490 sched_switch() at sched_switch+0x482/frame 0xffffff878eb869f0 mi_switch() at mi_switch+0x179/frame 0xffffff878eb86a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878eb86a70 fork_exit() at fork_exit+0x84/frame 0xffffff878eb86ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878eb86ab0 --- trap 0, rip = 0, rsp = 0xffffff878eb86b70, rbp = 0 --- Tracing command intr pid 12 tid 100067 td 0xfffffe0050495920 sched_switch() at sched_switch+0x482/frame 0xffffff878ea729f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ea72a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878ea72a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea72ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea72ab0 --- trap 0, rip = 0, rsp = 0xffffff878ea72b70, rbp = 0 --- Tracing command intr pid 12 tid 100065 td 0xfffffe0050485000 sched_switch() at sched_switch+0x482/frame 0xffffff878ea689f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ea68a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878ea68a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea68ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea68ab0 --- trap 0, rip = 0, rsp = 0xffffff878ea68b70, rbp = 0 --- Tracing command intr pid 12 tid 100061 td 0xfffffe0050489490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffffe00502f3920 sched_switch() at sched_switch+0x482/frame 0xffffff878ea4a9f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ea4aa30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878ea4aa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea4aab0 --- trap 0, rip = 0, rsp = 0xffffff878ea4ab70, rbp = 0 --- Tracing command intr pid 12 tid 100052 td 0xfffffe00502f2920 sched_switch() at sched_switch+0x482/frame 0xffffff878ea269f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ea26a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878ea26a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea26ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea26ab0 --- trap 0, rip = 0, rsp = 0xffffff878ea26b70, rbp = 0 --- Tracing command intr pid 12 tid 100051 td 0xfffffe00502f3000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffffe00502f0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffffe00502f0490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffffe00502f0920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffffe00502f1000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100046 td 0xfffffe00502f1490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffffe00502ea490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100044 td 0xfffffe00502ea920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100043 td 0xfffffe00502ef000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xfffffe00502ef490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xfffffe00502ef920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100040 td 0xfffffe00502e3920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100039 td 0xfffffe00502e9000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100038 td 0xfffffe00502e9490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100037 td 0xfffffe00502e9920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100036 td 0xfffffe00502ea000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100035 td 0xfffffe00502e2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100034 td 0xfffffe00502e2490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100033 td 0xfffffe00502e2920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100032 td 0xfffffe00502e3000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100031 td 0xfffffe00502e3490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100030 td 0xfffffe00502bd490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100029 td 0xfffffe00502bd920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100028 td 0xfffffe00502be000 sched_switch() at sched_switch+0x482/frame 0xffffff800038c7c0 mi_switch() at mi_switch+0x179/frame 0xffffff800038c800 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff800038c850 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff800038c8d0 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff800038c910 softclock_call_cc() at softclock_call_cc+0xef/frame 0xffffff800038c9d0 softclock() at softclock+0x47/frame 0xffffff800038c9f0 intr_event_execute_handlers() at intr_event_execute_handlers+0x93/frame 0xffffff800038ca30 ithread_loop() at ithread_loop+0xa6/frame 0xffffff800038ca70 fork_exit() at fork_exit+0x84/frame 0xffffff800038cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800038cab0 --- trap 0, rip = 0, rsp = 0xffffff800038cb70, rbp = 0 --- Tracing command intr pid 12 tid 100027 td 0xfffffe00502be490 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100026 td 0xfffffe00502be920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002fece0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002fed00 trap() at trap+0x42/frame 0xffffff80002fef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002fef20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff80002fefe0, rbp = 0xffffff8000382930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000382930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000382980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003829a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003829c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000382a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000382ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000382ab0 --- trap 0, rip = 0, rsp = 0xffffff8000382b70, rbp = 0 --- Tracing command idle pid 11 tid 100025 td 0xfffffe00502bb920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002f7ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002f7d00 trap() at trap+0x42/frame 0xffffff80002f7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002f7f20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff80002f7fe0, rbp = 0xffffff800037d930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800037d930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff800037d980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff800037d9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff800037d9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800037da70 fork_exit() at fork_exit+0x84/frame 0xffffff800037dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800037dab0 --- trap 0, rip = 0, rsp = 0xffffff800037db70, rbp = 0 --- Tracing command idle pid 11 tid 100024 td 0xfffffe00502bc000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002f0ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002f0d00 trap() at trap+0x42/frame 0xffffff80002f0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002f0f20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff80002f0fe0, rbp = 0xffffff8000378930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000378930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000378980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003789a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003789c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000378a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000378ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000378ab0 --- trap 0, rip = 0, rsp = 0xffffff8000378b70, rbp = 0 --- Tracing command idle pid 11 tid 100023 td 0xfffffe00502bc490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002e9ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002e9d00 trap() at trap+0x42/frame 0xffffff80002e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002e9f20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff80002e9fe0, rbp = 0xffffff8000373930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000373930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000373980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003739a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003739c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000373a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000373ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000373ab0 --- trap 0, rip = 0, rsp = 0xffffff8000373b70, rbp = 0 --- Tracing command idle pid 11 tid 100022 td 0xfffffe00502bc920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002e2ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002e2d00 trap() at trap+0x42/frame 0xffffff80002e2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002e2f20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff80002e2fe0, rbp = 0xffffff800036e930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800036e930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff800036e980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff800036e9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff800036e9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800036ea70 fork_exit() at fork_exit+0x84/frame 0xffffff800036eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800036eab0 --- trap 0, rip = 0, rsp = 0xffffff800036eb70, rbp = 0 --- Tracing command idle pid 11 tid 100021 td 0xfffffe00502bd000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002dbce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002dbd00 trap() at trap+0x42/frame 0xffffff80002dbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002dbf20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff80002dbfe0, rbp = 0xffffff8000369930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000369930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000369980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003699a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003699c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000369a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000369ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000369ab0 --- trap 0, rip = 0, rsp = 0xffffff8000369b70, rbp = 0 --- Tracing command idle pid 11 tid 100020 td 0xfffffe00502ba000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002d4ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002d4d00 trap() at trap+0x42/frame 0xffffff80002d4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002d4f20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff80002d4fe0, rbp = 0xffffff8000364930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000364930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000364980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003649a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003649c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000364a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000364ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000364ab0 --- trap 0, rip = 0, rsp = 0xffffff8000364b70, rbp = 0 --- Tracing command idle pid 11 tid 100019 td 0xfffffe00502ba490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002cdce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002cdd00 trap() at trap+0x42/frame 0xffffff80002cdf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002cdf20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff80002cdfe0, rbp = 0xffffff800035f930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800035f930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff800035f980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff800035f9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff800035f9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800035fa70 fork_exit() at fork_exit+0x84/frame 0xffffff800035fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800035fab0 --- trap 0, rip = 0, rsp = 0xffffff800035fb70, rbp = 0 --- Tracing command idle pid 11 tid 100018 td 0xfffffe00502ba920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002c6ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002c6d00 trap() at trap+0x42/frame 0xffffff80002c6f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002c6f20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff80002c6fe0, rbp = 0xffffff800035a930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800035a930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff800035a980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff800035a9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff800035a9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800035aa70 fork_exit() at fork_exit+0x84/frame 0xffffff800035aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800035aab0 --- trap 0, rip = 0, rsp = 0xffffff800035ab70, rbp = 0 --- Tracing command idle pid 11 tid 100017 td 0xfffffe00502bb000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002bfce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002bfd00 trap() at trap+0x42/frame 0xffffff80002bff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002bff20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff80002bffe0, rbp = 0xffffff8000355930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000355930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000355980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003559a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003559c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000355a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000355ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000355ab0 --- trap 0, rip = 0, rsp = 0xffffff8000355b70, rbp = 0 --- Tracing command idle pid 11 tid 100016 td 0xfffffe00502bb490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002b8ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002b8d00 trap() at trap+0x42/frame 0xffffff80002b8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002b8f20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff80002b8fe0, rbp = 0xffffff8000350930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000350930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000350980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003509a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003509c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000350a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000350ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000350ab0 --- trap 0, rip = 0, rsp = 0xffffff8000350b70, rbp = 0 --- Tracing command idle pid 11 tid 100015 td 0xfffffe00502b8490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002b1ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002b1d00 trap() at trap+0x42/frame 0xffffff80002b1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002b1f20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff80002b1fe0, rbp = 0xffffff800034b930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800034b930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff800034b980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff800034b9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff800034b9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800034ba70 fork_exit() at fork_exit+0x84/frame 0xffffff800034bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800034bab0 --- trap 0, rip = 0, rsp = 0xffffff800034bb70, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00502b8920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002aace0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002aad00 trap() at trap+0x42/frame 0xffffff80002aaf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002aaf20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff80002aafe0, rbp = 0xffffff8000346930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000346930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000346980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003469a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003469c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000346a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000346ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000346ab0 --- trap 0, rip = 0, rsp = 0xffffff8000346b70, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00502b9000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002a3ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002a3d00 trap() at trap+0x42/frame 0xffffff80002a3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002a3f20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff80002a3fe0, rbp = 0xffffff8000341930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000341930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000341980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003419a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003419c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000341a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000341ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000341ab0 --- trap 0, rip = 0, rsp = 0xffffff8000341b70, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe00502b9490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff800029cce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff800029cd00 trap() at trap+0x42/frame 0xffffff800029cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff800029cf20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff800029cfe0, rbp = 0xffffff800033c930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800033c930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff800033c980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff800033c9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff800033c9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800033ca70 fork_exit() at fork_exit+0x84/frame 0xffffff800033cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800033cab0 --- trap 0, rip = 0, rsp = 0xffffff800033cb70, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe00502b9920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000295ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000295d00 trap() at trap+0x42/frame 0xffffff8000295f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000295f20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff8000295fe0, rbp = 0xffffff8000337930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000337930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000337980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003379a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003379c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000337a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000337ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000337ab0 --- trap 0, rip = 0, rsp = 0xffffff8000337b70, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe00502aa920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff800028ece0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff800028ed00 trap() at trap+0x42/frame 0xffffff800028ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff800028ef20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff800028efe0, rbp = 0xffffff8000332930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000332930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000332980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003329a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003329c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000332a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000332ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000332ab0 --- trap 0, rip = 0, rsp = 0xffffff8000332b70, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe00502b7000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000287ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000287d00 trap() at trap+0x42/frame 0xffffff8000287f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000287f20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff8000287fe0, rbp = 0xffffff800032d930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800032d930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff800032d980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff800032d9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff800032d9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800032da70 fork_exit() at fork_exit+0x84/frame 0xffffff800032dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800032dab0 --- trap 0, rip = 0, rsp = 0xffffff800032db70, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe00502b7490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000280ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000280d00 trap() at trap+0x42/frame 0xffffff8000280f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000280f20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff8000280fe0, rbp = 0xffffff8000328930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000328930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000328980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003289a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003289c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000328a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000328ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000328ab0 --- trap 0, rip = 0, rsp = 0xffffff8000328b70, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00502b7920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000279ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000279d00 trap() at trap+0x42/frame 0xffffff8000279f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000279f20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff8000279fe0, rbp = 0xffffff8000323930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000323930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000323980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003239a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003239c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000323a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000323ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000323ab0 --- trap 0, rip = 0, rsp = 0xffffff8000323b70, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe00502b8000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000272ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000272d00 trap() at trap+0x42/frame 0xffffff8000272f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000272f20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff8000272fe0, rbp = 0xffffff800031e930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800031e930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff800031e980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff800031e9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff800031e9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800031ea70 fork_exit() at fork_exit+0x84/frame 0xffffff800031eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800031eab0 --- trap 0, rip = 0, rsp = 0xffffff800031eb70, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe00502a9000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff800026bce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff800026bd00 trap() at trap+0x42/frame 0xffffff800026bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff800026bf20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff800026bfe0, rbp = 0xffffff8000319930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000319930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000319980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003199a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003199c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000319a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000319ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000319ab0 --- trap 0, rip = 0, rsp = 0xffffff8000319b70, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe00502a9490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000264ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000264d00 trap() at trap+0x42/frame 0xffffff8000264f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000264f20 --- trap 0x13, rip = 0xffffffff80c8fe56, rsp = 0xffffff8000264fe0, rbp = 0xffffff8000314930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000314930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000314980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003149a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003149c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000314a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000314ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000314ab0 --- trap 0, rip = 0, rsp = 0xffffff8000314b70, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe00502a9920 sched_switch() at sched_switch+0x482/frame 0xffffff800030f960 mi_switch() at mi_switch+0x179/frame 0xffffff800030f9a0 critical_exit() at critical_exit+0x8b/frame 0xffffff800030f9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800030fa70 fork_exit() at fork_exit+0x84/frame 0xffffff800030fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800030fab0 --- trap 0, rip = 0, rsp = 0xffffff800030fb70, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe00502aa000 lockmgr_printinfo() at lockmgr_printinfo+0x55/frame 0xffffff800030a890 kern_reboot() at kern_reboot+0x6f6/frame 0xffffff800030a970 sys_reboot() at sys_reboot+0x80/frame 0xffffff800030a9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff800030aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff800030aab0 --- syscall (55, FreeBSD ELF64, sys_reboot), rip = 0x40ecdc, rsp = 0x7fffffffd6d8, rbp = 0x7fffffffd7c0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe00502aa490 sched_switch() at sched_switch+0x482/frame 0xffffff80003058f0 mi_switch() at mi_switch+0x179/frame 0xffffff8000305930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8000305970 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003059a0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff8000305a10 audit_worker() at audit_worker+0xa3/frame 0xffffff8000305a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000305ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000305ab0 --- trap 0, rip = 0, rsp = 0xffffff8000305b70, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffffe0058083490 sched_switch() at sched_switch+0x482/frame 0xffffff8821a81890 mi_switch() at mi_switch+0x179/frame 0xffffff8821a818d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821a81910 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff8821a81940 _sleep() at _sleep+0x312/frame 0xffffff8821a819d0 pause_sbt() at pause_sbt+0x70/frame 0xffffff8821a81a20 deadlkres() at deadlkres+0x66/frame 0xffffff8821a81a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821a81ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821a81ab0 --- trap 0, rip = 0, rsp = 0xffffff8821a81b70, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffffe0058083920 sched_switch() at sched_switch+0x482/frame 0xffffff8821a7c900 mi_switch() at mi_switch+0x179/frame 0xffffff8821a7c940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821a7c980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff8821a7c9b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff8821a7ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff8821a7ca70 fork_exit() at fork_exit+0x84/frame 0xffffff8821a7cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821a7cab0 --- trap 0, rip = 0, rsp = 0xffffff8821a7cb70, rbp = 0 --- Tracing command kernel pid 0 tid 100108 td 0xfffffe0051908920 sched_switch() at sched_switch+0x482/frame 0xffffff881f808900 mi_switch() at mi_switch+0x179/frame 0xffffff881f808940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f808980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f8089b0 _sleep() at _sleep+0x33d/frame 0xffffff881f808a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f808a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f808ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f808ab0 --- trap 0, rip = 0, rsp = 0xffffff881f808b70, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffffe0051909490 sched_switch() at sched_switch+0x482/frame 0xffffff881f7fe900 mi_switch() at mi_switch+0x179/frame 0xffffff881f7fe940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f7fe980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7fe9b0 _sleep() at _sleep+0x33d/frame 0xffffff881f7fea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f7fea70 fork_exit() at fork_exit+0x84/frame 0xffffff881f7feab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f7feab0 --- trap 0, rip = 0, rsp = 0xffffff881f7feb70, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffffe0051906920 sched_switch() at sched_switch+0x482/frame 0xffffff881f7f4900 mi_switch() at mi_switch+0x179/frame 0xffffff881f7f4940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f7f4980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7f49b0 _sleep() at _sleep+0x33d/frame 0xffffff881f7f4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f7f4a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f7f4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f7f4ab0 --- trap 0, rip = 0, rsp = 0xffffff881f7f4b70, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffffe0051907490 sched_switch() at sched_switch+0x482/frame 0xffffff881f7ea900 mi_switch() at mi_switch+0x179/frame 0xffffff881f7ea940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f7ea980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7ea9b0 _sleep() at _sleep+0x33d/frame 0xffffff881f7eaa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f7eaa70 fork_exit() at fork_exit+0x84/frame 0xffffff881f7eaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f7eaab0 --- trap 0, rip = 0, rsp = 0xffffff881f7eab70, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffffe00518e9920 sched_switch() at sched_switch+0x482/frame 0xffffff881f7e0900 mi_switch() at mi_switch+0x179/frame 0xffffff881f7e0940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f7e0980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7e09b0 _sleep() at _sleep+0x33d/frame 0xffffff881f7e0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f7e0a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f7e0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f7e0ab0 --- trap 0, rip = 0, rsp = 0xffffff881f7e0b70, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffffe0051901490 sched_switch() at sched_switch+0x482/frame 0xffffff881f7d6900 mi_switch() at mi_switch+0x179/frame 0xffffff881f7d6940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f7d6980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7d69b0 _sleep() at _sleep+0x33d/frame 0xffffff881f7d6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f7d6a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f7d6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f7d6ab0 --- trap 0, rip = 0, rsp = 0xffffff881f7d6b70, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffffe0051906000 sched_switch() at sched_switch+0x482/frame 0xffffff881f7cc900 mi_switch() at mi_switch+0x179/frame 0xffffff881f7cc940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f7cc980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7cc9b0 _sleep() at _sleep+0x33d/frame 0xffffff881f7cca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f7cca70 fork_exit() at fork_exit+0x84/frame 0xffffff881f7ccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f7ccab0 --- trap 0, rip = 0, rsp = 0xffffff881f7ccb70, rbp = 0 --- Tracing command kernel pid 0 tid 100094 td 0xfffffe00518e8490 sched_switch() at sched_switch+0x482/frame 0xffffff881f7c2900 mi_switch() at mi_switch+0x179/frame 0xffffff881f7c2940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f7c2980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7c29b0 _sleep() at _sleep+0x33d/frame 0xffffff881f7c2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f7c2a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f7c2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f7c2ab0 --- trap 0, rip = 0, rsp = 0xffffff881f7c2b70, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffffe00518e9490 sched_switch() at sched_switch+0x482/frame 0xffffff881f773900 mi_switch() at mi_switch+0x179/frame 0xffffff881f773940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f773980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7739b0 _sleep() at _sleep+0x33d/frame 0xffffff881f773a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f773a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f773ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f773ab0 --- trap 0, rip = 0, rsp = 0xffffff881f773b70, rbp = 0 --- Tracing command kernel pid 0 tid 100089 td 0xfffffe00518e6920 sched_switch() at sched_switch+0x482/frame 0xffffff881f769900 mi_switch() at mi_switch+0x179/frame 0xffffff881f769940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f769980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7699b0 _sleep() at _sleep+0x33d/frame 0xffffff881f769a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f769a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f769ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f769ab0 --- trap 0, rip = 0, rsp = 0xffffff881f769b70, rbp = 0 --- Tracing command kernel pid 0 tid 100087 td 0xfffffe00518e7490 sched_switch() at sched_switch+0x482/frame 0xffffff881f75f900 mi_switch() at mi_switch+0x179/frame 0xffffff881f75f940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f75f980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f75f9b0 _sleep() at _sleep+0x33d/frame 0xffffff881f75fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f75fa70 fork_exit() at fork_exit+0x84/frame 0xffffff881f75fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f75fab0 --- trap 0, rip = 0, rsp = 0xffffff881f75fb70, rbp = 0 --- Tracing command kernel pid 0 tid 100085 td 0xfffffe00518e4920 sched_switch() at sched_switch+0x482/frame 0xffffff881f755900 mi_switch() at mi_switch+0x179/frame 0xffffff881f755940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f755980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7559b0 _sleep() at _sleep+0x33d/frame 0xffffff881f755a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f755a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f755ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f755ab0 --- trap 0, rip = 0, rsp = 0xffffff881f755b70, rbp = 0 --- Tracing command kernel pid 0 tid 100083 td 0xfffffe00518e5490 sched_switch() at sched_switch+0x482/frame 0xffffff881f74b900 mi_switch() at mi_switch+0x179/frame 0xffffff881f74b940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f74b980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f74b9b0 _sleep() at _sleep+0x33d/frame 0xffffff881f74ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f74ba70 fork_exit() at fork_exit+0x84/frame 0xffffff881f74bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f74bab0 --- trap 0, rip = 0, rsp = 0xffffff881f74bb70, rbp = 0 --- Tracing command kernel pid 0 tid 100081 td 0xfffffe00518e6000 sched_switch() at sched_switch+0x482/frame 0xffffff881f741900 mi_switch() at mi_switch+0x179/frame 0xffffff881f741940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f741980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7419b0 _sleep() at _sleep+0x33d/frame 0xffffff881f741a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f741a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f741ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f741ab0 --- trap 0, rip = 0, rsp = 0xffffff881f741b70, rbp = 0 --- Tracing command kernel pid 0 tid 100079 td 0xfffffe00518e3490 sched_switch() at sched_switch+0x482/frame 0xffffff881f737900 mi_switch() at mi_switch+0x179/frame 0xffffff881f737940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f737980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7379b0 _sleep() at _sleep+0x33d/frame 0xffffff881f737a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f737a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f737ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f737ab0 --- trap 0, rip = 0, rsp = 0xffffff881f737b70, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffffe00518e4000 sched_switch() at sched_switch+0x482/frame 0xffffff881f72d900 mi_switch() at mi_switch+0x179/frame 0xffffff881f72d940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f72d980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f72d9b0 _sleep() at _sleep+0x33d/frame 0xffffff881f72da40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f72da70 fork_exit() at fork_exit+0x84/frame 0xffffff881f72dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f72dab0 --- trap 0, rip = 0, rsp = 0xffffff881f72db70, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe0050496000 sched_switch() at sched_switch+0x482/frame 0xffffff878ea6d900 mi_switch() at mi_switch+0x179/frame 0xffffff878ea6d940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea6d980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea6d9b0 _sleep() at _sleep+0x33d/frame 0xffffff878ea6da40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff878ea6da70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea6dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea6dab0 --- trap 0, rip = 0, rsp = 0xffffff878ea6db70, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffffe0050485490 sched_switch() at sched_switch+0x482/frame 0xffffff878ea63900 mi_switch() at mi_switch+0x179/frame 0xffffff878ea63940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea63980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea639b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff878ea63a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff878ea63a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea63ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea63ab0 --- trap 0, rip = 0, rsp = 0xffffff878ea63b70, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffffe0050485920 sched_switch() at sched_switch+0x482/frame 0xffffff878ea5e900 mi_switch() at mi_switch+0x179/frame 0xffffff878ea5e940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea5e980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea5e9b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff878ea5ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff878ea5ea70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea5eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea5eab0 --- trap 0, rip = 0, rsp = 0xffffff878ea5eb70, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffffe0050489000 sched_switch() at sched_switch+0x482/frame 0xffffff878ea59900 mi_switch() at mi_switch+0x179/frame 0xffffff878ea59940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea59980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea599b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff878ea59a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff878ea59a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea59ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea59ab0 --- trap 0, rip = 0, rsp = 0xffffff878ea59b70, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffffe00502f3490 sched_switch() at sched_switch+0x482/frame 0xffffff878ea4f900 mi_switch() at mi_switch+0x179/frame 0xffffff878ea4f940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea4f980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea4f9b0 _sleep() at _sleep+0x33d/frame 0xffffff878ea4fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff878ea4fa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea4fab0 --- trap 0, rip = 0, rsp = 0xffffff878ea4fb70, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffffe005030c000 sched_switch() at sched_switch+0x482/frame 0xffffff878ea45900 mi_switch() at mi_switch+0x179/frame 0xffffff878ea45940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea45980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea459b0 _sleep() at _sleep+0x33d/frame 0xffffff878ea45a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff878ea45a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea45ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea45ab0 --- trap 0, rip = 0, rsp = 0xffffff878ea45b70, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffffe005030c920 sched_switch() at sched_switch+0x482/frame 0xffffff878ea3a900 mi_switch() at mi_switch+0x179/frame 0xffffff878ea3a940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea3a980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea3a9b0 _sleep() at _sleep+0x33d/frame 0xffffff878ea3aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff878ea3aa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea3aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea3aab0 --- trap 0, rip = 0, rsp = 0xffffff878ea3ab70, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff815d8f00 sched_switch() at sched_switch+0x482/frame 0xffffffff819279c0 mi_switch() at mi_switch+0x179/frame 0xffffffff81927a00 sleepq_switch() at sleepq_switch+0x185/frame 0xffffffff81927a40 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffffff81927a70 _sleep() at _sleep+0x312/frame 0xffffffff81927b00 scheduler() at scheduler+0x261/frame 0xffffffff81927b50 mi_startup() at mi_startup+0x118/frame 0xffffffff81927b70 btext() at btext+0x2c db:0:allt> call doadump Dumping 2225 out of 31644 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete = 0 db:0:doadump> reset (kgdb) bt #0 doadump (textdump=0xd) at ../../../kern/kern_shutdown.c:259 #1 0xffffffff8033b1a5 in db_fncall (dummy1=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:578 #2 0xffffffff8033ae8d in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #3 0xffffffff8033f0ef in db_script_exec (scriptname=0xffffffff815d4390 "doadump", warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xffffffff8033ae8d in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #5 0xffffffff8033ac04 in db_command_loop () at ../../../ddb/db_command.c:502 #6 0xffffffff8033d5b0 in db_trap (type=, code=0x0) at ../../../ddb/db_main.c:231 #7 0xffffffff808f2823 in kdb_trap (type=0xc, code=0x0, tf=) at ../../../kern/subr_kdb.c:654 #8 0xffffffff80cabfba in trap_fatal (frame=0xffffff800030a7c0, eva=) at ../../../amd64/amd64/trap.c:868 #9 0xffffffff80cac274 in trap_pfault (frame=0x0, usermode=0x0) at ../../../amd64/amd64/trap.c:699 #10 0xffffffff80caba70 in trap (frame=0xffffff800030a7c0) at ../../../amd64/amd64/trap.c:463 #11 0xffffffff80c94ce2 in calltrap () at ../../../amd64/amd64/exception.S:232 #12 0xffffffff8089f035 in lockmgr_printinfo (lk=0xffffff8789f131d8) at ../../../kern/kern_lock.c:181 #13 0xffffffff808bb056 in kern_reboot (howto=0x0) at ../../../kern/kern_shutdown.c:409 #14 0xffffffff808ba950 in sys_reboot (td=0xfffffe00502aa000, uap=0xffffff800030aa40) at ../../../kern/kern_shutdown.c:191 #15 0xffffffff80cac7e2 in amd64_syscall (td=0xfffffe00502aa000, traced=0x0) at subr_syscall.c:134 #16 0xffffffff80c94fcb in Xfast_syscall () at ../../../amd64/amd64/exception.S:391 #17 0x000000000040ecdc in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xffffffff808bb056 in kern_reboot (howto=0x0) at ../../../kern/kern_shutdown.c:409 409 BUF_LOCKPRINTINFO(bp); (kgdb) p *bp $1 = {b_bufobj = 0xfffffe0059e5dd98, b_bcount = 0x8000, b_caller1 = 0x0, b_data = 0xffffff878f5a4000 "", b_error = 0x0, b_iocmd = 0x0, b_ioflags = 0x0, b_iooffset = 0x0, b_resid = 0x0, b_iodone = 0, b_blkno = 0x480, b_offset = 0x90000, b_bobufs = { tqe_next = 0x0, tqe_prev = 0xffffff8789eeb720}, b_vflags = 0x0, b_freelist = {tqe_next = 0xffffff8789f13440, tqe_prev = 0xffffffff8157bbc0}, b_qindex = 0x0, b_flags = 0x20000000, b_xflags = 0x2, b_lock = {lock_object = { lo_name = 0xffffffff80f8203a "bufwait", lo_flags = 0x6730000, lo_data = 0x0, lo_witness = 0xffffff80006c1880}, lk_lock = 0xfffffffffffffff0, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0xc, pcs = { 0xffffffff8089ef53, 0xffffffff80b0666d, 0xffffffff80af7a15, 0xffffffff80af77f5, 0xffffffff80ae6579, 0xffffffff80ae6f13, 0xffffffff80b1c2f3, 0xffffffff80d5531b, 0xffffffff8096fb53, 0xffffffff8091198f, 0xffffffff80cac7e2, 0xffffffff80c94fcb, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}, b_bufsize = 0x8000, b_runningbufspace = 0x0, b_kvabase = 0xffffff878f5a4000 "", b_kvaalloc = 0x0, b_kvasize = 0x8000, b_lblkno = 0x480, b_vp = 0xfffffe0059e5dc30, b_dirtyoff = 0x0, b_dirtyend = 0x0, b_rcred = 0x0, b_wcred = 0x0, b_saveaddr = 0xffffff878f5a4000, b_pager = {pg_reqpage = 0x0}, b_cluster = {cluster_head = { tqh_first = 0x0, tqh_last = 0x0}, cluster_entry = {tqe_next = 0x0, tqe_prev = 0x0}}, b_pages = {0xfffffe07d8050360, 0xfffffe07d80503c0, 0xfffffe07d8050420, 0xfffffe07d8050480, 0xfffffe07d80504e0, 0xfffffe07d8050540, 0xfffffe07d80505a0, 0xfffffe07d8050600, 0x0 }, b_npages = 0x8, b_dep = {lh_first = 0x0}, b_fsprivate1 = 0x0, b_fsprivate2 = 0x0, b_fsprivate3 = 0x0, b_pin_count = 0x0} (kgdb) f 12 #12 0xffffffff8089f035 in lockmgr_printinfo (lk=0xffffff8789f131d8) at ../../../kern/kern_lock.c:181 181 return ((x & LK_SHARE) ? NULL : (struct thread *)LK_HOLDER(x)); (kgdb) p *lk $2 = {lock_object = {lo_name = 0xffffffff80f8203a "bufwait", lo_flags = 0x6730000, lo_data = 0x0, lo_witness = 0xffffff80006c1880}, lk_lock = 0xfffffffffffffff0, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0xc, pcs = { 0xffffffff8089ef53, 0xffffffff80b0666d, 0xffffffff80af7a15, 0xffffffff80af77f5, 0xffffffff80ae6579, 0xffffffff80ae6f13, 0xffffffff80b1c2f3, 0xffffffff80d5531b, 0xffffffff8096fb53, 0xffffffff8091198f, 0xffffffff80cac7e2, 0xffffffff80c94fcb, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}} (kgdb) proc 1191 [Switching to thread 137 (Thread 100214)]#0 sched_switch (td=0xfffffe0089b4f920, newtd=, flags=) at ../../../kern/sched_ule.c:1954 1954 cpuid = PCPU_GET(cpuid); (kgdb) bt #0 sched_switch (td=0xfffffe0089b4f920, newtd=, flags=) at ../../../kern/sched_ule.c:1954 #1 0xffffffff808c4f99 in mi_switch (flags=0x104, newtd=0x0) at ../../../kern/kern_synch.c:487 #2 0xffffffff808fedc5 in sleepq_switch (wchan=, pri=) at ../../../kern/subr_sleepqueue.c:541 #3 0xffffffff808febf3 in sleepq_wait (wchan=0xfffffe07d7f77a00, pri=0x54) at ../../../kern/subr_sleepqueue.c:620 #4 0xffffffff808c48ed in _sleep (ident=, lock=, priority=0x254, wmesg=0xffffffff80fb6174 "pgrbwt", sbt=0x0, pr=0x0) at ../../../kern/kern_synch.c:249 #5 0xffffffff80b3ceab in vm_page_busy_sleep (m=0xfffffe07d7f77a00, wmesg=0xffffffff80fb6174 "pgrbwt") at ../../../vm/vm_page.c:581 #6 0xffffffff80b3d99b in vm_page_sleep_if_busy (m=, msg=, busyflags=, pref=0x1) at ../../../vm/vm_page.c:907 #7 0xffffffff80b401c7 in vm_page_grab (object=0xfffffe0059aa5c30, pindex=0x0, allocflags=0x812a2) at ../../../vm/vm_page.c:2536 #8 0xffffffff80947db6 in allocbuf (bp=0xffffff8789f13440, size=0x8000) at ../../../kern/vfs_bio.c:3488 #9 0xffffffff8094637a in getblk (vp=, blkno=0x0, size=0x8000, slpflag=, slptimeo=0x0, flags=) at ../../../kern/vfs_bio.c:3253 #10 0xffffffff80ae58e5 in ffs_balloc_ufs2 (vp=0xfffffe01380f64e0, startoffset=, size=, cred=0xfffffe00597c2700, flags=0x7f040000, bpp=0xffffff8821fad290) at ../../../ufs/ffs/ffs_balloc.c:776 #11 0xffffffff80b0c6a0 in ffs_write (ap=0xffffff8821fad450) at ../../../ufs/ffs/ffs_vnops.c:732 #12 0xffffffff80d55853 in VOP_WRITE_APV (vop=, a=) at vnode_if.c:999 #13 0xffffffff80b4be60 in vnode_pager_generic_putpages (vp=0x0, ma=0xffffff8821fad620, bytecount=, flags=, rtvals=0xffffff8821fad560) at vnode_if.h:413 #14 0xffffffff80d5851e in VOP_PUTPAGES_APV (vop=, a=) at vnode_if.c:2861 #15 0xffffffff80b49fcd in vnode_pager_putpages (object=, m=0xffffff8821fad620, count=, sync=0x8, rtvals=0xffffff8821fad560) at vnode_if.h:1189 #16 0xffffffff80b413f9 in vm_pageout_flush (mc=0xffffff8821fad620, count=0x10, flags=0x8, mreq=0x0, prunlen=0xffffff8821fad6cc, eio=0xffffff8821fad740) at vm_pager.h:144 #17 0xffffffff80b3a685 in vm_object_page_collect_flush (object=, p=, pagerflags=0x8, flags=0x4, clearobjflags=0xffffff8821fad744, eio=0xffffff8821fad740) at ../../../vm/vm_object.c:961 #18 0xffffffff80b3a3de in vm_object_page_clean (object=0xfffffe0059aa5c30, start=0x0, end=, flags=0x4) at ../../../vm/vm_object.c:887 #19 0xffffffff80960875 in vinactive (vp=0xfffffe01380f64e0, td=0xfffffe0089b4f920) at ../../../kern/vfs_subr.c:2449 #20 0xffffffff80960d90 in vputx (vp=0xfffffe01380f64e0, func=0x2) at ../../../kern/vfs_subr.c:2229 #21 0xffffffff80b3995c in vm_object_deallocate (object=) at ../../../vm/vm_object.c:488 #22 0xffffffff80b30729 in vm_map_process_deferred () at ../../../vm/vm_map.c:2733 #23 0xffffffff80b349d8 in vm_map_remove (map=, start=, end=) at ../../../vm/vm_map.c:511 #24 0xffffffff80b3056d in vmspace_exit (td=0xfffffe0089b4f920) at ../../../vm/vm_map.c:350 #25 0xffffffff8088635e in exit1 (td=0xfffffe0089b4f920, rv=) at ../../../kern/kern_exit.c:322 #26 0xffffffff80885e2e in sys_sys_exit (td=, uap=) at ../../../kern/kern_exit.c:122 #27 0xffffffff80cac7e2 in amd64_syscall (td=0xfffffe0089b4f920, traced=0x0) at subr_syscall.c:134 #28 0xffffffff80c94fcb in Xfast_syscall () at ../../../amd64/amd64/exception.S:391 #29 0x00000008008de52a in ?? () (kgdb) $ svn diff -x -p /var/tmp/vmobj-readlock/sys Index: /var/tmp/vmobj-readlock/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c =================================================================== --- /var/tmp/vmobj-readlock/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c (revision 253314) +++ /var/tmp/vmobj-readlock/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c (working copy) @@ -336,19 +336,9 @@ page_busy(vnode_t *vp, int64_t start, int64_t off, for (;;) { if ((pp = vm_page_lookup(obj, OFF_TO_IDX(start))) != NULL && pp->valid) { - if (vm_page_busy_wlocked(pp)) { - /* - * Reference the page before unlocking and - * sleeping so that the page daemon is less - * likely to reclaim it. - */ - vm_page_reference(pp); - vm_page_lock(pp); - zfs_vmobject_wunlock(obj); - vm_page_busy_sleep(pp, "zfsmwb"); - zfs_vmobject_wlock(obj); + if (vm_page_sleep_if_busy(pp, "zfsmwb", + VM_ALLOC_NOBUSY, TRUE)) continue; - } vm_page_busy_rlock(pp); } else if (pp == NULL) { if (!alloc) Index: /var/tmp/vmobj-readlock/sys/dev/drm2/i915/i915_gem.c =================================================================== --- /var/tmp/vmobj-readlock/sys/dev/drm2/i915/i915_gem.c (revision 253314) +++ /var/tmp/vmobj-readlock/sys/dev/drm2/i915/i915_gem.c (working copy) @@ -2333,7 +2333,8 @@ retry: m = vm_page_lookup(devobj, i); if (m == NULL) continue; - if (vm_page_sleep_if_busy(m, "915unm")) + if (vm_page_sleep_if_busy(m, "915unm", VM_ALLOC_NOBUSY, + FALSE)) goto retry; cdev_pager_free_page(devobj, m); } Index: /var/tmp/vmobj-readlock/sys/fs/tmpfs/tmpfs_subr.c =================================================================== --- /var/tmp/vmobj-readlock/sys/fs/tmpfs/tmpfs_subr.c (revision 253314) +++ /var/tmp/vmobj-readlock/sys/fs/tmpfs/tmpfs_subr.c (working copy) @@ -1331,7 +1331,8 @@ tmpfs_reg_resize(struct vnode *vp, off_t newsize, retry: m = vm_page_lookup(uobj, idx); if (m != NULL) { - if (vm_page_sleep_if_busy(m, "tmfssz")) + if (vm_page_sleep_if_busy(m, "tmfssz", + VM_ALLOC_NOBUSY, FALSE)) goto retry; MPASS(m->valid == VM_PAGE_BITS_ALL); } else if (vm_pager_has_page(uobj, idx, NULL, NULL)) { Index: /var/tmp/vmobj-readlock/sys/kern/subr_uio.c =================================================================== --- /var/tmp/vmobj-readlock/sys/kern/subr_uio.c (revision 253314) +++ /var/tmp/vmobj-readlock/sys/kern/subr_uio.c (working copy) @@ -107,12 +107,14 @@ vm_pgmoveco(vm_map_t mapa, vm_offset_t kaddr, vm_o VM_OBJECT_WLOCK(uobject); retry: if ((user_pg = vm_page_lookup(uobject, upindex)) != NULL) { - if (vm_page_sleep_if_busy(user_pg, "vm_pgmoveco")) + if (vm_page_sleep_if_busy(user_pg, "vm_pgmoveco", + VM_ALLOC_NOBUSY, FALSE)) goto retry; vm_page_lock(user_pg); pmap_remove_all(user_pg); vm_page_free(user_pg); vm_page_unlock(user_pg); + vm_page_busy_wunlock(user_pg); } else { /* * Even if a physical page does not exist in the Index: /var/tmp/vmobj-readlock/sys/kern/uipc_shm.c =================================================================== --- /var/tmp/vmobj-readlock/sys/kern/uipc_shm.c (revision 253314) +++ /var/tmp/vmobj-readlock/sys/kern/uipc_shm.c (working copy) @@ -281,7 +281,8 @@ shm_dotruncate(struct shmfd *shmfd, off_t length) retry: m = vm_page_lookup(object, idx); if (m != NULL) { - if (vm_page_sleep_if_busy(m, "shmtrc")) + if (vm_page_sleep_if_busy(m, "shmtrc", + VM_ALLOC_NOBUSY, FALSE)) goto retry; } else if (vm_pager_has_page(object, idx, NULL, NULL)) { m = vm_page_alloc(object, idx, VM_ALLOC_NORMAL); Index: /var/tmp/vmobj-readlock/sys/kern/vfs_bio.c =================================================================== --- /var/tmp/vmobj-readlock/sys/kern/vfs_bio.c (revision 253314) +++ /var/tmp/vmobj-readlock/sys/kern/vfs_bio.c (working copy) @@ -3442,7 +3442,7 @@ allocbuf(struct buf *bp, int size) KASSERT(m != bogus_page, ("allocbuf: bogus page found")); while (vm_page_sleep_if_busy(m, - "biodep")) + "biodep", VM_ALLOC_NOBUSY, FALSE)) continue; bp->b_pages[i] = NULL; Index: /var/tmp/vmobj-readlock/sys/vm/vm_fault.c =================================================================== --- /var/tmp/vmobj-readlock/sys/vm/vm_fault.c (revision 253314) +++ /var/tmp/vmobj-readlock/sys/vm/vm_fault.c (working copy) @@ -392,7 +392,8 @@ RetryFault:; unlock_map(&fs); if (fs.m == vm_page_lookup(fs.object, fs.pindex)) { - vm_page_sleep_if_busy(fs.m, "vmpfw"); + vm_page_sleep_if_busy(fs.m, "vmpfw", + VM_ALLOC_NOBUSY, FALSE); } vm_object_pip_wakeup(fs.object); VM_OBJECT_WUNLOCK(fs.object); Index: /var/tmp/vmobj-readlock/sys/vm/vm_object.c =================================================================== --- /var/tmp/vmobj-readlock/sys/vm/vm_object.c (revision 253314) +++ /var/tmp/vmobj-readlock/sys/vm/vm_object.c (working copy) @@ -870,7 +870,8 @@ rescan: np = TAILQ_NEXT(p, listq); if (p->valid == 0) continue; - if (vm_page_sleep_if_busy(p, "vpcwai")) { + if (vm_page_sleep_if_busy(p, "vpcwai", VM_ALLOC_NOBUSY, + FALSE)) { if (object->generation != curgeneration) { if ((flags & OBJPC_SYNC) != 0) goto rescan; Index: /var/tmp/vmobj-readlock/sys/vm/vm_object.h =================================================================== --- /var/tmp/vmobj-readlock/sys/vm/vm_object.h (revision 253314) +++ /var/tmp/vmobj-readlock/sys/vm/vm_object.h (working copy) @@ -226,6 +226,8 @@ extern struct vm_object kmem_object_store; rw_assert(&(object)->lock, RA_WLOCKED) #define VM_OBJECT_LOCK_DOWNGRADE(object) \ rw_downgrade(&(object)->lock) +#define VM_OBJECT_LOCK_TRYUPGRADE(object) \ + rw_try_upgrade(&(object)->lock) #define VM_OBJECT_RLOCK(object) \ rw_rlock(&(object)->lock) #define VM_OBJECT_RUNLOCK(object) \ @@ -238,6 +240,8 @@ extern struct vm_object kmem_object_store; rw_try_wlock(&(object)->lock) #define VM_OBJECT_WLOCK(object) \ rw_wlock(&(object)->lock) +#define VM_OBJECT_WOWNED(object) \ + rw_wowned(&(object)->lock) #define VM_OBJECT_WUNLOCK(object) \ rw_wunlock(&(object)->lock) Index: /var/tmp/vmobj-readlock/sys/vm/vm_page.c =================================================================== --- /var/tmp/vmobj-readlock/sys/vm/vm_page.c (revision 253314) +++ /var/tmp/vmobj-readlock/sys/vm/vm_page.c (working copy) @@ -869,26 +869,46 @@ vm_page_readahead_finish(vm_page_t m) * be locked. */ int -vm_page_sleep_if_busy(vm_page_t m, const char *msg) +vm_page_sleep_if_busy(vm_page_t m, const char *msg, int busyflags, + boolean_t pref) { vm_object_t obj; + int iswowned, sleepcond; vm_page_lock_assert(m, MA_NOTOWNED); - VM_OBJECT_ASSERT_WLOCKED(m->object); - if (vm_page_busy_locked(m)) { - /* - * The page-specific object must be cached because page - * identity can change during the sleep, causing the - * re-lock of a different object. - * It is assumed that a reference to the object is already - * held by the callers. - */ - obj = m->object; + /* + * The page-specific object must be cached because page + * identity can change during the sleep, causing the + * re-lock of a different object. + * It is assumed that a reference to the object is already + * held by the callers. + */ + obj = m->object; + VM_OBJECT_ASSERT_LOCKED(obj); + iswowned = VM_OBJECT_WOWNED(obj); + KASSERT((busyflags & VM_ALLOC_NOBUSY) == 0 || iswowned != 0, + ("vm_page_sleep_if_busy: VM_ALLOC_NOBUSY with object read lock")); + + if ((busyflags & VM_ALLOC_RBUSY) != 0) + sleepcond = vm_page_busy_tryrlock(m); + else if ((busyflags & VM_ALLOC_NOBUSY) != 0) + sleepcond = !vm_page_busy_locked(m); + else + sleepcond = vm_page_busy_trywlock(m); + if (!sleepcond) { + if (pref) + vm_page_aflag_set(m, PGA_REFERENCED); vm_page_lock(m); - VM_OBJECT_WUNLOCK(obj); + if (iswowned) + VM_OBJECT_WUNLOCK(obj); + else + VM_OBJECT_RUNLOCK(obj); vm_page_busy_sleep(m, msg); - VM_OBJECT_WLOCK(obj); + if (iswowned) + VM_OBJECT_WLOCK(obj); + else + VM_OBJECT_RLOCK(obj); return (TRUE); } return (FALSE); @@ -2500,44 +2520,42 @@ vm_page_t vm_page_grab(vm_object_t object, vm_pindex_t pindex, int allocflags) { vm_page_t m; - int sleep; + int origwlock; VM_OBJECT_ASSERT_WLOCKED(object); + origwlock = VM_OBJECT_WOWNED(object); KASSERT((allocflags & VM_ALLOC_RETRY) != 0, ("vm_page_grab: VM_ALLOC_RETRY is required")); KASSERT((allocflags & VM_ALLOC_RBUSY) == 0 || (allocflags & VM_ALLOC_IGN_RBUSY) != 0, ("vm_page_grab: VM_ALLOC_RBUSY/VM_ALLOC_IGN_RBUSY mismatch")); + KASSERT((allocflags & VM_ALLOC_NOBUSY) == 0 || origwlock != 0, + ("vm_page_grab: VM_ALLOC_NOBUSY with object read lock")); retrylookup: if ((m = vm_page_lookup(object, pindex)) != NULL) { - sleep = (allocflags & VM_ALLOC_IGN_RBUSY) != 0 ? - vm_page_busy_wlocked(m) : vm_page_busy_locked(m); - if (sleep) { - /* - * Reference the page before unlocking and - * sleeping so that the page daemon is less - * likely to reclaim it. - */ - vm_page_aflag_set(m, PGA_REFERENCED); - vm_page_lock(m); - VM_OBJECT_WUNLOCK(object); - vm_page_busy_sleep(m, "pgrbwt"); - VM_OBJECT_WLOCK(object); + if (vm_page_sleep_if_busy(m, "pgrbwt", allocflags, TRUE)) goto retrylookup; - } else { + else { if ((allocflags & VM_ALLOC_WIRED) != 0) { vm_page_lock(m); vm_page_wire(m); vm_page_unlock(m); } - if ((allocflags & - (VM_ALLOC_NOBUSY | VM_ALLOC_RBUSY)) == 0) - vm_page_busy_wlock(m); - if ((allocflags & VM_ALLOC_RBUSY) != 0) - vm_page_busy_rlock(m); + + /* + * If the lock state changed in the meanwhile, + * unwind back. + */ + if (VM_OBJECT_WOWNED(object) != origwlock) + VM_OBJECT_LOCK_DOWNGRADE(object); return (m); } } + if (!VM_OBJECT_WOWNED(object) && !VM_OBJECT_LOCK_TRYUPGRADE(object)) { + VM_OBJECT_RUNLOCK(object); + VM_OBJECT_WLOCK(object); + goto retrylookup; + } m = vm_page_alloc(object, pindex, allocflags & ~(VM_ALLOC_RETRY | VM_ALLOC_IGN_RBUSY)); if (m == NULL) { @@ -2545,7 +2563,12 @@ retrylookup: VM_WAIT; VM_OBJECT_WLOCK(object); goto retrylookup; - } else if (m->valid != 0) + } + + /* If the lock state changed in the meanwhile, unwind back. */ + if (VM_OBJECT_WOWNED(object) != origwlock) + VM_OBJECT_LOCK_DOWNGRADE(object); + if (m->valid != 0) return (m); if (allocflags & VM_ALLOC_ZERO && (m->flags & PG_ZERO) == 0) pmap_zero_page(m); Index: /var/tmp/vmobj-readlock/sys/vm/vm_page.h =================================================================== --- /var/tmp/vmobj-readlock/sys/vm/vm_page.h (revision 253314) +++ /var/tmp/vmobj-readlock/sys/vm/vm_page.h (working copy) @@ -439,7 +439,8 @@ void vm_page_rename (vm_page_t, vm_object_t, vm_pi void vm_page_requeue(vm_page_t m); void vm_page_requeue_locked(vm_page_t m); void vm_page_set_valid_range(vm_page_t m, int base, int size); -int vm_page_sleep_if_busy(vm_page_t m, const char *msg); +int vm_page_sleep_if_busy(vm_page_t m, const char *msg, int busyflags, + boolean_t pref); vm_offset_t vm_page_startup(vm_offset_t vaddr); void vm_page_unhold_pages(vm_page_t *ma, int count); void vm_page_unwire (vm_page_t, int); -- Test scenario: mmap4.sh